== sanity test 398b: DIO and buffer IO race ============== 10:00:03 (1790776803) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.00887 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144705: Wed Sep 30 10:02:45 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(5992KiB/134695msec) clat (usec): min=30, max=1447.9k, avg=43900.78, stdev=48172.48 lat (usec): min=30, max=1447.9k, avg=43902.80, stdev=48172.25 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 100], | 20.00th=[ 19530], 30.00th=[ 25560], 40.00th=[ 31851], | 50.00th=[ 38536], 60.00th=[ 45351], 70.00th=[ 53740], | 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[ 149947], 99.50th=[ 175113], 99.90th=[ 299893], | 99.95th=[1451230], 99.99th=[1451230] bw ( KiB/s): min= 7, max= 119, per=26.01%, avg=44.73, stdev=19.75, samples=261 iops : min= 1, max= 29, avg=10.54, stdev= 4.96, samples=261 write: IOPS=11, BW=46.7KiB/s (47.9kB/s)(6296KiB/134695msec); 0 zone resets clat (usec): min=919, max=682082, avg=43324.96, stdev=47972.83 lat (usec): min=920, max=682084, avg=43333.12, stdev=47976.53 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1745], 20.00th=[ 4752], | 30.00th=[ 9503], 40.00th=[ 20317], 50.00th=[ 31065], 60.00th=[ 43254], | 70.00th=[ 57410], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[125305], | 99.00th=[217056], 99.50th=[250610], 99.90th=[383779], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 111, per=26.02%, avg=46.84, stdev=19.72, samples=262 iops : min= 1, max= 27, avg=11.08, stdev= 4.95, samples=262 lat (usec) : 50=0.42%, 100=4.46%, 250=0.42%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.70%, 4=3.87%, 10=6.51%, 20=8.79%, 50=34.96% lat (msec) : 100=27.28%, 250=6.97%, 500=0.26%, 750=0.03%, 2000=0.03% cpu : usr=0.10%, sys=5.24%, ctx=6597, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144706: Wed Sep 30 10:02:45 2026 read: IOPS=10, BW=43.3KiB/s (44.3kB/s)(5940KiB/137203msec) clat (usec): min=21, max=294471, avg=43240.92, stdev=32503.45 lat (usec): min=21, max=294473, avg=43242.60, stdev=32503.51 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 172], 20.00th=[ 19792], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[147850], 99.50th=[191890], 99.90th=[267387], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 112, per=25.27%, avg=43.46, stdev=19.72, samples=266 iops : min= 1, max= 28, avg=10.22, stdev= 4.98, samples=266 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6348KiB/137203msec); 0 zone resets clat (usec): min=977, max=1477.8k, avg=45545.76, stdev=57450.01 lat (usec): min=978, max=1477.8k, avg=45549.60, stdev=57453.22 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1811], | 20.00th=[ 5473], 30.00th=[ 10552], 40.00th=[ 22152], | 50.00th=[ 34341], 60.00th=[ 45351], 70.00th=[ 58459], | 80.00th=[ 77071], 90.00th=[ 104334], 95.00th=[ 128451], | 99.00th=[ 198181], 99.50th=[ 225444], 99.90th=[ 434111], | 99.95th=[1484784], 99.99th=[1484784] bw ( KiB/s): min= 7, max= 103, per=25.43%, avg=45.77, stdev=18.91, samples=269 iops : min= 1, max= 25, avg=10.81, stdev= 4.78, samples=269 lat (usec) : 50=0.42%, 100=3.97%, 250=0.46%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.73%, 4=2.90%, 10=6.84%, 20=8.89%, 50=36.10% lat (msec) : 100=25.75%, 250=8.37%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=5.14%, ctx=6454, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144707: Wed Sep 30 10:02:45 2026 read: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6028KiB/137104msec) clat (usec): min=21, max=1312.5k, avg=43954.13, stdev=46624.57 lat (usec): min=22, max=1312.5k, avg=43958.22, stdev=46624.16 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 89], | 20.00th=[ 19268], 30.00th=[ 25822], 40.00th=[ 31851], | 50.00th=[ 37487], 60.00th=[ 44303], 70.00th=[ 53216], | 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[ 102237], | 99.00th=[ 154141], 99.50th=[ 202376], 99.90th=[ 325059], | 99.95th=[1317012], 99.99th=[1317012] bw ( KiB/s): min= 7, max= 103, per=25.49%, avg=43.85, stdev=20.65, samples=268 iops : min= 1, max= 25, avg=10.32, stdev= 5.19, samples=268 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6260KiB/137104msec); 0 zone resets clat (usec): min=874, max=373249, avg=44799.31, stdev=43653.84 lat (usec): min=875, max=373251, avg=44803.50, stdev=43655.35 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1860], 20.00th=[ 4948], | 30.00th=[ 10814], 40.00th=[ 23725], 50.00th=[ 35390], 60.00th=[ 46924], | 70.00th=[ 59507], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[129500], | 99.00th=[175113], 99.50th=[210764], 99.90th=[287310], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 119, per=25.26%, avg=45.47, stdev=18.71, samples=268 iops : min= 1, max= 29, avg=10.73, stdev= 4.69, samples=268 lat (usec) : 50=0.52%, 100=4.72%, 250=0.52%, 500=0.16%, 1000=0.20% lat (msec) : 2=5.34%, 4=3.87%, 10=6.02%, 20=7.98%, 50=34.99% lat (msec) : 100=27.15%, 250=8.37%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=5.18%, ctx=6515, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144709: Wed Sep 30 10:02:45 2026 read: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6052KiB/139002msec) clat (usec): min=31, max=358297, avg=43312.92, stdev=33827.34 lat (usec): min=32, max=358298, avg=43315.18, stdev=33828.04 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 98], 20.00th=[ 19530], | 30.00th=[ 25822], 40.00th=[ 31589], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[156238], 99.50th=[187696], 99.90th=[295699], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 133, per=25.28%, avg=43.48, stdev=18.54, samples=271 iops : min= 1, max= 33, avg=10.23, stdev= 4.66, samples=271 write: IOPS=11, BW=44.9KiB/s (45.9kB/s)(6236KiB/139002msec); 0 zone resets clat (usec): min=1071, max=1333.0k, avg=46625.47, stdev=56528.09 lat (usec): min=1072, max=1333.0k, avg=46641.49, stdev=56524.44 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 2057], | 20.00th=[ 5932], 30.00th=[ 11076], 40.00th=[ 24249], | 50.00th=[ 34866], 60.00th=[ 45876], 70.00th=[ 60556], | 80.00th=[ 79168], 90.00th=[ 105382], 95.00th=[ 129500], | 99.00th=[ 193987], 99.50th=[ 283116], 99.90th=[ 404751], | 99.95th=[1333789], 99.99th=[1333789] bw ( KiB/s): min= 7, max= 101, per=24.77%, avg=44.59, stdev=19.05, samples=272 iops : min= 1, max= 25, avg=10.51, stdev= 4.80, samples=272 lat (usec) : 50=0.46%, 100=4.65%, 250=0.59%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.08%, 4=3.12%, 10=6.61%, 20=8.30%, 50=35.22% lat (msec) : 100=26.79%, 250=8.59%, 500=0.29%, 2000=0.03% cpu : usr=0.07%, sys=5.03%, ctx=6666, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=173KiB/s (177kB/s), 43.3KiB/s-44.5KiB/s (44.3kB/s-45.6kB/s), io=23.4MiB (24.6MB), run=134695-139002msec WRITE: bw=181KiB/s (185kB/s), 44.9KiB/s-46.7KiB/s (45.9kB/s-47.9kB/s), io=24.6MiB (25.7MB), run=134695-139002msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144710: Wed Sep 30 10:05:12 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(5992KiB/283227msec) clat (msec): min=5, max=1571, avg=42.45, stdev=56.84 lat (msec): min=5, max=1571, avg=42.46, stdev=56.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 211], 99.50th=[ 321], 99.90th=[ 481], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 95, per=27.97%, avg=23.50, stdev=15.91, samples=492 iops : min= 1, max= 23, avg= 5.25, stdev= 4.01, samples=492 write: IOPS=5, BW=22.2KiB/s (22.8kB/s)(6296KiB/283227msec); 0 zone resets clat (msec): min=39, max=738, avg=139.41, stdev=67.75 lat (msec): min=39, max=738, avg=139.42, stdev=67.74 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 376], 99.50th=[ 405], 99.90th=[ 451], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 55, per=24.90%, avg=21.92, stdev= 9.96, samples=553 iops : min= 1, max= 13, avg= 4.86, stdev= 2.55, samples=553 lat (msec) : 10=1.73%, 20=11.56%, 50=24.06%, 100=24.80%, 250=33.89% lat (msec) : 500=3.91%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5445, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144711: Wed Sep 30 10:05:12 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(5940KiB/284839msec) clat (msec): min=5, max=1469, avg=42.15, stdev=53.60 lat (msec): min=5, max=1469, avg=42.15, stdev=53.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 211], 99.50th=[ 268], 99.90th=[ 464], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7, max= 96, per=27.82%, avg=23.37, stdev=14.70, samples=490 iops : min= 1, max= 24, avg= 5.22, stdev= 3.72, samples=490 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6348KiB/284839msec); 0 zone resets clat (msec): min=38, max=609, avg=139.91, stdev=67.84 lat (msec): min=38, max=609, avg=139.92, stdev=67.84 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 376], 99.50th=[ 439], 99.90th=[ 531], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 48, per=25.15%, avg=22.13, stdev= 9.70, samples=552 iops : min= 1, max= 12, avg= 4.91, stdev= 2.48, samples=552 lat (msec) : 10=1.56%, 20=11.04%, 50=24.54%, 100=24.51%, 250=34.44% lat (msec) : 500=3.81%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.24%, ctx=5445, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144712: Wed Sep 30 10:05:12 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6028KiB/284365msec) clat (msec): min=5, max=477, avg=43.08, stdev=41.61 lat (msec): min=5, max=477, avg=43.08, stdev=41.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 59], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 201], 99.50th=[ 305], 99.90th=[ 447], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 71, per=27.75%, avg=23.31, stdev=14.87, samples=499 iops : min= 1, max= 17, avg= 5.21, stdev= 3.77, samples=499 write: IOPS=5, BW=22.0KiB/s (22.5kB/s)(6260KiB/284365msec); 0 zone resets clat (msec): min=35, max=1639, avg=140.10, stdev=76.97 lat (msec): min=35, max=1639, avg=140.10, stdev=76.97 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 182], 90.00th=[ 228], 95.00th=[ 275], | 99.00th=[ 359], 99.50th=[ 397], 99.90th=[ 609], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7, max= 48, per=25.12%, avg=22.11, stdev= 9.87, samples=545 iops : min= 1, max= 12, avg= 4.91, stdev= 2.53, samples=545 lat (msec) : 10=1.60%, 20=10.87%, 50=24.25%, 100=25.52%, 250=33.66% lat (msec) : 500=4.00%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.24%, ctx=5390, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144713: Wed Sep 30 10:05:12 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6052KiB/285465msec) clat (msec): min=4, max=448, avg=40.45, stdev=36.56 lat (msec): min=4, max=448, avg=40.45, stdev=36.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 106], | 99.00th=[ 178], 99.50th=[ 224], 99.90th=[ 338], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 80, per=28.49%, avg=23.93, stdev=16.38, samples=488 iops : min= 1, max= 20, avg= 5.37, stdev= 4.15, samples=488 write: IOPS=5, BW=21.8KiB/s (22.4kB/s)(6236KiB/285465msec); 0 zone resets clat (msec): min=36, max=1573, avg=143.69, stdev=78.56 lat (msec): min=36, max=1573, avg=143.70, stdev=78.55 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 114], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 232], 95.00th=[ 275], | 99.00th=[ 380], 99.50th=[ 443], 99.90th=[ 735], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 56, per=24.73%, avg=21.76, stdev= 9.59, samples=551 iops : min= 1, max= 14, avg= 4.82, stdev= 2.46, samples=551 lat (msec) : 10=1.82%, 20=11.88%, 50=24.32%, 100=23.34%, 250=34.54% lat (msec) : 500=3.97%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5396, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=84.1KiB/s (86.1kB/s), 20.9KiB/s-21.2KiB/s (21.4kB/s-21.7kB/s), io=23.4MiB (24.6MB), run=283227-285465msec WRITE: bw=88.1KiB/s (90.2kB/s), 21.8KiB/s-22.3KiB/s (22.4kB/s-22.8kB/s), io=24.6MiB (25.7MB), run=283227-285465msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144780: Wed Sep 30 10:05:50 2026 read: IOPS=14, BW=235KiB/s (241kB/s)(5920KiB/25157msec) clat (usec): min=30, max=183309, avg=35024.23, stdev=31429.50 lat (usec): min=30, max=183310, avg=35026.10, stdev=31429.78 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 51], 10.00th=[ 62], 20.00th=[ 80], | 30.00th=[ 14877], 40.00th=[ 23987], 50.00th=[ 31851], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[125305], 99.50th=[149947], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 95, max= 507, per=25.35%, avg=233.49, stdev=82.16, samples=49 iops : min= 5, max= 31, avg=13.84, stdev= 5.19, samples=49 write: IOPS=15, BW=253KiB/s (259kB/s)(6368KiB/25157msec); 0 zone resets clat (usec): min=1354, max=247669, avg=30560.69, stdev=30125.84 lat (usec): min=1355, max=247673, avg=30564.36, stdev=30125.88 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1893], 10.00th=[ 2540], 20.00th=[ 5014], | 30.00th=[ 8848], 40.00th=[ 14091], 50.00th=[ 21627], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 51643], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[121111], 99.50th=[183501], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 539, per=26.04%, avg=252.33, stdev=106.33, samples=49 iops : min= 1, max= 33, avg=15.02, stdev= 6.73, samples=49 lat (usec) : 50=2.08%, 100=9.90%, 250=1.17%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=5.86%, 10=8.33%, 20=10.81%, 50=33.46% lat (msec) : 100=21.48%, 250=3.26% cpu : usr=0.12%, sys=6.54%, ctx=1354, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144781: Wed Sep 30 10:05:50 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(5744KiB/25981msec) clat (usec): min=37, max=197921, avg=33814.57, stdev=30924.02 lat (usec): min=38, max=197922, avg=33816.04, stdev=30924.09 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 76], | 30.00th=[ 13435], 40.00th=[ 25822], 50.00th=[ 32375], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 54264], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[137364], 99.50th=[187696], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 445, per=24.64%, avg=226.90, stdev=109.35, samples=50 iops : min= 1, max= 27, avg=13.42, stdev= 6.90, samples=50 write: IOPS=15, BW=252KiB/s (258kB/s)(6544KiB/25981msec); 0 zone resets clat (usec): min=1321, max=396715, avg=33704.52, stdev=44786.92 lat (usec): min=1323, max=396719, avg=33726.84, stdev=44777.04 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1795], 10.00th=[ 2343], 20.00th=[ 4948], | 30.00th=[ 7242], 40.00th=[ 11207], 50.00th=[ 20055], 60.00th=[ 28705], | 70.00th=[ 40109], 80.00th=[ 55837], 90.00th=[ 73925], 95.00th=[ 96994], | 99.00th=[252707], 99.50th=[283116], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 63, max= 479, per=25.95%, avg=251.43, stdev=104.90, samples=51 iops : min= 3, max= 29, avg=14.98, stdev= 6.60, samples=51 lat (usec) : 50=1.95%, 100=10.03%, 250=0.78%, 500=0.13% lat (msec) : 2=4.17%, 4=5.60%, 10=11.85%, 20=7.29%, 50=33.46% lat (msec) : 100=20.96%, 250=3.12%, 500=0.65% cpu : usr=0.08%, sys=6.26%, ctx=1338, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144782: Wed Sep 30 10:05:50 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(6256KiB/24512msec) clat (usec): min=35, max=183471, avg=33882.53, stdev=30824.23 lat (usec): min=35, max=183473, avg=33884.66, stdev=30825.14 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 16712], 40.00th=[ 23987], 50.00th=[ 30016], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 55313], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[133694], 99.50th=[152044], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 542, per=27.80%, avg=256.02, stdev=114.33, samples=48 iops : min= 3, max= 33, avg=15.25, stdev= 7.16, samples=48 write: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24512msec); 0 zone resets clat (usec): min=1099, max=305327, avg=29701.77, stdev=33295.28 lat (usec): min=1101, max=305330, avg=29744.66, stdev=33301.23 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1860], 10.00th=[ 2343], 20.00th=[ 4490], | 30.00th=[ 6849], 40.00th=[ 11600], 50.00th=[ 18220], 60.00th=[ 29492], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[149947], 99.50th=[227541], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 62, max= 476, per=25.12%, avg=243.37, stdev=95.57, samples=48 iops : min= 3, max= 29, avg=14.48, stdev= 6.01, samples=48 lat (usec) : 50=1.69%, 100=10.94%, 250=0.39%, 500=0.13% lat (msec) : 2=3.65%, 4=5.34%, 10=10.16%, 20=9.64%, 50=34.24% lat (msec) : 100=21.09%, 250=2.60%, 500=0.13% cpu : usr=0.13%, sys=6.78%, ctx=1324, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144783: Wed Sep 30 10:05:50 2026 read: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24491msec) clat (usec): min=37, max=193056, avg=35220.79, stdev=31320.34 lat (usec): min=38, max=193057, avg=35228.07, stdev=31323.38 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 17957], 40.00th=[ 25560], 50.00th=[ 31327], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[191890], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 125, max= 510, per=26.67%, avg=245.60, stdev=90.52, samples=48 iops : min= 7, max= 31, avg=14.60, stdev= 5.68, samples=48 write: IOPS=15, BW=255KiB/s (262kB/s)(6256KiB/24491msec); 0 zone resets clat (usec): min=1418, max=262633, avg=28545.44, stdev=30309.98 lat (usec): min=1420, max=262635, avg=28554.05, stdev=30318.86 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1827], 10.00th=[ 2409], 20.00th=[ 4359], | 30.00th=[ 7570], 40.00th=[ 12649], 50.00th=[ 17433], 60.00th=[ 25560], | 70.00th=[ 36439], 80.00th=[ 51119], 90.00th=[ 71828], 95.00th=[ 83362], | 99.00th=[129500], 99.50th=[158335], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 62, max= 606, per=26.32%, avg=255.02, stdev=106.86, samples=48 iops : min= 3, max= 37, avg=15.21, stdev= 6.72, samples=48 lat (usec) : 50=1.43%, 100=9.64%, 250=1.30%, 500=0.13% lat (msec) : 2=3.78%, 4=5.99%, 10=8.46%, 20=12.24%, 50=32.16% lat (msec) : 100=22.66%, 250=2.08%, 500=0.13% cpu : usr=0.12%, sys=6.90%, ctx=1354, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=922KiB/s (944kB/s), 221KiB/s-255KiB/s (226kB/s-261kB/s), io=23.4MiB (24.5MB), run=24491-25981msec WRITE: bw=970KiB/s (993kB/s), 246KiB/s-255KiB/s (252kB/s-262kB/s), io=24.6MiB (25.8MB), run=24491-25981msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144775: Wed Sep 30 10:06:27 2026 read: IOPS=5, BW=95.6KiB/s (97.9kB/s)(5920KiB/61943msec) clat (msec): min=8, max=311, avg=38.75, stdev=32.45 lat (msec): min=8, max=311, avg=38.75, stdev=32.45 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 48], 90.00th=[ 66], 95.00th=[ 91], | 99.00th=[ 182], 99.50th=[ 249], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 408, per=27.52%, avg=103.48, stdev=61.63, samples=112 iops : min= 1, max= 25, avg= 5.65, stdev= 3.94, samples=112 write: IOPS=6, BW=103KiB/s (105kB/s)(6368KiB/61943msec); 0 zone resets clat (msec): min=37, max=439, avg=118.90, stdev=60.21 lat (msec): min=37, max=439, avg=118.91, stdev=60.22 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 73], | 30.00th=[ 84], 40.00th=[ 92], 50.00th=[ 103], 60.00th=[ 114], | 70.00th=[ 130], 80.00th=[ 155], 90.00th=[ 203], 95.00th=[ 249], | 99.00th=[ 338], 99.50th=[ 388], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 30, max= 221, per=25.84%, avg=102.31, stdev=45.82, samples=122 iops : min= 1, max= 13, avg= 5.57, stdev= 2.94, samples=122 lat (msec) : 10=1.17%, 20=10.29%, 50=29.43%, 100=30.60%, 250=25.91% lat (msec) : 500=2.60% cpu : usr=0.04%, sys=1.54%, ctx=1492, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144776: Wed Sep 30 10:06:27 2026 read: IOPS=5, BW=90.3KiB/s (92.5kB/s)(5744KiB/63582msec) clat (msec): min=6, max=253, avg=42.69, stdev=36.22 lat (msec): min=6, max=253, avg=42.69, stdev=36.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 121], | 99.00th=[ 222], 99.50th=[ 224], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 23, max= 287, per=26.37%, avg=99.16, stdev=60.16, samples=113 iops : min= 1, max= 17, avg= 5.38, stdev= 3.79, samples=113 write: IOPS=6, BW=103KiB/s (105kB/s)(6544KiB/63582msec); 0 zone resets clat (msec): min=29, max=392, avg=117.72, stdev=58.76 lat (msec): min=29, max=392, avg=117.73, stdev=58.78 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 92], 50.00th=[ 102], 60.00th=[ 117], | 70.00th=[ 130], 80.00th=[ 155], 90.00th=[ 197], 95.00th=[ 222], | 99.00th=[ 363], 99.50th=[ 384], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 255, per=26.00%, avg=102.96, stdev=48.38, samples=124 iops : min= 1, max= 15, avg= 5.60, stdev= 3.09, samples=124 lat (msec) : 10=0.65%, 20=10.81%, 50=26.30%, 100=32.16%, 250=28.65% lat (msec) : 500=1.43% cpu : usr=0.06%, sys=1.61%, ctx=1526, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144777: Wed Sep 30 10:06:27 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(6256KiB/59892msec) clat (msec): min=6, max=252, avg=37.59, stdev=32.97 lat (msec): min=6, max=252, avg=37.59, stdev=32.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 38], 80.00th=[ 49], 90.00th=[ 66], 95.00th=[ 97], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 30, max= 319, per=29.85%, avg=112.22, stdev=73.80, samples=110 iops : min= 1, max= 19, avg= 6.19, stdev= 4.69, samples=110 write: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59892msec); 0 zone resets clat (msec): min=38, max=441, avg=119.29, stdev=60.74 lat (msec): min=38, max=441, avg=119.29, stdev=60.74 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 72], | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 117], | 70.00th=[ 131], 80.00th=[ 153], 90.00th=[ 201], 95.00th=[ 247], | 99.00th=[ 372], 99.50th=[ 422], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 30, max= 192, per=25.74%, avg=101.92, stdev=42.75, samples=116 iops : min= 1, max= 12, avg= 5.55, stdev= 2.76, samples=116 lat (msec) : 10=1.17%, 20=12.11%, 50=29.04%, 100=28.65%, 250=26.95% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.61%, ctx=1487, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144778: Wed Sep 30 10:06:27 2026 read: IOPS=6, BW=98.9KiB/s (101kB/s)(6032KiB/60989msec) clat (msec): min=6, max=208, avg=39.29, stdev=28.54 lat (msec): min=6, max=208, avg=39.29, stdev=28.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 56], 90.00th=[ 71], 95.00th=[ 90], | 99.00th=[ 148], 99.50th=[ 201], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 30, max= 318, per=28.24%, avg=106.20, stdev=60.98, samples=111 iops : min= 1, max= 19, avg= 5.82, stdev= 3.87, samples=111 write: IOPS=6, BW=103KiB/s (105kB/s)(6256KiB/60989msec); 0 zone resets clat (msec): min=30, max=409, avg=117.36, stdev=57.56 lat (msec): min=30, max=409, avg=117.37, stdev=57.56 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 63], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 93], 50.00th=[ 103], 60.00th=[ 112], | 70.00th=[ 126], 80.00th=[ 153], 90.00th=[ 194], 95.00th=[ 234], | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 31, max= 222, per=26.02%, avg=103.03, stdev=43.61, samples=119 iops : min= 1, max= 13, avg= 5.62, stdev= 2.78, samples=119 lat (msec) : 10=1.17%, 20=10.94%, 50=27.08%, 100=31.64%, 250=27.34% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.55%, ctx=1449, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=377KiB/s (386kB/s), 90.3KiB/s-104KiB/s (92.5kB/s-107kB/s), io=23.4MiB (24.5MB), run=59892-63582msec WRITE: bw=396KiB/s (406kB/s), 101KiB/s-103KiB/s (103kB/s-105kB/s), io=24.6MiB (25.8MB), run=59892-63582msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144800: Wed Sep 30 10:06:45 2026 read: IOPS=1, BW=1594KiB/s (1633kB/s)(7168KiB/4496msec) clat (usec): min=508, max=558990, avg=284733.72, stdev=161986.41 lat (usec): min=509, max=558991, avg=284745.77, stdev=161988.72 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[263193], | 30.00th=[274727], 40.00th=[274727], 50.00th=[291505], 60.00th=[291505], | 70.00th=[291505], 80.00th=[312476], 90.00th=[557843], 95.00th=[557843], | 99.00th=[557843], 99.50th=[557843], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 1558, max= 4096, per=56.16%, avg=2343.00, stdev=1000.23, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=1, BW=1139KiB/s (1166kB/s)(5120KiB/4496msec); 0 zone resets clat (msec): min=214, max=691, avg=440.58, stdev=226.23 lat (msec): min=214, max=692, avg=440.80, stdev=226.45 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1906, max= 3820, per=41.50%, avg=2423.75, stdev=933.01, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=8.33%, 500=58.33%, 750=25.00% cpu : usr=0.00%, sys=10.06%, ctx=222, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144801: Wed Sep 30 10:06:45 2026 read: IOPS=0, BW=417KiB/s (427kB/s)(2048KiB/4908msec) clat (msec): min=272, max=386, avg=329.52, stdev=80.07 lat (msec): min=272, max=386, avg=329.53, stdev=80.07 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 1532, max= 2007, per=42.41%, avg=1769.50, stdev=335.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2086KiB/s (2136kB/s)(10.0MiB/4908msec); 0 zone resets clat (msec): min=90, max=926, avg=397.47, stdev=287.76 lat (msec): min=90, max=926, avg=397.57, stdev=287.76 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 94], | 30.00th=[ 188], 40.00th=[ 203], 50.00th=[ 363], 60.00th=[ 388], | 70.00th=[ 401], 80.00th=[ 498], 90.00th=[ 827], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1910, max= 6144, per=61.60%, avg=3598.00, stdev=1738.80, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 2.12, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=50.00%, 1000=16.67% cpu : usr=0.00%, sys=9.92%, ctx=165, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144803: Wed Sep 30 10:06:45 2026 read: IOPS=1, BW=1379KiB/s (1412kB/s)(6144KiB/4457msec) clat (usec): min=582, max=686398, avg=351558.78, stdev=265049.71 lat (usec): min=583, max=686400, avg=351560.24, stdev=265049.75 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[141558], | 30.00th=[141558], 40.00th=[263193], 50.00th=[263193], 60.00th=[425722], | 70.00th=[591397], 80.00th=[591397], 90.00th=[683672], 95.00th=[683672], | 99.00th=[683672], 99.50th=[683672], 99.90th=[683672], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 1910, max= 4096, per=80.07%, avg=3340.33, stdev=1239.37, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1379KiB/s (1412kB/s)(6144KiB/4457msec); 0 zone resets clat (msec): min=130, max=707, avg=368.06, stdev=213.25 lat (msec): min=130, max=708, avg=368.81, stdev=212.84 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 388], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1438, max= 2027, per=32.32%, avg=1887.67, stdev=226.59, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=9.99%, ctx=217, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144805: Wed Sep 30 10:06:45 2026 read: IOPS=1, BW=1197KiB/s (1226kB/s)(5120KiB/4278msec) clat (usec): min=490, max=181582, avg=70292.24, stdev=80085.79 lat (usec): min=492, max=181583, avg=70293.65, stdev=80085.82 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[ 44303], 60.00th=[ 44303], | 70.00th=[124257], 80.00th=[124257], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1676KiB/s (1716kB/s)(7168KiB/4278msec); 0 zone resets clat (msec): min=164, max=897, avg=498.88, stdev=346.22 lat (msec): min=165, max=897, avg=499.09, stdev=346.09 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 186], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 355], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 869], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1910, max= 3813, per=40.42%, avg=2361.00, stdev=813.41, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 50=8.33%, 250=41.67%, 500=8.33%, 1000=25.00% cpu : usr=0.00%, sys=8.88%, ctx=118, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4173KiB/s (4273kB/s), 417KiB/s-1594KiB/s (427kB/s-1633kB/s), io=20.0MiB (20.0MB), run=4278-4908msec WRITE: bw=5842KiB/s (5982kB/s), 1139KiB/s-2086KiB/s (1166kB/s-2136kB/s), io=28.0MiB (29.4MB), run=4278-4908msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144802: Wed Sep 30 10:06:46 2026 read: IOPS=1, BW=1671KiB/s (1711kB/s)(7168KiB/4290msec) clat (msec): min=99, max=554, avg=276.57, stdev=178.06 lat (msec): min=99, max=554, avg=276.57, stdev=178.06 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 126], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 199], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 435], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1892, max= 3165, per=64.31%, avg=2225.20, stdev=528.61, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1193KiB/s (1222kB/s)(5120KiB/4290msec); 0 zone resets clat (msec): min=214, max=915, avg=458.74, stdev=269.84 lat (msec): min=214, max=915, avg=458.96, stdev=269.83 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1992, max= 2043, per=41.72%, avg=2020.80, stdev=23.11, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=2.80%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144804: Wed Sep 30 10:06:46 2026 read: IOPS=0, BW=346KiB/s (354kB/s)(2048KiB/5918msec) clat (msec): min=545, max=835, avg=690.27, stdev=205.36 lat (msec): min=545, max=835, avg=690.28, stdev=205.36 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2023, max= 2048, per=58.83%, avg=2035.50, stdev=17.68, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1730KiB/s (1772kB/s)(10.0MiB/5918msec); 0 zone resets clat (msec): min=158, max=1072, avg=432.21, stdev=287.27 lat (msec): min=158, max=1072, avg=432.32, stdev=287.27 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 188], | 30.00th=[ 300], 40.00th=[ 313], 50.00th=[ 330], 60.00th=[ 351], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 818], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1976, max= 4071, per=55.48%, avg=2687.33, stdev=1038.75, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.03%, sys=3.26%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144806: Wed Sep 30 10:06:46 2026 read: IOPS=1, BW=1118KiB/s (1145kB/s)(6144KiB/5495msec) clat (msec): min=97, max=682, avg=269.15, stdev=225.62 lat (msec): min=97, max=682, avg=269.15, stdev=225.62 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 271], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2035, max= 4007, per=73.22%, avg=2533.25, stdev=982.51, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1118KiB/s (1145kB/s)(6144KiB/5495msec); 0 zone resets clat (msec): min=385, max=879, avg=575.13, stdev=212.33 lat (msec): min=385, max=879, avg=575.23, stdev=212.33 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 684], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1892, max= 2043, per=41.21%, avg=1996.00, stdev=60.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=2.99%, ctx=69, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144807: Wed Sep 30 10:06:46 2026 read: IOPS=0, BW=895KiB/s (917kB/s)(5120KiB/5719msec) clat (msec): min=79, max=803, avg=351.53, stdev=326.84 lat (msec): min=79, max=803, avg=351.53, stdev=326.84 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2007, max= 6144, per=100.00%, avg=4075.50, stdev=2925.30, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1253KiB/s (1283kB/s)(7168KiB/5719msec); 0 zone resets clat (msec): min=262, max=840, avg=522.48, stdev=247.35 lat (msec): min=262, max=840, avg=522.59, stdev=247.35 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 305], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 493], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 827], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1892, max= 3953, per=47.89%, avg=2319.67, stdev=801.98, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=16.67%, 250=8.33%, 500=33.33%, 750=16.67%, 1000=25.00% cpu : usr=0.00%, sys=2.82%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3461KiB/s (3544kB/s), 346KiB/s-1671KiB/s (354kB/s-1711kB/s), io=20.0MiB (20.0MB), run=4290-5918msec WRITE: bw=4845KiB/s (4961kB/s), 1118KiB/s-1730KiB/s (1145kB/s-1772kB/s), io=28.0MiB (29.4MB), run=4290-5918msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144814: Wed Sep 30 10:07:05 2026 read: IOPS=0, BW=3473KiB/s (3557kB/s)(12.0MiB/3538msec) clat (msec): min=623, max=1907, avg=1130.92, stdev=683.26 lat (msec): min=623, max=1907, avg=1130.93, stdev=683.26 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 7968, max= 8000, per=100.00%, avg=7984.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.66%, ctx=253, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144816: Wed Sep 30 10:07:05 2026 read: IOPS=0, BW=627KiB/s (642kB/s)(4096KiB/6533msec) clat (nsec): min=2360.8M, max=2360.8M, avg=2360833956.00, stdev= 0.00 lat (nsec): min=2360.8M, max=2360.8M, avg=2360847535.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2366], 5.00th=[ 2366], 10.00th=[ 2366], 20.00th=[ 2366], | 30.00th=[ 2366], 40.00th=[ 2366], 50.00th=[ 2366], 60.00th=[ 2366], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1254KiB/s (1284kB/s)(8192KiB/6533msec); 0 zone resets clat (msec): min=1718, max=2333, avg=2026.19, stdev=435.02 lat (msec): min=1718, max=2334, avg=2026.61, stdev=435.07 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.46%, ctx=288, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144818: Wed Sep 30 10:07:05 2026 write: IOPS=0, BW=1677KiB/s (1717kB/s)(12.0MiB/7329msec); 0 zone resets clat (msec): min=343, max=4977, avg=2372.60, stdev=2370.32 lat (msec): min=343, max=4977, avg=2373.34, stdev=2370.07 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 1804], 50.00th=[ 1804], 60.00th=[ 1804], | 70.00th=[ 5000], 80.00th=[ 5000], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.81%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144820: Wed Sep 30 10:07:05 2026 write: IOPS=0, BW=2196KiB/s (2249kB/s)(12.0MiB/5596msec); 0 zone resets clat (msec): min=1110, max=2853, avg=1810.35, stdev=921.07 lat (msec): min=1110, max=2854, avg=1812.43, stdev=920.18 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.04%, sys=2.38%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2508KiB/s (2568kB/s), 627KiB/s-3473KiB/s (642kB/s-3557kB/s), io=16.0MiB (16.8MB), run=3538-6533msec WRITE: bw=4471KiB/s (4578kB/s), 1254KiB/s-2196KiB/s (1284kB/s-2249kB/s), io=32.0MiB (33.6MB), run=5596-7329msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144815: Wed Sep 30 10:07:06 2026 read: IOPS=0, BW=1869KiB/s (1913kB/s)(12.0MiB/6576msec) clat (msec): min=1737, max=2748, avg=2103.85, stdev=559.86 lat (msec): min=1737, max=2748, avg=2103.85, stdev=559.86 clat percentiles (msec): | 1.00th=[ 1737], 5.00th=[ 1737], 10.00th=[ 1737], 20.00th=[ 1737], | 30.00th=[ 1737], 40.00th=[ 1821], 50.00th=[ 1821], 60.00th=[ 1821], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8031, max= 8159, per=100.00%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.60%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144817: Wed Sep 30 10:07:06 2026 read: IOPS=0, BW=568KiB/s (582kB/s)(4096KiB/7207msec) clat (nsec): min=2669.6M, max=2669.6M, avg=2669627536.00, stdev= 0.00 lat (nsec): min=2669.6M, max=2669.6M, avg=2669629331.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2668], 5.00th=[ 2668], 10.00th=[ 2668], 20.00th=[ 2668], | 30.00th=[ 2668], 40.00th=[ 2668], 50.00th=[ 2668], 60.00th=[ 2668], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1137KiB/s (1164kB/s)(8192KiB/7207msec); 0 zone resets clat (msec): min=1552, max=2820, avg=2186.34, stdev=896.54 lat (msec): min=1553, max=2821, avg=2187.45, stdev=895.99 clat percentiles (msec): | 1.00th=[ 1552], 5.00th=[ 1552], 10.00th=[ 1552], 20.00th=[ 1552], | 30.00th=[ 1552], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 2836], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.06%, sys=1.96%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144819: Wed Sep 30 10:07:06 2026 write: IOPS=0, BW=1797KiB/s (1840kB/s)(12.0MiB/6837msec); 0 zone resets clat (msec): min=1313, max=3783, avg=2201.50, stdev=1373.09 lat (msec): min=1315, max=3783, avg=2203.23, stdev=1371.95 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.14%, ctx=60, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144821: Wed Sep 30 10:07:06 2026 write: IOPS=0, BW=1629KiB/s (1668kB/s)(12.0MiB/7543msec); 0 zone resets clat (msec): min=235, max=6045, avg=2432.41, stdev=3153.64 lat (msec): min=235, max=6049, avg=2434.06, stdev=3155.55 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 6074], 80.00th=[ 6074], 90.00th=[ 6074], 95.00th=[ 6074], | 99.00th=[ 6074], 99.50th=[ 6074], 99.90th=[ 6074], 99.95th=[ 6074], | 99.99th=[ 6074] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=1.55%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2273KiB/s (2328kB/s), 568KiB/s-1869KiB/s (582kB/s-1913kB/s), io=16.0MiB (16.8MB), run=6576-7207msec WRITE: bw=4344KiB/s (4448kB/s), 1137KiB/s-1797KiB/s (1164kB/s-1840kB/s), io=32.0MiB (33.6MB), run=6837-7543msec