== sanity test 398b: DIO and buffer IO race ============== 01:05:41 (1788757541) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.10034 s, 7.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145168: Mon Sep 7 01:08:18 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(5992KiB/136694msec) clat (usec): min=34, max=964128, avg=44156.86, stdev=41833.08 lat (usec): min=34, max=964129, avg=44164.97, stdev=41833.22 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 127], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 54264], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[100140], | 99.00th=[168821], 99.50th=[219153], 99.90th=[362808], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 109, per=24.82%, avg=43.43, stdev=19.30, samples=267 iops : min= 1, max= 27, avg=10.21, stdev= 4.86, samples=267 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6296KiB/136694msec); 0 zone resets clat (usec): min=842, max=370877, avg=44542.82, stdev=45311.88 lat (usec): min=843, max=370879, avg=44546.55, stdev=45311.94 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 3851], | 30.00th=[ 9896], 40.00th=[ 21890], 50.00th=[ 33817], 60.00th=[ 44303], | 70.00th=[ 59507], 80.00th=[ 77071], 90.00th=[107480], 95.00th=[128451], | 99.00th=[191890], 99.50th=[212861], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 136, per=25.05%, avg=45.85, stdev=19.42, samples=266 iops : min= 1, max= 34, avg=10.82, stdev= 4.90, samples=266 lat (usec) : 50=0.65%, 100=4.13%, 250=0.29%, 500=0.10%, 1000=0.23% lat (msec) : 2=7.36%, 4=2.86%, 10=5.34%, 20=8.79%, 50=35.74% lat (msec) : 100=25.62%, 250=8.53%, 500=0.33%, 1000=0.03% cpu : usr=0.08%, sys=4.82%, ctx=6394, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145169: Mon Sep 7 01:08:18 2026 read: IOPS=10, BW=43.4KiB/s (44.5kB/s)(5940KiB/136832msec) clat (usec): min=30, max=880402, avg=44146.64, stdev=41138.13 lat (usec): min=30, max=880403, avg=44148.15, stdev=41138.08 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 685], 20.00th=[ 20055], | 30.00th=[ 25560], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 65799], 90.00th=[ 83362], 95.00th=[ 94897], | 99.00th=[156238], 99.50th=[181404], 99.90th=[450888], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 111, per=24.87%, avg=43.53, stdev=19.06, samples=266 iops : min= 1, max= 27, avg=10.22, stdev= 4.81, samples=266 write: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6348KiB/136832msec); 0 zone resets clat (usec): min=853, max=381650, avg=44628.54, stdev=45296.86 lat (usec): min=855, max=381652, avg=44631.25, stdev=45296.06 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 3982], | 30.00th=[ 9110], 40.00th=[ 20579], 50.00th=[ 33817], 60.00th=[ 46400], | 70.00th=[ 60031], 80.00th=[ 77071], 90.00th=[104334], 95.00th=[133694], | 99.00th=[200279], 99.50th=[221250], 99.90th=[270533], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 152, per=25.12%, avg=45.98, stdev=21.96, samples=269 iops : min= 1, max= 38, avg=10.84, stdev= 5.54, samples=269 lat (usec) : 50=0.91%, 100=3.78%, 250=0.13%, 750=0.03%, 1000=0.29% lat (msec) : 2=7.06%, 4=3.19%, 10=5.96%, 20=8.59%, 50=34.31% lat (msec) : 100=27.86%, 250=7.58%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=4.90%, ctx=6437, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145170: Mon Sep 7 01:08:18 2026 read: IOPS=11, BW=44.5KiB/s (45.5kB/s)(6028KiB/135535msec) clat (usec): min=33, max=270871, avg=41513.80, stdev=29932.17 lat (usec): min=33, max=270871, avg=41519.45, stdev=29932.07 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 95], 20.00th=[ 19006], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[132645], 99.50th=[154141], 99.90th=[202376], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 127, per=25.45%, avg=44.54, stdev=20.58, samples=263 iops : min= 1, max= 31, avg=10.49, stdev= 5.17, samples=263 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6260KiB/135535msec); 0 zone resets clat (usec): min=770, max=854457, avg=46319.35, stdev=52762.74 lat (usec): min=770, max=854457, avg=46321.69, stdev=52762.88 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1680], 20.00th=[ 4817], | 30.00th=[ 10159], 40.00th=[ 23462], 50.00th=[ 34341], 60.00th=[ 45876], | 70.00th=[ 60556], 80.00th=[ 78119], 90.00th=[105382], 95.00th=[135267], | 99.00th=[204473], 99.50th=[252707], 99.90th=[541066], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 110, per=25.19%, avg=46.10, stdev=18.68, samples=264 iops : min= 1, max= 27, avg=10.88, stdev= 4.70, samples=264 lat (usec) : 50=0.98%, 100=4.07%, 250=0.29%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.33% lat (msec) : 2=5.66%, 4=3.48%, 10=6.12%, 20=8.43%, 50=35.68% lat (msec) : 100=27.08%, 250=7.39%, 500=0.23%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.87%, ctx=6287, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145171: Mon Sep 7 01:08:18 2026 read: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6052KiB/135307msec) clat (usec): min=28, max=885420, avg=42866.35, stdev=39906.38 lat (usec): min=28, max=885422, avg=42870.22, stdev=39910.57 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 88], 20.00th=[ 19792], | 30.00th=[ 24511], 40.00th=[ 29754], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[164627], 99.50th=[235930], 99.90th=[312476], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 103, per=25.64%, avg=44.87, stdev=18.95, samples=263 iops : min= 1, max= 25, avg=10.56, stdev= 4.75, samples=263 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6236KiB/135307msec); 0 zone resets clat (usec): min=873, max=501814, avg=44881.04, stdev=46588.79 lat (usec): min=875, max=501816, avg=44883.33, stdev=46588.98 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1434], 20.00th=[ 4047], | 30.00th=[ 9765], 40.00th=[ 21890], 50.00th=[ 32375], 60.00th=[ 46400], | 70.00th=[ 60031], 80.00th=[ 79168], 90.00th=[105382], 95.00th=[129500], | 99.00th=[187696], 99.50th=[235930], 99.90th=[337642], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 7, max= 103, per=25.16%, avg=46.05, stdev=18.94, samples=264 iops : min= 1, max= 25, avg=10.86, stdev= 4.76, samples=264 lat (usec) : 50=0.85%, 100=4.20%, 250=0.36%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.36% lat (msec) : 2=6.32%, 4=3.48%, 10=5.70%, 20=8.14%, 50=36.33% lat (msec) : 100=25.98%, 250=7.75%, 500=0.26%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.79%, ctx=6316, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=175KiB/s (180kB/s), 43.4KiB/s-44.7KiB/s (44.5kB/s-45.8kB/s), io=23.4MiB (24.6MB), run=135307-136832msec WRITE: bw=184KiB/s (188kB/s), 46.1KiB/s-46.4KiB/s (47.2kB/s-47.5kB/s), io=24.6MiB (25.7MB), run=135307-136832msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145173: Mon Sep 7 01:10:44 2026 read: IOPS=5, BW=21.5KiB/s (21.0kB/s)(5992KiB/278967msec) clat (msec): min=5, max=908, avg=33.64, stdev=44.99 lat (msec): min=5, max=908, avg=33.64, stdev=44.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 75], 95.00th=[ 104], | 99.00th=[ 188], 99.50th=[ 228], 99.90th=[ 609], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 94, per=29.12%, avg=24.75, stdev=17.72, samples=468 iops : min= 1, max= 23, avg= 5.58, stdev= 4.50, samples=468 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6296KiB/278967msec); 0 zone resets clat (msec): min=26, max=639, avg=145.14, stdev=80.66 lat (msec): min=26, max=639, avg=145.14, stdev=80.66 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 201], 90.00th=[ 257], 95.00th=[ 313], | 99.00th=[ 426], 99.50th=[ 464], 99.90th=[ 584], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 55, per=25.18%, avg=22.41, stdev=11.37, samples=541 iops : min= 1, max= 13, avg= 4.99, stdev= 2.92, samples=541 lat (msec) : 10=4.98%, 20=19.47%, 50=16.70%, 100=21.71%, 250=31.22% lat (msec) : 500=5.66%, 750=0.23%, 1000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5218, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145174: Mon Sep 7 01:10:44 2026 read: IOPS=5, BW=21.1KiB/s (21.6kB/s)(5940KiB/281425msec) clat (msec): min=4, max=968, avg=33.94, stdev=46.50 lat (msec): min=4, max=968, avg=33.95, stdev=46.50 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 44], 90.00th=[ 75], 95.00th=[ 103], | 99.00th=[ 182], 99.50th=[ 271], 99.90th=[ 600], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 101, per=29.23%, avg=24.85, stdev=17.46, samples=462 iops : min= 1, max= 25, avg= 5.60, stdev= 4.42, samples=462 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6348KiB/281425msec); 0 zone resets clat (msec): min=40, max=638, avg=145.48, stdev=78.85 lat (msec): min=40, max=638, avg=145.49, stdev=78.85 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 194], 90.00th=[ 255], 95.00th=[ 309], | 99.00th=[ 401], 99.50th=[ 443], 99.90th=[ 600], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 55, per=25.25%, avg=22.48, stdev=10.94, samples=544 iops : min= 1, max= 13, avg= 5.00, stdev= 2.81, samples=544 lat (msec) : 10=3.94%, 20=19.43%, 50=17.06%, 100=22.10%, 250=31.77% lat (msec) : 500=5.37%, 750=0.29%, 1000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5254, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145175: Mon Sep 7 01:10:44 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6028KiB/281981msec) clat (msec): min=4, max=505, avg=35.75, stdev=41.65 lat (msec): min=4, max=505, avg=35.75, stdev=41.65 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 50], 90.00th=[ 85], 95.00th=[ 106], | 99.00th=[ 174], 99.50th=[ 236], 99.90th=[ 456], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 119, per=28.31%, avg=24.06, stdev=17.55, samples=484 iops : min= 1, max= 29, avg= 5.41, stdev= 4.45, samples=484 write: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6260KiB/281981msec); 0 zone resets clat (msec): min=34, max=1168, avg=145.66, stdev=83.83 lat (msec): min=34, max=1168, avg=145.67, stdev=83.83 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 197], 90.00th=[ 259], 95.00th=[ 309], | 99.00th=[ 430], 99.50th=[ 481], 99.90th=[ 584], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 55, per=25.03%, avg=22.28, stdev=11.47, samples=541 iops : min= 1, max= 13, avg= 4.95, stdev= 2.95, samples=541 lat (msec) : 10=4.36%, 20=18.91%, 50=16.73%, 100=23.11%, 250=30.86% lat (msec) : 500=5.83%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5251, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145176: Mon Sep 7 01:10:44 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6052KiB/277862msec) clat (msec): min=5, max=450, avg=36.12, stdev=41.73 lat (msec): min=5, max=450, avg=36.13, stdev=41.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 50], 90.00th=[ 84], 95.00th=[ 115], | 99.00th=[ 188], 99.50th=[ 313], 99.90th=[ 422], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 119, per=29.57%, avg=25.14, stdev=17.82, samples=466 iops : min= 1, max= 29, avg= 5.67, stdev= 4.47, samples=466 write: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6236KiB/277862msec); 0 zone resets clat (msec): min=31, max=1160, avg=143.08, stdev=78.92 lat (msec): min=31, max=1160, avg=143.08, stdev=78.92 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 194], 90.00th=[ 249], 95.00th=[ 292], | 99.00th=[ 405], 99.50th=[ 472], 99.90th=[ 523], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 56, per=25.15%, avg=22.38, stdev=11.12, samples=537 iops : min= 1, max= 14, avg= 4.98, stdev= 2.86, samples=537 lat (msec) : 10=3.71%, 20=19.30%, 50=16.80%, 100=23.11%, 250=31.97% lat (msec) : 500=5.05%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.10%, ctx=5214, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=85.2KiB/s (87.2kB/s), 21.1KiB/s-21.8KiB/s (21.6kB/s-22.3kB/s), io=23.4MiB (24.6MB), run=277862-281981msec WRITE: bw=89.2KiB/s (91.3kB/s), 22.2KiB/s-22.6KiB/s (22.7kB/s-23.1kB/s), io=24.6MiB (25.7MB), run=277862-281981msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145240: Mon Sep 7 01:11:35 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5920KiB/35112msec) clat (usec): min=32, max=329683, avg=45636.67, stdev=42338.28 lat (usec): min=33, max=329685, avg=45637.94, stdev=42338.38 clat percentiles (usec): | 1.00th=[ 36], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 70], | 30.00th=[ 20055], 40.00th=[ 31065], 50.00th=[ 41157], 60.00th=[ 51119], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 98042], 95.00th=[120062], | 99.00th=[170918], 99.50th=[204473], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 30, max= 314, per=25.16%, avg=167.57, stdev=68.42, samples=67 iops : min= 1, max= 19, avg= 9.75, stdev= 4.35, samples=67 write: IOPS=11, BW=181KiB/s (186kB/s)(6368KiB/35112msec); 0 zone resets clat (usec): min=1314, max=387322, avg=44742.02, stdev=47367.23 lat (usec): min=1316, max=387324, avg=44768.45, stdev=47412.57 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1745], 10.00th=[ 2114], 20.00th=[ 6521], | 30.00th=[ 10552], 40.00th=[ 18482], 50.00th=[ 30540], 60.00th=[ 40633], | 70.00th=[ 56886], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[135267], | 99.00th=[210764], 99.50th=[225444], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 412, per=25.94%, avg=181.81, stdev=74.95, samples=67 iops : min= 1, max= 25, avg=10.63, stdev= 4.72, samples=67 lat (usec) : 50=2.47%, 100=9.11%, 250=0.65%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.69%, 4=2.73%, 10=8.46%, 20=6.90%, 50=27.21% lat (msec) : 100=25.91%, 250=11.07%, 500=0.26% cpu : usr=0.08%, sys=5.11%, ctx=1364, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145241: Mon Sep 7 01:11:35 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(5744KiB/35913msec) clat (usec): min=32, max=225096, avg=50038.76, stdev=44137.11 lat (usec): min=32, max=225097, avg=50041.75, stdev=44136.07 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 78], | 30.00th=[ 21103], 40.00th=[ 37487], 50.00th=[ 46400], 60.00th=[ 57410], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[111674], 95.00th=[130548], | 99.00th=[183501], 99.50th=[200279], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 30, max= 412, per=24.11%, avg=160.58, stdev=75.87, samples=69 iops : min= 1, max= 25, avg= 9.28, stdev= 4.76, samples=69 write: IOPS=11, BW=182KiB/s (187kB/s)(6544KiB/35913msec); 0 zone resets clat (usec): min=1359, max=221527, avg=43097.56, stdev=42891.99 lat (usec): min=1361, max=221527, avg=43099.92, stdev=42892.22 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 3458], 20.00th=[ 7111], | 30.00th=[ 11863], 40.00th=[ 18482], 50.00th=[ 32113], 60.00th=[ 43254], | 70.00th=[ 56361], 80.00th=[ 73925], 90.00th=[100140], 95.00th=[129500], | 99.00th=[200279], 99.50th=[210764], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 61, max= 381, per=25.80%, avg=180.89, stdev=72.82, samples=70 iops : min= 3, max= 23, avg=10.57, stdev= 4.57, samples=70 lat (usec) : 50=1.82%, 100=8.59%, 250=1.17%, 500=0.39%, 750=0.13% lat (msec) : 2=4.69%, 4=2.08%, 10=8.98%, 20=7.68%, 50=23.31% lat (msec) : 100=30.34%, 250=10.81% cpu : usr=0.07%, sys=5.50%, ctx=1414, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145242: Mon Sep 7 01:11:35 2026 read: IOPS=11, BW=178KiB/s (183kB/s)(6256KiB/35051msec) clat (usec): min=37, max=278065, avg=48712.12, stdev=40746.49 lat (usec): min=37, max=278066, avg=48713.69, stdev=40746.46 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 155], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 44827], 60.00th=[ 53740], | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[129500], | 99.00th=[166724], 99.50th=[173016], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 412, per=27.01%, avg=179.90, stdev=74.50, samples=68 iops : min= 1, max= 25, avg=10.50, stdev= 4.74, samples=68 write: IOPS=10, BW=172KiB/s (176kB/s)(6032KiB/35051msec); 0 zone resets clat (usec): min=1342, max=238134, avg=42112.70, stdev=43002.30 lat (usec): min=1345, max=238136, avg=42114.95, stdev=43002.22 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1795], 10.00th=[ 2966], 20.00th=[ 6456], | 30.00th=[ 10683], 40.00th=[ 17695], 50.00th=[ 25560], 60.00th=[ 41157], | 70.00th=[ 52167], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[132645], | 99.00th=[177210], 99.50th=[210764], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 62, max= 330, per=24.41%, avg=171.15, stdev=64.50, samples=68 iops : min= 3, max= 20, avg= 9.94, stdev= 4.14, samples=68 lat (usec) : 50=1.17%, 100=7.94%, 250=1.69%, 500=0.13%, 750=0.26% lat (msec) : 2=3.39%, 4=4.30%, 10=7.29%, 20=8.33%, 50=26.56% lat (msec) : 100=28.65%, 250=10.16%, 500=0.13% cpu : usr=0.05%, sys=4.79%, ctx=1407, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145243: Mon Sep 7 01:11:35 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35668msec) clat (usec): min=36, max=271436, avg=47876.00, stdev=46543.83 lat (usec): min=36, max=271438, avg=47877.36, stdev=46543.86 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 5735], 40.00th=[ 32900], 50.00th=[ 43254], 60.00th=[ 52167], | 70.00th=[ 65274], 80.00th=[ 81265], 90.00th=[105382], 95.00th=[129500], | 99.00th=[217056], 99.50th=[248513], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 377, per=26.49%, avg=176.43, stdev=71.52, samples=67 iops : min= 1, max= 23, avg=10.27, stdev= 4.49, samples=67 write: IOPS=10, BW=175KiB/s (180kB/s)(6256KiB/35668msec); 0 zone resets clat (usec): min=1376, max=292123, avg=43535.28, stdev=47519.51 lat (usec): min=1378, max=292124, avg=43539.14, stdev=47518.64 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1795], 10.00th=[ 2769], 20.00th=[ 6456], | 30.00th=[ 11338], 40.00th=[ 17695], 50.00th=[ 25560], 60.00th=[ 36439], | 70.00th=[ 52167], 80.00th=[ 72877], 90.00th=[109577], 95.00th=[139461], | 99.00th=[210764], 99.50th=[265290], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 407, per=25.39%, avg=178.01, stdev=82.35, samples=69 iops : min= 1, max= 25, avg=10.38, stdev= 5.22, samples=69 lat (usec) : 50=1.82%, 100=10.81%, 250=0.91%, 500=0.39%, 750=0.13% lat (msec) : 2=4.17%, 4=2.99%, 10=8.20%, 20=8.85%, 50=25.26% lat (msec) : 100=24.22%, 250=11.85%, 500=0.39% cpu : usr=0.07%, sys=4.93%, ctx=1314, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=667KiB/s (683kB/s), 160KiB/s-178KiB/s (164kB/s-183kB/s), io=23.4MiB (24.5MB), run=35051-35913msec WRITE: bw=702KiB/s (719kB/s), 172KiB/s-182KiB/s (176kB/s-187kB/s), io=24.6MiB (25.8MB), run=35051-35913msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145236: Mon Sep 7 01:12:19 2026 read: IOPS=4, BW=74.2KiB/s (75.0kB/s)(5920KiB/79783msec) clat (msec): min=5, max=303, avg=45.95, stdev=47.92 lat (msec): min=5, max=303, avg=45.95, stdev=47.92 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 63], 90.00th=[ 103], 95.00th=[ 157], | 99.00th=[ 249], 99.50th=[ 275], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 29, max= 286, per=29.15%, avg=86.88, stdev=54.68, samples=133 iops : min= 1, max= 17, avg= 4.65, stdev= 3.50, samples=133 write: IOPS=4, BW=79.8KiB/s (81.7kB/s)(6368KiB/79783msec); 0 zone resets clat (msec): min=35, max=518, avg=157.59, stdev=81.95 lat (msec): min=35, max=518, avg=157.60, stdev=81.95 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 107], 40.00th=[ 121], 50.00th=[ 134], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 211], 90.00th=[ 266], 95.00th=[ 330], | 99.00th=[ 456], 99.50th=[ 477], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 29, max= 223, per=26.13%, avg=81.80, stdev=41.23, samples=152 iops : min= 1, max= 13, avg= 4.31, stdev= 2.65, samples=152 lat (msec) : 10=1.82%, 20=12.63%, 50=22.66%, 100=18.88%, 250=37.37% lat (msec) : 500=6.51%, 750=0.13% cpu : usr=0.05%, sys=1.16%, ctx=1291, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145237: Mon Sep 7 01:12:19 2026 read: IOPS=4, BW=71.6KiB/s (73.3kB/s)(5744KiB/80261msec) clat (msec): min=6, max=355, avg=45.08, stdev=54.09 lat (msec): min=6, max=355, avg=45.08, stdev=54.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 99], 95.00th=[ 167], | 99.00th=[ 275], 99.50th=[ 347], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 23, max= 286, per=30.38%, avg=90.53, stdev=61.76, samples=125 iops : min= 1, max= 17, avg= 4.87, stdev= 3.91, samples=125 write: IOPS=5, BW=81.5KiB/s (83.5kB/s)(6544KiB/80261msec); 0 zone resets clat (msec): min=38, max=600, avg=155.89, stdev=87.98 lat (msec): min=38, max=600, avg=155.89, stdev=87.98 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 91], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 134], 60.00th=[ 153], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 266], 95.00th=[ 347], | 99.00th=[ 485], 99.50th=[ 510], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 23, max= 192, per=26.95%, avg=84.36, stdev=42.12, samples=152 iops : min= 1, max= 12, avg= 4.47, stdev= 2.74, samples=152 lat (msec) : 10=1.30%, 20=14.58%, 50=21.09%, 100=20.05%, 250=35.55% lat (msec) : 500=6.90%, 750=0.52% cpu : usr=0.04%, sys=1.14%, ctx=1308, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145238: Mon Sep 7 01:12:19 2026 read: IOPS=5, BW=80.2KiB/s (82.2kB/s)(6256KiB/77975msec) clat (msec): min=6, max=335, avg=43.86, stdev=45.80 lat (msec): min=6, max=335, avg=43.87, stdev=45.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 101], 95.00th=[ 150], | 99.00th=[ 262], 99.50th=[ 279], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 320, per=31.52%, avg=93.94, stdev=66.41, samples=131 iops : min= 1, max= 20, avg= 5.08, stdev= 4.27, samples=131 write: IOPS=4, BW=77.4KiB/s (79.2kB/s)(6032KiB/77975msec); 0 zone resets clat (msec): min=37, max=570, avg=160.01, stdev=87.53 lat (msec): min=37, max=570, avg=160.01, stdev=87.53 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 65], 10.00th=[ 77], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 215], 90.00th=[ 284], 95.00th=[ 347], | 99.00th=[ 485], 99.50th=[ 550], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 24, max= 223, per=24.88%, avg=77.87, stdev=39.15, samples=150 iops : min= 1, max= 13, avg= 4.06, stdev= 2.53, samples=150 lat (msec) : 10=1.56%, 20=13.93%, 50=25.39%, 100=16.54%, 250=35.03% lat (msec) : 500=7.16%, 750=0.39% cpu : usr=0.05%, sys=1.26%, ctx=1386, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145239: Mon Sep 7 01:12:19 2026 read: IOPS=4, BW=76.9KiB/s (78.7kB/s)(6032KiB/78453msec) clat (msec): min=5, max=327, avg=43.35, stdev=48.58 lat (msec): min=5, max=327, avg=43.36, stdev=48.58 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 109], 95.00th=[ 165], | 99.00th=[ 241], 99.50th=[ 255], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 345, per=32.44%, avg=96.67, stdev=69.39, samples=121 iops : min= 1, max= 21, avg= 5.25, stdev= 4.43, samples=121 write: IOPS=4, BW=79.7KiB/s (81.7kB/s)(6256KiB/78453msec); 0 zone resets clat (msec): min=34, max=720, avg=157.46, stdev=88.65 lat (msec): min=34, max=720, avg=157.46, stdev=88.65 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 62], 10.00th=[ 74], 20.00th=[ 91], | 30.00th=[ 105], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 215], 90.00th=[ 275], 95.00th=[ 334], | 99.00th=[ 435], 99.50th=[ 642], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 29, max= 220, per=26.03%, avg=81.47, stdev=40.98, samples=150 iops : min= 1, max= 13, avg= 4.29, stdev= 2.67, samples=150 lat (msec) : 10=1.95%, 20=14.84%, 50=23.44%, 100=16.93%, 250=35.94% lat (msec) : 500=6.64%, 750=0.26% cpu : usr=0.04%, sys=1.20%, ctx=1393, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=298KiB/s (306kB/s), 71.6KiB/s-80.2KiB/s (73.3kB/s-82.2kB/s), io=23.4MiB (24.5MB), run=77975-80261msec WRITE: bw=314KiB/s (322kB/s), 77.4KiB/s-81.5KiB/s (79.2kB/s-83.5kB/s), io=24.6MiB (25.8MB), run=77975-80261msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145261: Mon Sep 7 01:12:34 2026 read: IOPS=1, BW=1791KiB/s (1834kB/s)(7168KiB/4002msec) clat (msec): min=107, max=409, avg=297.29, stdev=108.02 lat (msec): min=107, max=409, avg=297.29, stdev=108.02 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 205], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 330], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 376], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1721, max= 4071, per=58.64%, avg=2969.50, stdev=1277.55, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1279KiB/s (1310kB/s)(5120KiB/4002msec); 0 zone resets clat (msec): min=210, max=481, avg=360.41, stdev=107.20 lat (msec): min=210, max=481, avg=360.50, stdev=107.20 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1980, max= 4015, per=35.43%, avg=2512.25, stdev=1002.13, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=75.00% cpu : usr=0.00%, sys=10.25%, ctx=167, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145262: Mon Sep 7 01:12:34 2026 read: IOPS=0, BW=513KiB/s (525kB/s)(2048KiB/3996msec) clat (usec): min=464, max=251912, avg=126188.62, stdev=177800.79 lat (usec): min=466, max=251915, avg=126190.68, stdev=177801.53 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 465], | 30.00th=[ 465], 40.00th=[ 465], 50.00th=[ 465], 60.00th=[252707], | 70.00th=[252707], 80.00th=[252707], 90.00th=[252707], 95.00th=[252707], | 99.00th=[252707], 99.50th=[252707], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 1681, max= 2007, per=36.41%, avg=1844.00, stdev=230.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2563KiB/s (2624kB/s)(10.0MiB/3996msec); 0 zone resets clat (msec): min=139, max=842, avg=362.42, stdev=216.82 lat (msec): min=139, max=842, avg=362.50, stdev=216.82 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 157], | 30.00th=[ 209], 40.00th=[ 262], 50.00th=[ 279], 60.00th=[ 300], | 70.00th=[ 426], 80.00th=[ 439], 90.00th=[ 575], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1980, max= 6023, per=51.18%, avg=3628.80, stdev=1683.41, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.49%, ctx=196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145263: Mon Sep 7 01:12:34 2026 read: IOPS=1, BW=1519KiB/s (1556kB/s)(6144KiB/4044msec) clat (msec): min=2, max=375, avg=210.51, stdev=135.97 lat (msec): min=2, max=375, avg=210.51, stdev=135.97 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 247], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2015, max= 4071, per=66.13%, avg=3349.00, stdev=1156.59, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1519KiB/s (1556kB/s)(6144KiB/4044msec); 0 zone resets clat (msec): min=248, max=859, avg=456.38, stdev=278.23 lat (msec): min=248, max=859, avg=456.46, stdev=278.23 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 317], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1980, max= 3282, per=32.82%, avg=2327.00, stdev=637.12, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 1000=16.67% cpu : usr=0.02%, sys=8.09%, ctx=122, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145264: Mon Sep 7 01:12:34 2026 read: IOPS=1, BW=1378KiB/s (1411kB/s)(5120KiB/3716msec) clat (usec): min=485, max=366202, avg=126052.09, stdev=174041.69 lat (usec): min=487, max=366204, avg=126053.42, stdev=174041.90 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 5211], 60.00th=[ 5211], | 70.00th=[256902], 80.00th=[256902], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1929KiB/s (1975kB/s)(7168KiB/3716msec); 0 zone resets clat (msec): min=211, max=828, avg=434.64, stdev=201.53 lat (msec): min=212, max=828, avg=434.88, stdev=201.33 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 292], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 368], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 518], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1831, max= 4079, per=33.76%, avg=2393.40, stdev=945.84, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=8.33%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=9.64%, ctx=192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5064KiB/s (5186kB/s), 513KiB/s-1791KiB/s (525kB/s-1834kB/s), io=20.0MiB (20.0MB), run=3716-4044msec WRITE: bw=7090KiB/s (7260kB/s), 1279KiB/s-2563KiB/s (1310kB/s-2624kB/s), io=28.0MiB (29.4MB), run=3716-4044msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145266: Mon Sep 7 01:12:36 2026 read: IOPS=1, BW=1372KiB/s (1405kB/s)(7168KiB/5226msec) clat (msec): min=85, max=1060, avg=316.85, stdev=349.89 lat (msec): min=85, max=1060, avg=316.85, stdev=349.89 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 104], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 169], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 451], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1477, max= 3984, per=61.77%, avg=2336.00, stdev=1121.88, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=980KiB/s (1003kB/s)(5120KiB/5226msec); 0 zone resets clat (msec): min=198, max=995, avg=578.25, stdev=307.62 lat (msec): min=198, max=995, avg=578.46, stdev=307.53 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1868, max= 4039, per=50.01%, avg=2647.33, stdev=1208.11, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.04%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145267: Mon Sep 7 01:12:36 2026 read: IOPS=0, BW=411KiB/s (420kB/s)(2048KiB/4988msec) clat (msec): min=94, max=331, avg=213.21, stdev=167.25 lat (msec): min=94, max=331, avg=213.21, stdev=167.25 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 95], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1544, max= 2039, per=47.37%, avg=1791.50, stdev=350.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2053KiB/s (2102kB/s)(10.0MiB/4988msec); 0 zone resets clat (msec): min=225, max=911, avg=449.09, stdev=256.03 lat (msec): min=225, max=911, avg=449.25, stdev=256.09 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 230], | 30.00th=[ 241], 40.00th=[ 300], 50.00th=[ 326], 60.00th=[ 330], | 70.00th=[ 439], 80.00th=[ 693], 90.00th=[ 802], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1868, max= 4071, per=55.89%, avg=2959.00, stdev=1092.21, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=3.31%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145268: Mon Sep 7 01:12:36 2026 read: IOPS=1, BW=1330KiB/s (1362kB/s)(6144KiB/4620msec) clat (msec): min=116, max=353, avg=203.81, stdev=91.97 lat (msec): min=116, max=353, avg=203.81, stdev=91.97 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 241], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1868, max= 3737, per=63.87%, avg=2415.75, stdev=884.13, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1330KiB/s (1362kB/s)(6144KiB/4620msec); 0 zone resets clat (msec): min=195, max=1104, avg=551.50, stdev=367.58 lat (msec): min=195, max=1104, avg=551.69, stdev=367.57 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 550], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1868, max= 3020, per=41.44%, avg=2193.75, stdev=555.41, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.99%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145269: Mon Sep 7 01:12:36 2026 read: IOPS=0, BW=946KiB/s (968kB/s)(5120KiB/5415msec) clat (msec): min=140, max=461, avg=277.19, stdev=143.65 lat (msec): min=140, max=461, avg=277.19, stdev=143.65 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2019, max= 4079, per=71.68%, avg=2711.00, stdev=1184.75, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1324KiB/s (1355kB/s)(7168KiB/5415msec); 0 zone resets clat (msec): min=168, max=1286, avg=564.03, stdev=421.88 lat (msec): min=168, max=1286, avg=564.15, stdev=421.88 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 218], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 485], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 953], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1530, max= 4087, per=42.59%, avg=2254.50, stdev=917.26, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=2.88%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3782KiB/s (3873kB/s), 411KiB/s-1372KiB/s (420kB/s-1405kB/s), io=20.0MiB (20.0MB), run=4620-5415msec WRITE: bw=5295KiB/s (5422kB/s), 980KiB/s-2053KiB/s (1003kB/s-2102kB/s), io=28.0MiB (29.4MB), run=4620-5415msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145280: Mon Sep 7 01:12:53 2026 read: IOPS=0, BW=3300KiB/s (3379kB/s)(12.0MiB/3724msec) clat (msec): min=194, max=1823, avg=1222.20, stdev=894.08 lat (msec): min=194, max=1823, avg=1222.20, stdev=894.08 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 7922, max= 8126, per=100.00%, avg=8024.00, stdev=144.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.04%, ctx=39, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145282: Mon Sep 7 01:12:53 2026 read: IOPS=0, BW=1004KiB/s (1028kB/s)(4096KiB/4079msec) clat (nsec): min=949147k, max=949147k, avg=949146893.00, stdev= 0.00 lat (nsec): min=949150k, max=949150k, avg=949149948.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2008KiB/s (2057kB/s)(8192KiB/4079msec); 0 zone resets clat (msec): min=1101, max=1807, avg=1454.51, stdev=499.47 lat (msec): min=1101, max=1808, avg=1454.98, stdev=499.43 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1804], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.02%, sys=2.92%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145284: Mon Sep 7 01:12:53 2026 write: IOPS=0, BW=3498KiB/s (3582kB/s)(12.0MiB/3513msec); 0 zone resets clat (msec): min=584, max=1601, avg=1137.50, stdev=514.22 lat (msec): min=586, max=1609, avg=1140.94, stdev=516.86 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7922, max= 8175, per=100.00%, avg=8048.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.13%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145286: Mon Sep 7 01:12:53 2026 write: IOPS=1, BW=4279KiB/s (4381kB/s)(12.0MiB/2872msec); 0 zone resets clat (msec): min=532, max=1498, avg=905.21, stdev=519.04 lat (msec): min=532, max=1498, avg=905.86, stdev=518.76 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8078, max= 8143, per=100.00%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.14%, sys=4.08%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4017KiB/s (4113kB/s), 1004KiB/s-3300KiB/s (1028kB/s-3379kB/s), io=16.0MiB (16.8MB), run=3724-4079msec WRITE: bw=8033KiB/s (8226kB/s), 2008KiB/s-4279KiB/s (2057kB/s-4381kB/s), io=32.0MiB (33.6MB), run=2872-4079msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145281: Mon Sep 7 01:12:54 2026 read: IOPS=1, BW=4264KiB/s (4366kB/s)(12.0MiB/2882msec) clat (msec): min=723, max=1275, avg=928.14, stdev=302.77 lat (msec): min=723, max=1275, avg=928.14, stdev=302.77 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7801, max= 8110, per=100.00%, avg=7955.50, stdev=218.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.14%, sys=10.17%, ctx=153, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145283: Mon Sep 7 01:12:54 2026 read: IOPS=0, BW=1143KiB/s (1170kB/s)(4096KiB/3585msec) clat (nsec): min=835097k, max=835097k, avg=835096627.00, stdev= 0.00 lat (nsec): min=835100k, max=835100k, avg=835099530.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2285KiB/s (2340kB/s)(8192KiB/3585msec); 0 zone resets clat (msec): min=856, max=1677, avg=1267.21, stdev=580.35 lat (msec): min=857, max=1678, avg=1267.66, stdev=580.40 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.06%, sys=3.74%, ctx=128, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145285: Mon Sep 7 01:12:54 2026 write: IOPS=0, BW=2819KiB/s (2887kB/s)(12.0MiB/4359msec); 0 zone resets clat (msec): min=243, max=2113, avg=1426.15, stdev=1029.04 lat (msec): min=245, max=2114, avg=1427.31, stdev=1028.01 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 1921], 50.00th=[ 1921], 60.00th=[ 1921], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.43%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145287: Mon Sep 7 01:12:54 2026 write: IOPS=0, BW=3916KiB/s (4010kB/s)(12.0MiB/3138msec); 0 zone resets clat (msec): min=756, max=1137, avg=985.57, stdev=202.07 lat (msec): min=756, max=1147, avg=989.00, stdev=205.71 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8031, max= 8143, per=100.00%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.72%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4570KiB/s (4680kB/s), 1143KiB/s-4264KiB/s (1170kB/s-4366kB/s), io=16.0MiB (16.8MB), run=2882-3585msec WRITE: bw=7517KiB/s (7698kB/s), 2285KiB/s-3916KiB/s (2340kB/s-4010kB/s), io=32.0MiB (33.6MB), run=3138-4359msec