== sanity test 398b: DIO and buffer IO race ============== 01:11:17 (1783141877) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.06143 s, 9.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180537: Sat Jul 4 01:13:21 2026 read: IOPS=14, BW=56.9KiB/s (58.3kB/s)(5992KiB/105289msec) clat (usec): min=37, max=930116, avg=37749.60, stdev=32158.15 lat (usec): min=38, max=930118, avg=37751.30, stdev=32158.03 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 192], 10.00th=[ 14615], 20.00th=[ 19792], | 30.00th=[ 24249], 40.00th=[ 28443], 50.00th=[ 32900], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 53740], 90.00th=[ 66847], 95.00th=[ 79168], | 99.00th=[107480], 99.50th=[128451], 99.90th=[160433], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 10, max= 120, per=25.56%, avg=56.74, stdev=19.54, samples=207 iops : min= 2, max= 30, avg=13.53, stdev= 4.93, samples=207 write: IOPS=14, BW=59.8KiB/s (61.2kB/s)(6296KiB/105289msec); 0 zone resets clat (usec): min=886, max=258709, avg=30617.30, stdev=31107.58 lat (usec): min=886, max=258710, avg=30620.21, stdev=31109.38 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1565], 10.00th=[ 2114], 20.00th=[ 4015], | 30.00th=[ 6849], 40.00th=[ 14877], 50.00th=[ 22414], 60.00th=[ 30540], | 70.00th=[ 38536], 80.00th=[ 52167], 90.00th=[ 70779], 95.00th=[ 91751], | 99.00th=[133694], 99.50th=[152044], 99.90th=[235930], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 168, per=25.81%, avg=59.89, stdev=24.01, samples=206 iops : min= 1, max= 42, avg=14.32, stdev= 6.06, samples=206 lat (usec) : 50=0.20%, 100=1.82%, 250=0.42%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=4.49%, 4=5.70%, 10=7.71%, 20=13.38%, 50=42.94% lat (msec) : 100=20.61%, 250=2.47%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.61%, ctx=6820, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180538: Sat Jul 4 01:13:21 2026 read: IOPS=13, BW=55.3KiB/s (56.6kB/s)(5940KiB/107401msec) clat (usec): min=39, max=933378, avg=39581.28, stdev=35465.88 lat (usec): min=39, max=933379, avg=39584.38, stdev=35466.83 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 1467], 10.00th=[ 14484], 20.00th=[ 20317], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 33424], 60.00th=[ 39584], | 70.00th=[ 45876], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[127402], 99.50th=[154141], 99.90th=[413139], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 5, max= 119, per=24.81%, avg=55.08, stdev=20.26, samples=211 iops : min= 1, max= 29, avg=13.11, stdev= 5.09, samples=211 write: IOPS=14, BW=59.1KiB/s (60.5kB/s)(6348KiB/107401msec); 0 zone resets clat (usec): min=911, max=188984, avg=30261.51, stdev=29442.06 lat (usec): min=912, max=188986, avg=30263.74, stdev=29442.49 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1532], 10.00th=[ 2212], 20.00th=[ 4555], | 30.00th=[ 7701], 40.00th=[ 15401], 50.00th=[ 22938], 60.00th=[ 29230], | 70.00th=[ 38536], 80.00th=[ 51643], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[127402], 99.50th=[139461], 99.90th=[166724], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 7, max= 150, per=25.27%, avg=58.64, stdev=23.49, samples=211 iops : min= 1, max= 37, avg=14.01, stdev= 5.93, samples=211 lat (usec) : 50=0.16%, 100=1.92%, 250=0.26%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.56%, 4=5.08%, 10=8.14%, 20=12.96%, 50=43.59% lat (msec) : 100=20.15%, 250=2.99%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=6.53%, ctx=7041, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180539: Sat Jul 4 01:13:21 2026 read: IOPS=14, BW=58.6KiB/s (60.0kB/s)(6028KiB/102814msec) clat (usec): min=37, max=903286, avg=38212.44, stdev=34266.70 lat (usec): min=37, max=903288, avg=38215.37, stdev=34266.35 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 95], 10.00th=[ 13566], 20.00th=[ 19792], | 30.00th=[ 23987], 40.00th=[ 28443], 50.00th=[ 32375], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[129500], 99.50th=[149947], 99.90th=[350225], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 5, max= 111, per=26.30%, avg=58.39, stdev=20.56, samples=202 iops : min= 1, max= 27, avg=13.94, stdev= 5.18, samples=202 write: IOPS=15, BW=60.9KiB/s (62.3kB/s)(6260KiB/102814msec); 0 zone resets clat (usec): min=779, max=214513, avg=28521.11, stdev=28134.53 lat (usec): min=780, max=214515, avg=28525.04, stdev=28133.49 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1467], 10.00th=[ 2008], 20.00th=[ 3523], | 30.00th=[ 5932], 40.00th=[ 12780], 50.00th=[ 21365], 60.00th=[ 28967], | 70.00th=[ 38536], 80.00th=[ 49546], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[114820], 99.50th=[129500], 99.90th=[191890], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 7, max= 118, per=26.06%, avg=60.46, stdev=22.88, samples=202 iops : min= 1, max= 29, avg=14.47, stdev= 5.76, samples=202 lat (usec) : 50=0.29%, 100=2.18%, 250=0.26%, 500=0.16%, 1000=0.13% lat (msec) : 2=4.92%, 4=6.22%, 10=8.07%, 20=12.11%, 50=43.85% lat (msec) : 100=19.43%, 250=2.31%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=6.72%, ctx=6732, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180540: Sat Jul 4 01:13:21 2026 read: IOPS=14, BW=56.1KiB/s (57.4kB/s)(6052KiB/107948msec) clat (usec): min=38, max=167574, avg=39133.41, stdev=25009.82 lat (usec): min=38, max=167575, avg=39134.79, stdev=25009.92 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 194], 10.00th=[ 14615], 20.00th=[ 20317], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 46400], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 84411], | 99.00th=[135267], 99.50th=[147850], 99.90th=[164627], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 7, max= 119, per=25.26%, avg=56.07, stdev=18.87, samples=211 iops : min= 1, max= 29, avg=13.36, stdev= 4.76, samples=211 write: IOPS=14, BW=57.8KiB/s (59.2kB/s)(6236KiB/107948msec); 0 zone resets clat (usec): min=800, max=820094, avg=30913.61, stdev=35785.81 lat (usec): min=801, max=820097, avg=30915.47, stdev=35785.76 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1500], 10.00th=[ 2057], 20.00th=[ 4228], | 30.00th=[ 7439], 40.00th=[ 15664], 50.00th=[ 23462], 60.00th=[ 30802], | 70.00th=[ 40109], 80.00th=[ 51643], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[122160], 99.50th=[149947], 99.90th=[231736], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 135, per=24.75%, avg=57.42, stdev=21.75, samples=212 iops : min= 1, max= 33, avg=13.70, stdev= 5.49, samples=212 lat (usec) : 50=0.07%, 100=2.21%, 250=0.23%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.85%, 4=4.92%, 10=7.65%, 20=12.57%, 50=43.85% lat (msec) : 100=20.54%, 250=2.83%, 1000=0.03% cpu : usr=0.08%, sys=6.58%, ctx=6993, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=222KiB/s (228kB/s), 55.3KiB/s-58.6KiB/s (56.6kB/s-60.0kB/s), io=23.4MiB (24.6MB), run=102814-107948msec WRITE: bw=233KiB/s (238kB/s), 57.8KiB/s-60.9KiB/s (59.2kB/s-62.3kB/s), io=24.6MiB (25.7MB), run=102814-107948msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180542: Sat Jul 4 01:13:53 2026 read: IOPS=10, BW=42.9KiB/s (43.0kB/s)(5992KiB/139517msec) clat (msec): min=5, max=960, avg=37.21, stdev=39.61 lat (msec): min=5, max=960, avg=37.21, stdev=39.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 83], 95.00th=[ 107], | 99.00th=[ 148], 99.50th=[ 176], 99.90th=[ 257], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 143, per=25.45%, avg=43.53, stdev=29.04, samples=269 iops : min= 1, max= 35, avg=10.25, stdev= 7.29, samples=269 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6296KiB/139517msec); 0 zone resets clat (msec): min=9, max=328, avg=52.96, stdev=37.90 lat (msec): min=9, max=328, avg=52.96, stdev=37.90 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 101], 95.00th=[ 126], | 99.00th=[ 201], 99.50th=[ 228], 99.90th=[ 271], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 149, per=25.05%, avg=45.08, stdev=28.04, samples=273 iops : min= 1, max= 37, avg=10.64, stdev= 7.05, samples=273 lat (msec) : 10=3.84%, 20=20.28%, 50=44.53%, 100=23.40%, 250=7.68% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.74%, ctx=5215, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180543: Sat Jul 4 01:13:53 2026 read: IOPS=10, BW=42.5KiB/s (43.6kB/s)(5940KiB/139609msec) clat (msec): min=5, max=776, avg=37.32, stdev=38.09 lat (msec): min=5, max=776, avg=37.32, stdev=38.09 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 110], | 99.00th=[ 161], 99.50th=[ 169], 99.90th=[ 271], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 143, per=24.94%, avg=42.65, stdev=29.62, samples=272 iops : min= 1, max= 35, avg=10.03, stdev= 7.42, samples=272 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6348KiB/139609msec); 0 zone resets clat (msec): min=10, max=406, avg=52.79, stdev=37.04 lat (msec): min=10, max=406, avg=52.79, stdev=37.04 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 78], 90.00th=[ 97], 95.00th=[ 122], | 99.00th=[ 192], 99.50th=[ 222], 99.90th=[ 292], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 127, per=25.19%, avg=45.33, stdev=27.12, samples=273 iops : min= 1, max= 31, avg=10.70, stdev= 6.82, samples=273 lat (msec) : 10=3.58%, 20=20.28%, 50=45.08%, 100=23.11%, 250=7.78% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=2.68%, ctx=5140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180544: Sat Jul 4 01:13:53 2026 read: IOPS=10, BW=43.3KiB/s (44.3kB/s)(6028KiB/139180msec) clat (msec): min=5, max=264, avg=37.04, stdev=32.79 lat (msec): min=5, max=264, avg=37.05, stdev=32.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 163], 99.50th=[ 188], 99.90th=[ 236], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 7, max= 151, per=25.28%, avg=43.22, stdev=27.94, samples=272 iops : min= 1, max= 37, avg=10.18, stdev= 7.01, samples=272 write: IOPS=11, BW=44.0KiB/s (46.1kB/s)(6260KiB/139180msec); 0 zone resets clat (msec): min=9, max=723, avg=52.95, stdev=39.64 lat (msec): min=9, max=723, avg=52.95, stdev=39.64 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 64], 80.00th=[ 77], 90.00th=[ 100], 95.00th=[ 121], | 99.00th=[ 171], 99.50th=[ 222], 99.90th=[ 401], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 135, per=24.87%, avg=44.76, stdev=27.40, samples=273 iops : min= 1, max= 33, avg=10.55, stdev= 6.90, samples=273 lat (msec) : 10=3.26%, 20=19.99%, 50=45.08%, 100=23.83%, 250=7.65% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=2.85%, ctx=5217, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180545: Sat Jul 4 01:13:53 2026 read: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6052KiB/139599msec) clat (msec): min=5, max=251, avg=37.27, stdev=31.73 lat (msec): min=5, max=251, avg=37.27, stdev=31.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 107], | 99.00th=[ 150], 99.50th=[ 159], 99.90th=[ 178], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 7, max= 159, per=25.51%, avg=43.62, stdev=29.04, samples=271 iops : min= 1, max= 39, avg=10.27, stdev= 7.30, samples=271 write: IOPS=11, BW=44.7KiB/s (45.7kB/s)(6236KiB/139599msec); 0 zone resets clat (msec): min=10, max=802, avg=53.10, stdev=42.47 lat (msec): min=10, max=802, avg=53.11, stdev=42.48 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 77], 90.00th=[ 103], 95.00th=[ 124], | 99.00th=[ 192], 99.50th=[ 245], 99.90th=[ 401], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 127, per=24.64%, avg=44.36, stdev=27.31, samples=274 iops : min= 1, max= 31, avg=10.46, stdev= 6.85, samples=274 lat (msec) : 10=2.93%, 20=20.70%, 50=45.35%, 100=22.17%, 250=8.63% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=2.78%, ctx=5162, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=172KiB/s (176kB/s), 42.5KiB/s-43.4KiB/s (43.6kB/s-44.4kB/s), io=23.4MiB (24.6MB), run=139180-139609msec WRITE: bw=180KiB/s (184kB/s), 44.7KiB/s-45.5KiB/s (45.7kB/s-46.6kB/s), io=24.6MiB (25.7MB), run=139180-139609msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180587: Sat Jul 4 01:14:26 2026 read: IOPS=14, BW=237KiB/s (242kB/s)(5920KiB/25003msec) clat (usec): min=41, max=131991, avg=34455.51, stdev=20395.63 lat (usec): min=42, max=131992, avg=34456.90, stdev=20395.68 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 88], 10.00th=[ 14615], 20.00th=[ 19530], | 30.00th=[ 23725], 40.00th=[ 27919], 50.00th=[ 31327], 60.00th=[ 35914], | 70.00th=[ 42206], 80.00th=[ 47449], 90.00th=[ 59507], 95.00th=[ 69731], | 99.00th=[100140], 99.50th=[107480], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 94, max= 383, per=24.30%, avg=232.55, stdev=76.47, samples=49 iops : min= 5, max= 23, avg=13.76, stdev= 4.80, samples=49 write: IOPS=15, BW=255KiB/s (261kB/s)(6368KiB/25003msec); 0 zone resets clat (usec): min=1367, max=166473, avg=30129.70, stdev=28100.79 lat (usec): min=1368, max=166476, avg=30148.10, stdev=28098.84 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2343], 10.00th=[ 3818], 20.00th=[ 6783], | 30.00th=[ 11076], 40.00th=[ 16909], 50.00th=[ 19792], 60.00th=[ 27657], | 70.00th=[ 37487], 80.00th=[ 47973], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[125305], 99.50th=[135267], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 31, max= 572, per=25.15%, avg=253.22, stdev=88.42, samples=49 iops : min= 1, max= 35, avg=15.06, stdev= 5.56, samples=49 lat (usec) : 50=0.39%, 100=2.34%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=1.56%, 4=3.91%, 10=9.11%, 20=18.23%, 50=45.83% lat (msec) : 100=15.89%, 250=1.82% cpu : usr=0.14%, sys=8.56%, ctx=1979, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180588: Sat Jul 4 01:14:26 2026 read: IOPS=14, BW=230KiB/s (235kB/s)(5744KiB/24988msec) clat (usec): min=45, max=136609, avg=37131.61, stdev=22696.33 lat (usec): min=46, max=136610, avg=37133.18, stdev=22696.22 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 103], 10.00th=[ 14615], 20.00th=[ 21103], | 30.00th=[ 24773], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 38536], | 70.00th=[ 44303], 80.00th=[ 52691], 90.00th=[ 63177], 95.00th=[ 78119], | 99.00th=[123208], 99.50th=[133694], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 31, max= 416, per=23.90%, avg=228.69, stdev=80.85, samples=49 iops : min= 1, max= 26, avg=13.51, stdev= 5.12, samples=49 write: IOPS=16, BW=262KiB/s (268kB/s)(6544KiB/24988msec); 0 zone resets clat (usec): min=1589, max=209949, avg=27943.03, stdev=26171.23 lat (usec): min=1590, max=209951, avg=27947.60, stdev=26170.40 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2507], 10.00th=[ 3720], 20.00th=[ 5866], | 30.00th=[ 10028], 40.00th=[ 17171], 50.00th=[ 21365], 60.00th=[ 26084], | 70.00th=[ 33424], 80.00th=[ 43779], 90.00th=[ 62129], 95.00th=[ 81265], | 99.00th=[116917], 99.50th=[121111], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 447, per=25.87%, avg=260.49, stdev=93.59, samples=49 iops : min= 1, max= 27, avg=15.51, stdev= 5.87, samples=49 lat (usec) : 50=0.13%, 100=2.08%, 250=0.65%, 1000=0.13% lat (msec) : 2=1.30%, 4=5.47%, 10=9.64%, 20=13.02%, 50=48.96% lat (msec) : 100=16.28%, 250=2.34% cpu : usr=0.12%, sys=8.67%, ctx=1901, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180589: Sat Jul 4 01:14:26 2026 read: IOPS=15, BW=254KiB/s (260kB/s)(6256KiB/24644msec) clat (usec): min=23, max=118152, avg=34523.84, stdev=19611.69 lat (usec): min=23, max=118153, avg=34525.59, stdev=19611.83 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 100], 10.00th=[ 12911], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 28705], 50.00th=[ 32900], 60.00th=[ 36439], | 70.00th=[ 42206], 80.00th=[ 49021], 90.00th=[ 61080], 95.00th=[ 69731], | 99.00th=[ 89654], 99.50th=[ 92799], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 95, max= 479, per=26.61%, avg=254.65, stdev=83.72, samples=48 iops : min= 5, max= 29, avg=15.15, stdev= 5.32, samples=48 write: IOPS=15, BW=245KiB/s (251kB/s)(6032KiB/24644msec); 0 zone resets clat (usec): min=1649, max=138372, avg=29411.90, stdev=26915.57 lat (usec): min=1650, max=138375, avg=29414.50, stdev=26915.76 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2737], 10.00th=[ 3490], 20.00th=[ 5997], | 30.00th=[ 8455], 40.00th=[ 15664], 50.00th=[ 21627], 60.00th=[ 28967], | 70.00th=[ 38536], 80.00th=[ 50070], 90.00th=[ 64750], 95.00th=[ 83362], | 99.00th=[125305], 99.50th=[128451], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 94, max= 383, per=23.97%, avg=241.42, stdev=80.81, samples=48 iops : min= 5, max= 23, avg=14.31, stdev= 5.04, samples=48 lat (usec) : 50=0.39%, 100=2.08%, 250=1.30%, 500=0.13%, 750=0.13% lat (msec) : 2=0.78%, 4=5.34%, 10=10.29%, 20=13.80%, 50=46.35% lat (msec) : 100=18.23%, 250=1.17% cpu : usr=0.08%, sys=9.04%, ctx=1981, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180590: Sat Jul 4 01:14:26 2026 read: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24548msec) clat (usec): min=43, max=137615, avg=35341.71, stdev=22892.19 lat (usec): min=43, max=137617, avg=35343.08, stdev=22892.22 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 147], 20.00th=[ 18744], | 30.00th=[ 25297], 40.00th=[ 28967], 50.00th=[ 32375], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 51643], 90.00th=[ 62653], 95.00th=[ 74974], | 99.00th=[110625], 99.50th=[127402], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 31, max= 415, per=25.51%, avg=244.08, stdev=78.27, samples=48 iops : min= 1, max= 25, avg=14.48, stdev= 4.96, samples=48 write: IOPS=15, BW=255KiB/s (261kB/s)(6256KiB/24548msec); 0 zone resets clat (usec): min=1468, max=153886, avg=28057.10, stdev=25498.58 lat (usec): min=1470, max=153889, avg=28059.67, stdev=25498.58 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2802], 10.00th=[ 4080], 20.00th=[ 6128], | 30.00th=[ 8455], 40.00th=[ 14615], 50.00th=[ 20579], 60.00th=[ 27395], | 70.00th=[ 36963], 80.00th=[ 46400], 90.00th=[ 65274], 95.00th=[ 83362], | 99.00th=[101188], 99.50th=[112722], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 95, max= 448, per=25.23%, avg=254.02, stdev=86.82, samples=48 iops : min= 5, max= 28, avg=15.10, stdev= 5.47, samples=48 lat (usec) : 50=0.39%, 100=3.78%, 250=1.17%, 500=0.65%, 750=0.13% lat (msec) : 2=1.17%, 4=3.65%, 10=11.85%, 20=11.72%, 50=46.09% lat (msec) : 100=17.97%, 250=1.43% cpu : usr=0.07%, sys=8.51%, ctx=1845, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=958KiB/s (981kB/s), 230KiB/s-254KiB/s (235kB/s-260kB/s), io=23.4MiB (24.5MB), run=24548-25003msec WRITE: bw=1008KiB/s (1032kB/s), 245KiB/s-262KiB/s (251kB/s-268kB/s), io=24.6MiB (25.8MB), run=24548-25003msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180591: Sat Jul 4 01:14:34 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(5920KiB/32545msec) clat (msec): min=5, max=147, avg=33.93, stdev=29.72 lat (msec): min=5, max=147, avg=33.93, stdev=29.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 80], 95.00th=[ 101], | 99.00th=[ 132], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 63, max= 539, per=24.96%, avg=183.19, stdev=120.64, samples=63 iops : min= 3, max= 33, avg=10.67, stdev= 7.60, samples=63 write: IOPS=12, BW=196KiB/s (200kB/s)(6368KiB/32545msec); 0 zone resets clat (msec): min=10, max=185, avg=49.75, stdev=34.03 lat (msec): min=10, max=185, avg=49.76, stdev=34.04 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 80], 90.00th=[ 100], 95.00th=[ 117], | 99.00th=[ 178], 99.50th=[ 184], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 508, per=25.24%, avg=195.11, stdev=123.35, samples=64 iops : min= 1, max= 31, avg=11.42, stdev= 7.72, samples=64 lat (msec) : 10=6.12%, 20=23.70%, 50=41.28%, 100=21.88%, 250=7.03% cpu : usr=0.06%, sys=3.37%, ctx=1280, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180592: Sat Jul 4 01:14:34 2026 read: IOPS=11, BW=176KiB/s (180kB/s)(5744KiB/32599msec) clat (msec): min=5, max=160, avg=34.52, stdev=30.09 lat (msec): min=5, max=160, avg=34.52, stdev=30.09 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 99], | 99.00th=[ 140], 99.50th=[ 155], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 31, max= 608, per=24.03%, avg=176.40, stdev=124.21, samples=63 iops : min= 1, max= 38, avg=10.21, stdev= 7.89, samples=63 write: IOPS=12, BW=201KiB/s (206kB/s)(6544KiB/32599msec); 0 zone resets clat (msec): min=11, max=208, avg=49.10, stdev=35.02 lat (msec): min=11, max=208, avg=49.11, stdev=35.02 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 46], | 70.00th=[ 60], 80.00th=[ 75], 90.00th=[ 102], 95.00th=[ 118], | 99.00th=[ 159], 99.50th=[ 190], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 576, per=25.51%, avg=197.16, stdev=122.36, samples=63 iops : min= 1, max= 36, avg=11.51, stdev= 7.77, samples=63 lat (msec) : 10=5.08%, 20=22.92%, 50=42.58%, 100=21.74%, 250=7.68% cpu : usr=0.07%, sys=3.43%, ctx=1342, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180593: Sat Jul 4 01:14:34 2026 read: IOPS=12, BW=197KiB/s (201kB/s)(6256KiB/31833msec) clat (msec): min=6, max=204, avg=34.77, stdev=29.35 lat (msec): min=6, max=204, avg=34.77, stdev=29.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 78], 95.00th=[ 96], | 99.00th=[ 140], 99.50th=[ 155], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 638, per=27.22%, avg=199.82, stdev=138.19, samples=62 iops : min= 1, max= 39, avg=11.68, stdev= 8.77, samples=62 write: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31833msec); 0 zone resets clat (msec): min=8, max=192, avg=47.76, stdev=31.40 lat (msec): min=8, max=192, avg=47.76, stdev=31.40 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 57], 80.00th=[ 72], 90.00th=[ 90], 95.00th=[ 112], | 99.00th=[ 157], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 63, max= 480, per=24.14%, avg=186.57, stdev=109.34, samples=63 iops : min= 3, max= 30, avg=10.84, stdev= 6.98, samples=63 lat (msec) : 10=3.39%, 20=24.48%, 50=42.97%, 100=22.79%, 250=6.38% cpu : usr=0.07%, sys=3.35%, ctx=1257, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180594: Sat Jul 4 01:14:34 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(6032KiB/32242msec) clat (msec): min=5, max=187, avg=35.17, stdev=29.99 lat (msec): min=5, max=187, avg=35.17, stdev=29.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 96], | 99.00th=[ 127], 99.50th=[ 182], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 544, per=25.62%, avg=188.05, stdev=128.10, samples=63 iops : min= 1, max= 34, avg=10.94, stdev= 8.12, samples=63 write: IOPS=12, BW=194KiB/s (199kB/s)(6256KiB/32242msec); 0 zone resets clat (msec): min=9, max=191, avg=47.70, stdev=32.33 lat (msec): min=9, max=191, avg=47.71, stdev=32.33 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 96], 95.00th=[ 114], | 99.00th=[ 157], 99.50th=[ 182], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 31, max= 512, per=25.04%, avg=193.56, stdev=124.82, samples=64 iops : min= 1, max= 32, avg=11.28, stdev= 7.91, samples=64 lat (msec) : 10=5.47%, 20=22.40%, 50=43.23%, 100=22.14%, 250=6.77% cpu : usr=0.08%, sys=3.37%, ctx=1313, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=735KiB/s (752kB/s), 176KiB/s-197KiB/s (180kB/s-201kB/s), io=23.4MiB (24.5MB), run=31833-32599msec WRITE: bw=773KiB/s (792kB/s), 189KiB/s-201KiB/s (194kB/s-206kB/s), io=24.6MiB (25.8MB), run=31833-32599msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180604: Sat Jul 4 01:14:43 2026 read: IOPS=2, BW=2846KiB/s (2914kB/s)(7168KiB/2519msec) clat (msec): min=46, max=314, avg=144.83, stdev=105.38 lat (msec): min=46, max=314, avg=144.83, stdev=105.38 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 59], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 89], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 264], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2023, max= 5446, per=58.80%, avg=3768.00, stdev=1712.48, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=2033KiB/s (2081kB/s)(5120KiB/2519msec); 0 zone resets clat (msec): min=112, max=559, avg=296.48, stdev=169.53 lat (msec): min=113, max=559, avg=296.87, stdev=169.20 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1815, max= 4047, per=29.34%, avg=2632.33, stdev=1230.07, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=7.51%, ctx=76, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180605: Sat Jul 4 01:14:43 2026 read: IOPS=0, BW=657KiB/s (673kB/s)(2048KiB/3116msec) clat (msec): min=69, max=336, avg=202.94, stdev=188.38 lat (msec): min=69, max=336, avg=202.94, stdev=188.38 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 70], 40.00th=[ 70], 50.00th=[ 70], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1855, max= 1965, per=29.81%, avg=1910.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3286KiB/s (3365kB/s)(10.0MiB/3116msec); 0 zone resets clat (msec): min=71, max=730, avg=264.86, stdev=229.27 lat (msec): min=71, max=730, avg=264.98, stdev=229.26 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 74], | 30.00th=[ 79], 40.00th=[ 110], 50.00th=[ 180], 60.00th=[ 226], | 70.00th=[ 230], 80.00th=[ 368], 90.00th=[ 584], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1855, max= 4047, per=32.61%, avg=2925.50, stdev=1176.65, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=12.36%, ctx=107, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180606: Sat Jul 4 01:14:43 2026 read: IOPS=1, BW=1922KiB/s (1969kB/s)(6144KiB/3196msec) clat (msec): min=52, max=908, avg=249.35, stdev=333.60 lat (msec): min=52, max=908, avg=249.36, stdev=333.60 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 80], 50.00th=[ 80], 60.00th=[ 99], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1965, max= 4087, per=52.66%, avg=3374.33, stdev=1220.54, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1922KiB/s (1969kB/s)(6144KiB/3196msec); 0 zone resets clat (msec): min=68, max=483, avg=278.28, stdev=152.91 lat (msec): min=68, max=483, avg=278.39, stdev=152.93 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 347], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1917, max= 3764, per=27.20%, avg=2439.75, stdev=884.71, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=41.67%, 250=8.33%, 500=41.67%, 1000=8.33% cpu : usr=0.03%, sys=8.33%, ctx=83, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180607: Sat Jul 4 01:14:43 2026 read: IOPS=1, BW=1869KiB/s (1914kB/s)(5120KiB/2739msec) clat (msec): min=48, max=407, avg=192.57, stdev=147.63 lat (msec): min=48, max=407, avg=192.57, stdev=147.63 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 49], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 125], 60.00th=[ 125], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2035, max= 6071, per=63.25%, avg=4053.00, stdev=2853.88, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2617KiB/s (2680kB/s)(7168KiB/2739msec); 0 zone resets clat (msec): min=80, max=480, avg=244.38, stdev=171.10 lat (msec): min=80, max=480, avg=245.37, stdev=172.07 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 116], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 124], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 405], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 3813, max= 3930, per=43.02%, avg=3859.33, stdev=62.18, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=11.18%, ctx=90, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6408KiB/s (6562kB/s), 657KiB/s-2846KiB/s (673kB/s-2914kB/s), io=20.0MiB (20.0MB), run=2519-3196msec WRITE: bw=8971KiB/s (9187kB/s), 1922KiB/s-3286KiB/s (1969kB/s-3365kB/s), io=28.0MiB (29.4MB), run=2519-3196msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180609: Sat Jul 4 01:14:43 2026 read: IOPS=3, BW=3119KiB/s (3194kB/s)(7168KiB/2298msec) clat (msec): min=30, max=235, avg=176.93, stdev=72.25 lat (msec): min=30, max=235, avg=176.93, stdev=72.25 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 155], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 197], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 232], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 1969, max= 4079, per=49.67%, avg=3036.50, stdev=1199.39, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=2, BW=2228KiB/s (2281kB/s)(5120KiB/2298msec); 0 zone resets clat (msec): min=111, max=318, avg=189.61, stdev=77.67 lat (msec): min=111, max=318, avg=189.70, stdev=77.65 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 2035, max= 4055, per=31.66%, avg=2709.67, stdev=1165.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 250=83.33%, 500=8.33% cpu : usr=0.00%, sys=27.64%, ctx=288, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180610: Sat Jul 4 01:14:43 2026 read: IOPS=0, BW=641KiB/s (656kB/s)(2048KiB/3195msec) clat (msec): min=131, max=246, avg=189.38, stdev=81.25 lat (msec): min=131, max=246, avg=189.38, stdev=81.25 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 1992, max= 1996, per=32.62%, avg=1994.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3205KiB/s (3282kB/s)(10.0MiB/3195msec); 0 zone resets clat (msec): min=67, max=822, avg=277.50, stdev=245.55 lat (msec): min=68, max=822, avg=277.64, stdev=245.55 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 108], | 30.00th=[ 140], 40.00th=[ 150], 50.00th=[ 159], 60.00th=[ 165], | 70.00th=[ 215], 80.00th=[ 351], 90.00th=[ 600], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2027, max= 4087, per=37.88%, avg=3241.60, stdev=1104.00, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=29.09%, ctx=322, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180611: Sat Jul 4 01:14:43 2026 read: IOPS=2, BW=2587KiB/s (2649kB/s)(6144KiB/2375msec) clat (usec): min=439, max=214187, avg=92559.60, stdev=102367.84 lat (usec): min=440, max=214188, avg=92560.79, stdev=102368.00 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 562], 50.00th=[ 562], 60.00th=[158335], | 70.00th=[181404], 80.00th=[181404], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 4055, max= 4071, per=66.46%, avg=4063.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2587KiB/s (2649kB/s)(6144KiB/2375msec); 0 zone resets clat (msec): min=58, max=729, avg=286.53, stdev=241.67 lat (msec): min=58, max=729, avg=286.61, stdev=241.71 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 239], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1950, max= 4071, per=31.39%, avg=2686.67, stdev=1199.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=8.33% cpu : usr=0.08%, sys=26.62%, ctx=185, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180612: Sat Jul 4 01:14:43 2026 read: IOPS=1, BW=1528KiB/s (1565kB/s)(5120KiB/3350msec) clat (usec): min=678, max=198879, avg=81234.32, stdev=88018.46 lat (usec): min=679, max=198880, avg=81235.42, stdev=88018.25 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 2638], 40.00th=[ 2638], 50.00th=[ 59507], 60.00th=[ 59507], | 70.00th=[143655], 80.00th=[143655], 90.00th=[198181], 95.00th=[198181], | 99.00th=[198181], 99.50th=[198181], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2140KiB/s (2191kB/s)(7168KiB/3350msec); 0 zone resets clat (msec): min=45, max=1129, avg=415.65, stdev=422.02 lat (msec): min=45, max=1129, avg=415.74, stdev=422.01 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 54], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 236], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 810], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1992, max= 2043, per=23.69%, avg=2027.25, stdev=23.73, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 50=8.33%, 100=16.67%, 250=33.33%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.06%, sys=18.54%, ctx=148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6113KiB/s (6260kB/s), 641KiB/s-3119KiB/s (656kB/s-3194kB/s), io=20.0MiB (20.0MB), run=2298-3350msec WRITE: bw=8559KiB/s (8764kB/s), 2140KiB/s-3205KiB/s (2191kB/s-3282kB/s), io=28.0MiB (29.4MB), run=2298-3350msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180619: Sat Jul 4 01:14:54 2026 read: IOPS=1, BW=6568KiB/s (6725kB/s)(12.0MiB/1871msec) clat (msec): min=447, max=606, avg=508.37, stdev=85.57 lat (msec): min=447, max=606, avg=508.37, stdev=85.57 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8062, max= 8062, per=92.07%, avg=8062.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.11%, sys=14.65%, ctx=759, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180620: Sat Jul 4 01:14:54 2026 read: IOPS=0, BW=2487KiB/s (2547kB/s)(4096KiB/1647msec) clat (nsec): min=583938k, max=583938k, avg=583937555.00, stdev= 0.00 lat (nsec): min=583940k, max=583940k, avg=583940045.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8062, max= 8062, per=92.07%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4974KiB/s (5093kB/s)(8192KiB/1647msec); 0 zone resets clat (msec): min=333, max=338, avg=335.84, stdev= 3.97 lat (msec): min=334, max=339, avg=337.20, stdev= 3.43 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 8062, max= 8062, per=62.76%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=12.33%, ctx=329, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180621: Sat Jul 4 01:14:54 2026 write: IOPS=1, BW=4817KiB/s (4933kB/s)(12.0MiB/2551msec); 0 zone resets clat (msec): min=106, max=1909, avg=723.10, stdev=1028.01 lat (msec): min=107, max=1910, avg=723.59, stdev=1028.27 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.55%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180622: Sat Jul 4 01:14:54 2026 write: IOPS=1, BW=5896KiB/s (6038kB/s)(12.0MiB/2084msec); 0 zone resets clat (msec): min=193, max=1328, avg=583.39, stdev=645.21 lat (msec): min=193, max=1328, avg=583.86, stdev=645.10 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 5712, max= 8062, per=53.62%, avg=6887.00, stdev=1661.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.19%, sys=5.86%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8757KiB/s (8967kB/s), 2487KiB/s-6568KiB/s (2547kB/s-6725kB/s), io=16.0MiB (16.8MB), run=1647-1871msec WRITE: bw=12.5MiB/s (13.2MB/s), 4817KiB/s-5896KiB/s (4933kB/s-6038kB/s), io=32.0MiB (33.6MB), run=1647-2551msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180623: Sat Jul 4 01:14:54 2026 read: IOPS=1, BW=6800KiB/s (6963kB/s)(12.0MiB/1807msec) clat (msec): min=213, max=1105, avg=583.64, stdev=465.14 lat (msec): min=213, max=1105, avg=585.10, stdev=464.43 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8175, max= 8175, per=94.51%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=4.26%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180624: Sat Jul 4 01:14:54 2026 read: IOPS=0, BW=2163KiB/s (2215kB/s)(4096KiB/1894msec) clat (nsec): min=658058k, max=658058k, avg=658057797.00, stdev= 0.00 lat (nsec): min=658060k, max=658060k, avg=658060178.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7816, max= 7816, per=90.36%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4325KiB/s (4429kB/s)(8192KiB/1894msec); 0 zone resets clat (msec): min=486, max=636, avg=561.16, stdev=106.16 lat (msec): min=486, max=636, avg=561.57, stdev=106.08 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8175, max= 8175, per=56.16%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.16%, sys=5.28%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180625: Sat Jul 4 01:14:54 2026 write: IOPS=1, BW=5459KiB/s (5590kB/s)(12.0MiB/2251msec); 0 zone resets clat (msec): min=89, max=1872, avg=735.19, stdev=988.33 lat (msec): min=90, max=1873, avg=735.58, stdev=988.39 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] lat (msec) : 100=33.33%, 250=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.62%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180626: Sat Jul 4 01:14:54 2026 write: IOPS=1, BW=6589KiB/s (6747kB/s)(12.0MiB/1865msec); 0 zone resets clat (msec): min=130, max=1267, avg=608.72, stdev=589.29 lat (msec): min=130, max=1267, avg=609.09, stdev=589.17 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min=10951, max=10951, per=75.23%, avg=10951.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.51%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8650KiB/s (8858kB/s), 2163KiB/s-6800KiB/s (2215kB/s-6963kB/s), io=16.0MiB (16.8MB), run=1807-1894msec WRITE: bw=14.2MiB/s (14.9MB/s), 4325KiB/s-6589KiB/s (4429kB/s-6747kB/s), io=32.0MiB (33.6MB), run=1865-2251msec