== sanity test 398b: DIO and buffer IO race ============== 00:32:41 (1790742761) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.60183 s, 9.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180018: Wed Sep 30 00:34:49 2026 read: IOPS=13, BW=54.6KiB/s (55.9kB/s)(5992KiB/109704msec) clat (usec): min=40, max=519873, avg=40412.55, stdev=28835.11 lat (usec): min=40, max=519875, avg=40421.46, stdev=28831.18 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10552], 10.00th=[ 15008], 20.00th=[ 20317], | 30.00th=[ 24511], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 57410], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[132645], 99.50th=[158335], 99.90th=[299893], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 6, max= 103, per=24.85%, avg=54.18, stdev=19.26, samples=217 iops : min= 1, max= 25, avg=12.91, stdev= 4.85, samples=217 write: IOPS=14, BW=57.4KiB/s (58.8kB/s)(6296KiB/109704msec); 0 zone resets clat (usec): min=871, max=233485, avg=31145.45, stdev=33168.61 lat (usec): min=872, max=233486, avg=31147.63, stdev=33168.65 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1500], 20.00th=[ 3294], | 30.00th=[ 6521], 40.00th=[ 13698], 50.00th=[ 22152], 60.00th=[ 30016], | 70.00th=[ 39060], 80.00th=[ 52691], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[154141], 99.50th=[164627], 99.90th=[204473], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 151, per=25.07%, avg=57.42, stdev=25.18, samples=215 iops : min= 1, max= 37, avg=13.72, stdev= 6.31, samples=215 lat (usec) : 50=0.36%, 100=1.37%, 250=0.07%, 500=0.03%, 1000=0.16% lat (msec) : 2=6.74%, 4=4.59%, 10=7.36%, 20=13.02%, 50=41.83% lat (msec) : 100=20.90%, 250=3.52%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.42%, ctx=6451, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180019: Wed Sep 30 00:34:49 2026 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(5940KiB/109721msec) clat (usec): min=28, max=474460, avg=40722.32, stdev=27683.03 lat (usec): min=28, max=474461, avg=40724.30, stdev=27683.53 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11076], 10.00th=[ 15533], 20.00th=[ 20579], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[123208], 99.50th=[143655], 99.90th=[196084], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 6, max= 103, per=24.64%, avg=53.71, stdev=19.35, samples=217 iops : min= 1, max= 25, avg=12.79, stdev= 4.85, samples=217 write: IOPS=14, BW=57.9KiB/s (59.2kB/s)(6348KiB/109721msec); 0 zone resets clat (usec): min=882, max=288272, avg=30946.37, stdev=33246.50 lat (usec): min=882, max=288272, avg=30947.89, stdev=33246.47 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1467], 20.00th=[ 3589], | 30.00th=[ 7242], 40.00th=[ 14746], 50.00th=[ 21890], 60.00th=[ 29492], | 70.00th=[ 38536], 80.00th=[ 52691], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[158335], 99.50th=[181404], 99.90th=[246416], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 6, max= 167, per=25.08%, avg=57.43, stdev=24.17, samples=217 iops : min= 1, max= 41, avg=13.72, stdev= 6.05, samples=217 lat (usec) : 50=0.16%, 100=1.43%, 250=0.10%, 500=0.07%, 1000=0.03% lat (msec) : 2=7.29%, 4=4.17%, 10=6.77%, 20=13.57%, 50=41.41% lat (msec) : 100=21.97%, 250=2.96%, 500=0.07% cpu : usr=0.09%, sys=5.55%, ctx=6494, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180020: Wed Sep 30 00:34:49 2026 read: IOPS=14, BW=56.2KiB/s (57.6kB/s)(6028KiB/107242msec) clat (usec): min=34, max=309086, avg=40414.29, stdev=27704.19 lat (usec): min=35, max=309088, avg=40418.58, stdev=27704.96 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9503], 10.00th=[ 14222], 20.00th=[ 20579], | 30.00th=[ 24773], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 46924], 80.00th=[ 57410], 90.00th=[ 73925], 95.00th=[ 86508], | 99.00th=[135267], 99.50th=[162530], 99.90th=[267387], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 103, per=25.73%, avg=56.09, stdev=20.49, samples=211 iops : min= 1, max= 25, avg=13.39, stdev= 5.14, samples=211 write: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6260KiB/107242msec); 0 zone resets clat (usec): min=870, max=510168, avg=29520.72, stdev=33566.17 lat (usec): min=871, max=510170, avg=29522.28, stdev=33566.20 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1172], 10.00th=[ 1369], 20.00th=[ 2802], | 30.00th=[ 5407], 40.00th=[ 11600], 50.00th=[ 20055], 60.00th=[ 28705], | 70.00th=[ 38536], 80.00th=[ 49546], 90.00th=[ 69731], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[164627], 99.90th=[223347], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 6, max= 134, per=25.31%, avg=57.97, stdev=23.55, samples=212 iops : min= 1, max= 33, avg=13.86, stdev= 5.90, samples=212 lat (usec) : 50=0.39%, 100=1.46%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=7.94%, 4=4.52%, 10=7.10%, 20=12.96%, 50=41.89% lat (msec) : 100=20.12%, 250=3.19%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.54%, ctx=6301, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180021: Wed Sep 30 00:34:49 2026 read: IOPS=13, BW=55.2KiB/s (56.5kB/s)(6052KiB/109702msec) clat (usec): min=42, max=288662, avg=40191.65, stdev=27164.93 lat (usec): min=43, max=288664, avg=40194.90, stdev=27164.09 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9765], 10.00th=[ 14877], 20.00th=[ 20055], | 30.00th=[ 24249], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[141558], 99.50th=[156238], 99.90th=[219153], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 120, per=25.24%, avg=55.01, stdev=21.29, samples=216 iops : min= 1, max= 30, avg=13.12, stdev= 5.35, samples=216 write: IOPS=14, BW=56.8KiB/s (58.2kB/s)(6236KiB/109702msec); 0 zone resets clat (usec): min=869, max=497672, avg=31275.82, stdev=34217.05 lat (usec): min=869, max=497675, avg=31277.82, stdev=34216.88 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1598], 20.00th=[ 3654], | 30.00th=[ 6718], 40.00th=[ 14877], 50.00th=[ 22152], 60.00th=[ 30540], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[166724], 99.90th=[225444], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 152, per=24.61%, avg=56.36, stdev=23.72, samples=217 iops : min= 1, max= 38, avg=13.46, stdev= 5.95, samples=217 lat (usec) : 50=0.29%, 100=1.33%, 250=0.16%, 500=0.10%, 1000=0.07% lat (msec) : 2=6.35%, 4=4.52%, 10=7.55%, 20=13.31%, 50=41.89% lat (msec) : 100=20.64%, 250=3.71%, 500=0.07% cpu : usr=0.07%, sys=5.49%, ctx=6482, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=219KiB/s (224kB/s), 54.1KiB/s-56.2KiB/s (55.4kB/s-57.6kB/s), io=23.4MiB (24.6MB), run=107242-109721msec WRITE: bw=229KiB/s (235kB/s), 56.8KiB/s-58.4KiB/s (58.2kB/s-59.8kB/s), io=24.6MiB (25.7MB), run=107242-109721msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180013: Wed Sep 30 00:35:33 2026 read: IOPS=9, BW=38.0KiB/s (39.9kB/s)(5992KiB/153726msec) clat (msec): min=5, max=959, avg=39.83, stdev=42.16 lat (msec): min=5, max=959, avg=39.83, stdev=42.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 86], 95.00th=[ 112], | 99.00th=[ 182], 99.50th=[ 207], 99.90th=[ 305], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 127, per=25.32%, avg=39.24, stdev=23.27, samples=296 iops : min= 1, max= 31, avg= 9.16, stdev= 5.85, samples=296 write: IOPS=10, BW=40.0KiB/s (41.9kB/s)(6296KiB/153726msec); 0 zone resets clat (msec): min=12, max=323, avg=59.53, stdev=38.94 lat (msec): min=12, max=323, avg=59.53, stdev=38.94 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 84], 90.00th=[ 108], 95.00th=[ 129], | 99.00th=[ 203], 99.50th=[ 245], 99.90th=[ 305], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 143, per=25.14%, avg=40.73, stdev=23.29, samples=300 iops : min= 1, max= 35, avg= 9.54, stdev= 5.84, samples=300 lat (msec) : 10=2.21%, 20=15.95%, 50=46.16%, 100=26.14%, 250=9.21% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=1.83%, ctx=4658, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180014: Wed Sep 30 00:35:33 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(5940KiB/153575msec) clat (msec): min=5, max=895, avg=39.26, stdev=40.58 lat (msec): min=5, max=895, avg=39.26, stdev=40.58 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 110], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 279], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 151, per=25.37%, avg=39.33, stdev=24.23, samples=294 iops : min= 1, max= 37, avg= 9.18, stdev= 6.09, samples=294 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6348KiB/153575msec); 0 zone resets clat (msec): min=9, max=322, avg=59.82, stdev=39.22 lat (msec): min=9, max=322, avg=59.82, stdev=39.22 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 70], 80.00th=[ 85], 90.00th=[ 111], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 224], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 135, per=25.19%, avg=40.81, stdev=23.32, samples=302 iops : min= 1, max= 33, avg= 9.55, stdev= 5.85, samples=302 lat (msec) : 10=2.99%, 20=14.32%, 50=46.94%, 100=25.78%, 250=9.73% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=1.80%, ctx=4596, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180015: Wed Sep 30 00:35:33 2026 read: IOPS=9, BW=39.0KiB/s (39.0kB/s)(6028KiB/154395msec) clat (msec): min=4, max=301, avg=40.02, stdev=33.88 lat (msec): min=4, max=301, avg=40.02, stdev=33.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 60], 90.00th=[ 89], 95.00th=[ 112], | 99.00th=[ 163], 99.50th=[ 178], 99.90th=[ 239], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 151, per=25.26%, avg=39.16, stdev=24.54, samples=300 iops : min= 1, max= 37, avg= 9.14, stdev= 6.17, samples=300 write: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6260KiB/154395msec); 0 zone resets clat (msec): min=9, max=951, avg=59.87, stdev=46.46 lat (msec): min=9, max=951, avg=59.88, stdev=46.46 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 111], 95.00th=[ 138], | 99.00th=[ 211], 99.50th=[ 253], 99.90th=[ 372], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 135, per=25.11%, avg=40.68, stdev=24.02, samples=300 iops : min= 1, max= 33, avg= 9.52, stdev= 6.03, samples=300 lat (msec) : 10=3.03%, 20=14.06%, 50=47.43%, 100=25.39%, 250=9.77% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=1.83%, ctx=4657, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180016: Wed Sep 30 00:35:33 2026 read: IOPS=9, BW=39.3KiB/s (40.3kB/s)(6052KiB/153942msec) clat (msec): min=5, max=226, avg=39.88, stdev=35.77 lat (msec): min=5, max=227, avg=39.88, stdev=35.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 88], 95.00th=[ 117], | 99.00th=[ 184], 99.50th=[ 205], 99.90th=[ 222], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 159, per=26.06%, avg=40.39, stdev=25.42, samples=292 iops : min= 1, max= 39, avg= 9.44, stdev= 6.37, samples=292 write: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6236KiB/153942msec); 0 zone resets clat (msec): min=10, max=927, avg=59.82, stdev=45.09 lat (msec): min=10, max=927, avg=59.82, stdev=45.09 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 107], 95.00th=[ 138], | 99.00th=[ 194], 99.50th=[ 266], 99.90th=[ 380], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 119, per=24.90%, avg=40.34, stdev=22.50, samples=301 iops : min= 1, max= 29, avg= 9.44, stdev= 5.66, samples=301 lat (msec) : 10=2.73%, 20=15.85%, 50=45.48%, 100=26.04%, 250=9.54% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.77%, ctx=4578, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (159kB/s), 38.7KiB/s-39.3KiB/s (39.6kB/s-40.3kB/s), io=23.4MiB (24.6MB), run=153575-154395msec WRITE: bw=163KiB/s (167kB/s), 40.5KiB/s-41.3KiB/s (41.5kB/s-42.3kB/s), io=24.6MiB (25.7MB), run=153575-154395msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180063: Wed Sep 30 00:36:11 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5920KiB/27851msec) clat (usec): min=39, max=123757, avg=37571.39, stdev=22297.60 lat (usec): min=39, max=123759, avg=37576.42, stdev=22300.32 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 71], 10.00th=[ 12518], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 65274], 95.00th=[ 80217], | 99.00th=[108528], 99.50th=[117965], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 62, max= 380, per=25.13%, avg=212.31, stdev=73.99, samples=55 iops : min= 3, max= 23, avg=12.51, stdev= 4.70, samples=55 write: IOPS=14, BW=229KiB/s (234kB/s)(6368KiB/27851msec); 0 zone resets clat (usec): min=1746, max=196058, avg=34668.15, stdev=34296.50 lat (usec): min=1748, max=196059, avg=34673.34, stdev=34296.09 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2606], 10.00th=[ 3752], 20.00th=[ 6259], | 30.00th=[ 9241], 40.00th=[ 15664], 50.00th=[ 23987], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 63177], 90.00th=[ 83362], 95.00th=[ 95945], | 99.00th=[168821], 99.50th=[185598], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 63, max= 382, per=25.63%, avg=227.87, stdev=66.25, samples=55 iops : min= 3, max= 23, avg=13.51, stdev= 4.14, samples=55 lat (usec) : 50=0.39%, 100=2.47%, 250=0.65%, 750=0.13% lat (msec) : 2=0.91%, 4=5.47%, 10=10.55%, 20=12.11%, 50=42.84% lat (msec) : 100=21.35%, 250=3.12% cpu : usr=0.07%, sys=6.49%, ctx=1731, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180064: Wed Sep 30 00:36:11 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(5744KiB/27696msec) clat (usec): min=44, max=175290, avg=41269.31, stdev=26443.10 lat (usec): min=44, max=175291, avg=41311.32, stdev=26492.92 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 72], 10.00th=[ 16909], 20.00th=[ 22414], | 30.00th=[ 28443], 40.00th=[ 32113], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 47973], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[149947], 99.50th=[158335], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 63, max= 446, per=24.45%, avg=206.57, stdev=78.85, samples=54 iops : min= 3, max= 27, avg=12.13, stdev= 4.98, samples=54 write: IOPS=14, BW=236KiB/s (242kB/s)(6544KiB/27696msec); 0 zone resets clat (usec): min=1430, max=192010, avg=31041.71, stdev=30530.40 lat (usec): min=1432, max=192013, avg=31043.86, stdev=30530.48 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1975], 10.00th=[ 2966], 20.00th=[ 5538], | 30.00th=[ 8455], 40.00th=[ 15795], 50.00th=[ 23200], 60.00th=[ 30540], | 70.00th=[ 41157], 80.00th=[ 51643], 90.00th=[ 67634], 95.00th=[ 86508], | 99.00th=[145753], 99.50th=[181404], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 446, per=26.47%, avg=235.31, stdev=96.29, samples=54 iops : min= 1, max= 27, avg=13.96, stdev= 6.05, samples=54 lat (usec) : 50=0.26%, 100=2.34%, 250=0.65%, 750=0.13% lat (msec) : 2=2.86%, 4=5.21%, 10=9.24%, 20=9.77%, 50=45.57% lat (msec) : 100=21.09%, 250=2.86% cpu : usr=0.04%, sys=6.82%, ctx=1713, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180065: Wed Sep 30 00:36:11 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(6256KiB/28335msec) clat (usec): min=48, max=196391, avg=42335.56, stdev=27270.37 lat (usec): min=50, max=196392, avg=42354.67, stdev=27270.49 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 114], 10.00th=[ 15401], 20.00th=[ 23462], | 30.00th=[ 28181], 40.00th=[ 32900], 50.00th=[ 38011], 60.00th=[ 43254], | 70.00th=[ 49021], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[173016], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 91, max= 380, per=26.12%, avg=220.71, stdev=69.17, samples=55 iops : min= 5, max= 23, avg=13.04, stdev= 4.34, samples=55 write: IOPS=13, BW=213KiB/s (218kB/s)(6032KiB/28335msec); 0 zone resets clat (usec): min=1352, max=182186, avg=30752.98, stdev=28511.44 lat (usec): min=1354, max=182188, avg=30755.26, stdev=28511.73 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2507], 10.00th=[ 3261], 20.00th=[ 5276], | 30.00th=[ 9241], 40.00th=[ 16909], 50.00th=[ 22676], 60.00th=[ 30540], | 70.00th=[ 39060], 80.00th=[ 52691], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[143655], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 479, per=23.59%, avg=209.69, stdev=97.25, samples=55 iops : min= 3, max= 29, avg=12.35, stdev= 6.14, samples=55 lat (usec) : 50=0.13%, 100=2.34%, 250=0.39%, 1000=0.13% lat (msec) : 2=1.82%, 4=5.21%, 10=8.72%, 20=9.38%, 50=46.74% lat (msec) : 100=21.88%, 250=3.26% cpu : usr=0.06%, sys=6.68%, ctx=1812, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180066: Wed Sep 30 00:36:11 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(6032KiB/27594msec) clat (usec): min=41, max=143238, avg=39273.43, stdev=23740.01 lat (usec): min=41, max=143239, avg=39274.67, stdev=23740.03 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 12780], 20.00th=[ 21627], | 30.00th=[ 26346], 40.00th=[ 31589], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 57934], 90.00th=[ 70779], 95.00th=[ 79168], | 99.00th=[108528], 99.50th=[137364], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 63, max= 348, per=25.65%, avg=216.72, stdev=67.56, samples=54 iops : min= 3, max= 21, avg=12.80, stdev= 4.24, samples=54 write: IOPS=14, BW=227KiB/s (232kB/s)(6256KiB/27594msec); 0 zone resets clat (usec): min=1382, max=227938, avg=32538.52, stdev=33750.92 lat (usec): min=1383, max=227939, avg=32545.41, stdev=33751.50 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1991], 10.00th=[ 3294], 20.00th=[ 5276], | 30.00th=[ 9503], 40.00th=[ 15401], 50.00th=[ 22152], 60.00th=[ 30016], | 70.00th=[ 39060], 80.00th=[ 52691], 90.00th=[ 76022], 95.00th=[104334], | 99.00th=[158335], 99.50th=[177210], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 62, max= 414, per=25.46%, avg=226.30, stdev=87.59, samples=54 iops : min= 3, max= 25, avg=13.37, stdev= 5.51, samples=54 lat (usec) : 50=0.13%, 100=3.52%, 250=0.39%, 500=0.13% lat (msec) : 2=2.86%, 4=4.17%, 10=9.64%, 20=11.46%, 50=42.06% lat (msec) : 100=22.14%, 250=3.52% cpu : usr=0.09%, sys=6.56%, ctx=1741, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=845KiB/s (866kB/s), 207KiB/s-221KiB/s (212kB/s-226kB/s), io=23.4MiB (24.5MB), run=27594-28335msec WRITE: bw=889KiB/s (911kB/s), 213KiB/s-236KiB/s (218kB/s-242kB/s), io=24.6MiB (25.8MB), run=27594-28335msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180068: Wed Sep 30 00:36:21 2026 read: IOPS=9, BW=159KiB/s (162kB/s)(5920KiB/37323msec) clat (msec): min=6, max=292, avg=38.39, stdev=30.88 lat (msec): min=6, max=292, avg=38.39, stdev=30.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 108], | 99.00th=[ 131], 99.50th=[ 171], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 448, per=25.46%, avg=160.37, stdev=95.00, samples=73 iops : min= 1, max= 28, avg= 9.30, stdev= 6.08, samples=73 write: IOPS=10, BW=171KiB/s (175kB/s)(6368KiB/37323msec); 0 zone resets clat (msec): min=12, max=225, avg=57.93, stdev=37.77 lat (msec): min=12, max=225, avg=57.93, stdev=37.77 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 201], 99.50th=[ 220], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 443, per=25.68%, avg=170.24, stdev=88.42, samples=74 iops : min= 1, max= 27, avg= 9.92, stdev= 5.65, samples=74 lat (msec) : 10=1.43%, 20=14.32%, 50=50.26%, 100=23.57%, 250=10.29% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.12%, ctx=1165, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180069: Wed Sep 30 00:36:21 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(5744KiB/37982msec) clat (msec): min=6, max=300, avg=41.32, stdev=38.56 lat (msec): min=6, max=300, avg=41.32, stdev=38.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 222], 99.50th=[ 247], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 411, per=24.34%, avg=153.37, stdev=97.07, samples=73 iops : min= 1, max= 25, avg= 8.86, stdev= 6.18, samples=73 write: IOPS=10, BW=172KiB/s (176kB/s)(6544KiB/37982msec); 0 zone resets clat (msec): min=12, max=218, avg=56.45, stdev=36.77 lat (msec): min=12, max=218, avg=56.46, stdev=36.77 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 68], 80.00th=[ 83], 90.00th=[ 105], 95.00th=[ 136], | 99.00th=[ 184], 99.50th=[ 203], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 448, per=26.08%, avg=172.89, stdev=98.04, samples=74 iops : min= 1, max= 28, avg=10.07, stdev= 6.26, samples=74 lat (msec) : 10=1.95%, 20=13.28%, 50=50.91%, 100=24.35%, 250=9.38% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.07%, ctx=1211, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180070: Wed Sep 30 00:36:21 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37285msec) clat (msec): min=7, max=309, avg=39.47, stdev=35.76 lat (msec): min=7, max=309, avg=39.47, stdev=35.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 59], 90.00th=[ 82], 95.00th=[ 112], | 99.00th=[ 174], 99.50th=[ 241], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 608, per=26.57%, avg=167.37, stdev=113.40, samples=73 iops : min= 1, max= 38, avg= 9.73, stdev= 7.23, samples=73 write: IOPS=10, BW=162KiB/s (166kB/s)(6032KiB/37285msec); 0 zone resets clat (msec): min=13, max=226, avg=57.58, stdev=37.07 lat (msec): min=13, max=226, avg=57.59, stdev=37.07 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 83], 90.00th=[ 107], 95.00th=[ 128], | 99.00th=[ 205], 99.50th=[ 222], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 62, max= 381, per=24.38%, avg=161.65, stdev=80.95, samples=72 iops : min= 3, max= 23, avg= 9.38, stdev= 5.19, samples=72 lat (msec) : 10=1.95%, 20=14.84%, 50=49.61%, 100=23.83%, 250=9.64% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.08%, ctx=1112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180071: Wed Sep 30 00:36:21 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(6032KiB/37702msec) clat (msec): min=6, max=243, avg=40.53, stdev=35.10 lat (msec): min=6, max=243, avg=40.53, stdev=35.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 87], 95.00th=[ 118], | 99.00th=[ 169], 99.50th=[ 226], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 448, per=25.39%, avg=159.97, stdev=98.25, samples=73 iops : min= 1, max= 28, avg= 9.27, stdev= 6.29, samples=73 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37702msec); 0 zone resets clat (msec): min=13, max=222, avg=57.20, stdev=38.07 lat (msec): min=13, max=222, avg=57.21, stdev=38.07 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 75], 90.00th=[ 112], 95.00th=[ 140], | 99.00th=[ 197], 99.50th=[ 215], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 384, per=24.71%, avg=163.84, stdev=86.94, samples=74 iops : min= 1, max= 24, avg= 9.51, stdev= 5.57, samples=74 lat (msec) : 10=1.56%, 20=16.28%, 50=47.92%, 100=23.83%, 250=10.42% cpu : usr=0.06%, sys=2.00%, ctx=1137, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=631KiB/s (646kB/s), 151KiB/s-168KiB/s (155kB/s-172kB/s), io=23.4MiB (24.5MB), run=37285-37982msec WRITE: bw=663KiB/s (679kB/s), 162KiB/s-172KiB/s (166kB/s-176kB/s), io=24.6MiB (25.8MB), run=37285-37982msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180089: Wed Sep 30 00:36:36 2026 read: IOPS=2, BW=2269KiB/s (2324kB/s)(7168KiB/3159msec) clat (usec): min=477, max=298461, avg=207513.60, stdev=99747.35 lat (usec): min=478, max=298463, avg=207515.39, stdev=99747.35 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[168821], | 30.00th=[221250], 40.00th=[221250], 50.00th=[242222], 60.00th=[254804], | 70.00th=[254804], 80.00th=[265290], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 2000, max= 3056, per=58.77%, avg=2281.50, stdev=516.61, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1621KiB/s (1660kB/s)(5120KiB/3159msec); 0 zone resets clat (msec): min=160, max=540, avg=332.40, stdev=150.25 lat (msec): min=160, max=540, avg=333.19, stdev=149.97 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1976, max= 4063, per=49.54%, avg=2692.67, stdev=1187.16, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=17.83%, ctx=240, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180091: Wed Sep 30 00:36:36 2026 read: IOPS=0, BW=425KiB/s (435kB/s)(2048KiB/4823msec) clat (usec): min=1379, max=407042, avg=204210.84, stdev=286846.83 lat (usec): min=1380, max=407044, avg=204212.60, stdev=286847.86 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[408945], | 70.00th=[408945], 80.00th=[408945], 90.00th=[408945], 95.00th=[408945], | 99.00th=[408945], 99.50th=[408945], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 2000, max= 2048, per=52.14%, avg=2024.00, stdev=33.94, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2123KiB/s (2174kB/s)(10.0MiB/4823msec); 0 zone resets clat (msec): min=147, max=803, avg=407.13, stdev=202.08 lat (msec): min=147, max=803, avg=407.21, stdev=202.09 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 178], | 30.00th=[ 226], 40.00th=[ 351], 50.00th=[ 363], 60.00th=[ 456], | 70.00th=[ 460], 80.00th=[ 485], 90.00th=[ 609], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1976, max= 5807, per=55.04%, avg=2991.50, stdev=1611.90, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.83, samples=6 lat (msec) : 2=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=15.08%, ctx=144, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180092: Wed Sep 30 00:36:36 2026 read: IOPS=1, BW=1379KiB/s (1412kB/s)(6144KiB/4456msec) clat (usec): min=450, max=274059, avg=158745.40, stdev=124726.87 lat (usec): min=452, max=274060, avg=158746.51, stdev=124726.81 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[200279], 50.00th=[200279], 60.00th=[238027], | 70.00th=[240124], 80.00th=[240124], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 1935, max= 4063, per=86.18%, avg=3345.67, stdev=1221.73, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1379KiB/s (1412kB/s)(6144KiB/4456msec); 0 zone resets clat (msec): min=201, max=1163, avg=548.50, stdev=399.93 lat (msec): min=202, max=1163, avg=548.59, stdev=399.93 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 468], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1610, max= 2048, per=35.72%, avg=1941.60, stdev=186.19, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.83%, ctx=214, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180093: Wed Sep 30 00:36:36 2026 read: IOPS=0, BW=971KiB/s (994kB/s)(5120KiB/5275msec) clat (usec): min=1122, max=247597, avg=155006.46, stdev=98462.13 lat (usec): min=1123, max=247598, avg=155007.47, stdev=98462.24 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1123], 10.00th=[ 1123], 20.00th=[ 1123], | 30.00th=[115868], 40.00th=[115868], 50.00th=[202376], 60.00th=[202376], | 70.00th=[206570], 80.00th=[206570], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 1946, max= 6131, per=100.00%, avg=4038.50, stdev=2959.24, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1359KiB/s (1391kB/s)(7168KiB/5275msec); 0 zone resets clat (msec): min=106, max=1818, avg=601.25, stdev=611.94 lat (msec): min=106, max=1818, avg=601.44, stdev=612.16 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 167], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 363], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 902], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 1935, max= 3893, per=43.77%, avg=2379.00, stdev=847.37, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=9.97%, ctx=211, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3882KiB/s (3976kB/s), 425KiB/s-2269KiB/s (435kB/s-2324kB/s), io=20.0MiB (20.0MB), run=3159-5275msec WRITE: bw=5435KiB/s (5566kB/s), 1359KiB/s-2123KiB/s (1391kB/s-2174kB/s), io=28.0MiB (29.4MB), run=3159-5275msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180086: Wed Sep 30 00:36:37 2026 read: IOPS=1, BW=1612KiB/s (1651kB/s)(7168KiB/4446msec) clat (msec): min=91, max=1087, avg=367.14, stdev=344.48 lat (msec): min=91, max=1087, avg=367.14, stdev=344.48 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 165], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 241], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 518], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1526, max= 4071, per=81.29%, avg=2884.00, stdev=1344.19, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1152KiB/s (1179kB/s)(5120KiB/4446msec); 0 zone resets clat (msec): min=219, max=599, avg=340.90, stdev=153.33 lat (msec): min=219, max=599, avg=341.85, stdev=153.04 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2039, max= 4096, per=67.10%, avg=3333.00, stdev=1126.62, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.94%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180087: Wed Sep 30 00:36:37 2026 read: IOPS=0, BW=385KiB/s (394kB/s)(2048KiB/5326msec) clat (msec): min=104, max=476, avg=290.79, stdev=263.26 lat (msec): min=104, max=476, avg=290.80, stdev=263.26 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1932, max= 2031, per=55.85%, avg=1981.50, stdev=70.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1923KiB/s (1969kB/s)(10.0MiB/5326msec); 0 zone resets clat (msec): min=98, max=1601, avg=445.56, stdev=424.07 lat (msec): min=98, max=1601, avg=445.86, stdev=424.01 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 157], | 30.00th=[ 249], 40.00th=[ 330], 50.00th=[ 342], 60.00th=[ 363], | 70.00th=[ 384], 80.00th=[ 422], 90.00th=[ 506], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 2019, max= 4079, per=60.44%, avg=3002.00, stdev=1068.79, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.06%, sys=7.06%, ctx=125, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180088: Wed Sep 30 00:36:37 2026 read: IOPS=1, BW=1654KiB/s (1694kB/s)(6144KiB/3714msec) clat (msec): min=107, max=738, avg=352.07, stdev=247.23 lat (msec): min=107, max=738, avg=352.07, stdev=247.23 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 426], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1976, max= 2035, per=56.69%, avg=2011.25, stdev=27.48, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1654KiB/s (1694kB/s)(6144KiB/3714msec); 0 zone resets clat (msec): min=146, max=552, avg=263.42, stdev=150.07 lat (msec): min=146, max=552, avg=263.75, stdev=150.03 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 245], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2031, max= 3016, per=47.55%, avg=2362.00, stdev=566.39, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 250=58.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=4.34%, ctx=58, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180090: Wed Sep 30 00:36:37 2026 read: IOPS=0, BW=887KiB/s (908kB/s)(5120KiB/5772msec) clat (msec): min=72, max=790, avg=349.94, stdev=283.62 lat (msec): min=72, max=790, avg=349.94, stdev=283.62 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1992, max= 3864, per=73.99%, avg=2625.00, stdev=1073.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1242KiB/s (1272kB/s)(7168KiB/5772msec); 0 zone resets clat (msec): min=131, max=1845, avg=532.81, stdev=595.41 lat (msec): min=131, max=1845, avg=532.91, stdev=595.41 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 205], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 326], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 506], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1976, max= 2048, per=40.56%, avg=2014.50, stdev=31.67, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=4.87%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3548KiB/s (3633kB/s), 385KiB/s-1654KiB/s (394kB/s-1694kB/s), io=20.0MiB (20.0MB), run=3714-5772msec WRITE: bw=4967KiB/s (5087kB/s), 1152KiB/s-1923KiB/s (1179kB/s-1969kB/s), io=28.0MiB (29.4MB), run=3714-5772msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180101: Wed Sep 30 00:36:52 2026 read: IOPS=0, BW=2639KiB/s (2703kB/s)(12.0MiB/4656msec) clat (msec): min=334, max=3785, avg=1527.97, stdev=1956.41 lat (msec): min=334, max=3785, avg=1527.97, stdev=1956.41 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.92%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180103: Wed Sep 30 00:36:52 2026 read: IOPS=0, BW=869KiB/s (890kB/s)(4096KiB/4713msec) clat (nsec): min=3566.9M, max=3566.9M, avg=3566920534.00, stdev= 0.00 lat (nsec): min=3566.9M, max=3566.9M, avg=3566923252.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3574], 5.00th=[ 3574], 10.00th=[ 3574], 20.00th=[ 3574], | 30.00th=[ 3574], 40.00th=[ 3574], 50.00th=[ 3574], 60.00th=[ 3574], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1738KiB/s (1780kB/s)(8192KiB/4713msec); 0 zone resets clat (msec): min=296, max=690, avg=493.37, stdev=278.12 lat (msec): min=297, max=690, avg=493.74, stdev=278.16 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.14%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180105: Wed Sep 30 00:36:52 2026 write: IOPS=0, BW=2705KiB/s (2770kB/s)(12.0MiB/4542msec); 0 zone resets clat (msec): min=350, max=3322, avg=1463.57, stdev=1620.28 lat (msec): min=351, max=3322, avg=1464.24, stdev=1620.10 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 8062, max= 8126, per=100.00%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.40%, ctx=122, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180107: Wed Sep 30 00:36:52 2026 write: IOPS=0, BW=2666KiB/s (2730kB/s)(12.0MiB/4609msec); 0 zone resets clat (msec): min=432, max=3467, avg=1480.82, stdev=1721.61 lat (msec): min=432, max=3468, avg=1481.31, stdev=1721.51 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.80%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3476KiB/s (3560kB/s), 869KiB/s-2639KiB/s (890kB/s-2703kB/s), io=16.0MiB (16.8MB), run=4656-4713msec WRITE: bw=6953KiB/s (7120kB/s), 1738KiB/s-2705KiB/s (1780kB/s-2770kB/s), io=32.0MiB (33.6MB), run=4542-4713msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180102: Wed Sep 30 00:36:52 2026 read: IOPS=1, BW=6012KiB/s (6156kB/s)(12.0MiB/2044msec) clat (msec): min=423, max=882, avg=639.37, stdev=230.90 lat (msec): min=423, max=882, avg=639.37, stdev=230.90 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=20.46%, ctx=244, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180104: Wed Sep 30 00:36:52 2026 read: IOPS=0, BW=808KiB/s (827kB/s)(4096KiB/5071msec) clat (nsec): min=3107.3M, max=3107.3M, avg=3107273259.00, stdev= 0.00 lat (nsec): min=3107.3M, max=3107.3M, avg=3107276739.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3104], 5.00th=[ 3104], 10.00th=[ 3104], 20.00th=[ 3104], | 30.00th=[ 3104], 40.00th=[ 3104], 50.00th=[ 3104], 60.00th=[ 3104], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1615KiB/s (1654kB/s)(8192KiB/5071msec); 0 zone resets clat (msec): min=898, max=917, avg=907.81, stdev=13.40 lat (msec): min=898, max=919, avg=908.92, stdev=14.66 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.12%, sys=7.12%, ctx=790, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180106: Wed Sep 30 00:36:52 2026 write: IOPS=0, BW=2426KiB/s (2484kB/s)(12.0MiB/5065msec); 0 zone resets clat (msec): min=233, max=3960, avg=1632.84, stdev=2029.60 lat (msec): min=233, max=3960, avg=1634.08, stdev=2028.89 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.33%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180108: Wed Sep 30 00:36:52 2026 write: IOPS=0, BW=2775KiB/s (2842kB/s)(12.0MiB/4428msec); 0 zone resets clat (msec): min=304, max=3625, avg=1414.75, stdev=1914.57 lat (msec): min=304, max=3625, avg=1415.12, stdev=1914.62 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 3641], 80.00th=[ 3641], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 6005, max= 8159, per=100.00%, avg=7082.00, stdev=1523.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.05%, sys=3.48%, ctx=235, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3231KiB/s (3308kB/s), 808KiB/s-6012KiB/s (827kB/s-6156kB/s), io=16.0MiB (16.8MB), run=2044-5071msec WRITE: bw=6462KiB/s (6617kB/s), 1615KiB/s-2775KiB/s (1654kB/s-2842kB/s), io=32.0MiB (33.6MB), run=4428-5071msec