== sanity test 398b: DIO and buffer IO race ============== 13:24:11 (1788801851) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.07156 s, 7.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143818: Mon Sep 7 13:26:50 2026 read: IOPS=10, BW=43.7KiB/s (44.8kB/s)(5992KiB/136971msec) clat (usec): min=37, max=470888, avg=44658.52, stdev=35250.15 lat (usec): min=37, max=470890, avg=44665.43, stdev=35251.19 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 2868], 20.00th=[ 19792], | 30.00th=[ 26608], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[164627], 99.50th=[185598], 99.90th=[346031], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 126, per=24.78%, avg=43.36, stdev=19.94, samples=268 iops : min= 1, max= 31, avg=10.16, stdev= 5.03, samples=268 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6296KiB/136971msec); 0 zone resets clat (usec): min=905, max=860372, avg=44087.33, stdev=48064.46 lat (usec): min=907, max=860375, avg=44094.73, stdev=48062.37 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 1631], 20.00th=[ 4752], | 30.00th=[ 10552], 40.00th=[ 22152], 50.00th=[ 32900], 60.00th=[ 44827], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[100140], 95.00th=[129500], | 99.00th=[187696], 99.50th=[212861], 99.90th=[346031], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 159, per=25.04%, avg=45.82, stdev=21.18, samples=267 iops : min= 1, max= 39, avg=10.78, stdev= 5.32, samples=267 lat (usec) : 50=0.26%, 100=3.87%, 250=0.49%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.89%, 4=3.19%, 10=5.99%, 20=9.64%, 50=35.32% lat (msec) : 100=27.41%, 250=7.42%, 500=0.26%, 1000=0.03% cpu : usr=0.11%, sys=5.19%, ctx=6543, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143819: Mon Sep 7 13:26:50 2026 read: IOPS=10, BW=43.9KiB/s (44.0kB/s)(5940KiB/135312msec) clat (usec): min=32, max=249248, avg=42428.19, stdev=30423.03 lat (usec): min=32, max=249251, avg=42430.23, stdev=30423.04 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 69], 10.00th=[ 98], 20.00th=[ 19530], | 30.00th=[ 25822], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[135267], 99.50th=[152044], 99.90th=[183501], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 102, per=25.03%, avg=43.81, stdev=18.65, samples=264 iops : min= 1, max= 25, avg=10.27, stdev= 4.68, samples=264 write: IOPS=11, BW=46.9KiB/s (48.0kB/s)(6348KiB/135312msec); 0 zone resets clat (usec): min=834, max=868731, avg=45160.99, stdev=50648.52 lat (usec): min=835, max=868733, avg=45171.05, stdev=50651.54 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1565], 20.00th=[ 4817], | 30.00th=[ 8848], 40.00th=[ 19792], 50.00th=[ 32637], 60.00th=[ 44827], | 70.00th=[ 61604], 80.00th=[ 77071], 90.00th=[105382], 95.00th=[131597], | 99.00th=[189793], 99.50th=[235930], 99.90th=[497026], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 125, per=25.49%, avg=46.65, stdev=20.87, samples=265 iops : min= 1, max= 31, avg=10.99, stdev= 5.26, samples=265 lat (usec) : 50=0.52%, 100=4.33%, 250=0.49%, 500=0.07%, 1000=0.16% lat (msec) : 2=6.05%, 4=3.06%, 10=7.45%, 20=8.53%, 50=34.60% lat (msec) : 100=26.66%, 250=7.94%, 500=0.10%, 1000=0.03% cpu : usr=0.11%, sys=5.29%, ctx=6471, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143820: Mon Sep 7 13:26:50 2026 read: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6028KiB/133732msec) clat (usec): min=34, max=727149, avg=42321.86, stdev=37831.23 lat (usec): min=34, max=727151, avg=42324.01, stdev=37831.29 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 66], 10.00th=[ 80], 20.00th=[ 18744], | 30.00th=[ 24773], 40.00th=[ 30016], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 63177], 90.00th=[ 84411], 95.00th=[100140], | 99.00th=[152044], 99.50th=[166724], 99.90th=[442500], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 101, per=25.63%, avg=44.86, stdev=20.61, samples=262 iops : min= 1, max= 25, avg=10.54, stdev= 5.19, samples=262 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6260KiB/133732msec); 0 zone resets clat (usec): min=899, max=867396, avg=44311.10, stdev=46721.53 lat (usec): min=902, max=867399, avg=44316.91, stdev=46720.41 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1352], 10.00th=[ 2040], 20.00th=[ 5604], | 30.00th=[ 11469], 40.00th=[ 21890], 50.00th=[ 34866], 60.00th=[ 46400], | 70.00th=[ 59507], 80.00th=[ 76022], 90.00th=[100140], 95.00th=[123208], | 99.00th=[183501], 99.50th=[212861], 99.90th=[308282], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 103, per=25.46%, avg=46.58, stdev=19.90, samples=262 iops : min= 1, max= 25, avg=10.98, stdev= 5.02, samples=262 lat (usec) : 50=0.68%, 100=4.82%, 250=0.52%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.11%, 4=3.26%, 10=6.41%, 20=8.82%, 50=36.10% lat (msec) : 100=26.46%, 250=7.16%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.13%, ctx=6286, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143821: Mon Sep 7 13:26:50 2026 read: IOPS=11, BW=44.7KiB/s (45.7kB/s)(6052KiB/135516msec) clat (usec): min=34, max=887187, avg=43696.00, stdev=43306.73 lat (usec): min=34, max=887188, avg=43700.75, stdev=43308.37 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 108], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[160433], 99.50th=[196084], 99.90th=[742392], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 103, per=25.40%, avg=44.45, stdev=18.81, samples=264 iops : min= 1, max= 25, avg=10.44, stdev= 4.73, samples=264 write: IOPS=11, BW=46.0KiB/s (47.1kB/s)(6236KiB/135516msec); 0 zone resets clat (usec): min=809, max=348980, avg=44101.96, stdev=43247.71 lat (usec): min=810, max=348982, avg=44110.09, stdev=43254.23 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1909], 20.00th=[ 5342], | 30.00th=[ 10945], 40.00th=[ 22414], 50.00th=[ 34341], 60.00th=[ 45351], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[104334], 95.00th=[125305], | 99.00th=[185598], 99.50th=[212861], 99.90th=[287310], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 143, per=25.03%, avg=45.80, stdev=20.29, samples=264 iops : min= 1, max= 35, avg=10.78, stdev= 5.12, samples=264 lat (usec) : 50=0.33%, 100=4.56%, 250=0.36%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.24%, 4=3.32%, 10=6.05%, 20=9.41%, 50=36.72% lat (msec) : 100=25.78%, 250=7.85%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.11%, sys=5.29%, ctx=6526, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=175KiB/s (180kB/s), 43.7KiB/s-45.1KiB/s (44.8kB/s-46.2kB/s), io=23.4MiB (24.6MB), run=133732-136971msec WRITE: bw=184KiB/s (188kB/s), 45.0KiB/s-46.9KiB/s (47.1kB/s-48.0kB/s), io=24.6MiB (25.7MB), run=133732-136971msec fio: pid=143825, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=143823: Mon Sep 7 13:29:11 2026 read: IOPS=5, BW=21.8KiB/s (22.4kB/s)(5992KiB/274330msec) clat (msec): min=5, max=877, avg=41.11, stdev=43.41 lat (msec): min=5, max=877, avg=41.11, stdev=43.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 81], 95.00th=[ 114], | 99.00th=[ 199], 99.50th=[ 247], 99.90th=[ 338], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 88, per=30.24%, avg=24.49, stdev=16.14, samples=471 iops : min= 1, max= 22, avg= 5.48, stdev= 4.08, samples=471 write: IOPS=5, BW=22.0KiB/s (23.5kB/s)(6296KiB/274330msec); 0 zone resets clat (msec): min=29, max=575, avg=134.82, stdev=70.94 lat (msec): min=29, max=575, avg=134.83, stdev=70.94 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 131], | 70.00th=[ 150], 80.00th=[ 182], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 376], 99.50th=[ 409], 99.90th=[ 535], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 71, per=26.61%, avg=22.62, stdev=11.25, samples=534 iops : min= 1, max= 17, avg= 5.00, stdev= 2.86, samples=534 lat (msec) : 10=2.25%, 20=13.02%, 50=23.34%, 100=26.30%, 250=30.86% lat (msec) : 500=4.13%, 750=0.07%, 1000=0.03% cpu : usr=0.07%, sys=1.25%, ctx=5524, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143824: Mon Sep 7 13:29:11 2026 read: IOPS=5, BW=21.3KiB/s (21.8kB/s)(5940KiB/278560msec) clat (msec): min=5, max=865, avg=39.53, stdev=41.41 lat (msec): min=5, max=865, avg=39.53, stdev=41.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 109], | 99.00th=[ 180], 99.50th=[ 220], 99.90th=[ 397], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 95, per=30.45%, avg=24.67, stdev=16.34, samples=464 iops : min= 1, max= 23, avg= 5.53, stdev= 4.12, samples=464 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6348KiB/278560msec); 0 zone resets clat (msec): min=33, max=911, avg=138.20, stdev=73.82 lat (msec): min=33, max=911, avg=138.21, stdev=73.84 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 234], 95.00th=[ 288], | 99.00th=[ 388], 99.50th=[ 422], 99.90th=[ 634], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 55, per=26.32%, avg=22.37, stdev=10.93, samples=545 iops : min= 1, max= 13, avg= 4.94, stdev= 2.78, samples=545 lat (msec) : 10=2.02%, 20=13.22%, 50=22.98%, 100=26.11%, 250=31.32% lat (msec) : 500=4.26%, 750=0.03%, 1000=0.07% cpu : usr=0.06%, sys=1.25%, ctx=5669, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=143825: Mon Sep 7 13:29:11 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(4672KiB/229649msec) clat (msec): min=5, max=467, avg=45.09, stdev=45.44 lat (msec): min=5, max=467, avg=45.09, stdev=45.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 97], 95.00th=[ 125], | 99.00th=[ 218], 99.50th=[ 279], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 111, per=27.44%, avg=22.22, stdev=15.99, samples=404 iops : min= 1, max= 27, avg= 4.90, stdev= 4.04, samples=404 write: IOPS=5, BW=21.2KiB/s (21.7kB/s)(4872KiB/229649msec); 0 zone resets clat (msec): min=34, max=1065, avg=144.93, stdev=81.49 lat (msec): min=34, max=1065, avg=144.93, stdev=81.49 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 197], 90.00th=[ 241], 95.00th=[ 288], | 99.00th=[ 414], 99.50th=[ 447], 99.90th=[ 911], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 64, per=24.79%, avg=21.07, stdev=11.08, samples=443 iops : min= 1, max= 16, avg= 4.60, stdev= 2.83, samples=443 lat (msec) : 10=2.18%, 20=11.81%, 50=22.62%, 100=24.01%, 250=34.48% lat (msec) : 500=4.69%, 750=0.08%, 1000=0.04%, 2000=0.04% cpu : usr=0.05%, sys=1.16%, ctx=3990, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1169,1218,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143826: Mon Sep 7 13:29:11 2026 read: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6052KiB/276875msec) clat (msec): min=5, max=646, avg=40.51, stdev=41.47 lat (msec): min=5, max=646, avg=40.52, stdev=41.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 116], | 99.00th=[ 176], 99.50th=[ 236], 99.90th=[ 477], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 93, per=30.94%, avg=25.06, stdev=16.55, samples=466 iops : min= 1, max= 23, avg= 5.62, stdev= 4.18, samples=466 write: IOPS=5, BW=22.5KiB/s (23.1kB/s)(6236KiB/276875msec); 0 zone resets clat (msec): min=33, max=1057, avg=138.00, stdev=74.44 lat (msec): min=33, max=1057, avg=138.00, stdev=74.43 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 155], 80.00th=[ 186], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 388], 99.50th=[ 414], 99.90th=[ 542], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 56, per=26.21%, avg=22.28, stdev=10.82, samples=538 iops : min= 1, max= 14, avg= 4.91, stdev= 2.76, samples=538 lat (msec) : 10=2.57%, 20=13.15%, 50=22.85%, 100=25.16%, 250=31.97% lat (msec) : 500=4.20%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=1.25%, ctx=5540, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=81.3KiB/s (83.3kB/s), 20.3KiB/s-21.9KiB/s (20.8kB/s-22.4kB/s), io=22.1MiB (23.2MB), run=229649-278560msec WRITE: bw=85.3KiB/s (87.3kB/s), 21.2KiB/s-22.0KiB/s (21.7kB/s-23.5kB/s), io=23.2MiB (24.3MB), run=229649-278560msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143882: Mon Sep 7 13:29:50 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5920KiB/27969msec) clat (usec): min=39, max=141121, avg=37712.42, stdev=27605.77 lat (usec): min=39, max=141123, avg=37718.88, stdev=27605.72 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 72], 20.00th=[ 12780], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[116917], 99.50th=[131597], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 31, max= 476, per=25.53%, avg=211.87, stdev=92.27, samples=54 iops : min= 1, max= 29, avg=12.44, stdev= 5.80, samples=54 write: IOPS=14, BW=228KiB/s (233kB/s)(6368KiB/27969msec); 0 zone resets clat (usec): min=1087, max=216176, avg=34635.39, stdev=37860.16 lat (usec): min=1089, max=216180, avg=34638.19, stdev=37860.04 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1926], 10.00th=[ 2671], 20.00th=[ 5014], | 30.00th=[ 9241], 40.00th=[ 12911], 50.00th=[ 22152], 60.00th=[ 32113], | 70.00th=[ 40109], 80.00th=[ 57934], 90.00th=[ 86508], 95.00th=[113771], | 99.00th=[183501], 99.50th=[212861], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 63, max= 472, per=26.31%, avg=229.69, stdev=98.81, samples=54 iops : min= 3, max= 29, avg=13.57, stdev= 6.17, samples=54 lat (usec) : 50=1.30%, 100=6.38%, 250=0.91%, 750=0.13% lat (msec) : 2=3.12%, 4=5.86%, 10=8.20%, 20=9.90%, 50=37.50% lat (msec) : 100=21.88%, 250=4.82% cpu : usr=0.10%, sys=6.58%, ctx=1479, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143883: Mon Sep 7 13:29:50 2026 read: IOPS=12, BW=204KiB/s (208kB/s)(5744KiB/28218msec) clat (usec): min=43, max=217533, avg=40651.31, stdev=27499.69 lat (usec): min=43, max=217535, avg=40658.13, stdev=27497.59 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 71], 10.00th=[ 89], 20.00th=[ 21627], | 30.00th=[ 29230], 40.00th=[ 33162], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[113771], 99.50th=[143655], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 415, per=24.85%, avg=206.26, stdev=75.39, samples=54 iops : min= 1, max= 25, avg=12.11, stdev= 4.75, samples=54 write: IOPS=14, BW=232KiB/s (237kB/s)(6544KiB/28218msec); 0 zone resets clat (usec): min=1224, max=364113, avg=32246.05, stdev=39689.53 lat (usec): min=1228, max=364117, avg=32277.69, stdev=39689.41 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1893], 10.00th=[ 2442], 20.00th=[ 4424], | 30.00th=[ 7439], 40.00th=[ 11600], 50.00th=[ 19530], 60.00th=[ 27657], | 70.00th=[ 37487], 80.00th=[ 53216], 90.00th=[ 76022], 95.00th=[103285], | 99.00th=[166724], 99.50th=[193987], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 31, max= 541, per=26.72%, avg=233.22, stdev=99.73, samples=54 iops : min= 1, max= 33, avg=13.81, stdev= 6.25, samples=54 lat (usec) : 50=0.65%, 100=4.82%, 250=0.78%, 500=0.26% lat (msec) : 2=3.52%, 4=6.12%, 10=10.16%, 20=9.64%, 50=37.24% lat (msec) : 100=22.40%, 250=4.17%, 500=0.26% cpu : usr=0.11%, sys=6.02%, ctx=1508, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143884: Mon Sep 7 13:29:50 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28854msec) clat (usec): min=31, max=194907, avg=38381.26, stdev=28623.07 lat (usec): min=31, max=194909, avg=38382.99, stdev=28623.01 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 69], 10.00th=[ 83], 20.00th=[ 17695], | 30.00th=[ 24773], 40.00th=[ 30802], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[120062], 99.50th=[185598], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 479, per=26.60%, avg=220.82, stdev=97.20, samples=56 iops : min= 1, max= 29, avg=13.04, stdev= 6.14, samples=56 write: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28854msec); 0 zone resets clat (usec): min=1169, max=375882, avg=35709.19, stdev=39272.42 lat (usec): min=1173, max=375884, avg=35720.85, stdev=39273.01 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1909], 10.00th=[ 2474], 20.00th=[ 5866], | 30.00th=[ 9110], 40.00th=[ 14484], 50.00th=[ 22676], 60.00th=[ 34341], | 70.00th=[ 43779], 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[164627], 99.50th=[181404], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 31, max= 446, per=23.89%, avg=208.58, stdev=95.00, samples=57 iops : min= 1, max= 27, avg=12.26, stdev= 6.00, samples=57 lat (usec) : 50=0.91%, 100=6.51%, 250=0.78%, 500=0.13%, 750=0.13% lat (msec) : 2=3.26%, 4=3.91%, 10=9.11%, 20=9.51%, 50=38.15% lat (msec) : 100=23.83%, 250=3.65%, 500=0.13% cpu : usr=0.12%, sys=5.93%, ctx=1520, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143885: Mon Sep 7 13:29:50 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(6032KiB/27061msec) clat (usec): min=31, max=254778, avg=39754.20, stdev=29563.30 lat (usec): min=31, max=254780, avg=39755.82, stdev=29563.10 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 18482], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[158335], 99.50th=[166724], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 63, max= 445, per=26.54%, avg=220.32, stdev=73.40, samples=53 iops : min= 3, max= 27, avg=13.00, stdev= 4.67, samples=53 write: IOPS=14, BW=231KiB/s (237kB/s)(6256KiB/27061msec); 0 zone resets clat (usec): min=1476, max=194725, avg=30666.73, stdev=31227.57 lat (usec): min=1478, max=194729, avg=30669.43, stdev=31227.69 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1926], 10.00th=[ 2573], 20.00th=[ 4686], | 30.00th=[ 7570], 40.00th=[ 13304], 50.00th=[ 21103], 60.00th=[ 30016], | 70.00th=[ 38536], 80.00th=[ 52691], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[189793], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 479, per=26.20%, avg=228.75, stdev=92.07, samples=53 iops : min= 3, max= 29, avg=13.53, stdev= 5.81, samples=53 lat (usec) : 50=0.52%, 100=6.12%, 250=0.65%, 500=0.13% lat (msec) : 2=3.12%, 4=5.21%, 10=9.64%, 20=9.38%, 50=39.45% lat (msec) : 100=23.18%, 250=2.47%, 500=0.13% cpu : usr=0.13%, sys=6.85%, ctx=1544, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=830KiB/s (850kB/s), 204KiB/s-223KiB/s (208kB/s-228kB/s), io=23.4MiB (24.5MB), run=27061-28854msec WRITE: bw=873KiB/s (894kB/s), 209KiB/s-232KiB/s (214kB/s-237kB/s), io=24.6MiB (25.8MB), run=27061-28854msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143886: Mon Sep 7 13:30:28 2026 read: IOPS=5, BW=89.6KiB/s (91.7kB/s)(5920KiB/66077msec) clat (msec): min=8, max=297, avg=38.28, stdev=39.47 lat (msec): min=8, max=297, avg=38.28, stdev=39.47 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 77], 95.00th=[ 115], | 99.00th=[ 211], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 29, max= 350, per=26.48%, avg=95.84, stdev=56.45, samples=120 iops : min= 1, max= 21, avg= 5.14, stdev= 3.58, samples=120 write: IOPS=6, BW=96.4KiB/s (98.7kB/s)(6368KiB/66077msec); 0 zone resets clat (msec): min=36, max=368, avg=129.63, stdev=58.44 lat (msec): min=36, max=368, avg=129.64, stdev=58.44 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 134], | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 209], 95.00th=[ 245], | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 27, max= 191, per=25.56%, avg=97.38, stdev=42.44, samples=128 iops : min= 1, max= 11, avg= 5.23, stdev= 2.69, samples=128 lat (msec) : 10=0.91%, 20=15.23%, 50=23.18%, 100=25.13%, 250=32.94% lat (msec) : 500=2.60% cpu : usr=0.06%, sys=1.30%, ctx=1281, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143887: Mon Sep 7 13:30:28 2026 read: IOPS=5, BW=87.0KiB/s (89.1kB/s)(5744KiB/65989msec) clat (msec): min=7, max=275, avg=34.23, stdev=33.03 lat (msec): min=7, max=275, avg=34.24, stdev=33.03 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 71], 95.00th=[ 108], | 99.00th=[ 169], 99.50th=[ 203], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 27, max= 345, per=27.15%, avg=98.28, stdev=69.87, samples=114 iops : min= 1, max= 21, avg= 5.28, stdev= 4.43, samples=114 write: IOPS=6, BW=99.2KiB/s (102kB/s)(6544KiB/65989msec); 0 zone resets clat (msec): min=44, max=447, avg=130.59, stdev=60.74 lat (msec): min=44, max=447, avg=130.60, stdev=60.74 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 163], 90.00th=[ 213], 95.00th=[ 262], | 99.00th=[ 321], 99.50th=[ 376], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 27, max= 191, per=26.49%, avg=100.91, stdev=39.61, samples=127 iops : min= 1, max= 11, avg= 5.45, stdev= 2.52, samples=127 lat (msec) : 10=1.82%, 20=16.67%, 50=21.35%, 100=23.31%, 250=33.59% lat (msec) : 500=3.26% cpu : usr=0.04%, sys=1.34%, ctx=1331, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143888: Mon Sep 7 13:30:28 2026 read: IOPS=6, BW=97.7KiB/s (100kB/s)(6256KiB/64013msec) clat (msec): min=5, max=324, avg=35.45, stdev=38.62 lat (msec): min=5, max=324, avg=35.45, stdev=38.62 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 71], 95.00th=[ 111], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 350, per=30.45%, avg=110.23, stdev=75.23, samples=112 iops : min= 1, max= 21, avg= 6.04, stdev= 4.75, samples=112 write: IOPS=5, BW=94.2KiB/s (96.5kB/s)(6032KiB/64013msec); 0 zone resets clat (msec): min=37, max=415, avg=132.68, stdev=65.06 lat (msec): min=37, max=415, avg=132.68, stdev=65.06 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 117], 60.00th=[ 132], | 70.00th=[ 144], 80.00th=[ 176], 90.00th=[ 213], 95.00th=[ 264], | 99.00th=[ 363], 99.50th=[ 388], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 31, max= 192, per=24.90%, avg=94.87, stdev=39.90, samples=124 iops : min= 1, max= 12, avg= 5.06, stdev= 2.55, samples=124 lat (msec) : 10=1.82%, 20=18.49%, 50=22.92%, 100=21.61%, 250=32.16% lat (msec) : 500=2.99% cpu : usr=0.07%, sys=1.40%, ctx=1412, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143889: Mon Sep 7 13:30:28 2026 read: IOPS=5, BW=94.3KiB/s (96.6kB/s)(6032KiB/63968msec) clat (msec): min=5, max=310, avg=35.37, stdev=38.45 lat (msec): min=5, max=310, avg=35.37, stdev=38.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 77], 95.00th=[ 114], | 99.00th=[ 207], 99.50th=[ 292], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 287, per=29.30%, avg=106.08, stdev=62.38, samples=111 iops : min= 1, max= 17, avg= 5.77, stdev= 3.94, samples=111 write: IOPS=6, BW=97.8KiB/s (100kB/s)(6256KiB/63968msec); 0 zone resets clat (msec): min=39, max=389, avg=128.51, stdev=58.63 lat (msec): min=39, max=389, avg=128.51, stdev=58.64 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 106], 50.00th=[ 116], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 207], 95.00th=[ 251], | 99.00th=[ 321], 99.50th=[ 368], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 27, max= 255, per=25.77%, avg=98.18, stdev=44.67, samples=125 iops : min= 1, max= 15, avg= 5.27, stdev= 2.82, samples=125 lat (msec) : 10=2.86%, 20=17.45%, 50=20.44%, 100=23.70%, 250=32.81% lat (msec) : 500=2.73% cpu : usr=0.06%, sys=1.38%, ctx=1325, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=362KiB/s (371kB/s), 87.0KiB/s-97.7KiB/s (89.1kB/s-100kB/s), io=23.4MiB (24.5MB), run=63968-66077msec WRITE: bw=381KiB/s (391kB/s), 94.2KiB/s-99.2KiB/s (96.5kB/s-102kB/s), io=24.6MiB (25.8MB), run=63968-66077msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143906: Mon Sep 7 13:30:42 2026 read: IOPS=1, BW=1675KiB/s (1715kB/s)(7168KiB/4279msec) clat (usec): min=1215, max=728682, avg=268068.12, stdev=269829.11 lat (usec): min=1217, max=728684, avg=268070.33, stdev=269828.86 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1221], 10.00th=[ 1221], 20.00th=[ 3785], | 30.00th=[125305], 40.00th=[125305], 50.00th=[223347], 60.00th=[278922], | 70.00th=[278922], 80.00th=[513803], 90.00th=[725615], 95.00th=[725615], | 99.00th=[725615], 99.50th=[725615], 99.90th=[725615], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 1530, max= 4047, per=63.75%, avg=2320.00, stdev=987.40, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1197KiB/s (1225kB/s)(5120KiB/4279msec); 0 zone resets clat (msec): min=119, max=813, avg=431.64, stdev=278.50 lat (msec): min=119, max=813, avg=431.75, stdev=278.47 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1992, max= 6000, per=65.50%, avg=3337.00, stdev=2306.27, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 2=8.33%, 4=8.33%, 250=33.33%, 500=16.67%, 750=25.00% lat (msec) : 1000=8.33% cpu : usr=0.05%, sys=9.26%, ctx=134, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143907: Mon Sep 7 13:30:42 2026 read: IOPS=0, BW=364KiB/s (373kB/s)(2048KiB/5627msec) clat (msec): min=250, max=2328, avg=1289.47, stdev=1469.43 lat (msec): min=250, max=2328, avg=1289.47, stdev=1469.43 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1670, max= 2007, per=50.52%, avg=1838.50, stdev=238.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1820KiB/s (1863kB/s)(10.0MiB/5627msec); 0 zone resets clat (msec): min=121, max=590, avg=284.51, stdev=138.81 lat (msec): min=121, max=590, avg=285.98, stdev=138.29 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 131], | 30.00th=[ 230], 40.00th=[ 232], 50.00th=[ 243], 60.00th=[ 259], | 70.00th=[ 284], 80.00th=[ 334], 90.00th=[ 422], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2007, max= 5988, per=62.87%, avg=3203.40, stdev=1772.64, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=11.70%, ctx=188, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143908: Mon Sep 7 13:30:42 2026 read: IOPS=1, BW=1653KiB/s (1693kB/s)(6144KiB/3716msec) clat (usec): min=466, max=505433, avg=196873.06, stdev=226967.09 lat (usec): min=467, max=505435, avg=196875.01, stdev=226967.31 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[ 717], 50.00th=[ 717], 60.00th=[274727], | 70.00th=[396362], 80.00th=[396362], 90.00th=[505414], 95.00th=[505414], | 99.00th=[505414], 99.50th=[505414], 99.90th=[505414], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 2000, max= 4047, per=92.39%, avg=3362.00, stdev=1179.53, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1653KiB/s (1693kB/s)(6144KiB/3716msec); 0 zone resets clat (msec): min=124, max=766, avg=405.20, stdev=291.88 lat (msec): min=125, max=767, avg=405.38, stdev=292.04 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 384], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2000, max= 3292, per=45.84%, avg=2335.50, stdev=637.78, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.03%, sys=13.19%, ctx=310, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143909: Mon Sep 7 13:30:42 2026 read: IOPS=1, BW=1352KiB/s (1384kB/s)(5120KiB/3787msec) clat (usec): min=845, max=352028, avg=205420.15, stdev=186121.61 lat (usec): min=847, max=352030, avg=205421.96, stdev=186122.02 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[ 848], | 30.00th=[ 2737], 40.00th=[ 2737], 50.00th=[325059], 60.00th=[325059], | 70.00th=[346031], 80.00th=[346031], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 2027, max= 6059, per=100.00%, avg=4043.00, stdev=2851.05, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1893KiB/s (1938kB/s)(7168KiB/3787msec); 0 zone resets clat (msec): min=122, max=1314, avg=389.92, stdev=436.05 lat (msec): min=122, max=1314, avg=390.70, stdev=435.72 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 157], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 192], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 575], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1560, max= 5988, per=75.86%, avg=3865.00, stdev=2219.60, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=14.98%, ctx=223, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3640KiB/s (3727kB/s), 364KiB/s-1675KiB/s (373kB/s-1715kB/s), io=20.0MiB (20.0MB), run=3716-5627msec WRITE: bw=5095KiB/s (5218kB/s), 1197KiB/s-1893KiB/s (1225kB/s-1938kB/s), io=28.0MiB (29.4MB), run=3716-5627msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143911: Mon Sep 7 13:30:44 2026 read: IOPS=1, BW=1156KiB/s (1184kB/s)(7168KiB/6199msec) clat (msec): min=82, max=1709, avg=536.06, stdev=581.66 lat (msec): min=82, max=1709, avg=536.06, stdev=581.66 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 91], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 342], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 785], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1903, max= 4079, per=100.00%, avg=3291.67, stdev=1206.21, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=826KiB/s (846kB/s)(5120KiB/6199msec); 0 zone resets clat (msec): min=168, max=897, avg=438.18, stdev=325.27 lat (msec): min=168, max=897, avg=441.34, stdev=327.99 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2043, max= 6083, per=89.97%, avg=4063.00, stdev=2856.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.18%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143912: Mon Sep 7 13:30:44 2026 read: IOPS=0, BW=343KiB/s (351kB/s)(2048KiB/5968msec) clat (msec): min=261, max=609, avg=435.47, stdev=246.04 lat (msec): min=261, max=609, avg=435.47, stdev=246.05 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1903, max= 2043, per=61.16%, avg=1973.00, stdev=98.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1716KiB/s (1757kB/s)(10.0MiB/5968msec); 0 zone resets clat (msec): min=184, max=1296, avg=490.20, stdev=318.55 lat (msec): min=184, max=1297, avg=490.38, stdev=318.58 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 259], | 30.00th=[ 300], 40.00th=[ 338], 50.00th=[ 393], 60.00th=[ 397], | 70.00th=[ 485], 80.00th=[ 600], 90.00th=[ 651], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1946, max= 4079, per=59.76%, avg=2698.83, stdev=1069.58, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=8.33%, 500=58.33%, 750=25.00%, 2000=8.33% cpu : usr=0.03%, sys=3.99%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143913: Mon Sep 7 13:30:44 2026 read: IOPS=1, BW=1072KiB/s (1098kB/s)(6144KiB/5729msec) clat (msec): min=96, max=244, avg=163.02, stdev=61.78 lat (msec): min=96, max=244, avg=163.02, stdev=61.78 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 148], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 3893, max= 4079, per=100.00%, avg=3986.00, stdev=131.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1072KiB/s (1098kB/s)(6144KiB/5729msec); 0 zone resets clat (msec): min=262, max=1653, avg=759.02, stdev=480.97 lat (msec): min=263, max=1655, avg=759.69, stdev=481.71 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 625], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1903, max= 2043, per=44.50%, avg=2009.40, stdev=59.97, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=25.00%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=4.07%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143914: Mon Sep 7 13:30:44 2026 read: IOPS=0, BW=807KiB/s (826kB/s)(5120KiB/6348msec) clat (msec): min=84, max=736, avg=291.37, stdev=259.75 lat (msec): min=84, max=736, avg=291.37, stdev=259.75 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2027, max= 3893, per=82.28%, avg=2654.33, stdev=1072.75, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1129KiB/s (1156kB/s)(7168KiB/6348msec); 0 zone resets clat (msec): min=179, max=1811, avg=676.53, stdev=577.39 lat (msec): min=179, max=1811, avg=676.91, stdev=577.18 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 257], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 451], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 961], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1903, max= 4087, per=53.41%, avg=2411.80, stdev=938.00, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.21%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3226KiB/s (3304kB/s), 343KiB/s-1156KiB/s (351kB/s-1184kB/s), io=20.0MiB (20.0MB), run=5729-6348msec WRITE: bw=4517KiB/s (4625kB/s), 826KiB/s-1716KiB/s (846kB/s-1757kB/s), io=28.0MiB (29.4MB), run=5729-6348msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143922: Mon Sep 7 13:31:05 2026 read: IOPS=0, BW=3680KiB/s (3768kB/s)(12.0MiB/3339msec) clat (msec): min=901, max=1325, avg=1106.07, stdev=212.11 lat (msec): min=901, max=1325, avg=1106.07, stdev=212.11 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.27%, sys=9.26%, ctx=238, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143923: Mon Sep 7 13:31:05 2026 read: IOPS=0, BW=1033KiB/s (1058kB/s)(4096KiB/3965msec) clat (nsec): min=1088.4M, max=1088.4M, avg=1088383625.00, stdev= 0.00 lat (nsec): min=1088.4M, max=1088.4M, avg=1088384711.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2066KiB/s (2116kB/s)(8192KiB/3965msec); 0 zone resets clat (msec): min=1343, max=1484, avg=1413.94, stdev=99.58 lat (msec): min=1344, max=1484, avg=1414.80, stdev=99.05 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.23%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143924: Mon Sep 7 13:31:05 2026 write: IOPS=0, BW=3017KiB/s (3089kB/s)(12.0MiB/4073msec); 0 zone resets clat (msec): min=555, max=1722, avg=1326.38, stdev=667.78 lat (msec): min=556, max=1722, avg=1327.01, stdev=667.68 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8000, max= 8143, per=100.00%, avg=8071.50, stdev=101.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.05%, sys=3.27%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143925: Mon Sep 7 13:31:05 2026 write: IOPS=0, BW=3601KiB/s (3688kB/s)(12.0MiB/3412msec); 0 zone resets clat (msec): min=939, max=1476, avg=1135.14, stdev=296.71 lat (msec): min=939, max=1477, avg=1136.14, stdev=296.68 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8062, max= 8110, per=100.00%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.70%, ctx=43, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4132KiB/s (4231kB/s), 1033KiB/s-3680KiB/s (1058kB/s-3768kB/s), io=16.0MiB (16.8MB), run=3339-3965msec WRITE: bw=8045KiB/s (8238kB/s), 2066KiB/s-3601KiB/s (2116kB/s-3688kB/s), io=32.0MiB (33.6MB), run=3412-4073msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143927: Mon Sep 7 13:31:06 2026 read: IOPS=0, BW=2638KiB/s (2701kB/s)(12.0MiB/4658msec) clat (msec): min=517, max=2137, avg=1551.94, stdev=898.66 lat (msec): min=517, max=2137, avg=1551.94, stdev=898.66 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 2005], 50.00th=[ 2005], 60.00th=[ 2005], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.04%, sys=1.50%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143928: Mon Sep 7 13:31:06 2026 read: IOPS=0, BW=905KiB/s (927kB/s)(4096KiB/4526msec) clat (nsec): min=2421.6M, max=2421.6M, avg=2421632138.00, stdev= 0.00 lat (nsec): min=2421.6M, max=2421.6M, avg=2421634157.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2433], 5.00th=[ 2433], 10.00th=[ 2433], 20.00th=[ 2433], | 30.00th=[ 2433], 40.00th=[ 2433], 50.00th=[ 2433], 60.00th=[ 2433], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1810KiB/s (1853kB/s)(8192KiB/4526msec); 0 zone resets clat (msec): min=602, max=1496, avg=1049.51, stdev=632.35 lat (msec): min=602, max=1499, avg=1051.19, stdev=634.07 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.13%, sys=2.61%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143929: Mon Sep 7 13:31:06 2026 write: IOPS=0, BW=2813KiB/s (2880kB/s)(12.0MiB/4369msec); 0 zone resets clat (msec): min=493, max=2023, avg=1453.20, stdev=836.17 lat (msec): min=493, max=2024, avg=1453.61, stdev=836.14 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8062, max= 8110, per=100.00%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=1.92%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143930: Mon Sep 7 13:31:06 2026 write: IOPS=0, BW=3337KiB/s (3417kB/s)(12.0MiB/3682msec); 0 zone resets clat (msec): min=1005, max=1346, avg=1174.68, stdev=170.50 lat (msec): min=1006, max=1347, avg=1175.63, stdev=170.25 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7968, max= 8126, per=100.00%, avg=8047.00, stdev=111.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.53%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3517KiB/s (3602kB/s), 905KiB/s-2638KiB/s (927kB/s-2701kB/s), io=16.0MiB (16.8MB), run=4526-4658msec WRITE: bw=7240KiB/s (7414kB/s), 1810KiB/s-3337KiB/s (1853kB/s-3417kB/s), io=32.0MiB (33.6MB), run=3682-4526msec