== sanity test 398b: DIO and buffer IO race ============== 11:02:35 (1787583755) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.75254 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145601: Mon Aug 24 11:05:07 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(5992KiB/130869msec) clat (usec): min=32, max=1164.8k, avg=42987.00, stdev=45374.72 lat (usec): min=32, max=1164.9k, avg=42989.75, stdev=45374.34 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 87], | 20.00th=[ 17433], 30.00th=[ 23725], 40.00th=[ 28705], | 50.00th=[ 33817], 60.00th=[ 41157], 70.00th=[ 51643], | 80.00th=[ 64750], 90.00th=[ 85459], 95.00th=[ 105382], | 99.00th=[ 166724], 99.50th=[ 229639], 99.90th=[ 320865], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 111, per=25.51%, avg=46.18, stdev=20.29, samples=253 iops : min= 1, max= 27, avg=10.91, stdev= 5.11, samples=253 write: IOPS=12, BW=48.1KiB/s (49.3kB/s)(6296KiB/130869msec); 0 zone resets clat (usec): min=698, max=916095, avg=41868.64, stdev=49117.45 lat (usec): min=698, max=916096, avg=41874.38, stdev=49115.26 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1172], 10.00th=[ 1385], 20.00th=[ 3556], | 30.00th=[ 7963], 40.00th=[ 17171], 50.00th=[ 28967], 60.00th=[ 42206], | 70.00th=[ 54264], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[127402], | 99.00th=[193987], 99.50th=[219153], 99.90th=[346031], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 142, per=25.67%, avg=48.51, stdev=22.50, samples=253 iops : min= 1, max= 35, avg=11.50, stdev= 5.66, samples=253 lat (usec) : 50=0.62%, 100=4.43%, 250=0.26%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.36% lat (msec) : 2=6.45%, 4=4.23%, 10=6.02%, 20=10.68%, 50=34.64% lat (msec) : 100=24.09%, 250=7.68%, 500=0.26%, 1000=0.03%, 2000=0.03% cpu : usr=0.07%, sys=5.11%, ctx=6284, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145602: Mon Aug 24 11:05:07 2026 read: IOPS=11, BW=44.8KiB/s (45.9kB/s)(5940KiB/132473msec) clat (usec): min=31, max=283832, avg=42034.30, stdev=33971.49 lat (usec): min=31, max=283833, avg=42038.09, stdev=33972.72 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 72], 20.00th=[ 16909], | 30.00th=[ 23725], 40.00th=[ 28181], 50.00th=[ 34866], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[160433], 99.50th=[185598], 99.90th=[274727], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 103, per=24.89%, avg=45.05, stdev=19.63, samples=256 iops : min= 1, max= 25, avg=10.62, stdev= 4.95, samples=256 write: IOPS=11, BW=47.9KiB/s (49.1kB/s)(6348KiB/132473msec); 0 zone resets clat (usec): min=746, max=1156.0k, avg=43790.31, stdev=58587.67 lat (usec): min=748, max=1156.0k, avg=43800.63, stdev=58585.25 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1172], 10.00th=[ 1450], | 20.00th=[ 3818], 30.00th=[ 8717], 40.00th=[ 20579], | 50.00th=[ 30802], 60.00th=[ 41681], 70.00th=[ 55837], | 80.00th=[ 72877], 90.00th=[ 102237], 95.00th=[ 127402], | 99.00th=[ 191890], 99.50th=[ 233833], 99.90th=[1019216], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 160, per=25.28%, avg=47.79, stdev=23.46, samples=257 iops : min= 1, max= 40, avg=11.32, stdev= 5.91, samples=257 lat (usec) : 50=0.81%, 100=4.52%, 250=0.26%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.39% lat (msec) : 2=6.41%, 4=4.17%, 10=5.96%, 20=9.47%, 50=34.90% lat (msec) : 100=24.77%, 250=7.85%, 500=0.23%, 750=0.03%, 2000=0.07% cpu : usr=0.08%, sys=5.16%, ctx=6291, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145603: Mon Aug 24 11:05:07 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6028KiB/131726msec) clat (usec): min=35, max=1184.2k, avg=41718.53, stdev=49664.02 lat (usec): min=35, max=1184.2k, avg=41727.51, stdev=49671.33 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 68], | 20.00th=[ 16909], 30.00th=[ 23200], 40.00th=[ 28181], | 50.00th=[ 34341], 60.00th=[ 42730], 70.00th=[ 50594], | 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[ 130548], 99.50th=[ 173016], 99.90th=[1052771], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 126, per=25.49%, avg=46.14, stdev=21.72, samples=255 iops : min= 1, max= 31, avg=10.90, stdev= 5.48, samples=255 write: IOPS=11, BW=47.5KiB/s (48.7kB/s)(6260KiB/131726msec); 0 zone resets clat (usec): min=668, max=409083, avg=43630.62, stdev=46763.70 lat (usec): min=669, max=409085, avg=43645.42, stdev=46770.62 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1270], 20.00th=[ 3392], | 30.00th=[ 7439], 40.00th=[ 19530], 50.00th=[ 30540], 60.00th=[ 44303], | 70.00th=[ 56886], 80.00th=[ 73925], 90.00th=[106431], 95.00th=[131597], | 99.00th=[198181], 99.50th=[240124], 99.90th=[367002], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 111, per=25.20%, avg=47.64, stdev=21.12, samples=256 iops : min= 1, max= 27, avg=11.28, stdev= 5.31, samples=256 lat (usec) : 50=0.98%, 100=5.08%, 250=0.29%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.29% lat (msec) : 2=7.42%, 4=3.12%, 10=6.38%, 20=8.92%, 50=34.15% lat (msec) : 100=25.10%, 250=7.85%, 500=0.13%, 2000=0.07% cpu : usr=0.08%, sys=5.16%, ctx=6277, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145604: Mon Aug 24 11:05:07 2026 read: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6052KiB/130342msec) clat (usec): min=33, max=268267, avg=40246.03, stdev=32236.39 lat (usec): min=33, max=268268, avg=40248.58, stdev=32236.17 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 72], 20.00th=[ 16450], | 30.00th=[ 22414], 40.00th=[ 27657], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 63177], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[141558], 99.50th=[160433], 99.90th=[227541], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 103, per=25.95%, avg=46.97, stdev=20.87, samples=251 iops : min= 1, max= 25, avg=11.11, stdev= 5.25, samples=251 write: IOPS=11, BW=47.8KiB/s (48.0kB/s)(6236KiB/130342msec); 0 zone resets clat (usec): min=646, max=1449.8k, avg=44222.85, stdev=63099.29 lat (usec): min=647, max=1449.8k, avg=44226.93, stdev=63099.69 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1139], 10.00th=[ 1287], | 20.00th=[ 3228], 30.00th=[ 7046], 40.00th=[ 17171], | 50.00th=[ 29230], 60.00th=[ 41157], 70.00th=[ 55837], | 80.00th=[ 74974], 90.00th=[ 105382], 95.00th=[ 135267], | 99.00th=[ 210764], 99.50th=[ 238027], 99.90th=[ 977273], | 99.95th=[1451230], 99.99th=[1451230] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=48.00, stdev=20.61, samples=253 iops : min= 1, max= 29, avg=11.36, stdev= 5.17, samples=253 lat (usec) : 50=0.94%, 100=4.72%, 250=0.49%, 500=0.16%, 750=0.16% lat (usec) : 1000=0.39% lat (msec) : 2=7.58%, 4=3.74%, 10=5.96%, 20=10.29%, 50=33.85% lat (msec) : 100=22.92%, 250=8.59%, 500=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.87%, ctx=6138, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (186kB/s), 44.8KiB/s-46.4KiB/s (45.9kB/s-47.5kB/s), io=23.4MiB (24.6MB), run=130342-132473msec WRITE: bw=190KiB/s (194kB/s), 47.5KiB/s-48.1KiB/s (48.7kB/s-49.3kB/s), io=24.6MiB (25.7MB), run=130342-132473msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145597: Mon Aug 24 11:07:15 2026 read: IOPS=5, BW=23.2KiB/s (23.7kB/s)(5992KiB/258643msec) clat (msec): min=5, max=1224, avg=33.98, stdev=46.85 lat (msec): min=5, max=1224, avg=33.98, stdev=46.85 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 103], | 99.00th=[ 174], 99.50th=[ 218], 99.90th=[ 380], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 111, per=28.36%, avg=26.09, stdev=18.68, samples=445 iops : min= 1, max= 27, avg= 5.93, stdev= 4.74, samples=445 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6296KiB/258643msec); 0 zone resets clat (msec): min=32, max=1090, avg=131.65, stdev=74.55 lat (msec): min=32, max=1090, avg=131.65, stdev=74.55 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 97], 50.00th=[ 110], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 178], 90.00th=[ 236], 95.00th=[ 271], | 99.00th=[ 380], 99.50th=[ 418], 99.90th=[ 477], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 63, per=25.10%, avg=24.10, stdev=12.19, samples=504 iops : min= 1, max= 15, avg= 5.42, stdev= 3.13, samples=504 lat (msec) : 10=6.35%, 20=17.90%, 50=16.28%, 100=27.15%, 250=28.16% lat (msec) : 500=4.10%, 2000=0.07% cpu : usr=0.04%, sys=1.07%, ctx=5060, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145598: Mon Aug 24 11:07:15 2026 read: IOPS=5, BW=22.8KiB/s (23.4kB/s)(5940KiB/260103msec) clat (msec): min=4, max=1128, avg=32.80, stdev=44.97 lat (msec): min=4, max=1128, avg=32.80, stdev=44.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 45], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 493], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 103, per=28.53%, avg=26.25, stdev=17.93, samples=438 iops : min= 1, max= 25, avg= 5.97, stdev= 4.55, samples=438 write: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6348KiB/260103msec); 0 zone resets clat (msec): min=32, max=493, avg=132.86, stdev=71.43 lat (msec): min=32, max=493, avg=132.87, stdev=71.44 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 127], | 70.00th=[ 148], 80.00th=[ 184], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 372], 99.50th=[ 435], 99.90th=[ 477], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 56, per=25.40%, avg=24.39, stdev=11.91, samples=503 iops : min= 1, max= 14, avg= 5.49, stdev= 3.06, samples=503 lat (msec) : 10=5.53%, 20=19.73%, 50=15.82%, 100=25.88%, 250=28.65% lat (msec) : 500=4.36%, 2000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5175, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145599: Mon Aug 24 11:07:15 2026 read: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6028KiB/260022msec) clat (msec): min=4, max=457, avg=34.44, stdev=38.38 lat (msec): min=4, max=457, avg=34.44, stdev=38.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 32], 80.00th=[ 50], 90.00th=[ 81], 95.00th=[ 113], | 99.00th=[ 171], 99.50th=[ 236], 99.90th=[ 384], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 93, per=27.77%, avg=25.55, stdev=17.04, samples=457 iops : min= 1, max= 23, avg= 5.80, stdev= 4.30, samples=457 write: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6260KiB/260022msec); 0 zone resets clat (msec): min=31, max=1320, avg=132.66, stdev=81.21 lat (msec): min=31, max=1320, avg=132.67, stdev=81.21 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 110], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 174], 90.00th=[ 234], 95.00th=[ 284], | 99.00th=[ 388], 99.50th=[ 451], 99.90th=[ 1028], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 64, per=25.10%, avg=24.09, stdev=12.53, samples=502 iops : min= 1, max= 16, avg= 5.42, stdev= 3.21, samples=502 lat (msec) : 10=5.01%, 20=20.05%, 50=15.56%, 100=25.78%, 250=29.56% lat (msec) : 500=3.94%, 750=0.03%, 2000=0.07% cpu : usr=0.05%, sys=1.07%, ctx=5104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145600: Mon Aug 24 11:07:15 2026 read: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6052KiB/259230msec) clat (msec): min=4, max=457, avg=33.69, stdev=36.24 lat (msec): min=4, max=457, avg=33.70, stdev=36.24 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 111], | 99.00th=[ 174], 99.50th=[ 194], 99.90th=[ 279], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 103, per=28.70%, avg=26.40, stdev=18.67, samples=444 iops : min= 1, max= 25, avg= 6.01, stdev= 4.75, samples=444 write: IOPS=6, BW=24.1KiB/s (24.6kB/s)(6236KiB/259230msec); 0 zone resets clat (msec): min=30, max=1416, avg=133.25, stdev=80.51 lat (msec): min=30, max=1416, avg=133.25, stdev=80.51 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 148], 80.00th=[ 180], 90.00th=[ 232], 95.00th=[ 275], | 99.00th=[ 380], 99.50th=[ 418], 99.90th=[ 1045], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 64, per=25.00%, avg=24.00, stdev=11.98, samples=501 iops : min= 1, max= 16, avg= 5.40, stdev= 3.08, samples=501 lat (msec) : 10=6.22%, 20=18.33%, 50=16.63%, 100=25.49%, 250=29.39% lat (msec) : 500=3.84%, 750=0.03%, 2000=0.07% cpu : usr=0.04%, sys=1.05%, ctx=5221, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=92.3KiB/s (94.5kB/s), 22.8KiB/s-23.3KiB/s (23.4kB/s-23.9kB/s), io=23.4MiB (24.6MB), run=258643-260103msec WRITE: bw=96.7KiB/s (98.0kB/s), 24.1KiB/s-24.4KiB/s (24.6kB/s-24.0kB/s), io=24.6MiB (25.7MB), run=258643-260103msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145657: Mon Aug 24 11:07:54 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5920KiB/27312msec) clat (usec): min=36, max=185829, avg=35257.14, stdev=31249.26 lat (usec): min=36, max=185829, avg=35258.32, stdev=31249.28 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 75], | 30.00th=[ 18482], 40.00th=[ 26608], 50.00th=[ 32637], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[137364], 99.50th=[170918], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 94, max= 465, per=25.84%, avg=217.83, stdev=82.62, samples=53 iops : min= 5, max= 29, avg=12.92, stdev= 5.24, samples=53 write: IOPS=14, BW=233KiB/s (239kB/s)(6368KiB/27312msec); 0 zone resets clat (usec): min=1422, max=213456, avg=35348.07, stdev=35964.84 lat (usec): min=1423, max=213458, avg=35359.63, stdev=35974.28 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1811], 10.00th=[ 2114], 20.00th=[ 5014], | 30.00th=[ 8586], 40.00th=[ 14091], 50.00th=[ 22938], 60.00th=[ 32637], | 70.00th=[ 48497], 80.00th=[ 62653], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[160433], 99.50th=[170918], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 62, max= 471, per=26.37%, avg=233.92, stdev=85.38, samples=53 iops : min= 3, max= 29, avg=13.91, stdev= 5.36, samples=53 lat (usec) : 50=2.08%, 100=8.98%, 250=1.17%, 500=0.26% lat (msec) : 2=5.08%, 4=4.69%, 10=7.68%, 20=9.38%, 50=32.03% lat (msec) : 100=23.57%, 250=5.08% cpu : usr=0.11%, sys=5.70%, ctx=1391, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145658: Mon Aug 24 11:07:54 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(5744KiB/28398msec) clat (usec): min=41, max=217288, avg=38260.11, stdev=32741.31 lat (usec): min=41, max=217289, avg=38261.33, stdev=32741.36 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 172], | 30.00th=[ 21365], 40.00th=[ 28181], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[173016], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 23, max= 377, per=24.01%, avg=202.40, stdev=98.60, samples=55 iops : min= 1, max= 23, avg=11.95, stdev= 6.18, samples=55 write: IOPS=14, BW=230KiB/s (236kB/s)(6544KiB/28398msec); 0 zone resets clat (usec): min=1366, max=439571, avg=35285.56, stdev=42298.50 lat (usec): min=1368, max=439573, avg=35291.51, stdev=42302.75 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1696], 10.00th=[ 2073], 20.00th=[ 4621], | 30.00th=[ 6980], 40.00th=[ 10945], 50.00th=[ 18744], 60.00th=[ 31851], | 70.00th=[ 45351], 80.00th=[ 64226], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[152044], 99.50th=[198181], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 62, max= 442, per=25.98%, avg=230.45, stdev=84.74, samples=55 iops : min= 3, max= 27, avg=13.71, stdev= 5.32, samples=55 lat (usec) : 50=0.65%, 100=7.94%, 250=1.04%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=5.21%, 4=4.30%, 10=11.72%, 20=8.72%, 50=30.73% lat (msec) : 100=22.66%, 250=5.99%, 500=0.13% cpu : usr=0.10%, sys=5.88%, ctx=1393, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145659: Mon Aug 24 11:07:54 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(6256KiB/27941msec) clat (usec): min=32, max=217854, avg=36647.71, stdev=32031.27 lat (usec): min=32, max=217855, avg=36651.92, stdev=32031.61 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 62], 20.00th=[ 88], | 30.00th=[ 18220], 40.00th=[ 29230], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[158335], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 60, max= 412, per=26.82%, avg=226.06, stdev=86.77, samples=54 iops : min= 3, max= 25, avg=13.41, stdev= 5.48, samples=54 write: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27941msec); 0 zone resets clat (usec): min=1261, max=213487, avg=35936.44, stdev=36999.86 lat (usec): min=1263, max=213490, avg=35940.47, stdev=37002.02 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1795], 10.00th=[ 3130], 20.00th=[ 5473], | 30.00th=[ 9372], 40.00th=[ 14484], 50.00th=[ 23987], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 63177], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[191890], 99.50th=[204473], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 444, per=24.25%, avg=215.07, stdev=84.80, samples=54 iops : min= 1, max= 27, avg=12.74, stdev= 5.25, samples=54 lat (usec) : 50=2.21%, 100=8.85%, 250=1.30%, 500=0.13% lat (msec) : 2=3.91%, 4=3.39%, 10=9.24%, 20=8.59%, 50=35.16% lat (msec) : 100=21.74%, 250=5.47% cpu : usr=0.10%, sys=5.58%, ctx=1426, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145661: Mon Aug 24 11:07:54 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(6032KiB/27355msec) clat (usec): min=33, max=179246, avg=36803.32, stdev=33479.17 lat (usec): min=33, max=179247, avg=36806.27, stdev=33479.40 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 78], | 30.00th=[ 17433], 40.00th=[ 25297], 50.00th=[ 32113], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[156238], 99.50th=[175113], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 62, max= 415, per=26.73%, avg=225.33, stdev=92.01, samples=52 iops : min= 3, max= 25, avg=13.37, stdev= 5.79, samples=52 write: IOPS=14, BW=229KiB/s (234kB/s)(6256KiB/27355msec); 0 zone resets clat (usec): min=1256, max=294367, avg=33699.67, stdev=38265.85 lat (usec): min=1259, max=294369, avg=33712.89, stdev=38270.97 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1680], 10.00th=[ 2212], 20.00th=[ 5014], | 30.00th=[ 7635], 40.00th=[ 12125], 50.00th=[ 18220], 60.00th=[ 28443], | 70.00th=[ 42730], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[154141], 99.50th=[238027], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 74, max= 479, per=25.97%, avg=230.32, stdev=91.44, samples=53 iops : min= 4, max= 29, avg=13.70, stdev= 5.73, samples=53 lat (usec) : 50=1.30%, 100=10.55%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.08%, 4=4.56%, 10=10.42%, 20=9.11%, 50=31.38% lat (msec) : 100=21.88%, 250=4.95%, 500=0.13% cpu : usr=0.08%, sys=6.13%, ctx=1436, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=843KiB/s (864kB/s), 202KiB/s-224KiB/s (207kB/s-229kB/s), io=23.4MiB (24.5MB), run=27312-28398msec WRITE: bw=887KiB/s (909kB/s), 216KiB/s-233KiB/s (221kB/s-239kB/s), io=24.6MiB (25.8MB), run=27312-28398msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145660: Mon Aug 24 11:08:40 2026 read: IOPS=5, BW=80.0KiB/s (82.9kB/s)(5920KiB/73126msec) clat (msec): min=6, max=378, avg=42.41, stdev=36.05 lat (msec): min=6, max=378, avg=42.42, stdev=36.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 74], 95.00th=[ 110], | 99.00th=[ 192], 99.50th=[ 234], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 285, per=28.44%, avg=92.14, stdev=54.12, samples=127 iops : min= 1, max= 17, avg= 5.00, stdev= 3.47, samples=127 write: IOPS=5, BW=87.1KiB/s (89.2kB/s)(6368KiB/73126msec); 0 zone resets clat (msec): min=44, max=496, avg=143.73, stdev=65.56 lat (msec): min=44, max=496, avg=143.73, stdev=65.55 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 167], 80.00th=[ 188], 90.00th=[ 224], 95.00th=[ 271], | 99.00th=[ 388], 99.50th=[ 443], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 30, max= 160, per=25.55%, avg=87.12, stdev=37.43, samples=144 iops : min= 1, max= 10, avg= 4.69, stdev= 2.43, samples=144 lat (msec) : 10=1.43%, 20=7.94%, 50=27.47%, 100=22.53%, 250=36.85% lat (msec) : 500=3.78% cpu : usr=0.04%, sys=1.27%, ctx=1403, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145662: Mon Aug 24 11:08:40 2026 read: IOPS=4, BW=77.8KiB/s (79.6kB/s)(5744KiB/73877msec) clat (msec): min=7, max=234, avg=42.52, stdev=34.55 lat (msec): min=7, max=234, avg=42.52, stdev=34.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 86], 95.00th=[ 122], | 99.00th=[ 174], 99.50th=[ 224], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 29, max= 255, per=28.15%, avg=91.22, stdev=56.80, samples=124 iops : min= 1, max= 15, avg= 4.96, stdev= 3.57, samples=124 write: IOPS=5, BW=88.6KiB/s (90.7kB/s)(6544KiB/73877msec); 0 zone resets clat (msec): min=39, max=533, avg=142.99, stdev=68.42 lat (msec): min=39, max=533, avg=142.99, stdev=68.42 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 114], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 228], 95.00th=[ 266], | 99.00th=[ 422], 99.50th=[ 439], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 30, max= 190, per=26.01%, avg=88.70, stdev=38.02, samples=145 iops : min= 1, max= 11, avg= 4.79, stdev= 2.47, samples=145 lat (msec) : 10=1.69%, 20=9.24%, 50=24.22%, 100=22.53%, 250=38.41% lat (msec) : 500=3.78%, 750=0.13% cpu : usr=0.04%, sys=1.17%, ctx=1341, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145663: Mon Aug 24 11:08:40 2026 read: IOPS=5, BW=88.5KiB/s (90.6kB/s)(6256KiB/70676msec) clat (msec): min=6, max=199, avg=39.33, stdev=29.95 lat (msec): min=6, max=199, avg=39.34, stdev=29.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 69], 95.00th=[ 102], | 99.00th=[ 167], 99.50th=[ 186], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 30, max= 352, per=30.06%, avg=97.39, stdev=64.43, samples=127 iops : min= 1, max= 22, avg= 5.34, stdev= 4.15, samples=127 write: IOPS=5, BW=85.3KiB/s (87.4kB/s)(6032KiB/70676msec); 0 zone resets clat (msec): min=50, max=526, avg=146.05, stdev=68.93 lat (msec): min=50, max=526, avg=146.05, stdev=68.93 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 239], 95.00th=[ 275], | 99.00th=[ 397], 99.50th=[ 456], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 30, max= 160, per=24.88%, avg=84.84, stdev=34.46, samples=140 iops : min= 1, max= 10, avg= 4.54, stdev= 2.22, samples=140 lat (msec) : 10=1.56%, 20=10.68%, 50=27.21%, 100=22.14%, 250=34.77% lat (msec) : 500=3.52%, 750=0.13% cpu : usr=0.06%, sys=1.37%, ctx=1406, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145664: Mon Aug 24 11:08:40 2026 read: IOPS=5, BW=82.8KiB/s (84.8kB/s)(6032KiB/72826msec) clat (msec): min=9, max=234, avg=42.53, stdev=36.28 lat (msec): min=9, max=234, avg=42.54, stdev=36.28 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 125], | 99.00th=[ 203], 99.50th=[ 232], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 30, max= 316, per=28.21%, avg=91.40, stdev=60.93, samples=129 iops : min= 1, max= 19, avg= 4.97, stdev= 3.82, samples=129 write: IOPS=5, BW=85.9KiB/s (87.0kB/s)(6256KiB/72826msec); 0 zone resets clat (msec): min=43, max=464, avg=144.74, stdev=60.95 lat (msec): min=43, max=464, avg=144.75, stdev=60.95 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 74], 10.00th=[ 87], 20.00th=[ 99], | 30.00th=[ 108], 40.00th=[ 118], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 186], 90.00th=[ 215], 95.00th=[ 262], | 99.00th=[ 372], 99.50th=[ 430], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 160, per=25.93%, avg=88.43, stdev=34.46, samples=139 iops : min= 1, max= 10, avg= 4.78, stdev= 2.26, samples=139 lat (msec) : 10=0.26%, 20=10.81%, 50=26.95%, 100=19.01%, 250=39.84% lat (msec) : 500=3.12% cpu : usr=0.05%, sys=1.29%, ctx=1344, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=324KiB/s (332kB/s), 77.8KiB/s-88.5KiB/s (79.6kB/s-90.6kB/s), io=23.4MiB (24.5MB), run=70676-73877msec WRITE: bw=341KiB/s (349kB/s), 85.3KiB/s-88.6KiB/s (87.4kB/s-90.7kB/s), io=24.6MiB (25.8MB), run=70676-73877msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145682: Mon Aug 24 11:08:58 2026 read: IOPS=1, BW=1605KiB/s (1644kB/s)(7168KiB/4466msec) clat (msec): min=7, max=1608, avg=416.26, stdev=544.97 lat (msec): min=7, max=1608, avg=416.26, stdev=544.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 133], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 224], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 439], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 2023, max= 4039, per=82.30%, avg=2988.25, stdev=1114.56, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1146KiB/s (1174kB/s)(5120KiB/4466msec); 0 zone resets clat (msec): min=119, max=550, avg=302.73, stdev=170.45 lat (msec): min=119, max=550, avg=303.04, stdev=170.27 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1932, max= 3968, per=51.55%, avg=2620.33, stdev=1167.20, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.33%, ctx=248, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145683: Mon Aug 24 11:08:58 2026 read: IOPS=0, BW=363KiB/s (372kB/s)(2048KiB/5640msec) clat (msec): min=178, max=241, avg=209.86, stdev=44.65 lat (msec): min=178, max=241, avg=209.86, stdev=44.65 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1442, max= 2023, per=47.71%, avg=1732.50, stdev=410.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1816KiB/s (1859kB/s)(10.0MiB/5640msec); 0 zone resets clat (msec): min=99, max=1849, avg=511.13, stdev=545.04 lat (msec): min=100, max=1849, avg=511.44, stdev=544.89 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 165], | 30.00th=[ 188], 40.00th=[ 292], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 321], 80.00th=[ 542], 90.00th=[ 1070], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 1932, max= 4079, per=52.70%, avg=2678.83, stdev=1069.87, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=16.67% cpu : usr=0.04%, sys=8.71%, ctx=142, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145684: Mon Aug 24 11:08:58 2026 read: IOPS=1, BW=1252KiB/s (1282kB/s)(6144KiB/4907msec) clat (msec): min=2, max=335, avg=103.05, stdev=123.79 lat (msec): min=2, max=335, avg=103.05, stdev=123.79 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 53], 50.00th=[ 53], 60.00th=[ 111], | 70.00th=[ 113], 80.00th=[ 113], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2023, max= 4039, per=91.66%, avg=3328.33, stdev=1131.94, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1252KiB/s (1282kB/s)(6144KiB/4907msec); 0 zone resets clat (msec): min=231, max=1692, avg=699.62, stdev=519.02 lat (msec): min=231, max=1692, avg=699.77, stdev=518.98 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 514], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1481, max= 2039, per=37.77%, avg=1919.83, stdev=216.68, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 4=8.33%, 10=8.33%, 100=8.33%, 250=25.00%, 500=25.00% lat (msec) : 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.48%, ctx=146, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145685: Mon Aug 24 11:08:58 2026 read: IOPS=1, BW=1102KiB/s (1129kB/s)(5120KiB/4645msec) clat (usec): min=567, max=248011, avg=96182.57, stdev=125542.50 lat (usec): min=568, max=248012, avg=96183.97, stdev=125542.69 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 1172], 40.00th=[ 1172], 50.00th=[ 12911], 60.00th=[ 12911], | 70.00th=[219153], 80.00th=[219153], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1543KiB/s (1580kB/s)(7168KiB/4645msec); 0 zone resets clat (msec): min=202, max=1555, avg=580.08, stdev=462.50 lat (msec): min=208, max=1555, avg=581.94, stdev=461.94 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 296], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 472], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 726], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 1503, max= 4039, per=45.17%, avg=2296.20, stdev=996.40, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 20=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=7.97%, ctx=138, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3631KiB/s (3718kB/s), 363KiB/s-1605KiB/s (372kB/s-1644kB/s), io=20.0MiB (20.0MB), run=4466-5640msec WRITE: bw=5084KiB/s (5206kB/s), 1146KiB/s-1816KiB/s (1174kB/s-1859kB/s), io=28.0MiB (29.4MB), run=4466-5640msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145687: Mon Aug 24 11:09:00 2026 read: IOPS=1, BW=1133KiB/s (1161kB/s)(7168KiB/6324msec) clat (msec): min=88, max=1786, avg=659.92, stdev=705.26 lat (msec): min=88, max=1786, avg=659.92, stdev=705.26 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 103], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 201], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 1401], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1996, max= 4087, per=78.89%, avg=2436.20, stdev=923.01, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=810KiB/s (829kB/s)(5120KiB/6324msec); 0 zone resets clat (msec): min=192, max=668, avg=335.89, stdev=193.29 lat (msec): min=192, max=669, avg=336.28, stdev=193.74 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2023, max= 4055, per=62.62%, avg=2707.00, stdev=1167.45, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=1.63%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145688: Mon Aug 24 11:09:00 2026 read: IOPS=0, BW=309KiB/s (316kB/s)(2048KiB/6632msec) clat (msec): min=94, max=173, avg=134.23, stdev=56.24 lat (msec): min=94, max=173, avg=134.23, stdev=56.24 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 95], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 1910, max= 2043, per=64.01%, avg=1976.50, stdev=94.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1544KiB/s (1581kB/s)(10.0MiB/6632msec); 0 zone resets clat (msec): min=131, max=2733, avg=634.26, stdev=757.55 lat (msec): min=131, max=2733, avg=634.40, stdev=757.53 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 226], | 30.00th=[ 239], 40.00th=[ 309], 50.00th=[ 439], 60.00th=[ 498], | 70.00th=[ 523], 80.00th=[ 558], 90.00th=[ 684], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1976, max= 2048, per=46.70%, avg=2018.86, stdev=25.41, samples=7 iops : min= 1, max= 2, avg= 1.14, stdev= 0.38, samples=7 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.08%, sys=2.08%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145689: Mon Aug 24 11:09:00 2026 read: IOPS=0, BW=1007KiB/s (1031kB/s)(6144KiB/6101msec) clat (msec): min=75, max=838, avg=303.86, stdev=288.19 lat (msec): min=75, max=838, avg=303.86, stdev=288.19 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 275], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2019, max= 4087, per=88.02%, avg=2718.00, stdev=1185.68, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=1007KiB/s (1031kB/s)(6144KiB/6101msec); 0 zone resets clat (msec): min=225, max=2195, avg=702.09, stdev=747.35 lat (msec): min=225, max=2195, avg=702.85, stdev=747.17 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 523], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1976, max= 4087, per=58.33%, avg=2521.50, stdev=1043.88, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.39%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145690: Mon Aug 24 11:09:00 2026 read: IOPS=0, BW=836KiB/s (856kB/s)(5120KiB/6126msec) clat (msec): min=126, max=489, avg=241.72, stdev=145.10 lat (msec): min=126, max=489, avg=241.72, stdev=145.10 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1996, max= 4087, per=87.46%, avg=2700.67, stdev=1200.65, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1170KiB/s (1198kB/s)(7168KiB/6126msec); 0 zone resets clat (msec): min=313, max=2039, avg=697.33, stdev=614.13 lat (msec): min=313, max=2039, avg=698.16, stdev=614.17 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 321], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 523], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 776], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 1976, max= 2048, per=46.79%, avg=2022.60, stdev=28.57, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.69%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3088KiB/s (3162kB/s), 309KiB/s-1133KiB/s (316kB/s-1161kB/s), io=20.0MiB (20.0MB), run=6101-6632msec WRITE: bw=4323KiB/s (4427kB/s), 810KiB/s-1544KiB/s (829kB/s-1581kB/s), io=28.0MiB (29.4MB), run=6101-6632msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145703: Mon Aug 24 11:09:16 2026 read: IOPS=0, BW=3767KiB/s (3857kB/s)(12.0MiB/3262msec) clat (msec): min=885, max=1169, avg=1063.92, stdev=155.15 lat (msec): min=885, max=1169, avg=1063.93, stdev=155.15 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8031, max= 8062, per=100.00%, avg=8046.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=9.84%, ctx=213, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145704: Mon Aug 24 11:09:16 2026 read: IOPS=0, BW=984KiB/s (1007kB/s)(4096KiB/4164msec) clat (nsec): min=956432k, max=956432k, avg=956431933.00, stdev= 0.00 lat (nsec): min=956434k, max=956434k, avg=956434303.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1967KiB/s (2015kB/s)(8192KiB/4164msec); 0 zone resets clat (msec): min=1171, max=1886, avg=1529.06, stdev=505.55 lat (msec): min=1172, max=1886, avg=1529.67, stdev=505.33 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1888], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.84%, ctx=105, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145705: Mon Aug 24 11:09:16 2026 write: IOPS=0, BW=2645KiB/s (2709kB/s)(12.0MiB/4645msec); 0 zone resets clat (msec): min=859, max=2153, avg=1480.47, stdev=648.73 lat (msec): min=859, max=2154, avg=1480.88, stdev=648.83 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.17%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145706: Mon Aug 24 11:09:16 2026 write: IOPS=0, BW=3345KiB/s (3426kB/s)(12.0MiB/3673msec); 0 zone resets clat (msec): min=274, max=2357, avg=1193.31, stdev=1063.06 lat (msec): min=275, max=2358, avg=1193.90, stdev=1063.19 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=4.47%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3935KiB/s (4029kB/s), 984KiB/s-3767KiB/s (1007kB/s-3857kB/s), io=16.0MiB (16.8MB), run=3262-4164msec WRITE: bw=7054KiB/s (7224kB/s), 1967KiB/s-3345KiB/s (2015kB/s-3426kB/s), io=32.0MiB (33.6MB), run=3673-4645msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145698: Mon Aug 24 11:09:16 2026 read: IOPS=0, BW=3524KiB/s (3609kB/s)(12.0MiB/3487msec) clat (msec): min=898, max=1402, avg=1131.08, stdev=254.40 lat (msec): min=898, max=1402, avg=1131.08, stdev=254.40 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8031, max= 8078, per=100.00%, avg=8054.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.50%, ctx=57, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145699: Mon Aug 24 11:09:16 2026 read: IOPS=0, BW=848KiB/s (868kB/s)(4096KiB/4831msec) clat (nsec): min=1605.6M, max=1605.6M, avg=1605574683.00, stdev= 0.00 lat (nsec): min=1605.6M, max=1605.6M, avg=1605578791.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1603], 5.00th=[ 1603], 10.00th=[ 1603], 20.00th=[ 1603], | 30.00th=[ 1603], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1696KiB/s (1736kB/s)(8192KiB/4831msec); 0 zone resets clat (msec): min=533, max=2581, avg=1557.80, stdev=1447.96 lat (msec): min=534, max=2584, avg=1559.69, stdev=1449.55 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 2567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 7728, max= 7728, per=100.00%, avg=7728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.30%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145700: Mon Aug 24 11:09:16 2026 write: IOPS=1, BW=6557KiB/s (6714kB/s)(12.0MiB/1874msec); 0 zone resets clat (msec): min=494, max=707, avg=585.21, stdev=109.92 lat (msec): min=495, max=708, avg=585.85, stdev=109.94 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.11%, sys=6.25%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145702: Mon Aug 24 11:09:16 2026 write: IOPS=1, BW=4112KiB/s (4211kB/s)(12.0MiB/2988msec); 0 zone resets clat (msec): min=396, max=1322, avg=938.63, stdev=482.73 lat (msec): min=397, max=1326, avg=943.63, stdev=485.10 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 6380, max= 8159, per=100.00%, avg=7269.50, stdev=1257.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.25%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3391KiB/s (3473kB/s), 848KiB/s-3524KiB/s (868kB/s-3609kB/s), io=16.0MiB (16.8MB), run=3487-4831msec WRITE: bw=6783KiB/s (6946kB/s), 1696KiB/s-6557KiB/s (1736kB/s-6714kB/s), io=32.0MiB (33.6MB), run=1874-4831msec