== sanity test 398b: DIO and buffer IO race ============== 21:48:54 (1786672134) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 9.54331 s, 5.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144472: Thu Aug 13 21:52:03 2026 read: IOPS=9, BW=36.8KiB/s (37.7kB/s)(5992KiB/162838msec) clat (usec): min=35, max=880372, avg=57934.11, stdev=46553.79 lat (usec): min=35, max=880374, avg=57936.16, stdev=46553.71 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 74], 10.00th=[ 18220], 20.00th=[ 27657], | 30.00th=[ 34341], 40.00th=[ 41157], 50.00th=[ 49021], 60.00th=[ 57934], | 70.00th=[ 70779], 80.00th=[ 84411], 90.00th=[102237], 95.00th=[128451], | 99.00th=[227541], 99.50th=[258999], 99.90th=[350225], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 95, per=25.23%, avg=36.83, stdev=16.16, samples=314 iops : min= 1, max= 23, avg= 8.54, stdev= 4.09, samples=314 write: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6296KiB/162838msec); 0 zone resets clat (usec): min=1134, max=378580, avg=48142.25, stdev=49946.33 lat (usec): min=1135, max=378583, avg=48148.31, stdev=49952.49 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1582], 10.00th=[ 2114], 20.00th=[ 6456], | 30.00th=[ 11863], 40.00th=[ 21627], 50.00th=[ 33817], 60.00th=[ 47449], | 70.00th=[ 63177], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[145753], | 99.00th=[229639], 99.50th=[270533], 99.90th=[367002], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 96, per=25.21%, avg=38.57, stdev=18.19, samples=315 iops : min= 1, max= 24, avg= 8.97, stdev= 4.61, samples=315 lat (usec) : 50=0.13%, 100=3.03%, 250=0.13%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.95%, 4=2.67%, 10=6.28%, 20=7.94%, 50=31.48% lat (msec) : 100=31.22%, 250=11.36%, 500=0.68%, 1000=0.03% cpu : usr=0.08%, sys=4.61%, ctx=6520, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144473: Thu Aug 13 21:52:03 2026 read: IOPS=9, BW=36.2KiB/s (37.1kB/s)(5940KiB/164028msec) clat (usec): min=32, max=858333, avg=57347.89, stdev=45651.63 lat (usec): min=32, max=858335, avg=57351.33, stdev=45651.99 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 85], 10.00th=[ 18482], 20.00th=[ 27919], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 49546], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 81265], 90.00th=[103285], 95.00th=[122160], | 99.00th=[196084], 99.50th=[248513], 99.90th=[446694], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 95, per=24.81%, avg=36.22, stdev=16.94, samples=317 iops : min= 1, max= 23, avg= 8.39, stdev= 4.28, samples=317 write: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6348KiB/164028msec); 0 zone resets clat (usec): min=863, max=335783, avg=49478.79, stdev=49156.74 lat (usec): min=863, max=335785, avg=49504.68, stdev=49164.82 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1614], 10.00th=[ 2147], 20.00th=[ 7308], | 30.00th=[ 12780], 40.00th=[ 24249], 50.00th=[ 36439], 60.00th=[ 49021], | 70.00th=[ 64750], 80.00th=[ 83362], 90.00th=[113771], 95.00th=[145753], | 99.00th=[221250], 99.50th=[261096], 99.90th=[274727], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 149, per=25.15%, avg=38.49, stdev=19.38, samples=319 iops : min= 1, max= 37, avg= 8.96, stdev= 4.89, samples=319 lat (usec) : 50=0.10%, 100=2.73%, 250=0.20%, 1000=0.07% lat (msec) : 2=4.98%, 4=2.38%, 10=6.05%, 20=7.88%, 50=31.12% lat (msec) : 100=31.90%, 250=12.11%, 500=0.46%, 1000=0.03% cpu : usr=0.09%, sys=4.82%, ctx=6694, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144474: Thu Aug 13 21:52:03 2026 read: IOPS=9, BW=36.9KiB/s (37.7kB/s)(6028KiB/163535msec) clat (usec): min=40, max=831529, avg=55717.49, stdev=44605.99 lat (usec): min=41, max=831532, avg=55734.39, stdev=44599.23 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 77], 10.00th=[ 16909], 20.00th=[ 26346], | 30.00th=[ 34341], 40.00th=[ 40109], 50.00th=[ 48497], 60.00th=[ 56886], | 70.00th=[ 66323], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[121111], | 99.00th=[187696], 99.50th=[250610], 99.90th=[429917], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 93, per=25.40%, avg=37.08, stdev=16.25, samples=314 iops : min= 1, max= 23, avg= 8.60, stdev= 4.11, samples=314 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6260KiB/163535msec); 0 zone resets clat (usec): min=1010, max=1084.9k, avg=50648.11, stdev=55289.94 lat (usec): min=1011, max=1084.9k, avg=50660.18, stdev=55283.58 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1598], 10.00th=[ 2573], | 20.00th=[ 7046], 30.00th=[ 13566], 40.00th=[ 25297], | 50.00th=[ 38011], 60.00th=[ 51119], 70.00th=[ 64750], | 80.00th=[ 84411], 90.00th=[ 116917], 95.00th=[ 147850], | 99.00th=[ 219153], 99.50th=[ 242222], 99.90th=[ 329253], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 103, per=25.10%, avg=38.40, stdev=17.51, samples=315 iops : min= 1, max= 25, avg= 8.93, stdev= 4.43, samples=315 lat (usec) : 50=0.13%, 100=3.03%, 250=0.26%, 500=0.03% lat (msec) : 2=4.59%, 4=2.31%, 10=6.38%, 20=7.52%, 50=31.48% lat (msec) : 100=32.16%, 250=11.65%, 500=0.39%, 1000=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.93%, ctx=6816, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144475: Thu Aug 13 21:52:03 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(6052KiB/163938msec) clat (usec): min=37, max=451455, avg=54884.48, stdev=41203.35 lat (usec): min=37, max=451456, avg=54893.33, stdev=41203.72 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 14746], 20.00th=[ 26346], | 30.00th=[ 32637], 40.00th=[ 40109], 50.00th=[ 47973], 60.00th=[ 56361], | 70.00th=[ 65799], 80.00th=[ 79168], 90.00th=[100140], 95.00th=[126354], | 99.00th=[198181], 99.50th=[235930], 99.90th=[434111], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 101, per=25.40%, avg=37.08, stdev=17.62, samples=316 iops : min= 1, max= 25, avg= 8.60, stdev= 4.46, samples=316 write: IOPS=9, BW=38.0KiB/s (38.0kB/s)(6236KiB/163938msec); 0 zone resets clat (usec): min=979, max=939712, avg=51715.50, stdev=57542.06 lat (usec): min=981, max=939713, avg=51718.23, stdev=57541.93 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1598], 10.00th=[ 2409], 20.00th=[ 6521], | 30.00th=[ 11207], 40.00th=[ 22152], 50.00th=[ 36439], 60.00th=[ 51643], | 70.00th=[ 67634], 80.00th=[ 88605], 90.00th=[121111], 95.00th=[154141], | 99.00th=[225444], 99.50th=[265290], 99.90th=[522191], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 101, per=24.87%, avg=38.05, stdev=17.88, samples=317 iops : min= 1, max= 25, avg= 8.84, stdev= 4.52, samples=317 lat (usec) : 50=0.20%, 100=3.39%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.72%, 4=2.67%, 10=7.10%, 20=7.19%, 50=29.79% lat (msec) : 100=31.41%, 250=12.50%, 500=0.46%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.69%, ctx=6660, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=146KiB/s (150kB/s), 36.2KiB/s-36.9KiB/s (37.1kB/s-37.8kB/s), io=23.4MiB (24.6MB), run=162838-164028msec WRITE: bw=153KiB/s (157kB/s), 38.0KiB/s-38.7KiB/s (38.0kB/s-39.6kB/s), io=24.6MiB (25.7MB), run=162838-164028msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144467: Thu Aug 13 21:54:15 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(5992KiB/294005msec) clat (msec): min=6, max=1101, avg=41.31, stdev=57.29 lat (msec): min=6, max=1101, avg=41.31, stdev=57.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 55], 90.00th=[ 93], 95.00th=[ 130], | 99.00th=[ 251], 99.50th=[ 359], 99.90th=[ 535], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 96, per=29.80%, avg=24.14, stdev=17.33, samples=479 iops : min= 1, max= 24, avg= 5.40, stdev= 4.38, samples=479 write: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6296KiB/294005msec); 0 zone resets clat (msec): min=37, max=573, avg=147.19, stdev=84.25 lat (msec): min=37, max=573, avg=147.19, stdev=84.24 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 121], 60.00th=[ 140], | 70.00th=[ 165], 80.00th=[ 205], 90.00th=[ 271], 95.00th=[ 317], | 99.00th=[ 422], 99.50th=[ 493], 99.90th=[ 550], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 6, max= 56, per=25.71%, avg=21.59, stdev=11.68, samples=560 iops : min= 1, max= 14, avg= 4.76, stdev= 3.00, samples=560 lat (msec) : 10=3.16%, 20=17.15%, 50=18.52%, 100=23.99%, 250=30.37% lat (msec) : 500=6.45%, 750=0.33%, 2000=0.03% cpu : usr=0.05%, sys=1.37%, ctx=5344, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144468: Thu Aug 13 21:54:15 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(5940KiB/295018msec) clat (msec): min=5, max=1069, avg=41.62, stdev=53.50 lat (msec): min=5, max=1069, avg=41.62, stdev=53.50 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 61], 90.00th=[ 93], 95.00th=[ 131], | 99.00th=[ 245], 99.50th=[ 313], 99.90th=[ 414], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 87, per=29.63%, avg=24.00, stdev=16.40, samples=477 iops : min= 1, max= 21, avg= 5.37, stdev= 4.16, samples=477 write: IOPS=5, BW=21.5KiB/s (22.0kB/s)(6348KiB/295018msec); 0 zone resets clat (msec): min=34, max=863, avg=146.62, stdev=85.59 lat (msec): min=34, max=863, avg=146.62, stdev=85.59 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 167], 80.00th=[ 199], 90.00th=[ 262], 95.00th=[ 317], | 99.00th=[ 435], 99.50th=[ 542], 99.90th=[ 709], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 63, per=25.63%, avg=21.53, stdev=11.85, samples=566 iops : min= 1, max= 15, avg= 4.74, stdev= 3.04, samples=566 lat (msec) : 10=3.32%, 20=16.28%, 50=18.33%, 100=24.15%, 250=31.61% lat (msec) : 500=5.89%, 750=0.36%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.33%, ctx=5248, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144469: Thu Aug 13 21:54:15 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6028KiB/295992msec) clat (msec): min=5, max=535, avg=40.82, stdev=47.20 lat (msec): min=5, max=535, avg=40.82, stdev=47.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 56], 90.00th=[ 92], 95.00th=[ 134], | 99.00th=[ 236], 99.50th=[ 284], 99.90th=[ 493], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 6, max= 119, per=29.47%, avg=23.87, stdev=17.50, samples=487 iops : min= 1, max= 29, avg= 5.33, stdev= 4.44, samples=487 write: IOPS=5, BW=21.1KiB/s (21.7kB/s)(6260KiB/295992msec); 0 zone resets clat (msec): min=31, max=1332, avg=149.52, stdev=94.56 lat (msec): min=31, max=1332, avg=149.53, stdev=94.56 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 140], | 70.00th=[ 165], 80.00th=[ 205], 90.00th=[ 271], 95.00th=[ 334], | 99.00th=[ 468], 99.50th=[ 567], 99.90th=[ 776], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 63, per=25.68%, avg=21.57, stdev=11.85, samples=557 iops : min= 1, max= 15, avg= 4.76, stdev= 3.05, samples=557 lat (msec) : 10=2.96%, 20=17.68%, 50=17.74%, 100=24.09%, 250=30.60% lat (msec) : 500=6.48%, 750=0.39%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.35%, ctx=5170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144470: Thu Aug 13 21:54:15 2026 read: IOPS=5, BW=20.7KiB/s (21.2kB/s)(6052KiB/292403msec) clat (msec): min=5, max=360, avg=40.45, stdev=44.64 lat (msec): min=5, max=360, avg=40.45, stdev=44.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 57], 90.00th=[ 92], 95.00th=[ 136], | 99.00th=[ 232], 99.50th=[ 284], 99.90th=[ 351], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 6, max= 110, per=30.10%, avg=24.38, stdev=17.65, samples=479 iops : min= 1, max= 27, avg= 5.46, stdev= 4.47, samples=479 write: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6236KiB/292403msec); 0 zone resets clat (msec): min=29, max=1202, avg=148.01, stdev=90.61 lat (msec): min=29, max=1202, avg=148.01, stdev=90.61 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 122], 60.00th=[ 140], | 70.00th=[ 165], 80.00th=[ 205], 90.00th=[ 264], 95.00th=[ 317], | 99.00th=[ 456], 99.50th=[ 542], 99.90th=[ 852], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 71, per=25.45%, avg=21.38, stdev=11.83, samples=560 iops : min= 1, max= 17, avg= 4.70, stdev= 3.04, samples=560 lat (msec) : 10=2.18%, 20=17.55%, 50=18.91%, 100=23.80%, 250=31.05% lat (msec) : 500=6.18%, 750=0.26%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.39%, ctx=5283, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=81.1KiB/s (83.1kB/s), 20.1KiB/s-20.7KiB/s (20.6kB/s-21.2kB/s), io=23.4MiB (24.6MB), run=292403-295992msec WRITE: bw=84.9KiB/s (86.0kB/s), 21.1KiB/s-21.5KiB/s (21.7kB/s-22.0kB/s), io=24.6MiB (25.7MB), run=292403-295992msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144535: Thu Aug 13 21:55:01 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(5920KiB/36720msec) clat (usec): min=41, max=205721, avg=48120.33, stdev=37962.96 lat (usec): min=41, max=205722, avg=48122.24, stdev=37962.80 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 70], 10.00th=[ 78], 20.00th=[ 562], | 30.00th=[ 30016], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 53740], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 98042], 95.00th=[114820], | 99.00th=[173016], 99.50th=[200279], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 349, per=24.74%, avg=161.32, stdev=67.63, samples=72 iops : min= 1, max= 21, avg= 9.40, stdev= 4.28, samples=72 write: IOPS=10, BW=173KiB/s (178kB/s)(6368KiB/36720msec); 0 zone resets clat (usec): min=1592, max=398518, avg=46484.74, stdev=50564.80 lat (usec): min=1595, max=398522, avg=46487.58, stdev=50564.87 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2245], 10.00th=[ 3884], 20.00th=[ 8029], | 30.00th=[ 12518], 40.00th=[ 19530], 50.00th=[ 31065], 60.00th=[ 45351], | 70.00th=[ 58459], 80.00th=[ 77071], 90.00th=[105382], 95.00th=[132645], | 99.00th=[223347], 99.50th=[371196], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 31, max= 376, per=25.59%, avg=175.56, stdev=86.41, samples=71 iops : min= 1, max= 23, avg=10.30, stdev= 5.52, samples=71 lat (usec) : 50=0.52%, 100=7.03%, 250=1.56%, 500=0.39%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=1.17%, 4=4.30%, 10=7.29%, 20=9.90%, 50=27.86% lat (msec) : 100=29.04%, 250=10.16%, 500=0.26% cpu : usr=0.13%, sys=5.55%, ctx=1531, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144536: Thu Aug 13 21:55:01 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5744KiB/36241msec) clat (usec): min=46, max=208263, avg=51094.69, stdev=36701.15 lat (usec): min=48, max=208265, avg=51100.02, stdev=36698.41 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 22938], | 30.00th=[ 34866], 40.00th=[ 40109], 50.00th=[ 47449], 60.00th=[ 55313], | 70.00th=[ 65799], 80.00th=[ 79168], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[154141], 99.50th=[181404], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 29, max= 401, per=25.03%, avg=163.17, stdev=69.87, samples=69 iops : min= 1, max= 25, avg= 9.54, stdev= 4.49, samples=69 write: IOPS=11, BW=181KiB/s (185kB/s)(6544KiB/36241msec); 0 zone resets clat (usec): min=1826, max=344727, avg=42381.69, stdev=45185.81 lat (usec): min=1829, max=344730, avg=42391.48, stdev=45182.71 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2245], 10.00th=[ 3752], 20.00th=[ 8160], | 30.00th=[ 12518], 40.00th=[ 17695], 50.00th=[ 29492], 60.00th=[ 40109], | 70.00th=[ 53216], 80.00th=[ 67634], 90.00th=[ 99091], 95.00th=[131597], | 99.00th=[200279], 99.50th=[238027], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 384, per=26.61%, avg=182.56, stdev=75.77, samples=70 iops : min= 1, max= 24, avg=10.76, stdev= 4.86, samples=70 lat (usec) : 50=0.13%, 100=6.77%, 250=0.65%, 1000=0.13% lat (msec) : 2=1.43%, 4=4.56%, 10=7.29%, 20=11.20%, 50=28.39% lat (msec) : 100=29.95%, 250=9.24%, 500=0.26% cpu : usr=0.07%, sys=6.08%, ctx=1581, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144539: Thu Aug 13 21:55:01 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35721msec) clat (usec): min=40, max=264058, avg=53027.92, stdev=43302.32 lat (usec): min=41, max=264060, avg=53029.73, stdev=43302.35 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 19530], | 30.00th=[ 30802], 40.00th=[ 39584], 50.00th=[ 45351], 60.00th=[ 54789], | 70.00th=[ 65799], 80.00th=[ 83362], 90.00th=[109577], 95.00th=[130548], | 99.00th=[227541], 99.50th=[238027], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 372, per=26.85%, avg=175.04, stdev=77.46, samples=70 iops : min= 1, max= 23, avg=10.29, stdev= 4.88, samples=70 write: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35721msec); 0 zone resets clat (usec): min=1808, max=256640, avg=39316.10, stdev=43337.68 lat (usec): min=1809, max=256643, avg=39324.16, stdev=43336.25 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2278], 10.00th=[ 3785], 20.00th=[ 7111], | 30.00th=[ 10290], 40.00th=[ 15139], 50.00th=[ 23725], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 68682], 90.00th=[ 98042], 95.00th=[124257], | 99.00th=[204473], 99.50th=[250610], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 415, per=24.38%, avg=167.21, stdev=77.26, samples=70 iops : min= 1, max= 25, avg= 9.77, stdev= 4.92, samples=70 lat (usec) : 50=0.65%, 100=7.16%, 250=1.04%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.30%, 4=3.91%, 10=8.98%, 20=9.51%, 50=29.82% lat (msec) : 100=26.43%, 250=10.42%, 500=0.39% cpu : usr=0.10%, sys=5.69%, ctx=1622, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144540: Thu Aug 13 21:55:01 2026 read: IOPS=11, BW=176KiB/s (181kB/s)(6032KiB/34204msec) clat (usec): min=44, max=258073, avg=48858.63, stdev=37465.98 lat (usec): min=45, max=258075, avg=48871.60, stdev=37464.97 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 21627], | 30.00th=[ 30016], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 51119], | 70.00th=[ 61080], 80.00th=[ 77071], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[158335], 99.50th=[173016], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 63, max= 469, per=27.88%, avg=181.80, stdev=73.40, samples=65 iops : min= 3, max= 29, avg=10.71, stdev= 4.69, samples=65 write: IOPS=11, BW=183KiB/s (187kB/s)(6256KiB/34204msec); 0 zone resets clat (usec): min=1482, max=374640, avg=39018.77, stdev=48608.13 lat (usec): min=1484, max=374644, avg=39021.83, stdev=48608.13 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2507], 10.00th=[ 3785], 20.00th=[ 6325], | 30.00th=[ 8848], 40.00th=[ 14222], 50.00th=[ 19268], 60.00th=[ 32375], | 70.00th=[ 45876], 80.00th=[ 63177], 90.00th=[ 91751], 95.00th=[135267], | 99.00th=[265290], 99.50th=[304088], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 32, max= 404, per=27.11%, avg=185.98, stdev=77.22, samples=66 iops : min= 2, max= 25, avg=10.97, stdev= 4.85, samples=66 lat (usec) : 50=0.39%, 100=6.64%, 250=0.78%, 750=0.26%, 1000=0.26% lat (msec) : 2=1.56%, 4=4.30%, 10=11.98%, 20=8.98%, 50=30.47% lat (msec) : 100=24.87%, 250=8.85%, 500=0.65% cpu : usr=0.06%, sys=5.67%, ctx=1541, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=652KiB/s (668kB/s), 158KiB/s-176KiB/s (162kB/s-181kB/s), io=23.4MiB (24.5MB), run=34204-36720msec WRITE: bw=686KiB/s (703kB/s), 169KiB/s-183KiB/s (173kB/s-187kB/s), io=24.6MiB (25.8MB), run=34204-36720msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144533: Thu Aug 13 21:55:39 2026 read: IOPS=4, BW=79.3KiB/s (81.2kB/s)(5920KiB/74651msec) clat (msec): min=7, max=317, avg=43.56, stdev=42.96 lat (msec): min=8, max=317, avg=43.56, stdev=42.96 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 96], 95.00th=[ 133], | 99.00th=[ 222], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 29, max= 288, per=29.09%, avg=92.81, stdev=58.95, samples=125 iops : min= 1, max= 18, avg= 4.97, stdev= 3.73, samples=125 write: IOPS=5, BW=85.3KiB/s (87.3kB/s)(6368KiB/74651msec); 0 zone resets clat (msec): min=42, max=452, avg=146.15, stdev=75.76 lat (msec): min=42, max=452, avg=146.16, stdev=75.76 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 188], 90.00th=[ 255], 95.00th=[ 309], | 99.00th=[ 401], 99.50th=[ 418], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 30, max= 191, per=25.63%, avg=85.88, stdev=42.22, samples=145 iops : min= 1, max= 11, avg= 4.53, stdev= 2.72, samples=145 lat (msec) : 10=0.78%, 20=13.28%, 50=22.79%, 100=22.79%, 250=34.64% lat (msec) : 500=5.73% cpu : usr=0.04%, sys=1.48%, ctx=1362, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144534: Thu Aug 13 21:55:39 2026 read: IOPS=4, BW=76.5KiB/s (78.4kB/s)(5744KiB/75049msec) clat (msec): min=6, max=349, avg=43.74, stdev=44.79 lat (msec): min=6, max=349, avg=43.75, stdev=44.79 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 122], | 99.00th=[ 247], 99.50th=[ 313], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 319, per=27.83%, avg=88.77, stdev=57.85, samples=126 iops : min= 1, max= 19, avg= 4.73, stdev= 3.67, samples=126 write: IOPS=5, BW=87.2KiB/s (89.3kB/s)(6544KiB/75049msec); 0 zone resets clat (msec): min=34, max=542, avg=144.29, stdev=76.84 lat (msec): min=34, max=542, avg=144.29, stdev=76.84 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 112], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 234], 95.00th=[ 309], | 99.00th=[ 418], 99.50th=[ 472], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 29, max= 224, per=26.94%, avg=90.24, stdev=42.96, samples=142 iops : min= 1, max= 14, avg= 4.81, stdev= 2.77, samples=142 lat (msec) : 10=1.69%, 20=12.24%, 50=22.40%, 100=20.83%, 250=38.67% lat (msec) : 500=3.91%, 750=0.26% cpu : usr=0.05%, sys=1.44%, ctx=1332, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144537: Thu Aug 13 21:55:39 2026 read: IOPS=5, BW=84.7KiB/s (86.8kB/s)(6256KiB/73826msec) clat (msec): min=7, max=354, avg=43.69, stdev=46.85 lat (msec): min=7, max=354, avg=43.69, stdev=46.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 58], 90.00th=[ 95], 95.00th=[ 133], | 99.00th=[ 247], 99.50th=[ 309], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 318, per=29.98%, avg=95.64, stdev=69.44, samples=129 iops : min= 1, max= 19, avg= 5.15, stdev= 4.38, samples=129 write: IOPS=5, BW=81.7KiB/s (83.7kB/s)(6032KiB/73826msec); 0 zone resets clat (msec): min=38, max=453, avg=149.30, stdev=76.26 lat (msec): min=38, max=453, avg=149.31, stdev=76.25 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 105], 40.00th=[ 114], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 201], 90.00th=[ 257], 95.00th=[ 321], | 99.00th=[ 405], 99.50th=[ 430], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 31, max= 191, per=24.90%, avg=83.40, stdev=39.80, samples=141 iops : min= 1, max= 11, avg= 4.37, stdev= 2.55, samples=141 lat (msec) : 10=1.43%, 20=12.63%, 50=25.26%, 100=20.44%, 250=34.64% lat (msec) : 500=5.60% cpu : usr=0.05%, sys=1.50%, ctx=1419, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144538: Thu Aug 13 21:55:39 2026 read: IOPS=5, BW=81.1KiB/s (83.0kB/s)(6032KiB/74405msec) clat (msec): min=7, max=295, avg=43.14, stdev=45.73 lat (msec): min=7, max=295, avg=43.15, stdev=45.73 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 93], 95.00th=[ 155], | 99.00th=[ 224], 99.50th=[ 255], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 29, max= 286, per=29.52%, avg=94.17, stdev=65.18, samples=126 iops : min= 1, max= 17, avg= 5.06, stdev= 4.13, samples=126 write: IOPS=5, BW=84.1KiB/s (86.1kB/s)(6256KiB/74405msec); 0 zone resets clat (msec): min=33, max=475, avg=148.40, stdev=81.03 lat (msec): min=33, max=475, avg=148.40, stdev=81.03 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 100], 40.00th=[ 112], 50.00th=[ 127], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 199], 90.00th=[ 271], 95.00th=[ 317], | 99.00th=[ 418], 99.50th=[ 439], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 29, max= 190, per=25.74%, avg=86.23, stdev=41.79, samples=143 iops : min= 1, max= 11, avg= 4.55, stdev= 2.67, samples=143 lat (msec) : 10=1.43%, 20=14.32%, 50=23.05%, 100=21.48%, 250=32.81% lat (msec) : 500=6.90% cpu : usr=0.04%, sys=1.49%, ctx=1386, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=319KiB/s (327kB/s), 76.5KiB/s-84.7KiB/s (78.4kB/s-86.8kB/s), io=23.4MiB (24.5MB), run=73826-75049msec WRITE: bw=336KiB/s (344kB/s), 81.7KiB/s-87.2KiB/s (83.7kB/s-89.3kB/s), io=24.6MiB (25.8MB), run=73826-75049msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144558: Thu Aug 13 21:55:58 2026 read: IOPS=1, BW=1200KiB/s (1229kB/s)(7168KiB/5974msec) clat (usec): min=1710, max=3651.3k, avg=692516.17, stdev=1308759.69 lat (usec): min=1711, max=3651.3k, avg=692517.86, stdev=1308759.99 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1713], 10.00th=[ 1713], | 20.00th=[ 160433], 30.00th=[ 189793], 40.00th=[ 189793], | 50.00th=[ 248513], 60.00th=[ 274727], 70.00th=[ 274727], | 80.00th=[ 325059], 90.00th=[3640656], 95.00th=[3640656], | 99.00th=[3640656], 99.50th=[3640656], 99.90th=[3640656], | 99.95th=[3640656], 99.99th=[3640656] bw ( KiB/s): min= 2007, max= 4096, per=100.00%, avg=3047.50, stdev=1178.14, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=0, BW=857KiB/s (878kB/s)(5120KiB/5974msec); 0 zone resets clat (msec): min=108, max=333, avg=218.66, stdev=88.79 lat (msec): min=108, max=333, avg=218.77, stdev=88.76 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 2019, max= 3984, per=70.25%, avg=2524.75, stdev=972.93, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 2=8.33%, 250=50.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.56%, ctx=678, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144559: Thu Aug 13 21:55:58 2026 read: IOPS=0, BW=294KiB/s (301kB/s)(2048KiB/6959msec) clat (usec): min=482, max=270364, avg=135423.25, stdev=190835.70 lat (usec): min=483, max=270368, avg=135425.66, stdev=190837.63 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 482], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[ 482], 60.00th=[270533], | 70.00th=[270533], 80.00th=[270533], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 2035, max= 2035, per=79.28%, avg=2035.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1471KiB/s (1507kB/s)(10.0MiB/6959msec); 0 zone resets clat (msec): min=79, max=3489, avg=621.83, stdev=1071.75 lat (msec): min=79, max=3489, avg=621.91, stdev=1071.75 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 123], | 30.00th=[ 129], 40.00th=[ 178], 50.00th=[ 201], 60.00th=[ 213], | 70.00th=[ 236], 80.00th=[ 245], 90.00th=[ 1334], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 2035, max= 8126, per=100.00%, avg=4567.00, stdev=3035.84, samples=4 iops : min= 1, max= 7, avg= 3.75, stdev= 2.75, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.56%, ctx=111, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144560: Thu Aug 13 21:55:58 2026 read: IOPS=0, BW=984KiB/s (1008kB/s)(6144KiB/6243msec) clat (usec): min=542, max=283826, avg=163915.15, stdev=105715.84 lat (usec): min=544, max=283827, avg=163916.41, stdev=105715.48 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 81265], | 30.00th=[ 81265], 40.00th=[162530], 50.00th=[162530], 60.00th=[221250], | 70.00th=[231736], 80.00th=[231736], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 1992, max= 6059, per=100.00%, avg=3366.33, stdev=2332.09, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=0, BW=984KiB/s (1008kB/s)(6144KiB/6243msec); 0 zone resets clat (msec): min=108, max=3562, avg=848.77, stdev=1341.72 lat (msec): min=108, max=3562, avg=848.89, stdev=1341.72 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 288], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 1992, max= 2872, per=62.12%, avg=2232.75, stdev=426.78, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=5.94%, ctx=146, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144561: Thu Aug 13 21:55:58 2026 read: IOPS=0, BW=642KiB/s (657kB/s)(5120KiB/7976msec) clat (msec): min=3, max=390, avg=184.35, stdev=159.88 lat (msec): min=3, max=390, avg=184.35, stdev=159.88 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 4015, max= 4063, per=100.00%, avg=4039.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=899KiB/s (920kB/s)(7168KiB/7976msec); 0 zone resets clat (msec): min=136, max=3875, avg=962.55, stdev=1311.22 lat (msec): min=138, max=3876, avg=962.93, stdev=1311.02 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 215], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 527], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 869], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 1992, max= 6095, per=79.03%, avg=2840.20, stdev=1819.61, samples=5 iops : min= 1, max= 5, avg= 2.00, stdev= 1.73, samples=5 lat (msec) : 4=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.92%, ctx=167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2568KiB/s (2629kB/s), 294KiB/s-1200KiB/s (301kB/s-1229kB/s), io=20.0MiB (20.0MB), run=5974-7976msec WRITE: bw=3595KiB/s (3681kB/s), 857KiB/s-1471KiB/s (878kB/s-1507kB/s), io=28.0MiB (29.4MB), run=5974-7976msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144562: Thu Aug 13 21:55:59 2026 read: IOPS=0, BW=812KiB/s (831kB/s)(7168KiB/8829msec) clat (msec): min=88, max=3291, avg=984.16, stdev=1215.75 lat (msec): min=88, max=3291, avg=984.16, stdev=1215.75 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 106], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 401], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 2022], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 1996, max= 2043, per=87.04%, avg=2018.50, stdev=16.00, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=580KiB/s (594kB/s)(5120KiB/8829msec); 0 zone resets clat (msec): min=185, max=722, avg=318.14, stdev=226.88 lat (msec): min=185, max=722, avg=318.25, stdev=226.86 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1988, max= 4047, per=100.00%, avg=3358.00, stdev=1186.46, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.01%, sys=1.23%, ctx=58, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144563: Thu Aug 13 21:55:59 2026 read: IOPS=0, BW=242KiB/s (248kB/s)(2048KiB/8461msec) clat (msec): min=102, max=522, avg=312.18, stdev=297.18 lat (msec): min=102, max=522, avg=312.18, stdev=297.18 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1988, max= 2043, per=86.91%, avg=2015.50, stdev=38.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1210KiB/s (1239kB/s)(10.0MiB/8461msec); 0 zone resets clat (msec): min=176, max=4211, avg=765.43, stdev=1218.00 lat (msec): min=176, max=4211, avg=765.53, stdev=1217.99 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 266], | 30.00th=[ 300], 40.00th=[ 334], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 468], 80.00th=[ 550], 90.00th=[ 617], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 1988, max= 4047, per=82.74%, avg=2686.67, stdev=1053.83, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.06%, sys=2.03%, ctx=81, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144564: Thu Aug 13 21:55:59 2026 read: IOPS=0, BW=834KiB/s (854kB/s)(6144KiB/7364msec) clat (msec): min=65, max=412, avg=167.88, stdev=123.57 lat (msec): min=65, max=412, avg=167.88, stdev=123.57 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2007, max= 6071, per=100.00%, avg=3367.00, stdev=2341.75, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=834KiB/s (854kB/s)(6144KiB/7364msec); 0 zone resets clat (msec): min=193, max=4205, avg=1014.06, stdev=1571.41 lat (msec): min=194, max=4205, avg=1014.17, stdev=1571.42 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 542], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 4212], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 1988, max= 2043, per=62.24%, avg=2020.80, stdev=23.75, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.04%, sys=2.05%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144565: Thu Aug 13 21:55:59 2026 read: IOPS=0, BW=625KiB/s (640kB/s)(5120KiB/8190msec) clat (msec): min=94, max=652, avg=316.94, stdev=206.24 lat (msec): min=94, max=652, avg=316.94, stdev=206.24 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 4047, max= 4047, per=100.00%, avg=4047.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=875KiB/s (896kB/s)(7168KiB/8190msec); 0 zone resets clat (msec): min=268, max=3821, avg=925.56, stdev=1284.82 lat (msec): min=268, max=3821, avg=925.65, stdev=1284.81 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 296], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 451], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 693], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1996, max= 2043, per=62.11%, avg=2016.80, stdev=20.84, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=8.33%, 500=50.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=1.78%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2320KiB/s (2375kB/s), 242KiB/s-834KiB/s (248kB/s-854kB/s), io=20.0MiB (20.0MB), run=7364-8829msec WRITE: bw=3247KiB/s (3325kB/s), 580KiB/s-1210KiB/s (594kB/s-1239kB/s), io=28.0MiB (29.4MB), run=7364-8829msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144572: Thu Aug 13 21:56:15 2026 read: IOPS=0, BW=3524KiB/s (3609kB/s)(12.0MiB/3487msec) clat (msec): min=206, max=2709, avg=1135.28, stdev=1370.44 lat (msec): min=206, max=2709, avg=1135.29, stdev=1370.44 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 6574, max= 8175, per=100.00%, avg=7374.50, stdev=1132.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.70%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144573: Thu Aug 13 21:56:15 2026 read: IOPS=0, BW=1001KiB/s (1025kB/s)(4096KiB/4093msec) clat (nsec): min=679490k, max=679490k, avg=679490372.00, stdev= 0.00 lat (nsec): min=679493k, max=679493k, avg=679492766.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2001KiB/s (2050kB/s)(8192KiB/4093msec); 0 zone resets clat (msec): min=1643, max=1735, avg=1689.71, stdev=65.17 lat (msec): min=1647, max=1736, avg=1691.90, stdev=62.89 clat percentiles (msec): | 1.00th=[ 1636], 5.00th=[ 1636], 10.00th=[ 1636], 20.00th=[ 1636], | 30.00th=[ 1636], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.35%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144574: Thu Aug 13 21:56:15 2026 write: IOPS=0, BW=2797KiB/s (2864kB/s)(12.0MiB/4394msec); 0 zone resets clat (msec): min=801, max=1967, avg=1457.81, stdev=596.58 lat (msec): min=801, max=1982, avg=1464.47, stdev=603.42 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 7922, max= 8143, per=100.00%, avg=8032.50, stdev=156.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.01%, ctx=73, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144575: Thu Aug 13 21:56:15 2026 write: IOPS=1, BW=5278KiB/s (5405kB/s)(12.0MiB/2328msec); 0 zone resets clat (msec): min=532, max=987, avg=774.91, stdev=228.87 lat (msec): min=533, max=988, avg=775.58, stdev=229.05 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 5843, max= 8094, per=93.45%, avg=6968.50, stdev=1591.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.56%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4003KiB/s (4099kB/s), 1001KiB/s-3524KiB/s (1025kB/s-3609kB/s), io=16.0MiB (16.8MB), run=3487-4093msec WRITE: bw=7457KiB/s (7636kB/s), 2001KiB/s-5278KiB/s (2050kB/s-5405kB/s), io=32.0MiB (33.6MB), run=2328-4394msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144577: Thu Aug 13 21:56:15 2026 read: IOPS=1, BW=4590KiB/s (4700kB/s)(12.0MiB/2677msec) clat (msec): min=695, max=1020, avg=891.62, stdev=172.34 lat (msec): min=695, max=1020, avg=891.62, stdev=172.34 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.26%, ctx=264, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144578: Thu Aug 13 21:56:15 2026 read: IOPS=0, BW=1030KiB/s (1055kB/s)(4096KiB/3975msec) clat (nsec): min=791904k, max=791904k, avg=791903862.00, stdev= 0.00 lat (nsec): min=791907k, max=791907k, avg=791907359.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2061KiB/s (2110kB/s)(8192KiB/3975msec); 0 zone resets clat (msec): min=726, max=2447, avg=1586.90, stdev=1216.62 lat (msec): min=727, max=2447, avg=1587.36, stdev=1216.57 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 2433], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 7968, max= 7968, per=96.66%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.73%, ctx=279, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144579: Thu Aug 13 21:56:15 2026 write: IOPS=0, BW=3317KiB/s (3397kB/s)(12.0MiB/3704msec); 0 zone resets clat (msec): min=1075, max=1543, avg=1232.00, stdev=270.09 lat (msec): min=1076, max=1547, avg=1233.64, stdev=272.09 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8078, max= 8159, per=98.49%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.05%, sys=2.89%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144580: Thu Aug 13 21:56:15 2026 write: IOPS=1, BW=5107KiB/s (5230kB/s)(12.0MiB/2406msec); 0 zone resets clat (msec): min=481, max=984, avg=800.88, stdev=277.55 lat (msec): min=482, max=985, avg=801.38, stdev=277.51 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8078, max= 8175, per=98.59%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.94%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4122KiB/s (4221kB/s), 1030KiB/s-4590KiB/s (1055kB/s-4700kB/s), io=16.0MiB (16.8MB), run=2677-3975msec WRITE: bw=8244KiB/s (8441kB/s), 2061KiB/s-5107KiB/s (2110kB/s-5230kB/s), io=32.0MiB (33.6MB), run=2406-3975msec