== sanity test 398b: DIO and buffer IO race ============== 08:45:54 (1786020354) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.0374 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143453: Thu Aug 6 08:49:23 2026 read: IOPS=8, BW=32.4KiB/s (33.2kB/s)(5992KiB/184664msec) clat (usec): min=27, max=3080.8k, avg=62199.24, stdev=99168.60 lat (usec): min=27, max=3080.8k, avg=62200.34, stdev=99168.60 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 453], | 20.00th=[ 25035], 30.00th=[ 34341], 40.00th=[ 42206], | 50.00th=[ 50594], 60.00th=[ 60031], 70.00th=[ 72877], | 80.00th=[ 88605], 90.00th=[ 110625], 95.00th=[ 139461], | 99.00th=[ 261096], 99.50th=[ 295699], 99.90th=[1501561], | 99.95th=[3070231], 99.99th=[3070231] bw ( KiB/s): min= 4, max= 79, per=26.21%, avg=33.82, stdev=15.91, samples=342 iops : min= 1, max= 19, avg= 7.80, stdev= 4.01, samples=342 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6296KiB/184664msec); 0 zone resets clat (usec): min=891, max=1600.9k, avg=57705.73, stdev=74815.02 lat (usec): min=891, max=1600.9k, avg=57712.05, stdev=74812.31 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1205], 10.00th=[ 1336], | 20.00th=[ 5211], 30.00th=[ 11469], 40.00th=[ 24773], | 50.00th=[ 41681], 60.00th=[ 55837], 70.00th=[ 73925], | 80.00th=[ 95945], 90.00th=[ 132645], 95.00th=[ 164627], | 99.00th=[ 270533], 99.50th=[ 341836], 99.90th=[ 801113], | 99.95th=[1602225], 99.99th=[1602225] bw ( KiB/s): min= 7, max= 111, per=26.32%, avg=35.54, stdev=17.38, samples=342 iops : min= 1, max= 27, avg= 8.22, stdev= 4.38, samples=342 lat (usec) : 50=1.63%, 100=3.09%, 250=0.13%, 500=0.03%, 1000=0.07% lat (msec) : 2=6.84%, 4=1.89%, 10=5.73%, 20=6.71%, 50=26.53% lat (msec) : 100=30.86%, 250=15.36%, 500=0.88%, 750=0.13%, 1000=0.03% lat (msec) : 2000=0.07%, >=2000=0.03% cpu : usr=0.05%, sys=3.24%, ctx=5892, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143454: Thu Aug 6 08:49:23 2026 read: IOPS=8, BW=32.2KiB/s (32.9kB/s)(5940KiB/184735msec) clat (usec): min=27, max=3045.6k, avg=62644.22, stdev=107818.77 lat (usec): min=27, max=3045.6k, avg=62646.23, stdev=107818.30 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 523], | 20.00th=[ 25822], 30.00th=[ 34341], 40.00th=[ 41157], | 50.00th=[ 49546], 60.00th=[ 59507], 70.00th=[ 71828], | 80.00th=[ 86508], 90.00th=[ 109577], 95.00th=[ 131597], | 99.00th=[ 248513], 99.50th=[ 337642], 99.90th=[1619002], | 99.95th=[3036677], 99.99th=[3036677] bw ( KiB/s): min= 4, max= 86, per=25.97%, avg=33.50, stdev=16.89, samples=342 iops : min= 1, max= 21, avg= 7.71, stdev= 4.25, samples=342 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6348KiB/184735msec); 0 zone resets clat (usec): min=872, max=982823, avg=57439.29, stdev=65808.44 lat (usec): min=873, max=982825, avg=57440.59, stdev=65808.53 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1287], 20.00th=[ 5014], | 30.00th=[ 11207], 40.00th=[ 25297], 50.00th=[ 41681], 60.00th=[ 55313], | 70.00th=[ 74974], 80.00th=[ 95945], 90.00th=[137364], 95.00th=[175113], | 99.00th=[270533], 99.50th=[367002], 99.90th=[429917], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 102, per=26.21%, avg=35.38, stdev=17.82, samples=346 iops : min= 1, max= 25, avg= 8.18, stdev= 4.50, samples=346 lat (usec) : 50=1.73%, 100=2.96%, 250=0.07%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=7.65%, 4=1.53%, 10=5.53%, 20=5.99%, 50=27.47% lat (msec) : 100=30.63%, 250=14.88%, 500=1.07%, 750=0.03%, 1000=0.07% lat (msec) : 2000=0.07%, >=2000=0.03% cpu : usr=0.04%, sys=2.91%, ctx=5870, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143455: Thu Aug 6 08:49:23 2026 read: IOPS=8, BW=32.9KiB/s (33.7kB/s)(6028KiB/183159msec) clat (usec): min=26, max=2944.8k, avg=62943.03, stdev=94909.16 lat (usec): min=26, max=2944.8k, avg=62944.90, stdev=94909.15 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 12387], | 20.00th=[ 26870], 30.00th=[ 34341], 40.00th=[ 42730], | 50.00th=[ 51119], 60.00th=[ 60556], 70.00th=[ 71828], | 80.00th=[ 87557], 90.00th=[ 114820], 95.00th=[ 141558], | 99.00th=[ 267387], 99.50th=[ 375391], 99.90th=[1199571], | 99.95th=[2936013], 99.99th=[2936013] bw ( KiB/s): min= 7, max= 84, per=26.66%, avg=34.40, stdev=16.83, samples=338 iops : min= 1, max= 21, avg= 7.94, stdev= 4.25, samples=338 write: IOPS=8, BW=34.2KiB/s (34.0kB/s)(6260KiB/183159msec); 0 zone resets clat (usec): min=894, max=1583.9k, avg=56077.24, stdev=78330.60 lat (usec): min=895, max=1583.9k, avg=56078.67, stdev=78330.58 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1303], | 20.00th=[ 4817], 30.00th=[ 10028], 40.00th=[ 20579], | 50.00th=[ 39584], 60.00th=[ 54264], 70.00th=[ 70779], | 80.00th=[ 94897], 90.00th=[ 131597], 95.00th=[ 160433], | 99.00th=[ 287310], 99.50th=[ 333448], 99.90th=[1061159], | 99.95th=[1585447], 99.99th=[1585447] bw ( KiB/s): min= 4, max= 87, per=26.31%, avg=35.51, stdev=17.03, samples=340 iops : min= 1, max= 21, avg= 8.22, stdev= 4.29, samples=340 lat (usec) : 50=1.76%, 100=2.67%, 250=0.03%, 750=0.03%, 1000=0.16% lat (msec) : 2=7.26%, 4=2.12%, 10=5.96%, 20=7.06%, 50=26.07% lat (msec) : 100=30.50%, 250=15.14%, 500=0.94%, 750=0.10%, 1000=0.07% lat (msec) : 2000=0.10%, >=2000=0.03% cpu : usr=0.04%, sys=3.11%, ctx=5854, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143457: Thu Aug 6 08:49:23 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6052KiB/185261msec) clat (usec): min=32, max=2962.2k, avg=62943.54, stdev=97036.16 lat (usec): min=33, max=2962.2k, avg=62952.20, stdev=97031.71 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 13698], | 20.00th=[ 25822], 30.00th=[ 34341], 40.00th=[ 41681], | 50.00th=[ 50070], 60.00th=[ 60031], 70.00th=[ 71828], | 80.00th=[ 86508], 90.00th=[ 110625], 95.00th=[ 139461], | 99.00th=[ 250610], 99.50th=[ 375391], 99.90th=[1052771], | 99.95th=[2969568], 99.99th=[2969568] bw ( KiB/s): min= 7, max= 120, per=26.42%, avg=34.08, stdev=16.53, samples=342 iops : min= 1, max= 30, avg= 7.86, stdev= 4.16, samples=342 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6236KiB/185261msec); 0 zone resets clat (usec): min=938, max=1404.7k, avg=57396.97, stdev=72983.14 lat (usec): min=939, max=1404.8k, avg=57405.86, stdev=72981.80 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1303], | 20.00th=[ 4490], 30.00th=[ 10159], 40.00th=[ 23987], | 50.00th=[ 40109], 60.00th=[ 56361], 70.00th=[ 76022], | 80.00th=[ 96994], 90.00th=[ 133694], 95.00th=[ 166724], | 99.00th=[ 283116], 99.50th=[ 371196], 99.90th=[ 834667], | 99.95th=[1400898], 99.99th=[1400898] bw ( KiB/s): min= 7, max= 87, per=25.64%, avg=34.62, stdev=16.85, samples=347 iops : min= 1, max= 21, avg= 7.99, stdev= 4.25, samples=347 lat (usec) : 50=1.73%, 100=2.21%, 250=0.10%, 750=0.03%, 1000=0.10% lat (msec) : 2=7.32%, 4=2.15%, 10=5.79%, 20=6.58%, 50=27.31% lat (msec) : 100=30.44%, 250=14.97%, 500=0.98%, 750=0.13%, 1000=0.07% lat (msec) : 2000=0.07%, >=2000=0.03% cpu : usr=0.04%, sys=3.12%, ctx=5792, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=130KiB/s (133kB/s), 32.2KiB/s-32.9KiB/s (32.9kB/s-33.7kB/s), io=23.4MiB (24.6MB), run=183159-185261msec WRITE: bw=136KiB/s (139kB/s), 33.7KiB/s-34.4KiB/s (34.5kB/s-35.2kB/s), io=24.6MiB (25.7MB), run=183159-185261msec fio: pid=143456, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=143456: Thu Aug 6 08:53:07 2026 read: IOPS=3, BW=13.6KiB/s (13.9kB/s)(4408KiB/324190msec) clat (msec): min=5, max=1513, avg=62.06, stdev=76.61 lat (msec): min=5, max=1513, avg=62.06, stdev=76.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 87], 90.00th=[ 124], 95.00th=[ 167], | 99.00th=[ 330], 99.50th=[ 477], 99.90th=[ 676], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7, max= 71, per=32.42%, avg=17.51, stdev=11.41, samples=478 iops : min= 1, max= 17, avg= 3.72, stdev= 2.89, samples=478 write: IOPS=3, BW=14.3KiB/s (14.6kB/s)(4624KiB/324190msec); 0 zone resets clat (msec): min=38, max=3197, avg=220.74, stdev=145.55 lat (msec): min=38, max=3197, avg=220.75, stdev=145.55 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 95], 10.00th=[ 110], 20.00th=[ 140], | 30.00th=[ 161], 40.00th=[ 182], 50.00th=[ 199], 60.00th=[ 220], | 70.00th=[ 247], 80.00th=[ 275], 90.00th=[ 342], 95.00th=[ 401], | 99.00th=[ 634], 99.50th=[ 718], 99.90th=[ 1972], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 7, max= 39, per=25.51%, avg=14.54, stdev= 6.94, samples=597 iops : min= 1, max= 9, avg= 2.97, stdev= 1.78, samples=597 lat (msec) : 10=0.80%, 20=7.66%, 50=20.05%, 100=16.42%, 250=39.40% lat (msec) : 500=14.34%, 750=1.02%, 1000=0.04%, 2000=0.18%, >=2000=0.04% cpu : usr=0.02%, sys=0.76%, ctx=3602, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1103,1156,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143458: Thu Aug 6 08:53:07 2026 read: IOPS=3, BW=14.5KiB/s (14.9kB/s)(5940KiB/408746msec) clat (msec): min=5, max=1597, avg=56.67, stdev=81.62 lat (msec): min=5, max=1597, avg=56.67, stdev=81.62 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 47], | 70.00th=[ 59], 80.00th=[ 75], 90.00th=[ 113], 95.00th=[ 150], | 99.00th=[ 288], 99.50th=[ 418], 99.90th=[ 1452], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7, max= 79, per=34.67%, avg=18.72, stdev=13.05, samples=605 iops : min= 1, max= 19, avg= 4.04, stdev= 3.29, samples=605 write: IOPS=3, BW=15.5KiB/s (15.9kB/s)(6348KiB/408746msec); 0 zone resets clat (msec): min=32, max=3520, avg=204.22, stdev=136.22 lat (msec): min=32, max=3520, avg=204.23, stdev=136.22 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 86], 10.00th=[ 103], 20.00th=[ 125], | 30.00th=[ 142], 40.00th=[ 161], 50.00th=[ 184], 60.00th=[ 207], | 70.00th=[ 230], 80.00th=[ 264], 90.00th=[ 326], 95.00th=[ 384], | 99.00th=[ 550], 99.50th=[ 667], 99.90th=[ 1401], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1, max= 47, per=28.13%, avg=16.03, stdev= 7.49, samples=749 iops : min= 0, max= 11, avg= 3.36, stdev= 1.93, samples=749 lat (msec) : 10=2.18%, 20=8.24%, 50=20.51%, 100=16.02%, 250=40.40% lat (msec) : 500=11.72%, 750=0.62%, 1000=0.10%, 2000=0.20%, >=2000=0.03% cpu : usr=0.02%, sys=0.89%, ctx=5554, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143459: Thu Aug 6 08:53:07 2026 read: IOPS=3, BW=14.9KiB/s (15.2kB/s)(6028KiB/405030msec) clat (msec): min=4, max=499, avg=54.40, stdev=50.60 lat (msec): min=4, max=499, avg=54.40, stdev=50.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 78], 90.00th=[ 111], 95.00th=[ 148], | 99.00th=[ 253], 99.50th=[ 326], 99.90th=[ 456], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 96, per=34.69%, avg=18.73, stdev=13.25, samples=613 iops : min= 1, max= 24, avg= 4.04, stdev= 3.35, samples=613 write: IOPS=3, BW=15.5KiB/s (15.8kB/s)(6260KiB/405030msec); 0 zone resets clat (msec): min=41, max=3632, avg=206.15, stdev=146.81 lat (msec): min=41, max=3632, avg=206.15, stdev=146.81 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 88], 10.00th=[ 102], 20.00th=[ 123], | 30.00th=[ 142], 40.00th=[ 161], 50.00th=[ 182], 60.00th=[ 207], | 70.00th=[ 230], 80.00th=[ 271], 90.00th=[ 326], 95.00th=[ 372], | 99.00th=[ 531], 99.50th=[ 827], 99.90th=[ 1770], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1, max= 47, per=27.74%, avg=15.81, stdev= 7.35, samples=749 iops : min= 0, max= 11, avg= 3.30, stdev= 1.90, samples=749 lat (msec) : 10=1.66%, 20=7.65%, 50=21.45%, 100=17.25%, 250=38.61% lat (msec) : 500=12.76%, 750=0.33%, 1000=0.10%, 2000=0.16%, >=2000=0.03% cpu : usr=0.02%, sys=0.84%, ctx=5277, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143460: Thu Aug 6 08:53:07 2026 read: IOPS=3, BW=14.0KiB/s (15.3kB/s)(6052KiB/404368msec) clat (msec): min=4, max=3089, avg=59.76, stdev=114.66 lat (msec): min=4, max=3089, avg=59.76, stdev=114.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 78], 90.00th=[ 115], 95.00th=[ 161], | 99.00th=[ 305], 99.50th=[ 435], 99.90th=[ 1838], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 6, max= 112, per=35.29%, avg=19.06, stdev=13.16, samples=606 iops : min= 1, max= 28, avg= 4.12, stdev= 3.33, samples=606 write: IOPS=3, BW=15.4KiB/s (15.8kB/s)(6236KiB/404368msec); 0 zone resets clat (msec): min=32, max=1370, avg=200.99, stdev=102.21 lat (msec): min=32, max=1370, avg=201.00, stdev=102.21 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 84], 10.00th=[ 101], 20.00th=[ 125], | 30.00th=[ 142], 40.00th=[ 163], 50.00th=[ 182], 60.00th=[ 205], | 70.00th=[ 228], 80.00th=[ 266], 90.00th=[ 326], 95.00th=[ 380], | 99.00th=[ 531], 99.50th=[ 676], 99.90th=[ 1053], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1, max= 55, per=27.87%, avg=15.89, stdev= 7.49, samples=742 iops : min= 0, max= 13, avg= 3.32, stdev= 1.92, samples=742 lat (msec) : 10=1.40%, 20=8.40%, 50=21.91%, 100=16.24%, 250=39.45% lat (msec) : 500=11.78%, 750=0.52%, 1000=0.13%, 2000=0.13%, >=2000=0.03% cpu : usr=0.02%, sys=0.87%, ctx=5577, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=54.9KiB/s (56.2kB/s), 13.6KiB/s-14.0KiB/s (13.9kB/s-15.3kB/s), io=21.9MiB (22.0MB), run=324190-408746msec WRITE: bw=57.4KiB/s (58.8kB/s), 14.3KiB/s-15.5KiB/s (14.6kB/s-15.9kB/s), io=22.9MiB (24.0MB), run=324190-408746msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143544: Thu Aug 6 08:54:02 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(5920KiB/36752msec) clat (usec): min=33, max=355420, avg=49645.87, stdev=43866.03 lat (usec): min=33, max=355420, avg=49646.87, stdev=43866.17 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 55], 20.00th=[ 76], | 30.00th=[ 27657], 40.00th=[ 36963], 50.00th=[ 44303], 60.00th=[ 55313], | 70.00th=[ 65274], 80.00th=[ 80217], 90.00th=[101188], 95.00th=[121111], | 99.00th=[191890], 99.50th=[242222], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 413, per=25.59%, avg=160.99, stdev=79.36, samples=72 iops : min= 1, max= 25, avg= 9.28, stdev= 5.05, samples=72 write: IOPS=10, BW=173KiB/s (177kB/s)(6368KiB/36752msec); 0 zone resets clat (usec): min=1416, max=517675, avg=45640.61, stdev=55357.60 lat (usec): min=1417, max=517676, avg=45642.22, stdev=55357.58 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1713], 10.00th=[ 1876], 20.00th=[ 5932], | 30.00th=[ 9634], 40.00th=[ 14746], 50.00th=[ 22676], 60.00th=[ 39584], | 70.00th=[ 60556], 80.00th=[ 80217], 90.00th=[121111], 95.00th=[149947], | 99.00th=[258999], 99.50th=[304088], 99.90th=[517997], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 30, max= 341, per=26.47%, avg=175.23, stdev=68.55, samples=71 iops : min= 1, max= 21, avg=10.20, stdev= 4.37, samples=71 lat (usec) : 50=2.47%, 100=7.55%, 250=0.65%, 500=0.26%, 750=0.26% lat (msec) : 2=5.60%, 4=2.34%, 10=8.59%, 20=9.24%, 50=23.18% lat (msec) : 100=27.34%, 250=11.85%, 500=0.52%, 750=0.13% cpu : usr=0.06%, sys=3.41%, ctx=1232, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143545: Thu Aug 6 08:54:02 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(5744KiB/38033msec) clat (usec): min=38, max=235202, avg=51780.02, stdev=45100.61 lat (usec): min=38, max=235203, avg=51781.14, stdev=45100.80 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 51], 10.00th=[ 54], 20.00th=[ 63], | 30.00th=[ 24249], 40.00th=[ 38011], 50.00th=[ 46400], 60.00th=[ 56886], | 70.00th=[ 69731], 80.00th=[ 89654], 90.00th=[113771], 95.00th=[133694], | 99.00th=[185598], 99.50th=[225444], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 29, max= 318, per=24.77%, avg=155.83, stdev=70.81, samples=71 iops : min= 1, max= 19, avg= 8.97, stdev= 4.53, samples=71 write: IOPS=10, BW=172KiB/s (176kB/s)(6544KiB/38033msec); 0 zone resets clat (usec): min=1283, max=461618, avg=46555.91, stdev=57156.81 lat (usec): min=1285, max=461620, avg=46557.52, stdev=57156.83 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 2311], 20.00th=[ 5932], | 30.00th=[ 9503], 40.00th=[ 14877], 50.00th=[ 25297], 60.00th=[ 40109], | 70.00th=[ 57410], 80.00th=[ 82314], 90.00th=[121111], 95.00th=[145753], | 99.00th=[270533], 99.50th=[341836], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 30, max= 507, per=25.82%, avg=170.93, stdev=90.50, samples=74 iops : min= 1, max= 31, avg= 9.89, stdev= 5.73, samples=74 lat (usec) : 50=1.95%, 100=9.64%, 250=0.52% lat (msec) : 2=5.08%, 4=2.47%, 10=10.03%, 20=7.55%, 50=22.53% lat (msec) : 100=27.34%, 250=12.24%, 500=0.65% cpu : usr=0.04%, sys=3.27%, ctx=1275, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143546: Thu Aug 6 08:54:02 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36834msec) clat (usec): min=33, max=179235, avg=48402.37, stdev=39132.73 lat (usec): min=33, max=179235, avg=48403.34, stdev=39132.74 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 63], | 30.00th=[ 24773], 40.00th=[ 39584], 50.00th=[ 47449], 60.00th=[ 57410], | 70.00th=[ 68682], 80.00th=[ 79168], 90.00th=[100140], 95.00th=[120062], | 99.00th=[147850], 99.50th=[170918], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 29, max= 375, per=27.32%, avg=171.85, stdev=77.47, samples=71 iops : min= 1, max= 23, avg= 9.96, stdev= 4.92, samples=71 write: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36834msec); 0 zone resets clat (usec): min=1399, max=260414, avg=46370.60, stdev=51608.47 lat (usec): min=1401, max=260415, avg=46372.22, stdev=51608.40 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1762], 10.00th=[ 1958], 20.00th=[ 6390], | 30.00th=[ 8979], 40.00th=[ 14222], 50.00th=[ 24249], 60.00th=[ 40633], | 70.00th=[ 61604], 80.00th=[ 84411], 90.00th=[123208], 95.00th=[154141], | 99.00th=[227541], 99.50th=[233833], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 349, per=24.69%, avg=163.44, stdev=79.31, samples=71 iops : min= 1, max= 21, avg= 9.42, stdev= 4.99, samples=71 lat (usec) : 50=2.99%, 100=9.51%, 250=0.65%, 750=0.13% lat (msec) : 2=5.08%, 4=1.82%, 10=8.85%, 20=8.20%, 50=20.96% lat (msec) : 100=29.17%, 250=12.50%, 500=0.13% cpu : usr=0.04%, sys=3.47%, ctx=1229, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143547: Thu Aug 6 08:54:02 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6032KiB/36654msec) clat (usec): min=25, max=227602, avg=49887.44, stdev=42285.87 lat (usec): min=25, max=227603, avg=49888.64, stdev=42285.51 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 46], 10.00th=[ 54], 20.00th=[ 61], | 30.00th=[ 26608], 40.00th=[ 40633], 50.00th=[ 48497], 60.00th=[ 56886], | 70.00th=[ 66323], 80.00th=[ 81265], 90.00th=[104334], 95.00th=[125305], | 99.00th=[193987], 99.50th=[210764], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 29, max= 412, per=26.66%, avg=167.67, stdev=71.94, samples=69 iops : min= 1, max= 25, avg= 9.71, stdev= 4.55, samples=69 write: IOPS=10, BW=171KiB/s (175kB/s)(6256KiB/36654msec); 0 zone resets clat (usec): min=1348, max=506384, avg=44793.01, stdev=54386.46 lat (usec): min=1350, max=506386, avg=44796.53, stdev=54385.51 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1663], 10.00th=[ 1876], 20.00th=[ 5473], | 30.00th=[ 8979], 40.00th=[ 14091], 50.00th=[ 23200], 60.00th=[ 39584], | 70.00th=[ 53740], 80.00th=[ 82314], 90.00th=[110625], 95.00th=[145753], | 99.00th=[225444], 99.50th=[295699], 99.90th=[505414], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 29, max= 345, per=26.06%, avg=172.49, stdev=70.66, samples=70 iops : min= 1, max= 21, avg=10.01, stdev= 4.51, samples=70 lat (usec) : 50=3.12%, 100=9.77%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.60%, 4=2.21%, 10=8.85%, 20=8.20%, 50=22.40% lat (msec) : 100=27.47%, 250=11.85%, 500=0.13%, 750=0.13% cpu : usr=0.05%, sys=3.36%, ctx=1232, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=630KiB/s (645kB/s), 151KiB/s-170KiB/s (155kB/s-174kB/s), io=23.4MiB (24.5MB), run=36654-38033msec WRITE: bw=663KiB/s (678kB/s), 164KiB/s-173KiB/s (168kB/s-177kB/s), io=24.6MiB (25.8MB), run=36654-38033msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143540: Thu Aug 6 08:54:51 2026 read: IOPS=4, BW=69.2KiB/s (70.9kB/s)(5920KiB/85535msec) clat (msec): min=6, max=354, avg=48.71, stdev=51.84 lat (msec): min=6, max=354, avg=48.71, stdev=51.84 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 106], 95.00th=[ 155], | 99.00th=[ 279], 99.50th=[ 347], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 287, per=30.17%, avg=82.67, stdev=49.36, samples=141 iops : min= 1, max= 17, avg= 4.38, stdev= 3.11, samples=141 write: IOPS=4, BW=74.4KiB/s (76.2kB/s)(6368KiB/85535msec); 0 zone resets clat (msec): min=56, max=463, avg=168.77, stdev=72.47 lat (msec): min=56, max=463, avg=168.77, stdev=72.47 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 82], 10.00th=[ 95], 20.00th=[ 111], | 30.00th=[ 126], 40.00th=[ 140], 50.00th=[ 153], 60.00th=[ 171], | 70.00th=[ 190], 80.00th=[ 218], 90.00th=[ 271], 95.00th=[ 313], | 99.00th=[ 430], 99.50th=[ 439], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 160, per=26.39%, avg=76.27, stdev=31.62, samples=164 iops : min= 1, max= 10, avg= 3.96, stdev= 2.05, samples=164 lat (msec) : 10=1.04%, 20=11.20%, 50=23.57%, 100=13.93%, 250=42.71% lat (msec) : 500=7.55% cpu : usr=0.02%, sys=1.01%, ctx=1274, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143541: Thu Aug 6 08:54:51 2026 read: IOPS=4, BW=66.4KiB/s (67.0kB/s)(5744KiB/86548msec) clat (msec): min=6, max=435, avg=46.09, stdev=48.41 lat (msec): min=6, max=435, avg=46.09, stdev=48.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 60], 90.00th=[ 94], 95.00th=[ 132], | 99.00th=[ 257], 99.50th=[ 284], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 316, per=29.91%, avg=81.94, stdev=57.35, samples=138 iops : min= 1, max= 19, avg= 4.35, stdev= 3.61, samples=138 write: IOPS=4, BW=75.6KiB/s (77.4kB/s)(6544KiB/86548msec); 0 zone resets clat (msec): min=43, max=654, avg=171.02, stdev=76.86 lat (msec): min=43, max=654, avg=171.02, stdev=76.86 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 78], 10.00th=[ 93], 20.00th=[ 113], | 30.00th=[ 128], 40.00th=[ 140], 50.00th=[ 157], 60.00th=[ 174], | 70.00th=[ 194], 80.00th=[ 218], 90.00th=[ 271], 95.00th=[ 321], | 99.00th=[ 405], 99.50th=[ 485], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 30, max= 192, per=26.62%, avg=76.94, stdev=32.94, samples=167 iops : min= 1, max= 12, avg= 4.01, stdev= 2.12, samples=167 lat (msec) : 10=1.69%, 20=9.24%, 50=24.09%, 100=14.84%, 250=42.97% lat (msec) : 500=6.90%, 750=0.26% cpu : usr=0.03%, sys=1.00%, ctx=1281, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143542: Thu Aug 6 08:54:51 2026 read: IOPS=4, BW=73.5KiB/s (75.3kB/s)(6256KiB/85071msec) clat (msec): min=6, max=308, avg=45.53, stdev=46.09 lat (msec): min=6, max=308, avg=45.53, stdev=46.09 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 100], 95.00th=[ 133], | 99.00th=[ 257], 99.50th=[ 284], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 318, per=31.46%, avg=86.19, stdev=58.75, samples=143 iops : min= 1, max= 19, avg= 4.60, stdev= 3.73, samples=143 write: IOPS=4, BW=70.9KiB/s (72.6kB/s)(6032KiB/85071msec); 0 zone resets clat (msec): min=52, max=659, avg=177.82, stdev=82.92 lat (msec): min=52, max=659, avg=177.82, stdev=82.92 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 89], 10.00th=[ 99], 20.00th=[ 112], | 30.00th=[ 128], 40.00th=[ 142], 50.00th=[ 161], 60.00th=[ 176], | 70.00th=[ 197], 80.00th=[ 232], 90.00th=[ 279], 95.00th=[ 334], | 99.00th=[ 489], 99.50th=[ 567], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 30, max= 160, per=24.97%, avg=72.17, stdev=30.22, samples=164 iops : min= 1, max= 10, avg= 3.71, stdev= 1.97, samples=164 lat (msec) : 10=1.30%, 20=12.11%, 50=24.61%, 100=13.54%, 250=40.10% lat (msec) : 500=7.94%, 750=0.39% cpu : usr=0.02%, sys=1.00%, ctx=1254, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143543: Thu Aug 6 08:54:51 2026 read: IOPS=4, BW=69.2KiB/s (70.9kB/s)(6032KiB/87164msec) clat (msec): min=5, max=505, avg=49.81, stdev=57.39 lat (msec): min=5, max=505, avg=49.82, stdev=57.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 108], 95.00th=[ 159], | 99.00th=[ 305], 99.50th=[ 418], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 30, max= 288, per=30.20%, avg=82.74, stdev=55.50, samples=142 iops : min= 1, max= 18, avg= 4.39, stdev= 3.52, samples=142 write: IOPS=4, BW=71.8KiB/s (73.5kB/s)(6256KiB/87164msec); 0 zone resets clat (msec): min=41, max=450, avg=173.91, stdev=70.69 lat (msec): min=41, max=450, avg=173.91, stdev=70.69 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 80], 10.00th=[ 97], 20.00th=[ 117], | 30.00th=[ 132], 40.00th=[ 146], 50.00th=[ 161], 60.00th=[ 178], | 70.00th=[ 199], 80.00th=[ 226], 90.00th=[ 266], 95.00th=[ 317], | 99.00th=[ 397], 99.50th=[ 443], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 30, max= 192, per=25.54%, avg=73.81, stdev=31.37, samples=166 iops : min= 1, max= 12, avg= 3.80, stdev= 2.03, samples=166 lat (msec) : 10=0.91%, 20=12.37%, 50=22.53%, 100=13.67%, 250=42.32% lat (msec) : 500=8.07%, 750=0.13% cpu : usr=0.01%, sys=0.93%, ctx=1212, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=275KiB/s (281kB/s), 66.4KiB/s-73.5KiB/s (67.0kB/s-75.3kB/s), io=23.4MiB (24.5MB), run=85071-87164msec WRITE: bw=289KiB/s (296kB/s), 70.9KiB/s-75.6KiB/s (72.6kB/s-77.4kB/s), io=24.6MiB (25.8MB), run=85071-87164msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143566: Thu Aug 6 08:55:07 2026 read: IOPS=1, BW=2029KiB/s (2078kB/s)(7168KiB/3533msec) clat (msec): min=194, max=495, avg=318.47, stdev=112.16 lat (msec): min=194, max=495, avg=318.47, stdev=112.16 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 201], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 296], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 401], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1882, max= 3357, per=55.62%, avg=2272.20, stdev=610.32, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1449KiB/s (1484kB/s)(5120KiB/3533msec); 0 zone resets clat (msec): min=103, max=546, avg=251.79, stdev=181.64 lat (msec): min=103, max=546, avg=251.84, stdev=181.64 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1882, max= 6107, per=58.29%, avg=3333.33, stdev=2402.93, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=13.76%, ctx=205, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143568: Thu Aug 6 08:55:07 2026 read: IOPS=0, BW=409KiB/s (418kB/s)(2048KiB/5013msec) clat (msec): min=341, max=685, avg=513.54, stdev=243.69 lat (msec): min=341, max=685, avg=513.54, stdev=243.69 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2031, max= 2039, per=49.82%, avg=2035.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2043KiB/s (2092kB/s)(10.0MiB/5013msec); 0 zone resets clat (msec): min=132, max=735, avg=370.79, stdev=172.25 lat (msec): min=132, max=735, avg=371.24, stdev=172.44 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 249], | 30.00th=[ 268], 40.00th=[ 275], 50.00th=[ 305], 60.00th=[ 321], | 70.00th=[ 451], 80.00th=[ 460], 90.00th=[ 514], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1882, max= 4096, per=52.86%, avg=3023.00, stdev=1141.10, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 250=16.67%, 500=58.33%, 750=25.00% cpu : usr=0.00%, sys=9.32%, ctx=138, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143569: Thu Aug 6 08:55:07 2026 read: IOPS=1, BW=1631KiB/s (1670kB/s)(6144KiB/3767msec) clat (usec): min=450, max=499082, avg=184208.31, stdev=184087.90 lat (usec): min=451, max=499083, avg=184209.21, stdev=184087.93 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 461], | 30.00th=[ 461], 40.00th=[177210], 50.00th=[177210], 60.00th=[191890], | 70.00th=[235930], 80.00th=[235930], 90.00th=[497026], 95.00th=[497026], | 99.00th=[497026], 99.50th=[497026], 99.90th=[497026], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 2048, max= 4071, per=82.76%, avg=3380.67, stdev=1154.37, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1631KiB/s (1670kB/s)(6144KiB/3767msec); 0 zone resets clat (msec): min=227, max=751, avg=414.99, stdev=235.52 lat (msec): min=227, max=751, avg=415.05, stdev=235.53 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 355], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1610, max= 2048, per=33.87%, avg=1936.83, stdev=171.46, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 500=16.67% lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.11%, sys=10.73%, ctx=164, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143571: Thu Aug 6 08:55:07 2026 read: IOPS=1, BW=1113KiB/s (1140kB/s)(5120KiB/4599msec) clat (usec): min=357, max=335277, avg=80905.40, stdev=145020.90 lat (usec): min=358, max=335277, avg=80906.25, stdev=145020.86 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 469], 40.00th=[ 469], 50.00th=[ 1811], 60.00th=[ 1811], | 70.00th=[ 66847], 80.00th=[ 66847], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2031, max= 6071, per=99.17%, avg=4051.00, stdev=2856.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1559KiB/s (1596kB/s)(7168KiB/4599msec); 0 zone resets clat (msec): min=201, max=1653, avg=577.91, stdev=519.00 lat (msec): min=201, max=1653, avg=577.97, stdev=519.00 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 236], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 338], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 818], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 2011, max= 2048, per=35.50%, avg=2030.40, stdev=14.28, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=16.67% lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.85%, ctx=177, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4085KiB/s (4183kB/s), 409KiB/s-2029KiB/s (418kB/s-2078kB/s), io=20.0MiB (20.0MB), run=3533-5013msec WRITE: bw=5720KiB/s (5857kB/s), 1449KiB/s-2043KiB/s (1484kB/s-2092kB/s), io=28.0MiB (29.4MB), run=3533-5013msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143567: Thu Aug 6 08:55:08 2026 read: IOPS=1, BW=1613KiB/s (1652kB/s)(7168KiB/4443msec) clat (msec): min=109, max=582, avg=273.73, stdev=179.02 lat (msec): min=109, max=582, avg=273.73, stdev=179.02 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 126], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 190], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 430], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1738, max= 4055, per=65.52%, avg=2343.00, stdev=962.74, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1152KiB/s (1180kB/s)(5120KiB/4443msec); 0 zone resets clat (msec): min=267, max=632, avg=470.65, stdev=131.48 lat (msec): min=267, max=632, avg=470.90, stdev=131.32 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1889, max= 2039, per=39.41%, avg=1973.25, stdev=66.37, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=33.33%, 500=41.67%, 750=25.00% cpu : usr=0.02%, sys=3.06%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143570: Thu Aug 6 08:55:08 2026 read: IOPS=0, BW=366KiB/s (374kB/s)(2048KiB/5601msec) clat (msec): min=137, max=700, avg=419.04, stdev=398.17 lat (msec): min=137, max=700, avg=419.04, stdev=398.17 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1954, max= 1957, per=54.68%, avg=1955.50, stdev= 2.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1828KiB/s (1872kB/s)(10.0MiB/5601msec); 0 zone resets clat (msec): min=197, max=1233, avg=443.92, stdev=302.74 lat (msec): min=197, max=1233, avg=443.98, stdev=302.74 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 262], | 30.00th=[ 284], 40.00th=[ 305], 50.00th=[ 317], 60.00th=[ 326], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 617], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1889, max= 4079, per=53.01%, avg=2654.33, stdev=1054.17, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=16.67%, 500=58.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.59%, ctx=97, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143572: Thu Aug 6 08:55:08 2026 read: IOPS=1, BW=1221KiB/s (1251kB/s)(6144KiB/5030msec) clat (msec): min=88, max=405, avg=184.53, stdev=123.48 lat (msec): min=88, max=405, avg=184.54, stdev=123.48 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 138], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1889, max= 3908, per=68.98%, avg=2466.75, stdev=963.30, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1221KiB/s (1251kB/s)(6144KiB/5030msec); 0 zone resets clat (msec): min=185, max=1729, avg=603.29, stdev=561.27 lat (msec): min=186, max=1729, avg=603.67, stdev=561.16 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 426], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1889, max= 2039, per=39.65%, avg=1985.40, stdev=62.66, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 2000=8.33% cpu : usr=0.00%, sys=3.46%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143573: Thu Aug 6 08:55:08 2026 read: IOPS=0, BW=894KiB/s (916kB/s)(5120KiB/5726msec) clat (msec): min=59, max=563, avg=255.84, stdev=198.06 lat (msec): min=59, max=563, avg=255.84, stdev=198.06 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1954, max= 3778, per=72.36%, avg=2587.67, stdev=1031.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1252KiB/s (1282kB/s)(7168KiB/5726msec); 0 zone resets clat (msec): min=207, max=1516, avg=623.55, stdev=435.32 lat (msec): min=207, max=1516, avg=623.65, stdev=435.29 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 296], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 617], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 684], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1957, max= 4079, per=50.11%, avg=2509.00, stdev=1047.10, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=33.33%, 2000=8.33% cpu : usr=0.07%, sys=2.83%, ctx=80, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3577KiB/s (3663kB/s), 366KiB/s-1613KiB/s (374kB/s-1652kB/s), io=20.0MiB (20.0MB), run=4443-5726msec WRITE: bw=5007KiB/s (5128kB/s), 1152KiB/s-1828KiB/s (1180kB/s-1872kB/s), io=28.0MiB (29.4MB), run=4443-5726msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143584: Thu Aug 6 08:55:26 2026 read: IOPS=0, BW=3520KiB/s (3604kB/s)(12.0MiB/3491msec) clat (msec): min=931, max=1242, avg=1109.90, stdev=160.58 lat (msec): min=931, max=1242, avg=1109.90, stdev=160.58 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7684, max= 8159, per=100.00%, avg=7921.50, stdev=335.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.74%, ctx=213, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143585: Thu Aug 6 08:55:26 2026 read: IOPS=0, BW=859KiB/s (880kB/s)(4096KiB/4767msec) clat (nsec): min=1067.1M, max=1067.1M, avg=1067126425.00, stdev= 0.00 lat (nsec): min=1067.1M, max=1067.1M, avg=1067128727.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1718KiB/s (1760kB/s)(8192KiB/4767msec); 0 zone resets clat (msec): min=894, max=2397, avg=1646.22, stdev=1063.02 lat (msec): min=894, max=2408, avg=1651.78, stdev=1070.52 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.78%, ctx=101, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143587: Thu Aug 6 08:55:26 2026 write: IOPS=1, BW=6589KiB/s (6747kB/s)(12.0MiB/1865msec); 0 zone resets clat (msec): min=479, max=654, avg=576.05, stdev=88.72 lat (msec): min=480, max=654, avg=576.33, stdev=88.69 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 6253, max= 7846, per=100.00%, avg=7049.50, stdev=1126.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.27%, sys=4.72%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143589: Thu Aug 6 08:55:26 2026 write: IOPS=0, BW=2693KiB/s (2758kB/s)(12.0MiB/4563msec); 0 zone resets clat (msec): min=474, max=2996, avg=1443.70, stdev=1358.66 lat (msec): min=475, max=2996, avg=1443.96, stdev=1358.66 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 7876, max= 8159, per=100.00%, avg=8017.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.08%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3437KiB/s (3519kB/s), 859KiB/s-3520KiB/s (880kB/s-3604kB/s), io=16.0MiB (16.8MB), run=3491-4767msec WRITE: bw=6874KiB/s (7039kB/s), 1718KiB/s-6589KiB/s (1760kB/s-6747kB/s), io=32.0MiB (33.6MB), run=1865-4767msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143582: Thu Aug 6 08:55:27 2026 read: IOPS=0, BW=3184KiB/s (3261kB/s)(12.0MiB/3859msec) clat (msec): min=934, max=1507, avg=1233.73, stdev=287.34 lat (msec): min=934, max=1507, avg=1233.73, stdev=287.34 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.08%, sys=3.60%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143583: Thu Aug 6 08:55:27 2026 read: IOPS=0, BW=722KiB/s (739kB/s)(4096KiB/5675msec) clat (nsec): min=1668.4M, max=1668.4M, avg=1668430889.00, stdev= 0.00 lat (nsec): min=1668.4M, max=1668.4M, avg=1668433295.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1670], 5.00th=[ 1670], 10.00th=[ 1670], 20.00th=[ 1670], | 30.00th=[ 1670], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1444KiB/s (1478kB/s)(8192KiB/5675msec); 0 zone resets clat (msec): min=895, max=2882, avg=1888.87, stdev=1405.25 lat (msec): min=895, max=2882, avg=1889.06, stdev=1405.17 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 2869], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.62%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143586: Thu Aug 6 08:55:27 2026 write: IOPS=0, BW=2171KiB/s (2224kB/s)(12.0MiB/5659msec); 0 zone resets clat (msec): min=777, max=2559, avg=1818.83, stdev=928.19 lat (msec): min=778, max=2561, avg=1819.58, stdev=928.75 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 2123], 50.00th=[ 2123], 60.00th=[ 2123], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 7984, max= 8192, per=100.00%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=3.16%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143588: Thu Aug 6 08:55:27 2026 write: IOPS=1, BW=4400KiB/s (4505kB/s)(12.0MiB/2793msec); 0 zone resets clat (msec): min=466, max=1245, avg=893.49, stdev=394.95 lat (msec): min=466, max=1248, avg=894.67, stdev=396.13 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 6206, max= 8159, per=100.00%, avg=7182.50, stdev=1380.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.37%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2887KiB/s (2956kB/s), 722KiB/s-3184KiB/s (739kB/s-3261kB/s), io=16.0MiB (16.8MB), run=3859-5675msec WRITE: bw=5774KiB/s (5913kB/s), 1444KiB/s-4400KiB/s (1478kB/s-4505kB/s), io=32.0MiB (33.6MB), run=2793-5675msec