== sanity test 398b: DIO and buffer IO race ============== 10:11:41 (1782223901) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.59291 s, 6.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143285: Tue Jun 23 10:14:45 2026 read: IOPS=9, BW=37.7KiB/s (38.7kB/s)(5992KiB/158749msec) clat (usec): min=37, max=1094.4k, avg=52983.95, stdev=48096.09 lat (usec): min=37, max=1094.4k, avg=52985.70, stdev=48096.22 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 371], | 20.00th=[ 22938], 30.00th=[ 30016], 40.00th=[ 36963], | 50.00th=[ 43779], 60.00th=[ 53740], 70.00th=[ 66323], | 80.00th=[ 81265], 90.00th=[ 102237], 95.00th=[ 121111], | 99.00th=[ 196084], 99.50th=[ 217056], 99.90th=[ 429917], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 95, per=24.93%, avg=37.39, stdev=16.89, samples=309 iops : min= 1, max= 23, avg= 8.68, stdev= 4.25, samples=309 write: IOPS=9, BW=39.7KiB/s (40.6kB/s)(6296KiB/158749msec); 0 zone resets clat (usec): min=931, max=452477, avg=50065.31, stdev=51352.30 lat (usec): min=933, max=452477, avg=50069.49, stdev=51351.89 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1614], 10.00th=[ 2057], 20.00th=[ 5932], | 30.00th=[ 10421], 40.00th=[ 22414], 50.00th=[ 38536], 60.00th=[ 52167], | 70.00th=[ 66323], 80.00th=[ 83362], 90.00th=[114820], 95.00th=[149947], | 99.00th=[229639], 99.50th=[261096], 99.90th=[392168], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 142, per=25.31%, avg=39.74, stdev=18.42, samples=306 iops : min= 1, max= 35, avg= 9.27, stdev= 4.63, samples=306 lat (usec) : 50=0.33%, 100=4.07%, 250=0.29%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.01%, 4=3.22%, 10=7.03%, 20=7.13%, 50=30.34% lat (msec) : 100=30.27%, 250=11.56%, 500=0.46%, 2000=0.03% cpu : usr=0.07%, sys=4.87%, ctx=6607, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143287: Tue Jun 23 10:14:45 2026 read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(5940KiB/158666msec) clat (usec): min=32, max=335176, avg=50612.83, stdev=37622.52 lat (usec): min=33, max=335177, avg=50615.73, stdev=37622.33 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 245], 20.00th=[ 23725], | 30.00th=[ 30802], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 51643], | 70.00th=[ 61080], 80.00th=[ 77071], 90.00th=[ 99091], 95.00th=[117965], | 99.00th=[164627], 99.50th=[193987], 99.90th=[295699], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 6, max= 109, per=25.07%, avg=37.61, stdev=16.46, samples=305 iops : min= 1, max= 27, avg= 8.73, stdev= 4.15, samples=305 write: IOPS=10, BW=40.0KiB/s (40.0kB/s)(6348KiB/158666msec); 0 zone resets clat (usec): min=862, max=1052.0k, avg=52219.69, stdev=59383.17 lat (usec): min=863, max=1052.0k, avg=52230.40, stdev=59395.19 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1680], 10.00th=[ 2245], | 20.00th=[ 5735], 30.00th=[ 11469], 40.00th=[ 23725], | 50.00th=[ 38011], 60.00th=[ 52691], 70.00th=[ 67634], | 80.00th=[ 90702], 90.00th=[ 122160], 95.00th=[ 149947], | 99.00th=[ 240124], 99.50th=[ 274727], 99.90th=[ 557843], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 6, max= 118, per=25.26%, avg=39.65, stdev=18.66, samples=309 iops : min= 1, max= 29, avg= 9.25, stdev= 4.71, samples=309 lat (usec) : 50=0.33%, 100=4.00%, 250=0.59%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.23%, 4=3.78%, 10=6.54%, 20=7.55%, 50=31.32% lat (msec) : 100=28.61%, 250=12.21%, 500=0.46%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=4.76%, ctx=6696, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143289: Tue Jun 23 10:14:45 2026 read: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6028KiB/156904msec) clat (usec): min=36, max=489843, avg=50009.81, stdev=37894.97 lat (usec): min=36, max=489844, avg=50013.43, stdev=37893.60 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 265], 20.00th=[ 23725], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 42730], 60.00th=[ 51119], | 70.00th=[ 62653], 80.00th=[ 74974], 90.00th=[ 96994], 95.00th=[114820], | 99.00th=[152044], 99.50th=[185598], 99.90th=[362808], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 7, max= 87, per=25.57%, avg=38.35, stdev=18.77, samples=305 iops : min= 1, max= 21, avg= 8.91, stdev= 4.72, samples=305 write: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6260KiB/156904msec); 0 zone resets clat (usec): min=1045, max=1069.9k, avg=51720.62, stdev=60869.10 lat (usec): min=1046, max=1069.9k, avg=51723.85, stdev=60869.29 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1614], 10.00th=[ 2114], | 20.00th=[ 5604], 30.00th=[ 10683], 40.00th=[ 21627], | 50.00th=[ 36963], 60.00th=[ 52167], 70.00th=[ 68682], | 80.00th=[ 87557], 90.00th=[ 116917], 95.00th=[ 154141], | 99.00th=[ 246416], 99.50th=[ 316670], 99.90th=[ 497026], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 92, per=25.25%, avg=39.65, stdev=17.36, samples=306 iops : min= 1, max= 23, avg= 9.25, stdev= 4.39, samples=306 lat (usec) : 50=0.55%, 100=4.00%, 250=0.29%, 500=0.49%, 750=0.07% lat (msec) : 2=4.79%, 4=3.68%, 10=6.41%, 20=7.36%, 50=31.05% lat (msec) : 100=29.33%, 250=11.33%, 500=0.62%, 2000=0.03% cpu : usr=0.07%, sys=4.90%, ctx=6605, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143291: Tue Jun 23 10:14:45 2026 read: IOPS=9, BW=38.0KiB/s (38.9kB/s)(6052KiB/159230msec) clat (usec): min=26, max=1134.3k, avg=50945.63, stdev=47118.32 lat (usec): min=26, max=1134.3k, avg=50951.48, stdev=47116.14 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 74], | 20.00th=[ 23725], 30.00th=[ 29492], 40.00th=[ 36439], | 50.00th=[ 42730], 60.00th=[ 51119], 70.00th=[ 62129], | 80.00th=[ 78119], 90.00th=[ 100140], 95.00th=[ 120062], | 99.00th=[ 164627], 99.50th=[ 183501], 99.90th=[ 350225], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 6, max= 103, per=25.81%, avg=38.72, stdev=18.84, samples=303 iops : min= 1, max= 25, avg= 9.01, stdev= 4.75, samples=303 write: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6236KiB/159230msec); 0 zone resets clat (usec): min=965, max=534020, avg=52344.53, stdev=56521.00 lat (usec): min=966, max=534021, avg=52349.75, stdev=56520.01 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1565], 10.00th=[ 2147], 20.00th=[ 5866], | 30.00th=[ 11076], 40.00th=[ 23200], 50.00th=[ 37487], 60.00th=[ 53740], | 70.00th=[ 68682], 80.00th=[ 90702], 90.00th=[121111], 95.00th=[152044], | 99.00th=[225444], 99.50th=[278922], 99.90th=[501220], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 7, max= 102, per=24.80%, avg=38.93, stdev=16.66, samples=310 iops : min= 1, max= 25, avg= 9.07, stdev= 4.20, samples=310 lat (usec) : 50=1.01%, 100=4.52%, 250=0.23%, 500=0.23%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.82%, 4=2.73%, 10=6.77%, 20=7.23%, 50=30.83% lat (msec) : 100=28.45%, 250=12.53%, 500=0.42%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=4.72%, ctx=6550, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=151KiB/s (154kB/s), 37.4KiB/s-38.4KiB/s (38.3kB/s-39.3kB/s), io=23.4MiB (24.6MB), run=156904-159230msec WRITE: bw=158KiB/s (162kB/s), 39.2KiB/s-40.0KiB/s (40.1kB/s-40.0kB/s), io=24.6MiB (25.7MB), run=156904-159230msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143284: Tue Jun 23 10:17:43 2026 read: IOPS=4, BW=17.8KiB/s (18.2kB/s)(5992KiB/336601msec) clat (msec): min=6, max=1140, avg=45.73, stdev=49.79 lat (msec): min=6, max=1140, avg=45.73, stdev=49.79 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 129], | 99.00th=[ 211], 99.50th=[ 284], 99.90th=[ 405], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 79, per=29.93%, avg=21.25, stdev=13.99, samples=541 iops : min= 1, max= 19, avg= 4.66, stdev= 3.54, samples=541 write: IOPS=4, BW=18.7KiB/s (19.2kB/s)(6296KiB/336601msec); 0 zone resets clat (msec): min=40, max=672, avg=169.96, stdev=82.54 lat (msec): min=40, max=672, avg=169.97, stdev=82.54 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 87], 20.00th=[ 104], | 30.00th=[ 120], 40.00th=[ 136], 50.00th=[ 150], 60.00th=[ 171], | 70.00th=[ 192], 80.00th=[ 228], 90.00th=[ 275], 95.00th=[ 330], | 99.00th=[ 468], 99.50th=[ 489], 99.90th=[ 592], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 48, per=25.09%, avg=18.56, stdev= 8.89, samples=647 iops : min= 1, max= 12, avg= 3.98, stdev= 2.27, samples=647 lat (msec) : 10=0.68%, 20=11.30%, 50=23.21%, 100=18.95%, 250=37.63% lat (msec) : 500=7.98%, 750=0.23%, 2000=0.03% cpu : usr=0.04%, sys=1.29%, ctx=5352, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143286: Tue Jun 23 10:17:43 2026 read: IOPS=4, BW=17.7KiB/s (18.1kB/s)(5940KiB/336303msec) clat (msec): min=6, max=1144, avg=45.85, stdev=54.46 lat (msec): min=6, max=1144, avg=45.86, stdev=54.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 60], 90.00th=[ 96], 95.00th=[ 126], | 99.00th=[ 239], 99.50th=[ 305], 99.90th=[ 518], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 95, per=29.69%, avg=21.08, stdev=14.38, samples=540 iops : min= 1, max= 23, avg= 4.62, stdev= 3.62, samples=540 write: IOPS=4, BW=18.9KiB/s (19.3kB/s)(6348KiB/336303msec); 0 zone resets clat (msec): min=36, max=621, avg=168.69, stdev=79.50 lat (msec): min=36, max=621, avg=168.69, stdev=79.50 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 88], 20.00th=[ 104], | 30.00th=[ 118], 40.00th=[ 133], 50.00th=[ 153], 60.00th=[ 167], | 70.00th=[ 192], 80.00th=[ 228], 90.00th=[ 279], 95.00th=[ 326], | 99.00th=[ 418], 99.50th=[ 477], 99.90th=[ 535], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 47, per=25.32%, avg=18.74, stdev= 8.75, samples=646 iops : min= 1, max= 11, avg= 4.03, stdev= 2.24, samples=646 lat (msec) : 10=1.33%, 20=11.10%, 50=23.31%, 100=17.02%, 250=39.65% lat (msec) : 500=7.36%, 750=0.20%, 2000=0.03% cpu : usr=0.04%, sys=1.23%, ctx=5388, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143288: Tue Jun 23 10:17:43 2026 read: IOPS=4, BW=17.0KiB/s (18.4kB/s)(6028KiB/335183msec) clat (msec): min=5, max=378, avg=46.35, stdev=40.91 lat (msec): min=5, max=378, avg=46.35, stdev=40.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 100], 95.00th=[ 132], | 99.00th=[ 188], 99.50th=[ 232], 99.90th=[ 376], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 103, per=29.24%, avg=20.76, stdev=14.90, samples=556 iops : min= 1, max= 25, avg= 4.54, stdev= 3.77, samples=556 write: IOPS=4, BW=18.7KiB/s (19.1kB/s)(6260KiB/335183msec); 0 zone resets clat (msec): min=51, max=1351, avg=169.18, stdev=86.86 lat (msec): min=51, max=1351, avg=169.19, stdev=86.85 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 77], 10.00th=[ 87], 20.00th=[ 103], | 30.00th=[ 118], 40.00th=[ 132], 50.00th=[ 148], 60.00th=[ 167], | 70.00th=[ 192], 80.00th=[ 228], 90.00th=[ 275], 95.00th=[ 330], | 99.00th=[ 451], 99.50th=[ 472], 99.90th=[ 760], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 47, per=25.05%, avg=18.54, stdev= 8.91, samples=644 iops : min= 1, max= 11, avg= 3.98, stdev= 2.29, samples=644 lat (msec) : 10=1.50%, 20=10.94%, 50=21.84%, 100=19.50%, 250=38.80% lat (msec) : 500=7.23%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=5477, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143290: Tue Jun 23 10:17:43 2026 read: IOPS=4, BW=18.1KiB/s (18.6kB/s)(6052KiB/333596msec) clat (msec): min=6, max=483, avg=44.76, stdev=43.58 lat (msec): min=6, max=483, avg=44.76, stdev=43.57 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 92], 95.00th=[ 124], | 99.00th=[ 211], 99.50th=[ 268], 99.90th=[ 380], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 103, per=30.79%, avg=21.86, stdev=15.05, samples=532 iops : min= 1, max= 25, avg= 4.82, stdev= 3.80, samples=532 write: IOPS=4, BW=18.7KiB/s (19.1kB/s)(6236KiB/333596msec); 0 zone resets clat (msec): min=42, max=1334, avg=170.18, stdev=87.92 lat (msec): min=42, max=1334, avg=170.19, stdev=87.92 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 87], 20.00th=[ 104], | 30.00th=[ 120], 40.00th=[ 133], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 192], 80.00th=[ 226], 90.00th=[ 279], 95.00th=[ 330], | 99.00th=[ 439], 99.50th=[ 558], 99.90th=[ 751], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 47, per=25.28%, avg=18.71, stdev= 8.65, samples=636 iops : min= 1, max= 11, avg= 4.02, stdev= 2.21, samples=636 lat (msec) : 10=1.37%, 20=11.69%, 50=23.05%, 100=18.03%, 250=37.96% lat (msec) : 500=7.52%, 750=0.33%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5357, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=71.3KiB/s (73.0kB/s), 17.7KiB/s-18.1KiB/s (18.1kB/s-18.6kB/s), io=23.4MiB (24.6MB), run=333596-336601msec WRITE: bw=74.7KiB/s (76.5kB/s), 18.7KiB/s-18.9KiB/s (19.1kB/s-19.3kB/s), io=24.6MiB (25.7MB), run=333596-336601msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143350: Tue Jun 23 10:18:26 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5920KiB/29601msec) clat (usec): min=37, max=391611, avg=43167.79, stdev=36183.86 lat (usec): min=37, max=391612, avg=43187.98, stdev=36186.35 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 1270], | 30.00th=[ 26608], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 46400], | 70.00th=[ 56361], 80.00th=[ 65274], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[121111], 99.50th=[160433], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 31, max= 378, per=25.84%, avg=197.42, stdev=63.68, samples=57 iops : min= 1, max= 23, avg=11.60, stdev= 4.07, samples=57 write: IOPS=13, BW=215KiB/s (220kB/s)(6368KiB/29601msec); 0 zone resets clat (usec): min=1710, max=182862, avg=33652.52, stdev=34274.03 lat (usec): min=1713, max=182865, avg=33663.61, stdev=34267.60 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2376], 10.00th=[ 3294], 20.00th=[ 6456], | 30.00th=[ 9241], 40.00th=[ 12518], 50.00th=[ 19530], 60.00th=[ 28705], | 70.00th=[ 40633], 80.00th=[ 62129], 90.00th=[ 88605], 95.00th=[105382], | 99.00th=[141558], 99.50th=[166724], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 62, max= 380, per=26.82%, avg=215.67, stdev=80.01, samples=57 iops : min= 3, max= 23, avg=12.74, stdev= 5.04, samples=57 lat (usec) : 50=1.43%, 100=6.38%, 250=0.78%, 500=0.78%, 1000=0.13% lat (msec) : 2=1.17%, 4=5.73%, 10=10.94%, 20=9.77%, 50=32.29% lat (msec) : 100=25.13%, 250=5.34%, 500=0.13% cpu : usr=0.06%, sys=5.61%, ctx=1456, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143351: Tue Jun 23 10:18:26 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(5744KiB/31343msec) clat (usec): min=44, max=237134, avg=48309.15, stdev=36880.15 lat (usec): min=44, max=237135, avg=48312.85, stdev=36881.01 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 21890], | 30.00th=[ 31065], 40.00th=[ 36963], 50.00th=[ 41681], 60.00th=[ 50594], | 70.00th=[ 62129], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[107480], | 99.00th=[175113], 99.50th=[223347], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 313, per=23.90%, avg=182.59, stdev=65.32, samples=61 iops : min= 1, max= 19, avg=10.66, stdev= 4.14, samples=61 write: IOPS=13, BW=209KiB/s (214kB/s)(6544KiB/31343msec); 0 zone resets clat (usec): min=1716, max=198567, avg=33686.85, stdev=33222.60 lat (usec): min=1717, max=198570, avg=33692.72, stdev=33220.15 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 21], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 83], 95.00th=[ 102], | 99.00th=[ 136], 99.50th=[ 153], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 62, max= 379, per=25.91%, avg=208.34, stdev=68.85, samples=61 iops : min= 3, max= 23, avg=12.30, stdev= 4.38, samples=61 lat (usec) : 50=0.52%, 100=6.51%, 250=0.26%, 500=0.13% lat (msec) : 2=0.39%, 4=4.30%, 10=13.02%, 20=9.90%, 50=32.16% lat (msec) : 100=26.82%, 250=5.99% cpu : usr=0.06%, sys=5.63%, ctx=1564, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143352: Tue Jun 23 10:18:26 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29796msec) clat (usec): min=41, max=134090, avg=40518.42, stdev=28683.91 lat (usec): min=41, max=134091, avg=40519.63, stdev=28683.99 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 9765], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[117965], 99.50th=[128451], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 60, max= 383, per=27.62%, avg=210.98, stdev=73.10, samples=58 iops : min= 3, max= 23, avg=12.45, stdev= 4.67, samples=58 write: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29796msec); 0 zone resets clat (usec): min=1535, max=279067, avg=36737.57, stdev=36927.37 lat (usec): min=1538, max=279070, avg=36739.68, stdev=36927.38 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2376], 10.00th=[ 3785], 20.00th=[ 7111], | 30.00th=[ 10028], 40.00th=[ 15926], 50.00th=[ 23725], 60.00th=[ 35390], | 70.00th=[ 48497], 80.00th=[ 63177], 90.00th=[ 84411], 95.00th=[100140], | 99.00th=[154141], 99.50th=[231736], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 476, per=25.02%, avg=201.12, stdev=84.25, samples=58 iops : min= 1, max= 29, avg=11.83, stdev= 5.37, samples=58 lat (usec) : 50=0.91%, 100=7.16%, 250=0.78%, 500=0.78%, 750=0.13% lat (msec) : 2=0.78%, 4=4.82%, 10=9.64%, 20=7.94%, 50=34.77% lat (msec) : 100=28.13%, 250=4.04%, 500=0.13% cpu : usr=0.06%, sys=5.98%, ctx=1555, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143353: Tue Jun 23 10:18:26 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30448msec) clat (usec): min=37, max=273983, avg=41618.11, stdev=34350.79 lat (usec): min=37, max=273984, avg=41619.24, stdev=34350.79 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 65], 20.00th=[ 277], | 30.00th=[ 24511], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[141558], 99.50th=[200279], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 414, per=25.80%, avg=197.08, stdev=77.12, samples=59 iops : min= 1, max= 25, avg=11.56, stdev= 4.86, samples=59 write: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30448msec); 0 zone resets clat (usec): min=1587, max=215149, avg=37192.19, stdev=38055.86 lat (usec): min=1589, max=215151, avg=37218.08, stdev=38048.60 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2212], 10.00th=[ 3261], 20.00th=[ 5997], | 30.00th=[ 9634], 40.00th=[ 14746], 50.00th=[ 25822], 60.00th=[ 36439], | 70.00th=[ 47449], 80.00th=[ 61604], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[181404], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 63, max= 407, per=25.54%, avg=205.31, stdev=80.98, samples=59 iops : min= 3, max= 25, avg=12.08, stdev= 5.14, samples=59 lat (usec) : 50=1.30%, 100=8.07%, 250=0.26%, 500=0.91%, 1000=0.13% lat (msec) : 2=1.30%, 4=5.60%, 10=9.24%, 20=9.24%, 50=32.94% lat (msec) : 100=24.87%, 250=5.99%, 500=0.13% cpu : usr=0.07%, sys=5.84%, ctx=1539, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=764KiB/s (783kB/s), 183KiB/s-210KiB/s (188kB/s-215kB/s), io=23.4MiB (24.5MB), run=29601-31343msec WRITE: bw=804KiB/s (823kB/s), 202KiB/s-215KiB/s (207kB/s-220kB/s), io=24.6MiB (25.8MB), run=29601-31343msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143355: Tue Jun 23 10:19:13 2026 read: IOPS=4, BW=79.0KiB/s (80.9kB/s)(5920KiB/74936msec) clat (msec): min=4, max=320, avg=42.42, stdev=37.55 lat (msec): min=4, max=320, avg=42.42, stdev=37.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 78], 95.00th=[ 105], | 99.00th=[ 194], 99.50th=[ 268], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 254, per=29.33%, avg=90.34, stdev=52.64, samples=127 iops : min= 1, max= 15, avg= 4.86, stdev= 3.32, samples=127 write: IOPS=5, BW=84.0KiB/s (87.0kB/s)(6368KiB/74936msec); 0 zone resets clat (msec): min=35, max=486, avg=148.66, stdev=66.40 lat (msec): min=35, max=486, avg=148.67, stdev=66.40 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 94], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 236], 95.00th=[ 264], | 99.00th=[ 435], 99.50th=[ 477], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 31, max= 188, per=26.67%, avg=86.41, stdev=35.45, samples=144 iops : min= 1, max= 11, avg= 4.59, stdev= 2.29, samples=144 lat (msec) : 10=0.78%, 20=10.16%, 50=25.78%, 100=20.44%, 250=38.28% lat (msec) : 500=4.56% cpu : usr=0.03%, sys=1.48%, ctx=1323, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143356: Tue Jun 23 10:19:13 2026 read: IOPS=4, BW=73.0KiB/s (75.7kB/s)(5744KiB/77665msec) clat (msec): min=8, max=285, avg=45.42, stdev=42.04 lat (msec): min=8, max=285, avg=45.42, stdev=42.04 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 94], 95.00th=[ 140], | 99.00th=[ 215], 99.50th=[ 266], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 23, max= 254, per=28.04%, avg=86.37, stdev=57.44, samples=131 iops : min= 1, max= 15, avg= 4.60, stdev= 3.58, samples=131 write: IOPS=5, BW=84.3KiB/s (86.3kB/s)(6544KiB/77665msec); 0 zone resets clat (msec): min=54, max=461, avg=149.93, stdev=62.72 lat (msec): min=54, max=461, avg=149.94, stdev=62.72 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 77], 10.00th=[ 85], 20.00th=[ 100], | 30.00th=[ 113], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 186], 90.00th=[ 236], 95.00th=[ 292], | 99.00th=[ 351], 99.50th=[ 372], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 23, max= 160, per=26.37%, avg=85.43, stdev=32.61, samples=150 iops : min= 1, max= 10, avg= 4.53, stdev= 2.14, samples=150 lat (msec) : 10=0.52%, 20=9.90%, 50=24.22%, 100=19.27%, 250=41.54% lat (msec) : 500=4.56% cpu : usr=0.04%, sys=1.50%, ctx=1418, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143357: Tue Jun 23 10:19:13 2026 read: IOPS=5, BW=85.1KiB/s (87.1kB/s)(6256KiB/73527msec) clat (msec): min=7, max=427, avg=44.55, stdev=47.10 lat (msec): min=7, max=427, avg=44.55, stdev=47.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 123], | 99.00th=[ 284], 99.50th=[ 288], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 286, per=30.80%, avg=94.86, stdev=60.06, samples=130 iops : min= 1, max= 17, avg= 5.12, stdev= 3.82, samples=130 write: IOPS=5, BW=82.0KiB/s (84.0kB/s)(6032KiB/73527msec); 0 zone resets clat (msec): min=49, max=454, avg=148.57, stdev=55.80 lat (msec): min=49, max=454, avg=148.57, stdev=55.80 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 80], 10.00th=[ 88], 20.00th=[ 103], | 30.00th=[ 114], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 224], 95.00th=[ 255], | 99.00th=[ 305], 99.50th=[ 359], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 30, max= 160, per=25.48%, avg=82.57, stdev=32.02, samples=142 iops : min= 1, max= 10, avg= 4.35, stdev= 2.05, samples=142 lat (msec) : 10=1.04%, 20=9.51%, 50=29.69%, 100=15.76%, 250=40.62% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.47%, ctx=1398, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143358: Tue Jun 23 10:19:13 2026 read: IOPS=4, BW=79.3KiB/s (81.2kB/s)(6032KiB/76028msec) clat (msec): min=9, max=337, avg=43.49, stdev=42.63 lat (msec): min=9, max=337, avg=43.50, stdev=42.63 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 86], 95.00th=[ 125], | 99.00th=[ 279], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 320, per=30.05%, avg=92.55, stdev=57.10, samples=128 iops : min= 1, max= 20, avg= 4.99, stdev= 3.64, samples=128 write: IOPS=5, BW=82.3KiB/s (84.3kB/s)(6256KiB/76028msec); 0 zone resets clat (msec): min=48, max=497, avg=152.38, stdev=68.09 lat (msec): min=48, max=497, avg=152.39, stdev=68.09 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 101], | 30.00th=[ 113], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 192], 90.00th=[ 241], 95.00th=[ 292], | 99.00th=[ 372], 99.50th=[ 456], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 30, max= 191, per=25.83%, avg=83.69, stdev=36.03, samples=147 iops : min= 1, max= 11, avg= 4.41, stdev= 2.34, samples=147 lat (msec) : 10=0.26%, 20=10.94%, 50=27.21%, 100=17.32%, 250=38.93% lat (msec) : 500=5.34% cpu : usr=0.05%, sys=1.45%, ctx=1379, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=308KiB/s (316kB/s), 73.0KiB/s-85.1KiB/s (75.7kB/s-87.1kB/s), io=23.4MiB (24.5MB), run=73527-77665msec WRITE: bw=324KiB/s (332kB/s), 82.0KiB/s-84.0KiB/s (84.0kB/s-87.0kB/s), io=24.6MiB (25.8MB), run=73527-77665msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143379: Tue Jun 23 10:19:32 2026 read: IOPS=1, BW=1363KiB/s (1396kB/s)(7168KiB/5258msec) clat (msec): min=95, max=703, avg=306.45, stdev=243.41 lat (msec): min=95, max=703, avg=306.45, stdev=243.41 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 123], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 209], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 600], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1825, max= 3676, per=70.95%, avg=2303.80, stdev=771.33, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=974KiB/s (997kB/s)(5120KiB/5258msec); 0 zone resets clat (msec): min=285, max=1095, avg=604.27, stdev=351.05 lat (msec): min=285, max=1095, avg=604.36, stdev=351.06 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 2015, max= 4063, per=55.76%, avg=2535.00, stdev=1018.74, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.74%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143380: Tue Jun 23 10:19:32 2026 read: IOPS=0, BW=325KiB/s (333kB/s)(2048KiB/6306msec) clat (msec): min=187, max=305, avg=246.34, stdev=83.01 lat (msec): min=187, max=305, avg=246.35, stdev=83.01 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1630, max= 2019, per=56.19%, avg=1824.50, stdev=275.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1624KiB/s (1663kB/s)(10.0MiB/6306msec); 0 zone resets clat (msec): min=190, max=1295, avg=576.37, stdev=377.93 lat (msec): min=190, max=1295, avg=576.49, stdev=377.95 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 259], | 30.00th=[ 288], 40.00th=[ 305], 50.00th=[ 321], 60.00th=[ 481], | 70.00th=[ 776], 80.00th=[ 869], 90.00th=[ 978], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1630, max= 4079, per=49.18%, avg=2235.88, stdev=757.84, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=16.67%, 500=50.00%, 1000=25.00%, 2000=8.33% cpu : usr=0.02%, sys=3.46%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143381: Tue Jun 23 10:19:32 2026 read: IOPS=1, BW=1247KiB/s (1277kB/s)(6144KiB/4926msec) clat (msec): min=136, max=374, avg=248.05, stdev=84.95 lat (msec): min=136, max=374, avg=248.05, stdev=84.95 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 264], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1825, max= 2039, per=61.13%, avg=1985.00, stdev=90.09, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1247KiB/s (1277kB/s)(6144KiB/4926msec); 0 zone resets clat (msec): min=245, max=1485, avg=565.09, stdev=470.71 lat (msec): min=246, max=1485, avg=565.94, stdev=470.11 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 409], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 1809, max= 2039, per=43.41%, avg=1973.20, stdev=94.96, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.94%, ctx=138, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143382: Tue Jun 23 10:19:32 2026 read: IOPS=0, BW=945KiB/s (968kB/s)(5120KiB/5416msec) clat (msec): min=118, max=969, avg=300.70, stdev=374.29 lat (msec): min=118, max=969, avg=300.70, stdev=374.29 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1825, max= 2039, per=60.93%, avg=1978.50, stdev=102.66, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1323KiB/s (1355kB/s)(7168KiB/5416msec); 0 zone resets clat (msec): min=269, max=1344, avg=547.19, stdev=373.75 lat (msec): min=270, max=1344, avg=547.32, stdev=373.73 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 330], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 676], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 1815, max= 4087, per=51.79%, avg=2354.60, stdev=973.79, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.75%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3248KiB/s (3326kB/s), 325KiB/s-1363KiB/s (333kB/s-1396kB/s), io=20.0MiB (20.0MB), run=4926-6306msec WRITE: bw=4547KiB/s (4656kB/s), 974KiB/s-1624KiB/s (997kB/s-1663kB/s), io=28.0MiB (29.4MB), run=4926-6306msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143384: Tue Jun 23 10:19:32 2026 read: IOPS=1, BW=1899KiB/s (1944kB/s)(7168KiB/3775msec) clat (usec): min=509, max=575459, avg=311597.75, stdev=174630.00 lat (usec): min=511, max=575460, avg=311599.10, stdev=174629.88 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[254804], | 30.00th=[287310], 40.00th=[287310], 50.00th=[295699], 60.00th=[346031], | 70.00th=[346031], 80.00th=[417334], 90.00th=[574620], 95.00th=[574620], | 99.00th=[574620], 99.50th=[574620], 99.90th=[574620], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 2027, max= 4071, per=83.51%, avg=2956.33, stdev=1034.53, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1356KiB/s (1389kB/s)(5120KiB/3775msec); 0 zone resets clat (msec): min=114, max=568, avg=318.28, stdev=193.58 lat (msec): min=114, max=569, avg=318.46, stdev=193.62 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2048, max= 5417, per=75.31%, avg=3732.50, stdev=2382.24, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=58.33%, 750=16.67% cpu : usr=0.05%, sys=13.14%, ctx=189, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143386: Tue Jun 23 10:19:32 2026 read: IOPS=0, BW=354KiB/s (363kB/s)(2048KiB/5785msec) clat (msec): min=215, max=309, avg=262.39, stdev=66.67 lat (msec): min=215, max=309, avg=262.39, stdev=66.67 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1689, max= 1984, per=51.88%, avg=1836.50, stdev=208.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1770KiB/s (1813kB/s)(10.0MiB/5785msec); 0 zone resets clat (msec): min=168, max=1028, avg=525.28, stdev=343.76 lat (msec): min=168, max=1028, avg=525.42, stdev=343.72 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 241], 50.00th=[ 266], 60.00th=[ 584], | 70.00th=[ 617], 80.00th=[ 860], 90.00th=[ 1020], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1984, max= 4096, per=52.79%, avg=2616.43, stdev=1005.15, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=10.89%, ctx=171, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143387: Tue Jun 23 10:19:32 2026 read: IOPS=1, BW=1264KiB/s (1295kB/s)(6144KiB/4859msec) clat (msec): min=2, max=352, avg=212.25, stdev=118.23 lat (msec): min=2, max=352, avg=212.25, stdev=118.23 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 249], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2035, max= 3968, per=71.17%, avg=2519.25, stdev=965.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1264KiB/s (1295kB/s)(6144KiB/4859msec); 0 zone resets clat (msec): min=211, max=1416, avg=597.21, stdev=466.41 lat (msec): min=211, max=1416, avg=597.32, stdev=466.38 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 676], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1805, max= 3002, per=44.08%, avg=2184.80, stdev=467.94, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.08%, sys=9.84%, ctx=210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143388: Tue Jun 23 10:19:32 2026 read: IOPS=1, BW=1047KiB/s (1073kB/s)(5120KiB/4888msec) clat (usec): min=513, max=308964, avg=74046.32, stdev=133773.51 lat (usec): min=514, max=308965, avg=74047.47, stdev=133773.40 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 59507], 80.00th=[ 59507], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 3968, max= 4079, per=100.00%, avg=4023.50, stdev=78.49, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1466KiB/s (1502kB/s)(7168KiB/4888msec); 0 zone resets clat (msec): min=206, max=1072, avg=644.41, stdev=371.44 lat (msec): min=206, max=1073, avg=645.16, stdev=372.30 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 288], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 1053], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1805, max= 4087, per=48.18%, avg=2387.60, stdev=954.55, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=25.00% lat (msec) : 100=8.33%, 250=8.33%, 500=33.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=8.25%, ctx=79, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3540KiB/s (3625kB/s), 354KiB/s-1899KiB/s (363kB/s-1944kB/s), io=20.0MiB (20.0MB), run=3775-5785msec WRITE: bw=4956KiB/s (5075kB/s), 1264KiB/s-1770KiB/s (1295kB/s-1813kB/s), io=28.0MiB (29.4MB), run=3775-5785msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143395: Tue Jun 23 10:19:48 2026 read: IOPS=0, BW=3491KiB/s (3575kB/s)(12.0MiB/3520msec) clat (msec): min=174, max=1721, avg=1109.92, stdev=822.50 lat (msec): min=174, max=1721, avg=1109.92, stdev=822.50 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.81%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143396: Tue Jun 23 10:19:48 2026 read: IOPS=0, BW=1287KiB/s (1318kB/s)(4096KiB/3183msec) clat (nsec): min=435758k, max=435758k, avg=435758188.00, stdev= 0.00 lat (nsec): min=435761k, max=435761k, avg=435760916.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 6206, max= 6206, per=100.00%, avg=6206.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2574KiB/s (2635kB/s)(8192KiB/3183msec); 0 zone resets clat (msec): min=1253, max=1331, avg=1292.57, stdev=55.35 lat (msec): min=1253, max=1332, avg=1292.89, stdev=55.32 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8110, max= 8110, per=84.55%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.68%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143397: Tue Jun 23 10:19:48 2026 write: IOPS=0, BW=3597KiB/s (3684kB/s)(12.0MiB/3416msec); 0 zone resets clat (msec): min=507, max=1315, avg=1022.35, stdev=447.04 lat (msec): min=509, max=1315, avg=1023.25, stdev=446.46 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8110, max= 8159, per=84.81%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=7.29%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143398: Tue Jun 23 10:19:48 2026 write: IOPS=1, BW=4710KiB/s (4823kB/s)(12.0MiB/2609msec); 0 zone resets clat (msec): min=470, max=1330, avg=787.41, stdev=472.46 lat (msec): min=470, max=1330, avg=788.02, stdev=472.35 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 5557, max= 8126, per=71.33%, avg=6841.50, stdev=1816.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.79%, ctx=88, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4655KiB/s (4766kB/s), 1287KiB/s-3491KiB/s (1318kB/s-3575kB/s), io=16.0MiB (16.8MB), run=3183-3520msec WRITE: bw=9593KiB/s (9823kB/s), 2574KiB/s-4710KiB/s (2635kB/s-4823kB/s), io=32.0MiB (33.6MB), run=2609-3416msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143399: Tue Jun 23 10:19:48 2026 read: IOPS=1, BW=4616KiB/s (4727kB/s)(12.0MiB/2662msec) clat (msec): min=724, max=960, avg=835.15, stdev=118.81 lat (msec): min=724, max=960, avg=835.15, stdev=118.81 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=11.42%, ctx=288, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143400: Tue Jun 23 10:19:48 2026 read: IOPS=0, BW=1209KiB/s (1238kB/s)(4096KiB/3387msec) clat (nsec): min=861414k, max=861414k, avg=861414265.00, stdev= 0.00 lat (nsec): min=861417k, max=861417k, avg=861417178.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2419KiB/s (2477kB/s)(8192KiB/3387msec); 0 zone resets clat (msec): min=1025, max=1428, avg=1226.90, stdev=284.74 lat (msec): min=1025, max=1429, avg=1227.62, stdev=285.18 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8159, max= 8159, per=94.10%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.08%, ctx=85, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143401: Tue Jun 23 10:19:48 2026 write: IOPS=0, BW=3252KiB/s (3330kB/s)(12.0MiB/3779msec); 0 zone resets clat (msec): min=223, max=1843, avg=1241.02, stdev=886.58 lat (msec): min=223, max=1844, avg=1241.68, stdev=886.62 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8159, max= 8159, per=94.10%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.38%, ctx=36, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143402: Tue Jun 23 10:19:48 2026 write: IOPS=1, BW=4819KiB/s (4934kB/s)(12.0MiB/2550msec); 0 zone resets clat (msec): min=593, max=1140, avg=808.71, stdev=291.63 lat (msec): min=594, max=1141, avg=809.21, stdev=291.60 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8159, max= 8192, per=94.29%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.24%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4837KiB/s (4953kB/s), 1209KiB/s-4616KiB/s (1238kB/s-4727kB/s), io=16.0MiB (16.8MB), run=2662-3387msec WRITE: bw=8671KiB/s (8879kB/s), 2419KiB/s-4819KiB/s (2477kB/s-4934kB/s), io=32.0MiB (33.6MB), run=2550-3779msec