== sanity test 398b: DIO and buffer IO race ============== 00:10:28 (1788840628) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.3564 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144266: Tue Sep 8 00:12:49 2026 read: IOPS=12, BW=49.4KiB/s (50.6kB/s)(5992KiB/121363msec) clat (usec): min=33, max=818444, avg=37615.54, stdev=36492.54 lat (usec): min=33, max=818445, avg=37617.05, stdev=36492.44 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 14615], | 30.00th=[ 20579], 40.00th=[ 25297], 50.00th=[ 30802], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 59507], 90.00th=[ 77071], 95.00th=[ 90702], | 99.00th=[125305], 99.50th=[143655], 99.90th=[375391], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 144, per=25.59%, avg=49.40, stdev=22.84, samples=237 iops : min= 1, max= 36, avg=11.70, stdev= 5.77, samples=237 write: IOPS=12, BW=51.9KiB/s (53.1kB/s)(6296KiB/121363msec); 0 zone resets clat (usec): min=940, max=405357, avg=41045.60, stdev=44044.13 lat (usec): min=941, max=405359, avg=41050.48, stdev=44044.40 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1483], 20.00th=[ 3589], | 30.00th=[ 7832], 40.00th=[ 16712], 50.00th=[ 29754], 60.00th=[ 40633], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[100140], 95.00th=[128451], | 99.00th=[202376], 99.50th=[217056], 99.90th=[291505], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 119, per=25.56%, avg=51.63, stdev=20.28, samples=238 iops : min= 1, max= 29, avg=12.27, stdev= 5.11, samples=238 lat (usec) : 50=0.98%, 100=5.60%, 250=0.36%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=6.54%, 4=4.43%, 10=6.35%, 20=10.97%, 50=34.64% lat (msec) : 100=23.08%, 250=6.41%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=5.57%, ctx=6275, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144267: Tue Sep 8 00:12:49 2026 read: IOPS=12, BW=48.4KiB/s (49.5kB/s)(5940KiB/122791msec) clat (usec): min=30, max=781513, avg=38520.67, stdev=37257.92 lat (usec): min=30, max=781514, avg=38527.74, stdev=37256.90 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 15008], | 30.00th=[ 21103], 40.00th=[ 25822], 50.00th=[ 31327], 60.00th=[ 38011], | 70.00th=[ 48497], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[173016], 99.90th=[267387], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 111, per=24.91%, avg=48.07, stdev=20.19, samples=241 iops : min= 1, max= 27, avg=11.38, stdev= 5.07, samples=241 write: IOPS=12, BW=51.7KiB/s (52.9kB/s)(6348KiB/122791msec); 0 zone resets clat (usec): min=912, max=474514, avg=41041.48, stdev=42959.66 lat (usec): min=913, max=474516, avg=41047.70, stdev=42960.96 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1434], 20.00th=[ 3785], | 30.00th=[ 8455], 40.00th=[ 19792], 50.00th=[ 31851], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[175113], 99.50th=[223347], 99.90th=[367002], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 128, per=25.38%, avg=51.27, stdev=21.57, samples=241 iops : min= 1, max= 32, avg=12.18, stdev= 5.44, samples=241 lat (usec) : 50=1.11%, 100=5.50%, 250=0.49%, 500=0.13%, 1000=0.36% lat (msec) : 2=6.61%, 4=4.17%, 10=6.32%, 20=9.47%, 50=34.86% lat (msec) : 100=24.45%, 250=6.28%, 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=5.40%, ctx=6250, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144268: Tue Sep 8 00:12:49 2026 read: IOPS=12, BW=48.7KiB/s (49.8kB/s)(6028KiB/123844msec) clat (usec): min=32, max=263566, avg=36201.10, stdev=29399.48 lat (usec): min=33, max=263567, avg=36203.92, stdev=29399.07 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 14091], | 30.00th=[ 20317], 40.00th=[ 25560], 50.00th=[ 31065], 60.00th=[ 36963], | 70.00th=[ 45351], 80.00th=[ 57410], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[128451], 99.50th=[145753], 99.90th=[198181], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 110, per=25.12%, avg=48.49, stdev=20.42, samples=242 iops : min= 1, max= 27, avg=11.48, stdev= 5.13, samples=242 write: IOPS=12, BW=50.5KiB/s (51.8kB/s)(6260KiB/123844msec); 0 zone resets clat (usec): min=938, max=859318, avg=44007.62, stdev=51078.65 lat (usec): min=939, max=859319, avg=44012.69, stdev=51076.53 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 3654], | 30.00th=[ 8717], 40.00th=[ 21365], 50.00th=[ 33162], 60.00th=[ 43779], | 70.00th=[ 55837], 80.00th=[ 74974], 90.00th=[104334], 95.00th=[127402], | 99.00th=[187696], 99.50th=[233833], 99.90th=[541066], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 99, per=24.84%, avg=50.19, stdev=19.60, samples=243 iops : min= 1, max= 24, avg=11.90, stdev= 4.93, samples=243 lat (usec) : 50=1.20%, 100=5.92%, 250=0.42%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.26% lat (msec) : 2=7.49%, 4=3.26%, 10=5.86%, 20=9.86%, 50=35.19% lat (msec) : 100=23.21%, 250=6.97%, 500=0.10%, 750=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.40%, ctx=6321, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144269: Tue Sep 8 00:12:49 2026 read: IOPS=12, BW=49.1KiB/s (50.2kB/s)(6052KiB/123379msec) clat (usec): min=29, max=801994, avg=38343.36, stdev=41569.36 lat (usec): min=30, max=801995, avg=38346.92, stdev=41568.58 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 11994], | 30.00th=[ 19792], 40.00th=[ 24773], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 59507], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[129500], 99.50th=[173016], 99.90th=[650118], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 112, per=25.47%, avg=49.15, stdev=20.90, samples=240 iops : min= 1, max= 28, avg=11.65, stdev= 5.26, samples=240 write: IOPS=12, BW=50.5KiB/s (51.8kB/s)(6236KiB/123379msec); 0 zone resets clat (usec): min=916, max=325909, avg=41670.99, stdev=42032.07 lat (usec): min=916, max=325911, avg=41674.41, stdev=42031.81 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1467], 20.00th=[ 4146], | 30.00th=[ 8717], 40.00th=[ 20055], 50.00th=[ 30802], 60.00th=[ 42206], | 70.00th=[ 57410], 80.00th=[ 73925], 90.00th=[100140], 95.00th=[122160], | 99.00th=[173016], 99.50th=[214959], 99.90th=[270533], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 112, per=24.89%, avg=50.29, stdev=18.86, samples=241 iops : min= 1, max= 28, avg=11.93, stdev= 4.76, samples=241 lat (usec) : 50=1.50%, 100=6.15%, 250=0.49%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=6.18%, 4=3.68%, 10=6.67%, 20=10.19%, 50=33.95% lat (msec) : 100=23.47%, 250=7.03%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.44%, ctx=6258, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=194KiB/s (199kB/s), 48.4KiB/s-49.4KiB/s (49.5kB/s-50.6kB/s), io=23.4MiB (24.6MB), run=121363-123844msec WRITE: bw=203KiB/s (208kB/s), 50.5KiB/s-51.9KiB/s (51.8kB/s-53.1kB/s), io=24.6MiB (25.7MB), run=121363-123844msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144271: Tue Sep 8 00:15:05 2026 read: IOPS=5, BW=23.4KiB/s (23.0kB/s)(5992KiB/255813msec) clat (msec): min=5, max=843, avg=32.94, stdev=39.23 lat (msec): min=5, max=843, avg=32.95, stdev=39.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 77], 95.00th=[ 104], | 99.00th=[ 165], 99.50th=[ 209], 99.90th=[ 284], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 103, per=28.44%, avg=26.17, stdev=17.77, samples=444 iops : min= 1, max= 25, avg= 5.94, stdev= 4.47, samples=444 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6296KiB/255813msec); 0 zone resets clat (msec): min=38, max=689, avg=131.08, stdev=63.61 lat (msec): min=38, max=689, avg=131.08, stdev=63.62 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 222], 95.00th=[ 255], | 99.00th=[ 342], 99.50th=[ 380], 99.90th=[ 535], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 56, per=25.00%, avg=24.25, stdev=10.95, samples=502 iops : min= 1, max= 14, avg= 5.46, stdev= 2.82, samples=502 lat (msec) : 10=4.52%, 20=19.14%, 50=17.48%, 100=24.80%, 250=31.12% lat (msec) : 500=2.83%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.12%, ctx=5124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144272: Tue Sep 8 00:15:05 2026 read: IOPS=5, BW=22.9KiB/s (23.5kB/s)(5940KiB/259013msec) clat (msec): min=5, max=951, avg=32.70, stdev=43.41 lat (msec): min=5, max=951, avg=32.71, stdev=43.41 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 70], 95.00th=[ 99], | 99.00th=[ 188], 99.50th=[ 249], 99.90th=[ 426], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 95, per=28.52%, avg=26.24, stdev=17.77, samples=438 iops : min= 1, max= 23, avg= 5.96, stdev= 4.45, samples=438 write: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6348KiB/259013msec); 0 zone resets clat (msec): min=33, max=847, avg=132.53, stdev=68.50 lat (msec): min=33, max=847, avg=132.53, stdev=68.50 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 222], 95.00th=[ 271], | 99.00th=[ 342], 99.50th=[ 393], 99.90th=[ 726], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 56, per=25.06%, avg=24.31, stdev=11.23, samples=504 iops : min= 1, max= 14, avg= 5.47, stdev= 2.88, samples=504 lat (msec) : 10=4.85%, 20=19.50%, 50=16.80%, 100=24.74%, 250=30.37% lat (msec) : 500=3.65%, 750=0.03%, 1000=0.07% cpu : usr=0.04%, sys=1.07%, ctx=5158, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144273: Tue Sep 8 00:15:05 2026 read: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6028KiB/256585msec) clat (msec): min=5, max=368, avg=33.02, stdev=33.87 lat (msec): min=5, max=368, avg=33.02, stdev=33.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 104], | 99.00th=[ 157], 99.50th=[ 207], 99.90th=[ 326], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 111, per=28.12%, avg=25.87, stdev=17.56, samples=451 iops : min= 1, max= 27, avg= 5.87, stdev= 4.42, samples=451 write: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6260KiB/256585msec); 0 zone resets clat (msec): min=42, max=1133, avg=132.08, stdev=71.23 lat (msec): min=42, max=1133, avg=132.08, stdev=71.23 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 113], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 262], | 99.00th=[ 372], 99.50th=[ 422], 99.90th=[ 542], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 56, per=25.06%, avg=24.31, stdev=11.21, samples=497 iops : min= 1, max= 14, avg= 5.47, stdev= 2.87, samples=497 lat (msec) : 10=4.52%, 20=18.98%, 50=17.06%, 100=25.26%, 250=30.99% lat (msec) : 500=3.09%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.12%, ctx=5132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144274: Tue Sep 8 00:15:05 2026 read: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6052KiB/257161msec) clat (msec): min=5, max=425, avg=32.97, stdev=36.38 lat (msec): min=5, max=425, avg=32.97, stdev=36.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 73], 95.00th=[ 107], | 99.00th=[ 171], 99.50th=[ 201], 99.90th=[ 368], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 103, per=28.54%, avg=26.26, stdev=18.26, samples=446 iops : min= 1, max= 25, avg= 5.97, stdev= 4.62, samples=446 write: IOPS=6, BW=24.2KiB/s (24.8kB/s)(6236KiB/257161msec); 0 zone resets clat (msec): min=34, max=1002, avg=132.88, stdev=70.41 lat (msec): min=34, max=1002, avg=132.89, stdev=70.41 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 130], | 70.00th=[ 150], 80.00th=[ 176], 90.00th=[ 220], 95.00th=[ 262], | 99.00th=[ 342], 99.50th=[ 435], 99.90th=[ 835], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 55, per=24.77%, avg=24.03, stdev=11.06, samples=500 iops : min= 1, max= 13, avg= 5.40, stdev= 2.82, samples=500 lat (msec) : 10=4.20%, 20=20.18%, 50=16.86%, 100=24.25%, 250=31.02% lat (msec) : 500=3.35%, 750=0.07%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=5045, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=92.7KiB/s (94.9kB/s), 22.9KiB/s-23.5KiB/s (23.5kB/s-24.1kB/s), io=23.4MiB (24.6MB), run=255813-259013msec WRITE: bw=97.1KiB/s (99.4kB/s), 24.2KiB/s-24.6KiB/s (24.8kB/s-25.2kB/s), io=24.6MiB (25.7MB), run=255813-259013msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144340: Tue Sep 8 00:15:44 2026 read: IOPS=14, BW=228KiB/s (233kB/s)(5920KiB/26016msec) clat (usec): min=37, max=281484, avg=35889.54, stdev=32876.85 lat (usec): min=37, max=281486, avg=35892.83, stdev=32877.37 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 95], | 30.00th=[ 22152], 40.00th=[ 27657], 50.00th=[ 32900], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[158335], 99.50th=[204473], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 96, max= 448, per=25.68%, avg=227.02, stdev=75.05, samples=51 iops : min= 6, max= 28, avg=13.43, stdev= 4.73, samples=51 write: IOPS=15, BW=245KiB/s (251kB/s)(6368KiB/26016msec); 0 zone resets clat (usec): min=1452, max=172742, avg=31866.78, stdev=32071.41 lat (usec): min=1454, max=172743, avg=31869.77, stdev=32070.81 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1893], 10.00th=[ 2999], 20.00th=[ 5800], | 30.00th=[ 8586], 40.00th=[ 13304], 50.00th=[ 21103], 60.00th=[ 30016], | 70.00th=[ 42206], 80.00th=[ 54789], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[156238], 99.50th=[170918], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 64, max= 480, per=26.33%, avg=244.82, stdev=89.86, samples=51 iops : min= 4, max= 30, avg=14.57, stdev= 5.64, samples=51 lat (usec) : 50=1.82%, 100=7.94%, 250=0.26%, 500=0.39%, 750=0.13% lat (msec) : 2=3.52%, 4=3.39%, 10=11.07%, 20=10.68%, 50=36.85% lat (msec) : 100=20.31%, 250=3.52%, 500=0.13% cpu : usr=0.07%, sys=6.19%, ctx=1404, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144341: Tue Sep 8 00:15:44 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5744KiB/27088msec) clat (usec): min=38, max=215435, avg=37256.29, stdev=29210.12 lat (usec): min=38, max=215435, avg=37259.95, stdev=29207.47 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 537], | 30.00th=[ 22938], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 72877], 95.00th=[ 83362], | 99.00th=[115868], 99.50th=[175113], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 61, max= 382, per=24.69%, avg=218.22, stdev=75.13, samples=51 iops : min= 3, max= 23, avg=12.88, stdev= 4.71, samples=51 write: IOPS=15, BW=242KiB/s (247kB/s)(6544KiB/27088msec); 0 zone resets clat (usec): min=1331, max=347708, avg=33375.55, stdev=40032.22 lat (usec): min=1331, max=347710, avg=33435.64, stdev=40039.14 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1844], 10.00th=[ 2868], 20.00th=[ 5211], | 30.00th=[ 7832], 40.00th=[ 12387], 50.00th=[ 19792], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 53216], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[175113], 99.50th=[187696], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 62, max= 541, per=25.81%, avg=240.00, stdev=92.76, samples=53 iops : min= 3, max= 33, avg=14.23, stdev= 5.84, samples=53 lat (usec) : 50=1.56%, 100=7.29%, 250=0.39%, 750=0.13% lat (msec) : 2=3.26%, 4=5.21%, 10=10.68%, 20=11.46%, 50=34.51% lat (msec) : 100=21.61%, 250=3.65%, 500=0.26% cpu : usr=0.08%, sys=6.06%, ctx=1462, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144342: Tue Sep 8 00:15:44 2026 read: IOPS=14, BW=236KiB/s (241kB/s)(6256KiB/26536msec) clat (usec): min=37, max=203152, avg=34821.71, stdev=29520.56 lat (usec): min=37, max=203154, avg=34823.13, stdev=29520.53 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 231], | 30.00th=[ 21890], 40.00th=[ 26346], 50.00th=[ 31589], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 53740], 90.00th=[ 65274], 95.00th=[ 85459], | 99.00th=[137364], 99.50th=[173016], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 61, max= 479, per=26.86%, avg=237.48, stdev=93.92, samples=52 iops : min= 3, max= 29, avg=14.08, stdev= 5.93, samples=52 write: IOPS=14, BW=227KiB/s (233kB/s)(6032KiB/26536msec); 0 zone resets clat (usec): min=1412, max=234913, avg=34154.13, stdev=36031.61 lat (usec): min=1414, max=234916, avg=34160.69, stdev=36035.45 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1680], 10.00th=[ 2606], 20.00th=[ 5473], | 30.00th=[ 8717], 40.00th=[ 14877], 50.00th=[ 22938], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[106431], | 99.00th=[162530], 99.50th=[191890], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 62, max= 445, per=24.26%, avg=225.62, stdev=86.97, samples=52 iops : min= 3, max= 27, avg=13.35, stdev= 5.43, samples=52 lat (usec) : 50=1.30%, 100=7.94%, 250=1.04%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.56%, 4=4.04%, 10=8.85%, 20=8.07%, 50=39.58% lat (msec) : 100=19.40%, 250=4.82% cpu : usr=0.10%, sys=6.10%, ctx=1516, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144343: Tue Sep 8 00:15:44 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(6032KiB/26863msec) clat (usec): min=37, max=256272, avg=35243.69, stdev=31136.71 lat (usec): min=38, max=256272, avg=35244.94, stdev=31136.66 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 105], | 30.00th=[ 20579], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 44827], 80.00th=[ 56886], 90.00th=[ 69731], 95.00th=[ 80217], | 99.00th=[143655], 99.50th=[185598], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 446, per=25.26%, avg=223.28, stdev=90.03, samples=53 iops : min= 1, max= 27, avg=13.19, stdev= 5.65, samples=53 write: IOPS=14, BW=233KiB/s (238kB/s)(6256KiB/26863msec); 0 zone resets clat (usec): min=1445, max=245526, avg=34572.72, stdev=40092.80 lat (usec): min=1447, max=245527, avg=34586.87, stdev=40084.27 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 2540], 20.00th=[ 4359], | 30.00th=[ 6259], 40.00th=[ 9634], 50.00th=[ 19792], 60.00th=[ 29230], | 70.00th=[ 44303], 80.00th=[ 61604], 90.00th=[ 90702], 95.00th=[106431], | 99.00th=[191890], 99.50th=[227541], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 62, max= 415, per=25.10%, avg=233.40, stdev=91.52, samples=53 iops : min= 3, max= 25, avg=13.83, stdev= 5.78, samples=53 lat (usec) : 50=1.04%, 100=8.46%, 250=1.43%, 500=0.26%, 750=0.13% lat (msec) : 2=4.30%, 4=4.82%, 10=11.98%, 20=6.90%, 50=34.11% lat (msec) : 100=21.48%, 250=4.95%, 500=0.13% cpu : usr=0.07%, sys=5.86%, ctx=1428, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=884KiB/s (905kB/s), 212KiB/s-236KiB/s (217kB/s-241kB/s), io=23.4MiB (24.5MB), run=26016-27088msec WRITE: bw=930KiB/s (953kB/s), 227KiB/s-245KiB/s (233kB/s-251kB/s), io=24.6MiB (25.8MB), run=26016-27088msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144335: Tue Sep 8 00:16:19 2026 read: IOPS=5, BW=94.6KiB/s (96.9kB/s)(5920KiB/62568msec) clat (msec): min=6, max=267, avg=34.19, stdev=33.52 lat (msec): min=6, max=267, avg=34.20, stdev=33.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 80], 95.00th=[ 105], | 99.00th=[ 178], 99.50th=[ 218], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 318, per=26.76%, avg=102.21, stdev=63.78, samples=112 iops : min= 1, max= 19, avg= 5.65, stdev= 4.06, samples=112 write: IOPS=6, BW=102KiB/s (104kB/s)(6368KiB/62568msec); 0 zone resets clat (msec): min=37, max=466, avg=125.29, stdev=63.94 lat (msec): min=37, max=466, avg=125.29, stdev=63.94 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 87], 40.00th=[ 95], 50.00th=[ 107], 60.00th=[ 121], | 70.00th=[ 140], 80.00th=[ 161], 90.00th=[ 203], 95.00th=[ 257], | 99.00th=[ 380], 99.50th=[ 443], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 29, max= 192, per=25.31%, avg=101.75, stdev=45.29, samples=122 iops : min= 1, max= 12, avg= 5.61, stdev= 2.88, samples=122 lat (msec) : 10=3.39%, 20=16.67%, 50=21.09%, 100=27.34%, 250=28.78% lat (msec) : 500=2.73% cpu : usr=0.05%, sys=1.38%, ctx=1335, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144336: Tue Sep 8 00:16:19 2026 read: IOPS=5, BW=92.1KiB/s (94.3kB/s)(5744KiB/62360msec) clat (msec): min=6, max=190, avg=34.13, stdev=32.10 lat (msec): min=6, max=190, avg=34.14, stdev=32.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 102], | 99.00th=[ 180], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 23, max= 414, per=27.24%, avg=104.06, stdev=69.32, samples=108 iops : min= 1, max= 25, avg= 5.76, stdev= 4.41, samples=108 write: IOPS=6, BW=105KiB/s (107kB/s)(6544KiB/62360msec); 0 zone resets clat (msec): min=37, max=364, avg=122.17, stdev=55.69 lat (msec): min=37, max=364, avg=122.18, stdev=55.71 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 123], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 188], 95.00th=[ 234], | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 29, max= 192, per=26.15%, avg=105.12, stdev=43.46, samples=122 iops : min= 1, max= 12, avg= 5.83, stdev= 2.77, samples=122 lat (msec) : 10=1.95%, 20=18.49%, 50=18.62%, 100=27.73%, 250=31.38% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.20%, ctx=1229, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144337: Tue Sep 8 00:16:19 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(6256KiB/60588msec) clat (msec): min=6, max=268, avg=31.57, stdev=29.66 lat (msec): min=6, max=268, avg=31.57, stdev=29.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 84], | 99.00th=[ 155], 99.50th=[ 197], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 30, max= 349, per=29.15%, avg=111.34, stdev=76.97, samples=111 iops : min= 1, max= 21, avg= 6.22, stdev= 4.85, samples=111 write: IOPS=6, BW=99.6KiB/s (102kB/s)(6032KiB/60588msec); 0 zone resets clat (msec): min=41, max=434, avg=127.50, stdev=61.22 lat (msec): min=41, max=434, avg=127.50, stdev=61.22 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 142], 80.00th=[ 169], 90.00th=[ 209], 95.00th=[ 257], | 99.00th=[ 313], 99.50th=[ 418], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 29, max= 191, per=24.51%, avg=98.52, stdev=42.35, samples=119 iops : min= 1, max= 11, avg= 5.41, stdev= 2.69, samples=119 lat (msec) : 10=2.34%, 20=18.75%, 50=22.66%, 100=24.22%, 250=29.17% lat (msec) : 500=2.86% cpu : usr=0.03%, sys=1.27%, ctx=1325, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144338: Tue Sep 8 00:16:19 2026 read: IOPS=6, BW=97.0KiB/s (99.4kB/s)(6032KiB/62158msec) clat (msec): min=6, max=225, avg=32.65, stdev=29.58 lat (msec): min=6, max=225, avg=32.65, stdev=29.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 70], 95.00th=[ 93], | 99.00th=[ 150], 99.50th=[ 174], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 313, per=28.24%, avg=107.89, stdev=67.31, samples=110 iops : min= 1, max= 19, avg= 6.01, stdev= 4.25, samples=110 write: IOPS=6, BW=101KiB/s (103kB/s)(6256KiB/62158msec); 0 zone resets clat (msec): min=44, max=635, avg=126.98, stdev=64.73 lat (msec): min=44, max=635, avg=126.99, stdev=64.73 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 109], 60.00th=[ 123], | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 262], | 99.00th=[ 351], 99.50th=[ 388], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 31, max= 223, per=25.21%, avg=101.34, stdev=43.41, samples=122 iops : min= 1, max= 13, avg= 5.59, stdev= 2.76, samples=122 lat (msec) : 10=2.21%, 20=18.88%, 50=21.22%, 100=24.48%, 250=30.08% lat (msec) : 500=2.99%, 750=0.13% cpu : usr=0.04%, sys=1.26%, ctx=1275, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=383KiB/s (392kB/s), 92.1KiB/s-103KiB/s (94.3kB/s-106kB/s), io=23.4MiB (24.5MB), run=60588-62568msec WRITE: bw=403KiB/s (412kB/s), 99.6KiB/s-105KiB/s (102kB/s-107kB/s), io=24.6MiB (25.8MB), run=60588-62568msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144365: Tue Sep 8 00:16:36 2026 read: IOPS=1, BW=1322KiB/s (1354kB/s)(7168KiB/5422msec) clat (usec): min=524, max=2702.2k, avg=515989.80, stdev=970888.51 lat (usec): min=526, max=2702.2k, avg=515991.14, stdev=970889.01 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], | 20.00th=[ 2057], 30.00th=[ 154141], 40.00th=[ 154141], | 50.00th=[ 202376], 60.00th=[ 250610], 70.00th=[ 250610], | 80.00th=[ 299893], 90.00th=[2701132], 95.00th=[2701132], | 99.00th=[2701132], 99.50th=[2701132], 99.90th=[2701132], | 99.95th=[2701132], 99.99th=[2701132] bw ( KiB/s): min= 1935, max= 4079, per=100.00%, avg=3001.50, stdev=1199.24, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=944KiB/s (967kB/s)(5120KiB/5422msec); 0 zone resets clat (msec): min=158, max=611, avg=346.30, stdev=165.68 lat (msec): min=158, max=611, avg=346.40, stdev=165.67 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1992, max= 5807, per=95.32%, avg=3899.50, stdev=2697.61, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.58%, ctx=546, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144366: Tue Sep 8 00:16:36 2026 read: IOPS=0, BW=292KiB/s (299kB/s)(2048KiB/7007msec) clat (usec): min=563, max=538472, avg=269517.77, stdev=380359.13 lat (usec): min=564, max=538474, avg=269519.88, stdev=380359.84 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[ 562], 60.00th=[541066], | 70.00th=[541066], 80.00th=[541066], 90.00th=[541066], 95.00th=[541066], | 99.00th=[541066], 99.50th=[541066], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 1976, max= 2039, per=68.70%, avg=2007.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1461KiB/s (1496kB/s)(10.0MiB/7007msec); 0 zone resets clat (msec): min=46, max=2526, avg=617.84, stdev=723.23 lat (msec): min=46, max=2526, avg=618.01, stdev=723.21 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 144], | 30.00th=[ 178], 40.00th=[ 305], 50.00th=[ 376], 60.00th=[ 418], | 70.00th=[ 542], 80.00th=[ 684], 90.00th=[ 953], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2000, max= 6144, per=89.09%, avg=3644.80, stdev=1716.44, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 1.87, samples=5 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=16.67%, 500=25.00%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=7.65%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144367: Tue Sep 8 00:16:36 2026 read: IOPS=1, BW=1074KiB/s (1100kB/s)(6144KiB/5719msec) clat (usec): min=531, max=345335, avg=68517.83, stdev=137739.85 lat (usec): min=532, max=345336, avg=68518.80, stdev=137739.57 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 570], | 30.00th=[ 570], 40.00th=[ 1074], 50.00th=[ 1074], 60.00th=[ 2245], | 70.00th=[ 61604], 80.00th=[ 61604], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 1950, max= 4079, per=91.32%, avg=2668.33, stdev=1221.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1074KiB/s (1100kB/s)(6144KiB/5719msec); 0 zone resets clat (msec): min=183, max=3212, avg=839.24, stdev=1167.35 lat (msec): min=183, max=3212, avg=839.34, stdev=1167.37 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1400, max= 2039, per=45.39%, avg=1857.00, stdev=307.54, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=8.33%, 500=41.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.33%, ctx=109, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144368: Tue Sep 8 00:16:36 2026 read: IOPS=0, BW=854KiB/s (875kB/s)(5120KiB/5992msec) clat (usec): min=493, max=336040, avg=129777.68, stdev=152574.24 lat (usec): min=494, max=336042, avg=129778.94, stdev=152574.33 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 494], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 66847], 60.00th=[ 66847], | 70.00th=[244319], 80.00th=[244319], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 3953, max= 4096, per=100.00%, avg=4024.50, stdev=101.12, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1196KiB/s (1225kB/s)(7168KiB/5992msec); 0 zone resets clat (msec): min=125, max=3000, avg=719.17, stdev=1034.64 lat (msec): min=125, max=3000, avg=719.32, stdev=1034.64 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 142], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 251], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 793], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1950, max= 2048, per=49.14%, avg=2010.40, stdev=44.39, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.86%, ctx=164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2923KiB/s (2993kB/s), 292KiB/s-1322KiB/s (299kB/s-1354kB/s), io=20.0MiB (20.0MB), run=5422-7007msec WRITE: bw=4092KiB/s (4190kB/s), 944KiB/s-1461KiB/s (967kB/s-1496kB/s), io=28.0MiB (29.4MB), run=5422-7007msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144361: Tue Sep 8 00:16:37 2026 read: IOPS=0, BW=956KiB/s (979kB/s)(7168KiB/7494msec) clat (msec): min=72, max=2592, avg=748.70, stdev=964.71 lat (msec): min=72, max=2592, avg=748.70, stdev=964.71 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 75], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 241], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 1519], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2011, max= 4087, per=100.00%, avg=3034.50, stdev=1161.22, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=0, BW=683KiB/s (700kB/s)(5120KiB/7494msec); 0 zone resets clat (msec): min=127, max=1060, avg=378.78, stdev=388.85 lat (msec): min=127, max=1060, avg=378.88, stdev=388.86 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1996, max= 4096, per=70.94%, avg=2713.33, stdev=1197.71, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.82%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144362: Tue Sep 8 00:16:37 2026 read: IOPS=0, BW=297KiB/s (304kB/s)(2048KiB/6893msec) clat (msec): min=96, max=181, avg=138.85, stdev=60.13 lat (msec): min=96, max=181, avg=138.85, stdev=60.13 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1440, max= 1805, per=59.39%, avg=1622.50, stdev=258.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1486KiB/s (1521kB/s)(10.0MiB/6893msec); 0 zone resets clat (msec): min=237, max=2984, avg=647.67, stdev=831.80 lat (msec): min=237, max=2984, avg=647.79, stdev=831.79 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 251], | 30.00th=[ 313], 40.00th=[ 342], 50.00th=[ 347], 60.00th=[ 368], | 70.00th=[ 468], 80.00th=[ 477], 90.00th=[ 693], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1935, max= 4096, per=67.85%, avg=2595.43, stdev=1022.52, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.35%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144363: Tue Sep 8 00:16:37 2026 read: IOPS=0, BW=901KiB/s (922kB/s)(6144KiB/6821msec) clat (msec): min=151, max=1059, avg=345.26, stdev=351.49 lat (msec): min=151, max=1059, avg=345.26, stdev=351.49 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 3871, max= 4096, per=100.00%, avg=3983.50, stdev=159.10, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=0, BW=901KiB/s (922kB/s)(6144KiB/6821msec); 0 zone resets clat (msec): min=118, max=3248, avg=782.97, stdev=1213.99 lat (msec): min=118, max=3248, avg=783.16, stdev=1213.94 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 384], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 2000, max= 2840, per=58.34%, avg=2231.50, stdev=406.17, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.68%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144364: Tue Sep 8 00:16:37 2026 read: IOPS=0, BW=728KiB/s (745kB/s)(5120KiB/7036msec) clat (msec): min=92, max=774, avg=309.08, stdev=277.20 lat (msec): min=92, max=774, avg=309.08, stdev=277.20 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1805, max= 2048, per=72.65%, avg=1984.75, stdev=119.86, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=0, BW=1019KiB/s (1043kB/s)(7168KiB/7036msec); 0 zone resets clat (msec): min=186, max=3031, avg=758.62, stdev=1011.99 lat (msec): min=186, max=3031, avg=758.78, stdev=1011.98 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 253], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 414], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 592], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1416, max= 3992, per=59.53%, avg=2277.20, stdev=991.34, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.47%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2733KiB/s (2798kB/s), 297KiB/s-956KiB/s (304kB/s-979kB/s), io=20.0MiB (20.0MB), run=6821-7494msec WRITE: bw=3826KiB/s (3918kB/s), 683KiB/s-1486KiB/s (700kB/s-1521kB/s), io=28.0MiB (29.4MB), run=6821-7494msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144376: Tue Sep 8 00:16:51 2026 read: IOPS=1, BW=4800KiB/s (4915kB/s)(12.0MiB/2560msec) clat (msec): min=767, max=889, avg=844.41, stdev=66.62 lat (msec): min=767, max=889, avg=844.41, stdev=66.62 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.92%, ctx=250, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144377: Tue Sep 8 00:16:51 2026 read: IOPS=0, BW=1804KiB/s (1848kB/s)(4096KiB/2270msec) clat (nsec): min=616747k, max=616747k, avg=616746768.00, stdev= 0.00 lat (nsec): min=616749k, max=616749k, avg=616748841.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3609KiB/s (3695kB/s)(8192KiB/2270msec); 0 zone resets clat (msec): min=282, max=1324, avg=803.52, stdev=736.41 lat (msec): min=283, max=1324, avg=803.89, stdev=736.45 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8159, max= 8159, per=70.32%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.35%, ctx=60, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144378: Tue Sep 8 00:16:51 2026 write: IOPS=1, BW=4351KiB/s (4456kB/s)(12.0MiB/2824msec); 0 zone resets clat (msec): min=835, max=958, avg=917.17, stdev=70.67 lat (msec): min=839, max=959, avg=918.83, stdev=69.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8143, max= 8159, per=70.25%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=9.95%, ctx=123, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144379: Tue Sep 8 00:16:51 2026 write: IOPS=1, BW=5185KiB/s (5309kB/s)(12.0MiB/2370msec); 0 zone resets clat (msec): min=275, max=1626, avg=768.50, stdev=746.02 lat (msec): min=275, max=1627, avg=769.19, stdev=746.26 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 5572, max= 8159, per=59.17%, avg=6865.50, stdev=1829.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.28%, ctx=35, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6400KiB/s (6554kB/s), 1804KiB/s-4800KiB/s (1848kB/s-4915kB/s), io=16.0MiB (16.8MB), run=2270-2560msec WRITE: bw=11.3MiB/s (11.9MB/s), 3609KiB/s-5185KiB/s (3695kB/s-5309kB/s), io=32.0MiB (33.6MB), run=2270-2824msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144380: Tue Sep 8 00:16:52 2026 read: IOPS=1, BW=4100KiB/s (4199kB/s)(12.0MiB/2997msec) clat (msec): min=466, max=1446, avg=964.41, stdev=490.22 lat (msec): min=466, max=1446, avg=964.41, stdev=490.22 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8000, max= 8175, per=100.00%, avg=8087.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.70%, ctx=70, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144381: Tue Sep 8 00:16:52 2026 read: IOPS=0, BW=1454KiB/s (1489kB/s)(4096KiB/2817msec) clat (nsec): min=1135.5M, max=1135.5M, avg=1135484273.00, stdev= 0.00 lat (nsec): min=1135.5M, max=1135.5M, avg=1135486645.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2908KiB/s (2978kB/s)(8192KiB/2817msec); 0 zone resets clat (msec): min=412, max=1195, avg=803.95, stdev=553.46 lat (msec): min=413, max=1195, avg=804.44, stdev=553.45 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8110, max= 8110, per=86.65%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.20%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144382: Tue Sep 8 00:16:52 2026 write: IOPS=0, BW=3510KiB/s (3594kB/s)(12.0MiB/3501msec); 0 zone resets clat (msec): min=285, max=1725, avg=1130.99, stdev=751.82 lat (msec): min=287, max=1725, avg=1131.84, stdev=751.11 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8110, max= 8110, per=86.65%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.69%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144383: Tue Sep 8 00:16:52 2026 write: IOPS=1, BW=4441KiB/s (4547kB/s)(12.0MiB/2767msec); 0 zone resets clat (msec): min=351, max=1753, avg=904.41, stdev=746.56 lat (msec): min=353, max=1754, avg=905.50, stdev=745.86 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 5834, max= 8192, per=74.93%, avg=7013.00, stdev=1667.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.59%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5467KiB/s (5598kB/s), 1454KiB/s-4100KiB/s (1489kB/s-4199kB/s), io=16.0MiB (16.8MB), run=2817-2997msec WRITE: bw=9360KiB/s (9584kB/s), 2908KiB/s-4441KiB/s (2978kB/s-4547kB/s), io=32.0MiB (33.6MB), run=2767-3501msec