== sanity test 398b: DIO and buffer IO race ============== 16:23:27 (1783974207) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.66054 s, 7.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143627: Mon Jul 13 16:25:57 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(5992KiB/128960msec) clat (usec): min=31, max=1053.4k, avg=40931.00, stdev=42278.65 lat (usec): min=31, max=1053.4k, avg=40936.04, stdev=42277.11 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 61], | 20.00th=[ 15533], 30.00th=[ 22414], 40.00th=[ 27919], | 50.00th=[ 34341], 60.00th=[ 41157], 70.00th=[ 51643], | 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[ 145753], 99.50th=[ 181404], 99.90th=[ 278922], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 5, max= 110, per=25.17%, avg=46.31, stdev=20.36, samples=252 iops : min= 1, max= 27, avg=10.91, stdev= 5.10, samples=252 write: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6296KiB/128960msec); 0 zone resets clat (usec): min=832, max=412222, avg=42725.33, stdev=44654.45 lat (usec): min=833, max=412224, avg=42729.36, stdev=44653.75 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1467], 20.00th=[ 4228], | 30.00th=[ 7767], 40.00th=[ 17957], 50.00th=[ 30802], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[122160], | 99.00th=[179307], 99.50th=[217056], 99.90th=[367002], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 7, max= 119, per=25.23%, avg=48.70, stdev=20.36, samples=252 iops : min= 1, max= 29, avg=11.51, stdev= 5.11, samples=252 lat (usec) : 50=1.33%, 100=5.63%, 250=0.46%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=6.54%, 4=3.32%, 10=7.32%, 20=8.92%, 50=32.94% lat (msec) : 100=25.39%, 250=7.55%, 500=0.26%, 2000=0.03% cpu : usr=0.08%, sys=5.37%, ctx=6307, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143629: Mon Jul 13 16:25:57 2026 read: IOPS=11, BW=45.7KiB/s (46.7kB/s)(5940KiB/130109msec) clat (usec): min=30, max=1014.1k, avg=40232.89, stdev=41849.44 lat (usec): min=30, max=1014.1k, avg=40235.55, stdev=41849.16 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 62], | 20.00th=[ 15533], 30.00th=[ 22676], 40.00th=[ 27657], | 50.00th=[ 33817], 60.00th=[ 41157], 70.00th=[ 49021], | 80.00th=[ 60031], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[ 147850], 99.50th=[ 181404], 99.90th=[ 429917], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 111, per=24.78%, avg=45.60, stdev=19.95, samples=252 iops : min= 1, max= 27, avg=10.73, stdev= 5.03, samples=252 write: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6348KiB/130109msec); 0 zone resets clat (usec): min=909, max=368728, avg=44063.79, stdev=45351.72 lat (usec): min=911, max=368730, avg=44077.46, stdev=45342.68 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1844], 20.00th=[ 4948], | 30.00th=[ 9372], 40.00th=[ 20841], 50.00th=[ 32637], 60.00th=[ 44827], | 70.00th=[ 56886], 80.00th=[ 73925], 90.00th=[107480], 95.00th=[130548], | 99.00th=[193987], 99.50th=[242222], 99.90th=[333448], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 124, per=24.98%, avg=48.20, stdev=21.03, samples=254 iops : min= 1, max= 31, avg=11.39, stdev= 5.28, samples=254 lat (usec) : 50=1.24%, 100=5.53%, 250=0.23%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.10% lat (msec) : 2=5.70%, 4=3.09%, 10=7.58%, 20=8.95%, 50=35.03% lat (msec) : 100=24.02%, 250=8.14%, 500=0.20%, 2000=0.03% cpu : usr=0.06%, sys=5.48%, ctx=6310, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143630: Mon Jul 13 16:25:57 2026 read: IOPS=11, BW=46.5KiB/s (47.7kB/s)(6028KiB/129494msec) clat (usec): min=21, max=538330, avg=38745.72, stdev=33472.04 lat (usec): min=21, max=538331, avg=38748.14, stdev=33472.46 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 14484], | 30.00th=[ 21365], 40.00th=[ 26346], 50.00th=[ 32900], 60.00th=[ 39584], | 70.00th=[ 49021], 80.00th=[ 60031], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[135267], 99.50th=[158335], 99.90th=[193987], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=46.73, stdev=21.70, samples=251 iops : min= 1, max= 29, avg=11.02, stdev= 5.44, samples=251 write: IOPS=12, BW=48.3KiB/s (49.5kB/s)(6260KiB/129494msec); 0 zone resets clat (usec): min=860, max=1112.0k, avg=45183.47, stdev=53513.57 lat (usec): min=862, max=1112.0k, avg=45185.29, stdev=53513.51 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 1876], | 20.00th=[ 4948], 30.00th=[ 10159], 40.00th=[ 20579], | 50.00th=[ 33162], 60.00th=[ 44827], 70.00th=[ 58459], | 80.00th=[ 77071], 90.00th=[ 102237], 95.00th=[ 129500], | 99.00th=[ 196084], 99.50th=[ 233833], 99.90th=[ 480248], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 119, per=25.02%, avg=48.29, stdev=19.83, samples=252 iops : min= 1, max= 29, avg=11.40, stdev= 4.97, samples=252 lat (usec) : 50=1.63%, 100=5.63%, 250=0.46%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.31%, 4=3.42%, 10=6.97%, 20=10.12%, 50=33.46% lat (msec) : 100=25.10%, 250=7.52%, 500=0.16%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.45%, ctx=6283, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143632: Mon Jul 13 16:25:57 2026 read: IOPS=11, BW=47.0KiB/s (48.2kB/s)(6052KiB/128661msec) clat (usec): min=31, max=390684, avg=39710.52, stdev=32290.80 lat (usec): min=31, max=390684, avg=39715.50, stdev=32291.51 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 16909], | 30.00th=[ 23462], 40.00th=[ 28181], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 49021], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[158335], 99.90th=[278922], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 104, per=25.58%, avg=47.07, stdev=19.05, samples=249 iops : min= 1, max= 26, avg=11.10, stdev= 4.79, samples=249 write: IOPS=12, BW=48.5KiB/s (49.6kB/s)(6236KiB/128661msec); 0 zone resets clat (usec): min=1050, max=1109.7k, avg=43722.68, stdev=52874.18 lat (usec): min=1051, max=1109.7k, avg=43735.03, stdev=52879.35 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1860], | 20.00th=[ 4817], 30.00th=[ 9241], 40.00th=[ 20055], | 50.00th=[ 32113], 60.00th=[ 42730], 70.00th=[ 54789], | 80.00th=[ 72877], 90.00th=[ 102237], 95.00th=[ 135267], | 99.00th=[ 191890], 99.50th=[ 223347], 99.90th=[ 459277], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 110, per=25.05%, avg=48.35, stdev=20.31, samples=250 iops : min= 1, max= 27, avg=11.43, stdev= 5.11, samples=250 lat (usec) : 50=0.98%, 100=5.47%, 250=0.52%, 500=0.03% lat (msec) : 2=5.66%, 4=3.71%, 10=6.87%, 20=8.69%, 50=36.26% lat (msec) : 100=24.45%, 250=7.06%, 500=0.26%, 2000=0.03% cpu : usr=0.07%, sys=5.47%, ctx=6276, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=185KiB/s (189kB/s), 45.7KiB/s-47.0KiB/s (46.7kB/s-48.2kB/s), io=23.4MiB (24.6MB), run=128661-130109msec WRITE: bw=193KiB/s (198kB/s), 48.3KiB/s-48.8KiB/s (49.5kB/s-49.0kB/s), io=24.6MiB (25.7MB), run=128661-130109msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143625: Mon Jul 13 16:28:47 2026 read: IOPS=4, BW=19.0KiB/s (20.5kB/s)(5992KiB/299685msec) clat (msec): min=6, max=1092, avg=40.13, stdev=43.43 lat (msec): min=6, max=1092, avg=40.13, stdev=43.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 159], 99.50th=[ 207], 99.90th=[ 355], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 96, per=28.41%, avg=22.72, stdev=15.68, samples=508 iops : min= 1, max= 24, avg= 5.05, stdev= 3.95, samples=508 write: IOPS=5, BW=21.0KiB/s (21.5kB/s)(6296KiB/299685msec); 0 zone resets clat (msec): min=42, max=573, avg=151.99, stdev=71.67 lat (msec): min=42, max=573, avg=151.99, stdev=71.67 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 96], | 30.00th=[ 108], 40.00th=[ 121], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 201], 90.00th=[ 249], 95.00th=[ 288], | 99.00th=[ 380], 99.50th=[ 414], 99.90th=[ 567], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 55, per=24.90%, avg=20.67, stdev= 9.53, samples=584 iops : min= 1, max= 13, avg= 4.53, stdev= 2.42, samples=584 lat (msec) : 10=2.15%, 20=13.61%, 50=21.45%, 100=20.44%, 250=37.24% lat (msec) : 500=4.92%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=5542, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143626: Mon Jul 13 16:28:47 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(5940KiB/299725msec) clat (msec): min=5, max=1028, avg=40.39, stdev=43.68 lat (msec): min=5, max=1028, avg=40.39, stdev=43.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 83], 95.00th=[ 110], | 99.00th=[ 180], 99.50th=[ 228], 99.90th=[ 342], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 88, per=28.79%, avg=23.03, stdev=15.79, samples=496 iops : min= 1, max= 22, avg= 5.13, stdev= 3.99, samples=496 write: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6348KiB/299725msec); 0 zone resets clat (msec): min=40, max=641, avg=150.83, stdev=74.20 lat (msec): min=40, max=641, avg=150.83, stdev=74.20 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 105], 40.00th=[ 120], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 414], 99.50th=[ 456], 99.90th=[ 567], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 55, per=24.94%, avg=20.70, stdev= 9.72, samples=588 iops : min= 1, max= 13, avg= 4.54, stdev= 2.48, samples=588 lat (msec) : 10=2.28%, 20=13.35%, 50=21.48%, 100=21.84%, 250=36.07% lat (msec) : 500=4.79%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5561, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143628: Mon Jul 13 16:28:47 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6028KiB/300138msec) clat (msec): min=6, max=334, avg=41.18, stdev=36.41 lat (msec): min=6, max=334, avg=41.18, stdev=36.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 83], 95.00th=[ 111], | 99.00th=[ 188], 99.50th=[ 243], 99.90th=[ 321], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 96, per=28.39%, avg=22.71, stdev=15.24, samples=511 iops : min= 1, max= 24, avg= 5.04, stdev= 3.85, samples=511 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6260KiB/300138msec); 0 zone resets clat (msec): min=43, max=1105, avg=151.90, stdev=75.30 lat (msec): min=43, max=1105, avg=151.91, stdev=75.30 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 121], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 284], | 99.00th=[ 393], 99.50th=[ 468], 99.90th=[ 558], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 55, per=24.71%, avg=20.51, stdev= 9.68, samples=585 iops : min= 1, max= 13, avg= 4.49, stdev= 2.46, samples=585 lat (msec) : 10=2.28%, 20=12.24%, 50=22.17%, 100=21.71%, 250=36.98% lat (msec) : 500=4.43%, 750=0.16%, 2000=0.03% cpu : usr=0.03%, sys=1.30%, ctx=5447, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143631: Mon Jul 13 16:28:47 2026 read: IOPS=5, BW=20.3KiB/s (20.7kB/s)(6052KiB/298822msec) clat (msec): min=5, max=349, avg=40.19, stdev=36.55 lat (msec): min=5, max=349, avg=40.19, stdev=36.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 60], 90.00th=[ 83], 95.00th=[ 109], | 99.00th=[ 182], 99.50th=[ 251], 99.90th=[ 342], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 95, per=29.22%, avg=23.37, stdev=16.15, samples=499 iops : min= 1, max= 23, avg= 5.21, stdev= 4.05, samples=499 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6236KiB/298822msec); 0 zone resets clat (msec): min=38, max=1102, avg=152.44, stdev=75.75 lat (msec): min=38, max=1102, avg=152.44, stdev=75.75 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 95], | 30.00th=[ 109], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 174], 80.00th=[ 203], 90.00th=[ 249], 95.00th=[ 292], | 99.00th=[ 376], 99.50th=[ 435], 99.90th=[ 684], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 55, per=24.83%, avg=20.61, stdev= 9.62, samples=580 iops : min= 1, max= 13, avg= 4.51, stdev= 2.44, samples=580 lat (msec) : 10=2.38%, 20=13.74%, 50=20.61%, 100=21.03%, 250=36.98% lat (msec) : 500=5.11%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5694, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=80.0KiB/s (81.9kB/s), 19.8KiB/s-20.3KiB/s (20.3kB/s-20.7kB/s), io=23.4MiB (24.6MB), run=298822-300138msec WRITE: bw=83.8KiB/s (85.8kB/s), 20.9KiB/s-21.2KiB/s (21.4kB/s-21.7kB/s), io=24.6MiB (25.7MB), run=298822-300138msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143691: Mon Jul 13 16:29:36 2026 read: IOPS=9, BW=155KiB/s (158kB/s)(5920KiB/38259msec) clat (usec): min=37, max=290469, avg=50754.41, stdev=44945.65 lat (usec): min=38, max=290471, avg=50755.84, stdev=44945.81 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 3621], | 30.00th=[ 25035], 40.00th=[ 35914], 50.00th=[ 43779], 60.00th=[ 52691], | 70.00th=[ 65799], 80.00th=[ 80217], 90.00th=[102237], 95.00th=[139461], | 99.00th=[202376], 99.50th=[248513], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 27, max= 410, per=25.39%, avg=158.97, stdev=75.32, samples=73 iops : min= 1, max= 25, avg= 9.15, stdev= 4.77, samples=73 write: IOPS=10, BW=166KiB/s (170kB/s)(6368KiB/38259msec); 0 zone resets clat (usec): min=1621, max=512010, avg=47647.67, stdev=57631.06 lat (usec): min=1623, max=512012, avg=47663.13, stdev=57627.94 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2073], 10.00th=[ 3228], 20.00th=[ 6849], | 30.00th=[ 10814], 40.00th=[ 18220], 50.00th=[ 27132], 60.00th=[ 43254], | 70.00th=[ 59507], 80.00th=[ 80217], 90.00th=[107480], 95.00th=[145753], | 99.00th=[252707], 99.50th=[442500], 99.90th=[513803], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 30, max= 441, per=25.90%, avg=170.45, stdev=90.32, samples=73 iops : min= 1, max= 27, avg= 9.88, stdev= 5.72, samples=73 lat (usec) : 50=0.52%, 100=6.77%, 250=0.91%, 500=0.52%, 1000=0.26% lat (msec) : 2=2.60%, 4=4.17%, 10=8.33%, 20=9.51%, 50=27.34% lat (msec) : 100=27.21%, 250=11.20%, 500=0.52%, 750=0.13% cpu : usr=0.06%, sys=5.03%, ctx=1524, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143692: Mon Jul 13 16:29:36 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5744KiB/34428msec) clat (usec): min=32, max=423342, avg=51304.98, stdev=45452.00 lat (usec): min=33, max=423343, avg=51306.38, stdev=45451.97 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 65], 10.00th=[ 76], 20.00th=[ 17957], | 30.00th=[ 28181], 40.00th=[ 35914], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[103285], 95.00th=[132645], | 99.00th=[187696], 99.50th=[274727], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 32, max= 509, per=27.00%, avg=169.00, stdev=89.94, samples=66 iops : min= 2, max= 31, avg= 9.80, stdev= 5.63, samples=66 write: IOPS=11, BW=190KiB/s (195kB/s)(6544KiB/34428msec); 0 zone resets clat (usec): min=1340, max=335817, avg=38835.81, stdev=47387.53 lat (usec): min=1343, max=335820, avg=38840.43, stdev=47387.85 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1893], 10.00th=[ 2474], 20.00th=[ 4817], | 30.00th=[ 7504], 40.00th=[ 13173], 50.00th=[ 21890], 60.00th=[ 31327], | 70.00th=[ 42730], 80.00th=[ 68682], 90.00th=[103285], 95.00th=[124257], | 99.00th=[235930], 99.50th=[270533], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 509, per=28.72%, avg=189.00, stdev=102.29, samples=67 iops : min= 1, max= 31, avg=11.07, stdev= 6.47, samples=67 lat (usec) : 50=0.39%, 100=5.86%, 250=1.04%, 500=0.26%, 750=0.13% lat (msec) : 2=3.39%, 4=5.08%, 10=10.68%, 20=8.98%, 50=28.91% lat (msec) : 100=24.87%, 250=9.64%, 500=0.78% cpu : usr=0.09%, sys=5.43%, ctx=1510, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143693: Mon Jul 13 16:29:36 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(6256KiB/34413msec) clat (usec): min=35, max=384108, avg=46213.15, stdev=44314.90 lat (usec): min=35, max=384111, avg=46214.73, stdev=44314.87 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 119], | 30.00th=[ 22414], 40.00th=[ 32637], 50.00th=[ 40109], 60.00th=[ 50070], | 70.00th=[ 57410], 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[128451], | 99.00th=[189793], 99.50th=[227541], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 31, max= 480, per=29.75%, avg=186.23, stdev=90.63, samples=66 iops : min= 1, max= 30, avg=10.89, stdev= 5.75, samples=66 write: IOPS=10, BW=175KiB/s (179kB/s)(6032KiB/34413msec); 0 zone resets clat (usec): min=1390, max=553618, avg=42564.46, stdev=58153.54 lat (usec): min=1392, max=553620, avg=42568.31, stdev=58152.64 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1975], 10.00th=[ 2671], 20.00th=[ 4686], | 30.00th=[ 7963], 40.00th=[ 12125], 50.00th=[ 20841], 60.00th=[ 32637], | 70.00th=[ 52167], 80.00th=[ 74974], 90.00th=[108528], 95.00th=[145753], | 99.00th=[214959], 99.50th=[463471], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 63, max= 438, per=28.20%, avg=185.54, stdev=93.64, samples=63 iops : min= 3, max= 27, avg=10.84, stdev= 5.94, samples=63 lat (usec) : 50=1.04%, 100=8.59%, 250=1.95%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.60%, 4=5.99%, 10=9.64%, 20=8.07%, 50=25.91% lat (msec) : 100=25.39%, 250=9.77%, 500=0.39%, 750=0.13% cpu : usr=0.07%, sys=5.44%, ctx=1469, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143694: Mon Jul 13 16:29:36 2026 read: IOPS=11, BW=177KiB/s (182kB/s)(6032KiB/34002msec) clat (usec): min=21, max=452192, avg=47628.47, stdev=49506.80 lat (usec): min=21, max=452194, avg=47630.16, stdev=49506.89 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 106], | 30.00th=[ 25297], 40.00th=[ 33162], 50.00th=[ 40109], 60.00th=[ 47973], | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[221250], 99.50th=[421528], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 29, max= 348, per=28.58%, avg=178.89, stdev=83.72, samples=65 iops : min= 1, max= 21, avg=10.43, stdev= 5.30, samples=65 write: IOPS=11, BW=184KiB/s (188kB/s)(6256KiB/34002msec); 0 zone resets clat (usec): min=1433, max=316006, avg=40327.57, stdev=50082.19 lat (usec): min=1434, max=316009, avg=40338.76, stdev=50094.93 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2040], 10.00th=[ 3163], 20.00th=[ 5538], | 30.00th=[ 8717], 40.00th=[ 12387], 50.00th=[ 18482], 60.00th=[ 28967], | 70.00th=[ 49021], 80.00th=[ 68682], 90.00th=[104334], 95.00th=[143655], | 99.00th=[229639], 99.50th=[299893], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 416, per=27.95%, avg=183.88, stdev=88.26, samples=66 iops : min= 1, max= 26, avg=10.73, stdev= 5.59, samples=66 lat (usec) : 50=1.17%, 100=8.33%, 250=0.78%, 500=0.26% lat (msec) : 2=2.47%, 4=5.34%, 10=9.90%, 20=10.94%, 50=27.47% lat (msec) : 100=23.44%, 250=9.24%, 500=0.65% cpu : usr=0.09%, sys=5.17%, ctx=1471, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=626KiB/s (641kB/s), 155KiB/s-182KiB/s (158kB/s-186kB/s), io=23.4MiB (24.5MB), run=34002-38259msec WRITE: bw=659KiB/s (674kB/s), 166KiB/s-190KiB/s (170kB/s-195kB/s), io=24.6MiB (25.8MB), run=34002-38259msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143695: Mon Jul 13 16:30:24 2026 read: IOPS=4, BW=68.6KiB/s (70.3kB/s)(5920KiB/86274msec) clat (msec): min=7, max=351, avg=45.93, stdev=50.13 lat (msec): min=7, max=351, avg=45.93, stdev=50.13 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 91], 95.00th=[ 159], | 99.00th=[ 271], 99.50th=[ 334], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 314, per=30.77%, avg=84.62, stdev=53.31, samples=137 iops : min= 1, max= 19, avg= 4.49, stdev= 3.36, samples=137 write: IOPS=4, BW=73.8KiB/s (75.6kB/s)(6368KiB/86274msec); 0 zone resets clat (msec): min=52, max=637, avg=173.10, stdev=86.05 lat (msec): min=52, max=637, avg=173.10, stdev=86.05 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 79], 10.00th=[ 90], 20.00th=[ 104], | 30.00th=[ 118], 40.00th=[ 134], 50.00th=[ 155], 60.00th=[ 176], | 70.00th=[ 197], 80.00th=[ 230], 90.00th=[ 284], 95.00th=[ 338], | 99.00th=[ 514], 99.50th=[ 567], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 30, max= 192, per=26.42%, avg=76.61, stdev=37.03, samples=163 iops : min= 1, max= 12, avg= 3.98, stdev= 2.41, samples=163 lat (msec) : 10=1.56%, 20=10.55%, 50=24.35%, 100=17.45%, 250=37.76% lat (msec) : 500=7.81%, 750=0.52% cpu : usr=0.04%, sys=1.14%, ctx=1304, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143696: Mon Jul 13 16:30:24 2026 read: IOPS=4, BW=66.1KiB/s (67.7kB/s)(5744KiB/86891msec) clat (msec): min=8, max=405, avg=45.91, stdev=53.01 lat (msec): min=8, max=405, avg=45.91, stdev=53.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 97], 95.00th=[ 155], | 99.00th=[ 342], 99.50th=[ 388], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 27, max= 288, per=31.27%, avg=85.98, stdev=58.48, samples=130 iops : min= 1, max= 18, avg= 4.58, stdev= 3.77, samples=130 write: IOPS=4, BW=75.3KiB/s (77.1kB/s)(6544KiB/86891msec); 0 zone resets clat (msec): min=44, max=553, avg=171.78, stdev=84.87 lat (msec): min=44, max=553, avg=171.79, stdev=84.86 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 88], 20.00th=[ 106], | 30.00th=[ 122], 40.00th=[ 136], 50.00th=[ 153], 60.00th=[ 171], | 70.00th=[ 197], 80.00th=[ 230], 90.00th=[ 279], 95.00th=[ 334], | 99.00th=[ 460], 99.50th=[ 493], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 192, per=26.55%, avg=76.98, stdev=34.19, samples=165 iops : min= 1, max= 12, avg= 4.00, stdev= 2.23, samples=165 lat (msec) : 10=1.43%, 20=12.50%, 50=22.27%, 100=15.10%, 250=39.71% lat (msec) : 500=8.85%, 750=0.13% cpu : usr=0.04%, sys=1.20%, ctx=1376, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143697: Mon Jul 13 16:30:24 2026 read: IOPS=4, BW=76.1KiB/s (77.9kB/s)(6256KiB/82197msec) clat (msec): min=7, max=360, avg=43.40, stdev=47.07 lat (msec): min=7, max=360, avg=43.40, stdev=47.07 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 92], 95.00th=[ 125], | 99.00th=[ 266], 99.50th=[ 342], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 377, per=32.28%, avg=88.76, stdev=64.01, samples=139 iops : min= 1, max= 23, avg= 4.74, stdev= 4.06, samples=139 write: IOPS=4, BW=73.4KiB/s (75.1kB/s)(6032KiB/82197msec); 0 zone resets clat (msec): min=45, max=1021, avg=172.04, stdev=98.60 lat (msec): min=45, max=1021, avg=172.06, stdev=98.65 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 79], 10.00th=[ 88], 20.00th=[ 104], | 30.00th=[ 117], 40.00th=[ 129], 50.00th=[ 144], 60.00th=[ 167], | 70.00th=[ 186], 80.00th=[ 226], 90.00th=[ 288], 95.00th=[ 342], | 99.00th=[ 493], 99.50th=[ 634], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 30, max= 192, per=26.47%, avg=76.75, stdev=35.40, samples=154 iops : min= 1, max= 12, avg= 3.98, stdev= 2.30, samples=154 lat (msec) : 10=1.30%, 20=11.72%, 50=27.08%, 100=14.97%, 250=36.20% lat (msec) : 500=8.33%, 750=0.26%, 2000=0.13% cpu : usr=0.03%, sys=1.16%, ctx=1311, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143698: Mon Jul 13 16:30:24 2026 read: IOPS=4, BW=69.6KiB/s (71.3kB/s)(6032KiB/86628msec) clat (msec): min=5, max=351, avg=48.12, stdev=55.83 lat (msec): min=5, max=351, avg=48.12, stdev=55.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 103], 95.00th=[ 188], | 99.00th=[ 296], 99.50th=[ 338], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 288, per=31.49%, avg=86.61, stdev=54.15, samples=136 iops : min= 1, max= 18, avg= 4.61, stdev= 3.46, samples=136 write: IOPS=4, BW=72.2KiB/s (73.9kB/s)(6256KiB/86628msec); 0 zone resets clat (msec): min=41, max=1013, avg=173.73, stdev=94.19 lat (msec): min=41, max=1013, avg=173.73, stdev=94.19 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 77], 10.00th=[ 90], 20.00th=[ 105], | 30.00th=[ 123], 40.00th=[ 136], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 194], 80.00th=[ 230], 90.00th=[ 288], 95.00th=[ 338], | 99.00th=[ 567], 99.50th=[ 625], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 30, max= 160, per=25.85%, avg=74.96, stdev=35.68, samples=164 iops : min= 1, max= 10, avg= 3.87, stdev= 2.34, samples=164 lat (msec) : 10=0.65%, 20=11.59%, 50=25.78%, 100=14.32%, 250=38.93% lat (msec) : 500=8.07%, 750=0.52%, 2000=0.13% cpu : usr=0.03%, sys=1.17%, ctx=1319, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=276KiB/s (282kB/s), 66.1KiB/s-76.1KiB/s (67.7kB/s-77.9kB/s), io=23.4MiB (24.5MB), run=82197-86891msec WRITE: bw=290KiB/s (297kB/s), 72.2KiB/s-75.3KiB/s (73.9kB/s-77.1kB/s), io=24.6MiB (25.8MB), run=82197-86891msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143721: Mon Jul 13 16:30:41 2026 read: IOPS=1, BW=1579KiB/s (1617kB/s)(7168KiB/4540msec) clat (msec): min=97, max=812, avg=387.66, stdev=329.56 lat (msec): min=97, max=812, avg=387.66, stdev=329.56 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 114], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 178], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 802], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1906, max= 3946, per=55.07%, avg=2367.60, stdev=883.28, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1128KiB/s (1155kB/s)(5120KiB/4540msec); 0 zone resets clat (msec): min=179, max=355, avg=264.75, stdev=79.12 lat (msec): min=179, max=356, avg=264.89, stdev=79.15 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2003, max= 3953, per=44.14%, avg=2657.00, stdev=1122.38, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=3.57%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143722: Mon Jul 13 16:30:41 2026 read: IOPS=0, BW=430KiB/s (440kB/s)(2048KiB/4763msec) clat (msec): min=229, max=256, avg=242.73, stdev=18.93 lat (msec): min=229, max=256, avg=242.74, stdev=18.93 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1973, max= 2019, per=46.43%, avg=1996.00, stdev=32.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2150KiB/s (2202kB/s)(10.0MiB/4763msec); 0 zone resets clat (msec): min=161, max=1118, avg=412.78, stdev=297.72 lat (msec): min=161, max=1118, avg=413.37, stdev=297.54 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 184], | 30.00th=[ 203], 40.00th=[ 266], 50.00th=[ 300], 60.00th=[ 313], | 70.00th=[ 376], 80.00th=[ 506], 90.00th=[ 709], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1950, max= 6023, per=49.52%, avg=2980.50, stdev=1655.83, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.13%, sys=3.99%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143724: Mon Jul 13 16:30:41 2026 read: IOPS=1, BW=1344KiB/s (1376kB/s)(6144KiB/4571msec) clat (msec): min=43, max=851, avg=241.85, stdev=306.42 lat (msec): min=43, max=851, avg=241.85, stdev=306.42 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 62], | 30.00th=[ 62], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 161], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1950, max= 4079, per=62.05%, avg=2667.33, stdev=1222.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1344KiB/s (1376kB/s)(6144KiB/4571msec); 0 zone resets clat (msec): min=118, max=965, avg=471.02, stdev=282.73 lat (msec): min=118, max=965, avg=471.14, stdev=282.73 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 435], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1950, max= 2039, per=33.28%, avg=2003.00, stdev=40.87, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 1000=16.67% cpu : usr=0.02%, sys=3.22%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143726: Mon Jul 13 16:30:41 2026 read: IOPS=1, BW=1144KiB/s (1171kB/s)(5120KiB/4476msec) clat (msec): min=136, max=968, avg=349.96, stdev=350.95 lat (msec): min=136, max=968, avg=349.96, stdev=350.95 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 3900, max= 3946, per=91.25%, avg=3923.00, stdev=32.53, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1601KiB/s (1640kB/s)(7168KiB/4476msec); 0 zone resets clat (msec): min=199, max=680, avg=377.77, stdev=178.08 lat (msec): min=199, max=680, avg=378.35, stdev=177.88 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 239], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 321], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 567], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1976, max= 4079, per=40.22%, avg=2421.00, stdev=927.14, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.82%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4300KiB/s (4403kB/s), 430KiB/s-1579KiB/s (440kB/s-1617kB/s), io=20.0MiB (20.0MB), run=4476-4763msec WRITE: bw=6020KiB/s (6164kB/s), 1128KiB/s-2150KiB/s (1155kB/s-2202kB/s), io=28.0MiB (29.4MB), run=4476-4763msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143723: Mon Jul 13 16:30:41 2026 read: IOPS=2, BW=2100KiB/s (2151kB/s)(7168KiB/3413msec) clat (usec): min=525, max=525684, avg=235401.31, stdev=220839.75 lat (usec): min=527, max=525686, avg=235402.68, stdev=220839.88 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 930], | 30.00th=[ 21890], 40.00th=[ 21890], 50.00th=[337642], 60.00th=[371196], | 70.00th=[371196], 80.00th=[387974], 90.00th=[526386], 95.00th=[526386], | 99.00th=[526386], 99.50th=[526386], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 1943, max= 4039, per=68.73%, avg=2980.25, stdev=1148.71, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1500KiB/s (1536kB/s)(5120KiB/3413msec); 0 zone resets clat (msec): min=148, max=460, avg=272.72, stdev=120.64 lat (msec): min=148, max=460, avg=272.82, stdev=120.65 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2019, max= 4087, per=44.68%, avg=2712.33, stdev=1190.51, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 50=8.33%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=11.61%, ctx=145, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143725: Mon Jul 13 16:30:41 2026 read: IOPS=0, BW=434KiB/s (444kB/s)(2048KiB/4723msec) clat (usec): min=819, max=399076, avg=199948.13, stdev=281610.53 lat (usec): min=820, max=399079, avg=199949.87, stdev=281611.21 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], 20.00th=[ 824], | 30.00th=[ 824], 40.00th=[ 824], 50.00th=[ 824], 60.00th=[400557], | 70.00th=[400557], 80.00th=[400557], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 1954, max= 2031, per=45.95%, avg=1992.50, stdev=54.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2168KiB/s (2220kB/s)(10.0MiB/4723msec); 0 zone resets clat (msec): min=161, max=867, avg=399.01, stdev=245.83 lat (msec): min=161, max=867, avg=399.12, stdev=245.83 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 178], | 30.00th=[ 203], 40.00th=[ 234], 50.00th=[ 317], 60.00th=[ 338], | 70.00th=[ 426], 80.00th=[ 502], 90.00th=[ 760], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1943, max= 4096, per=46.45%, avg=2819.80, stdev=1150.66, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=12.01%, ctx=151, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143727: Mon Jul 13 16:30:41 2026 read: IOPS=2, BW=2108KiB/s (2158kB/s)(6144KiB/2915msec) clat (usec): min=418, max=351883, avg=179053.32, stdev=160839.38 lat (usec): min=419, max=351884, avg=179054.58, stdev=160839.35 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[113771], 50.00th=[113771], 60.00th=[287310], | 70.00th=[316670], 80.00th=[316670], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 1943, max= 3908, per=57.16%, avg=2478.25, stdev=954.12, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=2, BW=2108KiB/s (2158kB/s)(6144KiB/2915msec); 0 zone resets clat (msec): min=212, max=507, avg=299.64, stdev=108.71 lat (msec): min=212, max=507, avg=299.71, stdev=108.70 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1954, max= 2925, per=36.82%, avg=2235.25, stdev=461.37, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=13.14%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143728: Mon Jul 13 16:30:41 2026 read: IOPS=1, BW=1382KiB/s (1415kB/s)(5120KiB/3704msec) clat (usec): min=488, max=276283, avg=146585.42, stdev=134787.89 lat (usec): min=489, max=276283, avg=146586.52, stdev=134787.70 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[225444], 60.00th=[225444], | 70.00th=[229639], 80.00th=[229639], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1935KiB/s (1982kB/s)(7168KiB/3704msec); 0 zone resets clat (msec): min=172, max=889, avg=370.03, stdev=240.40 lat (msec): min=172, max=889, avg=370.31, stdev=240.39 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 199], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 330], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 363], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 3886, max= 4063, per=65.83%, avg=3996.00, stdev=96.02, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.03%, sys=10.34%, ctx=148, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4336KiB/s (4440kB/s), 434KiB/s-2108KiB/s (444kB/s-2158kB/s), io=20.0MiB (20.0MB), run=2915-4723msec WRITE: bw=6071KiB/s (6216kB/s), 1500KiB/s-2168KiB/s (1536kB/s-2220kB/s), io=28.0MiB (29.4MB), run=2915-4723msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143735: Mon Jul 13 16:30:55 2026 read: IOPS=1, BW=4100KiB/s (4199kB/s)(12.0MiB/2997msec) clat (msec): min=805, max=1045, avg=943.58, stdev=124.00 lat (msec): min=805, max=1045, avg=943.59, stdev=124.00 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8000, max= 8110, per=100.00%, avg=8055.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.40%, sys=10.31%, ctx=279, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143737: Mon Jul 13 16:30:55 2026 read: IOPS=0, BW=1018KiB/s (1042kB/s)(4096KiB/4024msec) clat (nsec): min=1119.3M, max=1119.3M, avg=1119264958.00, stdev= 0.00 lat (nsec): min=1119.3M, max=1119.3M, avg=1119267358.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2036KiB/s (2085kB/s)(8192KiB/4024msec); 0 zone resets clat (msec): min=1099, max=1603, avg=1351.46, stdev=355.96 lat (msec): min=1100, max=1603, avg=1351.91, stdev=355.98 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8110, max= 8110, per=99.59%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=5.57%, ctx=252, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143738: Mon Jul 13 16:30:55 2026 write: IOPS=0, BW=3122KiB/s (3197kB/s)(12.0MiB/3936msec); 0 zone resets clat (msec): min=423, max=1898, avg=1260.85, stdev=757.34 lat (msec): min=425, max=1900, avg=1262.62, stdev=757.34 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8000, max= 8159, per=99.22%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.41%, ctx=104, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143740: Mon Jul 13 16:30:55 2026 write: IOPS=1, BW=4191KiB/s (4292kB/s)(12.0MiB/2932msec); 0 zone resets clat (msec): min=510, max=1533, avg=947.64, stdev=527.23 lat (msec): min=511, max=1533, avg=948.10, stdev=527.29 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7846, max= 8031, per=97.49%, avg=7938.50, stdev=130.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.68%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4072KiB/s (4169kB/s), 1018KiB/s-4100KiB/s (1042kB/s-4199kB/s), io=16.0MiB (16.8MB), run=2997-4024msec WRITE: bw=8143KiB/s (8339kB/s), 2036KiB/s-4191KiB/s (2085kB/s-4292kB/s), io=32.0MiB (33.6MB), run=2932-4024msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143736: Mon Jul 13 16:30:56 2026 read: IOPS=0, BW=3481KiB/s (3565kB/s)(12.0MiB/3530msec) clat (msec): min=663, max=1808, avg=1138.62, stdev=596.84 lat (msec): min=663, max=1808, avg=1138.62, stdev=596.84 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.17%, sys=2.47%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143739: Mon Jul 13 16:30:56 2026 read: IOPS=0, BW=910KiB/s (931kB/s)(4096KiB/4503msec) clat (nsec): min=2156.9M, max=2156.9M, avg=2156914376.00, stdev= 0.00 lat (nsec): min=2156.9M, max=2156.9M, avg=2156916831.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2165], 5.00th=[ 2165], 10.00th=[ 2165], 20.00th=[ 2165], | 30.00th=[ 2165], 40.00th=[ 2165], 50.00th=[ 2165], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1819KiB/s (1863kB/s)(8192KiB/4503msec); 0 zone resets clat (msec): min=833, max=1204, avg=1018.89, stdev=262.63 lat (msec): min=833, max=1208, avg=1021.24, stdev=265.47 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.09%, ctx=104, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143741: Mon Jul 13 16:30:56 2026 write: IOPS=0, BW=2887KiB/s (2957kB/s)(12.0MiB/4256msec); 0 zone resets clat (msec): min=362, max=1973, avg=1395.90, stdev=896.90 lat (msec): min=363, max=1975, avg=1396.80, stdev=897.41 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 1854], 50.00th=[ 1854], 60.00th=[ 1854], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8078, max= 8110, per=100.00%, avg=8094.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.16%, sys=2.40%, ctx=32, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143742: Mon Jul 13 16:30:56 2026 write: IOPS=0, BW=3729KiB/s (3819kB/s)(12.0MiB/3295msec); 0 zone resets clat (msec): min=900, max=1364, avg=1079.31, stdev=249.71 lat (msec): min=901, max=1366, avg=1080.26, stdev=250.71 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7968, max= 8192, per=100.00%, avg=8080.00, stdev=158.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.06%, sys=3.88%, ctx=49, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3638KiB/s (3726kB/s), 910KiB/s-3481KiB/s (931kB/s-3565kB/s), io=16.0MiB (16.8MB), run=3530-4503msec WRITE: bw=7277KiB/s (7452kB/s), 1819KiB/s-3729KiB/s (1863kB/s-3819kB/s), io=32.0MiB (33.6MB), run=3295-4503msec