== sanity test 398b: DIO and buffer IO race ============== 17:40:31 (1790718031) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.14728 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179363: Tue Sep 29 17:42:41 2026 read: IOPS=13, BW=53.0KiB/s (55.3kB/s)(5992KiB/110997msec) clat (usec): min=41, max=990304, avg=41205.00, stdev=37696.69 lat (usec): min=42, max=990307, avg=41207.89, stdev=37695.87 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11731], 10.00th=[ 14877], 20.00th=[ 20055], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[158335], 99.50th=[177210], 99.90th=[308282], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 117, per=24.99%, avg=53.99, stdev=19.93, samples=217 iops : min= 1, max= 29, avg=12.85, stdev= 5.05, samples=217 write: IOPS=14, BW=56.7KiB/s (58.1kB/s)(6296KiB/110997msec); 0 zone resets clat (usec): min=896, max=230047, avg=31018.09, stdev=32372.82 lat (usec): min=897, max=230049, avg=31020.98, stdev=32372.26 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1713], 20.00th=[ 3490], | 30.00th=[ 7242], 40.00th=[ 14091], 50.00th=[ 21365], 60.00th=[ 28181], | 70.00th=[ 39584], 80.00th=[ 55313], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[162530], 99.90th=[202376], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 172, per=25.23%, avg=57.01, stdev=24.99, samples=216 iops : min= 1, max= 43, avg=13.61, stdev= 6.31, samples=216 lat (usec) : 50=0.16%, 100=1.24%, 250=0.20%, 750=0.03%, 1000=0.10% lat (msec) : 2=6.22%, 4=4.92%, 10=7.00%, 20=14.45%, 50=40.95% lat (msec) : 100=21.06%, 250=3.61%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.53%, ctx=6611, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179365: Tue Sep 29 17:42:41 2026 read: IOPS=13, BW=54.4KiB/s (55.7kB/s)(5940KiB/109131msec) clat (usec): min=46, max=295507, avg=39864.71, stdev=25426.06 lat (usec): min=46, max=295508, avg=39866.26, stdev=25425.96 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 10683], 10.00th=[ 15401], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 70779], 95.00th=[ 82314], | 99.00th=[132645], 99.50th=[143655], 99.90th=[193987], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 5, max= 118, per=25.11%, avg=54.24, stdev=19.63, samples=214 iops : min= 1, max= 29, avg=12.92, stdev= 4.98, samples=214 write: IOPS=14, BW=58.2KiB/s (59.6kB/s)(6348KiB/109131msec); 0 zone resets clat (usec): min=1001, max=934006, avg=31188.33, stdev=39227.29 lat (usec): min=1001, max=934007, avg=31189.97, stdev=39227.16 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1237], 10.00th=[ 1729], 20.00th=[ 3654], | 30.00th=[ 7570], 40.00th=[ 14746], 50.00th=[ 21627], 60.00th=[ 28181], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 73925], 95.00th=[ 96994], | 99.00th=[139461], 99.50th=[168821], 99.90th=[227541], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 127, per=25.71%, avg=58.10, stdev=24.43, samples=213 iops : min= 1, max= 31, avg=13.90, stdev= 6.12, samples=213 lat (usec) : 50=0.10%, 100=1.30%, 250=0.26%, 1000=0.03% lat (msec) : 2=6.28%, 4=4.79%, 10=7.13%, 20=13.31%, 50=42.90% lat (msec) : 100=20.28%, 250=3.55%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.75%, ctx=6490, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179366: Tue Sep 29 17:42:41 2026 read: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6028KiB/110813msec) clat (usec): min=39, max=968633, avg=40017.50, stdev=34349.64 lat (usec): min=39, max=968634, avg=40019.39, stdev=34349.72 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11076], 10.00th=[ 16319], 20.00th=[ 21365], | 30.00th=[ 25035], 40.00th=[ 29230], 50.00th=[ 33817], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 56886], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[122160], 99.50th=[147850], 99.90th=[214959], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 5, max= 118, per=25.12%, avg=54.25, stdev=19.98, samples=217 iops : min= 1, max= 29, avg=12.92, stdev= 5.02, samples=217 write: IOPS=14, BW=56.5KiB/s (57.8kB/s)(6260KiB/110813msec); 0 zone resets clat (usec): min=979, max=315623, avg=31981.39, stdev=32570.56 lat (usec): min=979, max=315624, avg=31985.08, stdev=32571.39 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1631], 20.00th=[ 3621], | 30.00th=[ 7635], 40.00th=[ 16188], 50.00th=[ 23200], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 55313], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[132645], 99.50th=[149947], 99.90th=[231736], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 150, per=24.90%, avg=56.27, stdev=22.53, samples=217 iops : min= 1, max= 37, avg=13.43, stdev= 5.68, samples=217 lat (usec) : 50=0.26%, 100=1.37%, 250=0.07%, 750=0.03%, 1000=0.13% lat (msec) : 2=6.05%, 4=4.92%, 10=6.67%, 20=11.75%, 50=43.82% lat (msec) : 100=21.84%, 250=3.03%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.49%, ctx=6606, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179367: Tue Sep 29 17:42:41 2026 read: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6052KiB/109211msec) clat (usec): min=32, max=861291, avg=40515.82, stdev=34558.99 lat (usec): min=33, max=861293, avg=40522.80, stdev=34558.23 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11076], 10.00th=[ 15139], 20.00th=[ 19792], | 30.00th=[ 24249], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 46400], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[173016], 99.90th=[242222], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 15, max= 111, per=25.61%, avg=55.32, stdev=19.93, samples=214 iops : min= 3, max= 27, avg=13.18, stdev= 5.00, samples=214 write: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6236KiB/109211msec); 0 zone resets clat (usec): min=1034, max=301233, avg=30449.99, stdev=32938.09 lat (usec): min=1035, max=301234, avg=30457.54, stdev=32939.58 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1205], 10.00th=[ 1549], 20.00th=[ 3523], | 30.00th=[ 6456], 40.00th=[ 13435], 50.00th=[ 21627], 60.00th=[ 28705], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[143655], 99.50th=[164627], 99.90th=[263193], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 119, per=25.19%, avg=56.92, stdev=22.89, samples=214 iops : min= 1, max= 29, avg=13.59, stdev= 5.76, samples=214 lat (usec) : 50=0.20%, 100=1.37%, 250=0.13%, 500=0.03%, 750=0.03% lat (msec) : 2=6.61%, 4=4.59%, 10=7.39%, 20=13.48%, 50=43.00% lat (msec) : 100=19.17%, 250=3.87%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.44%, ctx=6441, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=216KiB/s (222kB/s), 53.0KiB/s-55.4KiB/s (55.3kB/s-56.7kB/s), io=23.4MiB (24.6MB), run=109131-110997msec WRITE: bw=226KiB/s (232kB/s), 56.5KiB/s-58.2KiB/s (57.8kB/s-59.6kB/s), io=24.6MiB (25.7MB), run=109131-110997msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179368: Tue Sep 29 17:43:23 2026 read: IOPS=9, BW=39.5KiB/s (40.5kB/s)(5992KiB/151527msec) clat (msec): min=5, max=928, avg=40.29, stdev=42.76 lat (msec): min=5, max=928, avg=40.30, stdev=42.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 111], | 99.00th=[ 186], 99.50th=[ 215], 99.90th=[ 321], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 143, per=25.53%, avg=39.82, stdev=25.51, samples=294 iops : min= 1, max= 35, avg= 9.30, stdev= 6.42, samples=294 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6296KiB/151527msec); 0 zone resets clat (msec): min=11, max=307, avg=57.70, stdev=36.67 lat (msec): min=11, max=307, avg=57.70, stdev=36.67 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 130], | 99.00th=[ 186], 99.50th=[ 211], 99.90th=[ 251], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 134, per=25.26%, avg=41.42, stdev=23.00, samples=297 iops : min= 1, max= 33, avg= 9.70, stdev= 5.77, samples=297 lat (msec) : 10=2.44%, 20=16.34%, 50=46.09%, 100=25.29%, 250=9.60% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=1.86%, ctx=4845, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179369: Tue Sep 29 17:43:23 2026 read: IOPS=9, BW=39.2KiB/s (40.1kB/s)(5940KiB/151671msec) clat (msec): min=5, max=945, avg=39.74, stdev=43.72 lat (msec): min=5, max=945, avg=39.75, stdev=43.72 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 87], 95.00th=[ 115], | 99.00th=[ 182], 99.50th=[ 241], 99.90th=[ 305], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 134, per=25.60%, avg=39.93, stdev=25.83, samples=290 iops : min= 1, max= 33, avg= 9.33, stdev= 6.49, samples=290 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6348KiB/151671msec); 0 zone resets clat (msec): min=9, max=299, avg=58.16, stdev=36.21 lat (msec): min=9, max=299, avg=58.16, stdev=36.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 85], 90.00th=[ 108], 95.00th=[ 132], | 99.00th=[ 180], 99.50th=[ 192], 99.90th=[ 266], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 119, per=25.43%, avg=41.71, stdev=22.88, samples=297 iops : min= 1, max= 29, avg= 9.78, stdev= 5.74, samples=297 lat (msec) : 10=3.03%, 20=17.06%, 50=44.27%, 100=25.62%, 250=9.80% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=1.93%, ctx=4861, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179370: Tue Sep 29 17:43:23 2026 read: IOPS=9, BW=39.4KiB/s (40.3kB/s)(6028KiB/153103msec) clat (msec): min=5, max=266, avg=39.73, stdev=35.17 lat (msec): min=5, max=266, avg=39.73, stdev=35.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 110], | 99.00th=[ 176], 99.50th=[ 201], 99.90th=[ 251], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 7, max= 151, per=25.38%, avg=39.60, stdev=25.48, samples=297 iops : min= 1, max= 37, avg= 9.25, stdev= 6.41, samples=297 write: IOPS=10, BW=40.9KiB/s (41.9kB/s)(6260KiB/153103msec); 0 zone resets clat (msec): min=10, max=940, avg=59.35, stdev=45.81 lat (msec): min=10, max=940, avg=59.35, stdev=45.81 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 113], 95.00th=[ 138], | 99.00th=[ 188], 99.50th=[ 264], 99.90th=[ 309], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 119, per=24.72%, avg=40.54, stdev=24.65, samples=301 iops : min= 1, max= 29, avg= 9.49, stdev= 6.18, samples=301 lat (msec) : 10=2.38%, 20=16.99%, 50=45.80%, 100=24.09%, 250=10.38% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.07%, sys=1.87%, ctx=4892, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179371: Tue Sep 29 17:43:23 2026 read: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6052KiB/152769msec) clat (msec): min=4, max=300, avg=39.95, stdev=36.09 lat (msec): min=4, max=300, avg=39.96, stdev=36.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 88], 95.00th=[ 116], | 99.00th=[ 176], 99.50th=[ 205], 99.90th=[ 262], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 151, per=25.54%, avg=39.84, stdev=25.58, samples=296 iops : min= 1, max= 37, avg= 9.31, stdev= 6.40, samples=296 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6236KiB/152769msec); 0 zone resets clat (msec): min=9, max=981, avg=59.01, stdev=45.49 lat (msec): min=9, max=981, avg=59.01, stdev=45.49 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 111], 95.00th=[ 133], | 99.00th=[ 209], 99.50th=[ 259], 99.90th=[ 309], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 119, per=24.93%, avg=40.88, stdev=22.35, samples=297 iops : min= 1, max= 29, avg= 9.57, stdev= 5.63, samples=297 lat (msec) : 10=3.09%, 20=15.76%, 50=46.48%, 100=24.28%, 250=10.03% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.94%, ctx=4796, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=157KiB/s (161kB/s), 39.2KiB/s-39.6KiB/s (40.1kB/s-40.6kB/s), io=23.4MiB (24.6MB), run=151527-153103msec WRITE: bw=164KiB/s (168kB/s), 40.8KiB/s-41.9KiB/s (41.8kB/s-42.9kB/s), io=24.6MiB (25.7MB), run=151527-153103msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179423: Tue Sep 29 17:44:08 2026 read: IOPS=11, BW=176KiB/s (181kB/s)(5920KiB/33569msec) clat (usec): min=39, max=213656, avg=48286.76, stdev=33614.07 lat (usec): min=39, max=213657, avg=48287.90, stdev=33614.07 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 114], 20.00th=[ 23462], | 30.00th=[ 29754], 40.00th=[ 34866], 50.00th=[ 42730], 60.00th=[ 51119], | 70.00th=[ 62129], 80.00th=[ 73925], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[162530], 99.50th=[183501], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 480, per=24.13%, avg=172.08, stdev=70.28, samples=65 iops : min= 1, max= 30, avg=10.05, stdev= 4.55, samples=65 write: IOPS=11, BW=190KiB/s (194kB/s)(6368KiB/33569msec); 0 zone resets clat (usec): min=1294, max=313288, avg=39300.42, stdev=43014.30 lat (usec): min=1295, max=313290, avg=39304.42, stdev=43018.58 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1975], 10.00th=[ 3523], 20.00th=[ 6259], | 30.00th=[ 9503], 40.00th=[ 16581], 50.00th=[ 25822], 60.00th=[ 33817], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[122160], | 99.00th=[210764], 99.50th=[287310], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 512, per=24.98%, avg=187.38, stdev=93.39, samples=65 iops : min= 1, max= 32, avg=11.02, stdev= 5.95, samples=65 lat (usec) : 50=0.65%, 100=4.04%, 250=0.26% lat (msec) : 2=2.86%, 4=3.26%, 10=10.81%, 20=8.46%, 50=34.24% lat (msec) : 100=27.47%, 250=7.68%, 500=0.26% cpu : usr=0.06%, sys=5.56%, ctx=1617, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179424: Tue Sep 29 17:44:08 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(5744KiB/32784msec) clat (usec): min=45, max=284877, avg=49319.95, stdev=35475.07 lat (usec): min=46, max=284878, avg=49323.32, stdev=35473.49 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 64], 10.00th=[ 13304], 20.00th=[ 22938], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 61604], 80.00th=[ 74974], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[170918], 99.50th=[175113], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 415, per=24.52%, avg=174.86, stdev=86.06, samples=64 iops : min= 1, max= 25, avg=10.22, stdev= 5.49, samples=64 write: IOPS=12, BW=200KiB/s (204kB/s)(6544KiB/32784msec); 0 zone resets clat (usec): min=1347, max=192803, avg=36754.70, stdev=35417.65 lat (usec): min=1348, max=192806, avg=36761.92, stdev=35413.75 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2147], 10.00th=[ 3851], 20.00th=[ 7898], | 30.00th=[ 10945], 40.00th=[ 17433], 50.00th=[ 27919], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[158335], 99.50th=[181404], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 32, max= 446, per=26.50%, avg=198.78, stdev=84.85, samples=64 iops : min= 2, max= 27, avg=11.73, stdev= 5.38, samples=64 lat (usec) : 50=0.13%, 100=3.26%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=2.34%, 4=2.99%, 10=8.72%, 20=12.89%, 50=36.33% lat (msec) : 100=25.65%, 250=6.77%, 500=0.13% cpu : usr=0.05%, sys=5.54%, ctx=1715, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179425: Tue Sep 29 17:44:08 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(6256KiB/33022msec) clat (usec): min=42, max=359378, avg=46260.62, stdev=35314.89 lat (usec): min=42, max=359378, avg=46261.78, stdev=35314.86 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 188], 20.00th=[ 21627], | 30.00th=[ 27919], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[106431], | 99.00th=[143655], 99.50th=[181404], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 59, max= 410, per=26.25%, avg=187.16, stdev=84.87, samples=64 iops : min= 3, max= 25, avg=11.00, stdev= 5.38, samples=64 write: IOPS=11, BW=183KiB/s (187kB/s)(6032KiB/33022msec); 0 zone resets clat (usec): min=1640, max=202920, avg=39460.48, stdev=37854.54 lat (usec): min=1641, max=202921, avg=39469.09, stdev=37854.96 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1876], 10.00th=[ 3032], 20.00th=[ 6718], | 30.00th=[ 11863], 40.00th=[ 19006], 50.00th=[ 28705], 60.00th=[ 39584], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[154141], 99.50th=[187696], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 378, per=23.66%, avg=177.48, stdev=83.73, samples=64 iops : min= 1, max= 23, avg=10.36, stdev= 5.28, samples=64 lat (usec) : 50=0.65%, 100=4.30%, 250=0.26%, 1000=0.13% lat (msec) : 2=2.73%, 4=3.65%, 10=7.03%, 20=10.55%, 50=36.72% lat (msec) : 100=26.56%, 250=7.29%, 500=0.13% cpu : usr=0.06%, sys=4.91%, ctx=1611, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179426: Tue Sep 29 17:44:08 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(6032KiB/32792msec) clat (usec): min=42, max=196215, avg=45786.06, stdev=30170.56 lat (usec): min=43, max=196216, avg=45789.20, stdev=30169.59 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 145], 20.00th=[ 23725], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[168821], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 416, per=25.56%, avg=182.25, stdev=75.92, samples=64 iops : min= 1, max= 26, avg=10.67, stdev= 4.82, samples=64 write: IOPS=11, BW=191KiB/s (195kB/s)(6256KiB/32792msec); 0 zone resets clat (usec): min=1629, max=247671, avg=39600.56, stdev=41430.63 lat (usec): min=1629, max=247672, avg=39613.35, stdev=41434.83 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2442], 10.00th=[ 4228], 20.00th=[ 7111], | 30.00th=[ 10552], 40.00th=[ 16319], 50.00th=[ 24249], 60.00th=[ 36439], | 70.00th=[ 52167], 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[198181], 99.50th=[227541], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 428, per=25.43%, avg=190.72, stdev=81.55, samples=64 iops : min= 1, max= 26, avg=11.20, stdev= 5.17, samples=64 lat (usec) : 50=0.39%, 100=4.30%, 250=0.52%, 750=0.13% lat (msec) : 2=1.82%, 4=3.39%, 10=9.51%, 20=11.07%, 50=33.20% lat (msec) : 100=29.17%, 250=6.51% cpu : usr=0.05%, sys=5.57%, ctx=1705, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=714KiB/s (731kB/s), 175KiB/s-189KiB/s (179kB/s-194kB/s), io=23.4MiB (24.5MB), run=32784-33569msec WRITE: bw=751KiB/s (769kB/s), 183KiB/s-200KiB/s (187kB/s-204kB/s), io=24.6MiB (25.8MB), run=32784-33569msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179418: Tue Sep 29 17:44:22 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5920KiB/47169msec) clat (msec): min=6, max=370, avg=49.76, stdev=40.28 lat (msec): min=6, max=370, avg=49.76, stdev=40.28 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 69], 90.00th=[ 93], 95.00th=[ 133], | 99.00th=[ 211], 99.50th=[ 222], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 351, per=25.24%, avg=127.47, stdev=75.17, samples=91 iops : min= 1, max= 21, avg= 7.15, stdev= 4.75, samples=91 write: IOPS=8, BW=135KiB/s (138kB/s)(6368KiB/47169msec); 0 zone resets clat (msec): min=14, max=264, avg=71.88, stdev=45.91 lat (msec): min=14, max=264, avg=71.88, stdev=45.91 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 101], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 230], 99.50th=[ 247], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 380, per=25.38%, avg=134.78, stdev=70.65, samples=93 iops : min= 1, max= 23, avg= 7.60, stdev= 4.46, samples=93 lat (msec) : 10=0.65%, 20=7.68%, 50=44.27%, 100=32.42%, 250=14.71% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.78%, ctx=1318, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179419: Tue Sep 29 17:44:22 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5744KiB/47342msec) clat (msec): min=9, max=221, avg=48.71, stdev=37.70 lat (msec): min=9, max=221, avg=48.72, stdev=37.70 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 103], 95.00th=[ 134], | 99.00th=[ 180], 99.50th=[ 218], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 28, max= 447, per=24.67%, avg=124.58, stdev=79.33, samples=90 iops : min= 1, max= 27, avg= 6.96, stdev= 5.01, samples=90 write: IOPS=8, BW=138KiB/s (142kB/s)(6544KiB/47342msec); 0 zone resets clat (msec): min=16, max=300, avg=72.62, stdev=45.75 lat (msec): min=16, max=300, avg=72.63, stdev=45.75 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 157], | 99.00th=[ 236], 99.50th=[ 264], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 443, per=25.81%, avg=137.03, stdev=73.34, samples=93 iops : min= 1, max= 27, avg= 7.75, stdev= 4.62, samples=93 lat (msec) : 10=0.26%, 20=8.98%, 50=43.36%, 100=30.47%, 250=16.54% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.57%, ctx=1195, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179420: Tue Sep 29 17:44:22 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(6256KiB/47386msec) clat (msec): min=7, max=241, avg=49.25, stdev=39.83 lat (msec): min=7, max=241, avg=49.25, stdev=39.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 184], 99.50th=[ 232], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 352, per=26.43%, avg=133.49, stdev=86.71, samples=92 iops : min= 1, max= 22, avg= 7.52, stdev= 5.47, samples=92 write: IOPS=7, BW=127KiB/s (130kB/s)(6032KiB/47386msec); 0 zone resets clat (msec): min=13, max=308, avg=74.45, stdev=51.21 lat (msec): min=13, max=308, avg=74.47, stdev=51.23 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 60], 60.00th=[ 70], | 70.00th=[ 84], 80.00th=[ 113], 90.00th=[ 148], 95.00th=[ 174], | 99.00th=[ 262], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 352, per=23.82%, avg=126.50, stdev=68.87, samples=92 iops : min= 1, max= 22, avg= 7.09, stdev= 4.35, samples=92 lat (msec) : 10=1.04%, 20=9.38%, 50=45.96%, 100=26.04%, 250=17.06% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.77%, ctx=1244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179421: Tue Sep 29 17:44:22 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(6032KiB/47381msec) clat (msec): min=7, max=230, avg=53.31, stdev=43.70 lat (msec): min=7, max=230, avg=53.31, stdev=43.70 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 61], 80.00th=[ 80], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 383, per=25.69%, avg=129.72, stdev=72.61, samples=90 iops : min= 1, max= 23, avg= 7.29, stdev= 4.59, samples=90 write: IOPS=8, BW=132KiB/s (135kB/s)(6256KiB/47381msec); 0 zone resets clat (msec): min=14, max=308, avg=69.33, stdev=47.11 lat (msec): min=14, max=308, avg=69.33, stdev=47.11 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 96], 90.00th=[ 132], 95.00th=[ 161], | 99.00th=[ 249], 99.50th=[ 300], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 415, per=25.00%, avg=132.77, stdev=80.05, samples=92 iops : min= 1, max= 25, avg= 7.48, stdev= 5.02, samples=92 lat (msec) : 10=0.52%, 20=8.85%, 50=45.18%, 100=28.91%, 250=16.15% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.76%, ctx=1238, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=505KiB/s (518kB/s), 121KiB/s-132KiB/s (124kB/s-135kB/s), io=23.4MiB (24.5MB), run=47169-47386msec WRITE: bw=532KiB/s (545kB/s), 127KiB/s-138KiB/s (130kB/s-142kB/s), io=24.6MiB (25.8MB), run=47169-47386msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179438: Tue Sep 29 17:44:36 2026 read: IOPS=2, BW=2141KiB/s (2192kB/s)(7168KiB/3348msec) clat (usec): min=925, max=375387, avg=187199.91, stdev=122528.35 lat (usec): min=926, max=375389, avg=187201.33, stdev=122528.13 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], 20.00th=[122160], | 30.00th=[130548], 40.00th=[130548], 50.00th=[160433], 60.00th=[235930], | 70.00th=[235930], 80.00th=[283116], 90.00th=[375391], 95.00th=[375391], | 99.00th=[375391], 99.50th=[375391], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 1812, max= 3923, per=53.51%, avg=2424.50, stdev=1003.29, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1529KiB/s (1566kB/s)(5120KiB/3348msec); 0 zone resets clat (msec): min=195, max=599, avg=377.23, stdev=158.49 lat (msec): min=195, max=599, avg=377.46, stdev=158.42 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1924, max= 2043, per=31.69%, avg=2010.25, stdev=57.59, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.06%, sys=19.36%, ctx=261, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179439: Tue Sep 29 17:44:36 2026 read: IOPS=0, BW=453KiB/s (464kB/s)(2048KiB/4519msec) clat (usec): min=517, max=247645, avg=124081.41, stdev=174746.38 lat (usec): min=517, max=247648, avg=124083.08, stdev=174747.57 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 519], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[ 519], 60.00th=[248513], | 70.00th=[248513], 80.00th=[248513], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 2031, max= 2035, per=44.87%, avg=2033.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2266KiB/s (2320kB/s)(10.0MiB/4519msec); 0 zone resets clat (msec): min=158, max=817, avg=424.67, stdev=242.15 lat (msec): min=158, max=817, avg=424.96, stdev=242.02 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 188], | 30.00th=[ 247], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 368], | 70.00th=[ 506], 80.00th=[ 584], 90.00th=[ 802], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2035, max= 3849, per=36.90%, avg=2340.67, stdev=738.94, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=16.67% cpu : usr=0.04%, sys=17.97%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179440: Tue Sep 29 17:44:36 2026 read: IOPS=1, BW=1562KiB/s (1600kB/s)(6144KiB/3933msec) clat (usec): min=447, max=491158, avg=210879.92, stdev=198822.43 lat (usec): min=448, max=491159, avg=210881.32, stdev=198822.39 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 5145], | 30.00th=[ 5145], 40.00th=[189793], 50.00th=[189793], 60.00th=[191890], | 70.00th=[387974], 80.00th=[387974], 90.00th=[492831], 95.00th=[492831], | 99.00th=[492831], 99.50th=[492831], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 2043, max= 4087, per=75.10%, avg=3403.00, stdev=1177.80, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1562KiB/s (1600kB/s)(6144KiB/3933msec); 0 zone resets clat (msec): min=104, max=592, avg=417.67, stdev=182.19 lat (msec): min=104, max=593, avg=417.84, stdev=182.29 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 523], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1812, max= 4079, per=38.82%, avg=2462.50, stdev=1081.51, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=15.44%, ctx=197, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179441: Tue Sep 29 17:44:36 2026 read: IOPS=1, BW=1634KiB/s (1673kB/s)(5120KiB/3133msec) clat (usec): min=325, max=320663, avg=157768.65, stdev=148025.01 lat (usec): min=326, max=320664, avg=157769.68, stdev=148025.38 clat percentiles (usec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[227541], 60.00th=[227541], | 70.00th=[238027], 80.00th=[238027], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2288KiB/s (2343kB/s)(7168KiB/3133msec); 0 zone resets clat (msec): min=156, max=537, avg=317.71, stdev=152.52 lat (msec): min=156, max=537, avg=317.82, stdev=152.55 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 171], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 271], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 451], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1812, max= 5774, per=54.02%, avg=3427.00, stdev=1869.93, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 500=16.67% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=21.66%, ctx=216, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4532KiB/s (4641kB/s), 453KiB/s-2141KiB/s (464kB/s-2192kB/s), io=20.0MiB (20.0MB), run=3133-4519msec WRITE: bw=6345KiB/s (6497kB/s), 1529KiB/s-2288KiB/s (1566kB/s-2343kB/s), io=28.0MiB (29.4MB), run=3133-4519msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179443: Tue Sep 29 17:44:36 2026 read: IOPS=1, BW=1787KiB/s (1830kB/s)(7168KiB/4011msec) clat (msec): min=56, max=736, avg=282.63, stdev=256.81 lat (msec): min=56, max=736, avg=282.63, stdev=256.81 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 120], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 171], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 550], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1892, max= 2909, per=50.99%, avg=2184.40, stdev=410.14, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1276KiB/s (1307kB/s)(5120KiB/4011msec); 0 zone resets clat (msec): min=194, max=523, avg=372.70, stdev=119.24 lat (msec): min=195, max=523, avg=372.86, stdev=119.22 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2043, max= 3703, per=43.29%, avg=2596.33, stdev=958.40, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=25.00% cpu : usr=0.02%, sys=7.53%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179444: Tue Sep 29 17:44:36 2026 read: IOPS=0, BW=428KiB/s (439kB/s)(2048KiB/4780msec) clat (msec): min=207, max=486, avg=347.20, stdev=196.94 lat (msec): min=207, max=486, avg=347.20, stdev=196.94 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1448, max= 1851, per=38.50%, avg=1649.50, stdev=284.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2142KiB/s (2194kB/s)(10.0MiB/4780msec); 0 zone resets clat (msec): min=177, max=1050, avg=391.18, stdev=261.46 lat (msec): min=177, max=1050, avg=391.83, stdev=261.42 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 205], | 30.00th=[ 228], 40.00th=[ 241], 50.00th=[ 313], 60.00th=[ 317], | 70.00th=[ 380], 80.00th=[ 418], 90.00th=[ 584], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1851, max= 4071, per=38.72%, avg=2322.50, stdev=860.67, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.82%, ctx=111, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179445: Tue Sep 29 17:44:36 2026 read: IOPS=1, BW=1455KiB/s (1490kB/s)(6144KiB/4222msec) clat (msec): min=82, max=407, avg=178.19, stdev=116.29 lat (msec): min=82, max=407, avg=178.20, stdev=116.29 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 155], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1851, max= 4087, per=57.57%, avg=2466.25, stdev=1083.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1455KiB/s (1490kB/s)(6144KiB/4222msec); 0 zone resets clat (msec): min=228, max=802, avg=493.89, stdev=207.76 lat (msec): min=228, max=802, avg=493.99, stdev=207.76 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 542], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1851, max= 2043, per=32.80%, avg=1967.20, stdev=89.77, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=6.63%, ctx=113, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179446: Tue Sep 29 17:44:36 2026 read: IOPS=1, BW=1130KiB/s (1157kB/s)(5120KiB/4531msec) clat (msec): min=82, max=155, avg=114.23, stdev=28.80 lat (msec): min=82, max=155, avg=114.23, stdev=28.80 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 112], 60.00th=[ 112], | 70.00th=[ 127], 80.00th=[ 127], 90.00th=[ 157], 95.00th=[ 157], | 99.00th=[ 157], 99.50th=[ 157], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 2035, max= 6131, per=95.31%, avg=4083.00, stdev=2896.31, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1582KiB/s (1620kB/s)(7168KiB/4531msec); 0 zone resets clat (msec): min=97, max=1156, avg=555.42, stdev=391.68 lat (msec): min=97, max=1156, avg=555.60, stdev=391.62 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 105], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 684], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 768], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1892, max= 2043, per=33.38%, avg=2002.40, stdev=63.21, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.09%, sys=6.62%, ctx=128, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4285KiB/s (4387kB/s), 428KiB/s-1787KiB/s (439kB/s-1830kB/s), io=20.0MiB (20.0MB), run=4011-4780msec WRITE: bw=5998KiB/s (6142kB/s), 1276KiB/s-2142KiB/s (1307kB/s-2194kB/s), io=28.0MiB (29.4MB), run=4011-4780msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179453: Tue Sep 29 17:44:49 2026 read: IOPS=1, BW=4099KiB/s (4197kB/s)(12.0MiB/2998msec) clat (msec): min=560, max=1309, avg=949.57, stdev=375.43 lat (msec): min=560, max=1309, avg=949.57, stdev=375.43 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7861, max= 8110, per=100.00%, avg=7985.50, stdev=176.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.10%, sys=4.30%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179454: Tue Sep 29 17:44:49 2026 read: IOPS=0, BW=1295KiB/s (1326kB/s)(4096KiB/3164msec) clat (nsec): min=1022.0M, max=1022.0M, avg=1022994672.00, stdev= 0.00 lat (nsec): min=1022.0M, max=1022.0M, avg=1022996731.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2589KiB/s (2651kB/s)(8192KiB/3164msec); 0 zone resets clat (msec): min=668, max=1395, avg=1032.20, stdev=513.68 lat (msec): min=669, max=1395, avg=1032.56, stdev=513.66 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8143, max= 8143, per=78.63%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.70%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179455: Tue Sep 29 17:44:49 2026 write: IOPS=1, BW=4423KiB/s (4529kB/s)(12.0MiB/2778msec); 0 zone resets clat (msec): min=468, max=1302, avg=883.45, stdev=416.99 lat (msec): min=468, max=1304, avg=884.64, stdev=418.10 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 6553, max= 8143, per=70.95%, avg=7348.00, stdev=1124.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.80%, ctx=114, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179456: Tue Sep 29 17:44:49 2026 write: IOPS=1, BW=6578KiB/s (6736kB/s)(12.0MiB/1868msec); 0 zone resets clat (msec): min=267, max=808, avg=603.87, stdev=293.48 lat (msec): min=268, max=809, avg=604.64, stdev=293.64 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7861, max= 7907, per=76.13%, avg=7884.00, stdev=32.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=7.18%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5178KiB/s (5303kB/s), 1295KiB/s-4099KiB/s (1326kB/s-4197kB/s), io=16.0MiB (16.8MB), run=2998-3164msec WRITE: bw=10.1MiB/s (10.6MB/s), 2589KiB/s-6578KiB/s (2651kB/s-6736kB/s), io=32.0MiB (33.6MB), run=1868-3164msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179457: Tue Sep 29 17:44:49 2026 read: IOPS=1, BW=5167KiB/s (5291kB/s)(12.0MiB/2378msec) clat (msec): min=651, max=790, avg=728.74, stdev=70.69 lat (msec): min=651, max=790, avg=728.74, stdev=70.69 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7907, max= 8175, per=100.00%, avg=8041.00, stdev=189.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.50%, ctx=404, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179458: Tue Sep 29 17:44:49 2026 read: IOPS=0, BW=1558KiB/s (1595kB/s)(4096KiB/2629msec) clat (nsec): min=798248k, max=798248k, avg=798248480.00, stdev= 0.00 lat (nsec): min=798251k, max=798251k, avg=798251045.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3116KiB/s (3191kB/s)(8192KiB/2629msec); 0 zone resets clat (msec): min=555, max=1219, avg=887.50, stdev=470.18 lat (msec): min=555, max=1221, avg=888.57, stdev=471.22 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8175, max= 8175, per=77.07%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.76%, ctx=135, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179459: Tue Sep 29 17:44:49 2026 write: IOPS=0, BW=3978KiB/s (4073kB/s)(12.0MiB/3089msec); 0 zone resets clat (msec): min=193, max=1398, avg=945.55, stdev=655.76 lat (msec): min=194, max=1399, avg=945.96, stdev=655.62 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8126, max= 8192, per=76.92%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.37%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179460: Tue Sep 29 17:44:49 2026 write: IOPS=1, BW=5146KiB/s (5269kB/s)(12.0MiB/2388msec); 0 zone resets clat (msec): min=279, max=1447, avg=706.49, stdev=644.25 lat (msec): min=279, max=1447, avg=706.84, stdev=644.13 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8159, max= 8159, per=76.92%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.91%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6232KiB/s (6382kB/s), 1558KiB/s-5167KiB/s (1595kB/s-5291kB/s), io=16.0MiB (16.8MB), run=2378-2629msec WRITE: bw=10.4MiB/s (10.9MB/s), 3116KiB/s-5146KiB/s (3191kB/s-5269kB/s), io=32.0MiB (33.6MB), run=2388-3089msec