== sanity test 398b: DIO and buffer IO race ============== 10:09:07 (1788876547) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.83406 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179592: Tue Sep 8 10:11:17 2026 read: IOPS=13, BW=53.7KiB/s (55.0kB/s)(5992KiB/111527msec) clat (usec): min=35, max=191791, avg=39956.15, stdev=26250.12 lat (usec): min=35, max=191792, avg=39959.30, stdev=26250.33 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 7832], 10.00th=[ 15008], 20.00th=[ 20579], | 30.00th=[ 25560], 40.00th=[ 29492], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 57410], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[139461], 99.50th=[158335], 99.90th=[187696], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 7, max= 127, per=25.04%, avg=53.35, stdev=20.81, samples=220 iops : min= 1, max= 31, avg=12.69, stdev= 5.24, samples=220 write: IOPS=14, BW=56.5KiB/s (57.8kB/s)(6296KiB/111527msec); 0 zone resets clat (usec): min=1034, max=830322, avg=32577.25, stdev=38861.70 lat (usec): min=1035, max=830323, avg=32580.78, stdev=38861.02 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1303], 10.00th=[ 1844], 20.00th=[ 3589], | 30.00th=[ 6259], 40.00th=[ 15270], 50.00th=[ 23725], 60.00th=[ 31065], | 70.00th=[ 41157], 80.00th=[ 54789], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[147850], 99.50th=[170918], 99.90th=[238027], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 159, per=25.24%, avg=56.28, stdev=22.97, samples=219 iops : min= 1, max= 39, avg=13.43, stdev= 5.79, samples=219 lat (usec) : 50=0.13%, 100=1.86%, 250=0.23%, 750=0.03% lat (msec) : 2=5.73%, 4=5.86%, 10=7.10%, 20=10.94%, 50=43.26% lat (msec) : 100=21.22%, 250=3.61%, 1000=0.03% cpu : usr=0.10%, sys=6.29%, ctx=6857, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179593: Tue Sep 8 10:11:17 2026 read: IOPS=13, BW=54.2KiB/s (55.5kB/s)(5940KiB/109676msec) clat (usec): min=50, max=245947, avg=40053.29, stdev=25230.37 lat (usec): min=52, max=245948, avg=40055.41, stdev=25229.41 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 12256], 10.00th=[ 16450], 20.00th=[ 21103], | 30.00th=[ 25297], 40.00th=[ 30016], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 55837], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[129500], 99.50th=[147850], 99.90th=[219153], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 10, max= 119, per=25.29%, avg=53.87, stdev=19.57, samples=215 iops : min= 2, max= 29, avg=12.81, stdev= 4.91, samples=215 write: IOPS=14, BW=57.9KiB/s (59.3kB/s)(6348KiB/109676msec); 0 zone resets clat (usec): min=1043, max=850487, avg=31327.37, stdev=38985.95 lat (usec): min=1045, max=850489, avg=31377.27, stdev=39191.34 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1336], 10.00th=[ 1811], 20.00th=[ 3490], | 30.00th=[ 5800], 40.00th=[ 12649], 50.00th=[ 22152], 60.00th=[ 28705], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 74974], 95.00th=[ 98042], | 99.00th=[145753], 99.50th=[175113], 99.90th=[240124], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 152, per=25.59%, avg=57.07, stdev=23.34, samples=216 iops : min= 1, max= 38, avg=13.63, stdev= 5.89, samples=216 lat (usec) : 100=1.24%, 250=0.26%, 500=0.03%, 1000=0.03% lat (msec) : 2=6.12%, 4=5.44%, 10=8.24%, 20=11.62%, 50=42.29% lat (msec) : 100=21.06%, 250=3.65%, 1000=0.03% cpu : usr=0.11%, sys=6.46%, ctx=6756, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179594: Tue Sep 8 10:11:17 2026 read: IOPS=13, BW=54.7KiB/s (56.0kB/s)(6028KiB/110152msec) clat (usec): min=36, max=866037, avg=39623.82, stdev=34409.00 lat (usec): min=36, max=866038, avg=39628.60, stdev=34407.71 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 104], 10.00th=[ 14615], 20.00th=[ 19530], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 33424], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 55837], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[137364], 99.50th=[168821], 99.90th=[299893], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 10, max= 151, per=25.45%, avg=54.21, stdev=20.38, samples=217 iops : min= 2, max= 37, avg=12.90, stdev= 5.13, samples=217 write: IOPS=14, BW=56.8KiB/s (58.2kB/s)(6260KiB/110152msec); 0 zone resets clat (usec): min=1038, max=198490, avg=31934.74, stdev=30844.92 lat (usec): min=1039, max=198491, avg=31937.11, stdev=30844.79 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1450], 10.00th=[ 2089], 20.00th=[ 3916], | 30.00th=[ 6783], 40.00th=[ 14877], 50.00th=[ 24249], 60.00th=[ 33162], | 70.00th=[ 42730], 80.00th=[ 55313], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[127402], 99.50th=[139461], 99.90th=[175113], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 15, max= 151, per=25.29%, avg=56.40, stdev=23.57, samples=216 iops : min= 3, max= 37, avg=13.46, stdev= 5.96, samples=216 lat (usec) : 50=0.13%, 100=2.21%, 250=0.29%, 1000=0.07% lat (msec) : 2=4.88%, 4=5.66%, 10=7.85%, 20=11.65%, 50=41.83% lat (msec) : 100=21.81%, 250=3.55%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.17%, ctx=6677, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179595: Tue Sep 8 10:11:17 2026 read: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6052KiB/112301msec) clat (usec): min=34, max=869845, avg=41313.20, stdev=34311.09 lat (usec): min=34, max=869848, avg=41318.05, stdev=34309.49 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11076], 10.00th=[ 15795], 20.00th=[ 21103], | 30.00th=[ 25822], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 57410], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[129500], 99.50th=[162530], 99.90th=[299893], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 111, per=25.03%, avg=53.32, stdev=19.21, samples=221 iops : min= 1, max= 27, avg=12.68, stdev= 4.85, samples=221 write: IOPS=13, BW=55.5KiB/s (56.9kB/s)(6236KiB/112301msec); 0 zone resets clat (usec): min=1023, max=280761, avg=31707.64, stdev=31292.11 lat (usec): min=1024, max=280763, avg=31709.77, stdev=31292.01 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1434], 10.00th=[ 2089], 20.00th=[ 4178], | 30.00th=[ 7308], 40.00th=[ 15139], 50.00th=[ 24249], 60.00th=[ 32113], | 70.00th=[ 42730], 80.00th=[ 55313], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[135267], 99.50th=[160433], 99.90th=[225444], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 119, per=24.73%, avg=55.15, stdev=21.65, samples=220 iops : min= 1, max= 29, avg=13.15, stdev= 5.46, samples=220 lat (usec) : 50=0.20%, 100=1.33%, 250=0.33%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.79%, 4=5.08%, 10=7.75%, 20=11.98%, 50=42.48% lat (msec) : 100=22.62%, 250=3.26%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=6.12%, ctx=6805, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=214KiB/s (219kB/s), 53.7KiB/s-54.7KiB/s (55.0kB/s-56.0kB/s), io=23.4MiB (24.6MB), run=109676-112301msec WRITE: bw=224KiB/s (229kB/s), 55.5KiB/s-57.9KiB/s (56.9kB/s-59.3kB/s), io=24.6MiB (25.7MB), run=109676-112301msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179597: Tue Sep 8 10:11:51 2026 read: IOPS=10, BW=41.2KiB/s (42.2kB/s)(5992KiB/145307msec) clat (msec): min=6, max=838, avg=38.46, stdev=40.89 lat (msec): min=6, max=838, avg=38.47, stdev=40.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 90], 95.00th=[ 118], | 99.00th=[ 165], 99.50th=[ 192], 99.90th=[ 288], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 142, per=25.01%, avg=41.02, stdev=28.60, samples=284 iops : min= 1, max= 35, avg= 9.62, stdev= 7.21, samples=284 write: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6296KiB/145307msec); 0 zone resets clat (msec): min=9, max=391, avg=55.61, stdev=38.82 lat (msec): min=9, max=391, avg=55.61, stdev=38.82 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 84], 90.00th=[ 106], 95.00th=[ 128], | 99.00th=[ 186], 99.50th=[ 226], 99.90th=[ 279], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 126, per=25.11%, avg=43.19, stdev=27.48, samples=284 iops : min= 1, max= 31, avg=10.16, stdev= 6.93, samples=284 lat (msec) : 10=2.86%, 20=20.21%, 50=45.05%, 100=21.74%, 250=9.86% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=2.16%, ctx=4817, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179598: Tue Sep 8 10:11:51 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(5940KiB/145826msec) clat (msec): min=5, max=876, avg=38.43, stdev=41.68 lat (msec): min=5, max=876, avg=38.43, stdev=41.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 55], 90.00th=[ 89], 95.00th=[ 120], | 99.00th=[ 182], 99.50th=[ 203], 99.90th=[ 338], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 143, per=24.96%, avg=40.94, stdev=28.46, samples=282 iops : min= 1, max= 35, avg= 9.60, stdev= 7.16, samples=282 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6348KiB/145826msec); 0 zone resets clat (msec): min=11, max=392, avg=55.80, stdev=39.99 lat (msec): min=11, max=392, avg=55.81, stdev=39.99 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 109], 95.00th=[ 131], | 99.00th=[ 199], 99.50th=[ 236], 99.90th=[ 309], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 128, per=24.97%, avg=42.94, stdev=27.31, samples=287 iops : min= 1, max= 32, avg=10.10, stdev= 6.90, samples=287 lat (msec) : 10=2.60%, 20=19.01%, 50=46.68%, 100=22.23%, 250=9.24% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=2.13%, ctx=4883, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179599: Tue Sep 8 10:11:51 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6028KiB/145715msec) clat (msec): min=5, max=334, avg=38.67, stdev=36.04 lat (msec): min=5, max=334, avg=38.67, stdev=36.04 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 90], 95.00th=[ 114], | 99.00th=[ 169], 99.50th=[ 194], 99.90th=[ 284], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 136, per=25.20%, avg=41.33, stdev=27.16, samples=284 iops : min= 1, max= 34, avg= 9.70, stdev= 6.85, samples=284 write: IOPS=10, BW=42.0KiB/s (43.0kB/s)(6260KiB/145715msec); 0 zone resets clat (msec): min=10, max=905, avg=55.77, stdev=43.97 lat (msec): min=10, max=905, avg=55.77, stdev=43.97 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 82], 90.00th=[ 109], 95.00th=[ 134], | 99.00th=[ 190], 99.50th=[ 222], 99.90th=[ 305], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 128, per=24.82%, avg=42.69, stdev=27.97, samples=285 iops : min= 1, max= 32, avg=10.04, stdev= 7.05, samples=285 lat (msec) : 10=2.44%, 20=19.95%, 50=45.38%, 100=22.17%, 250=9.86% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=2.17%, ctx=4803, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179601: Tue Sep 8 10:11:51 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6052KiB/145138msec) clat (msec): min=6, max=272, avg=37.31, stdev=34.27 lat (msec): min=6, max=272, avg=37.31, stdev=34.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 56], 90.00th=[ 86], 95.00th=[ 113], | 99.00th=[ 153], 99.50th=[ 194], 99.90th=[ 239], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 168, per=25.73%, avg=42.19, stdev=28.93, samples=280 iops : min= 1, max= 42, avg= 9.91, stdev= 7.28, samples=280 write: IOPS=10, BW=42.0KiB/s (43.0kB/s)(6236KiB/145138msec); 0 zone resets clat (msec): min=11, max=898, avg=56.79, stdev=44.58 lat (msec): min=11, max=898, avg=56.79, stdev=44.58 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 230], 99.90th=[ 309], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 112, per=24.98%, avg=42.97, stdev=26.67, samples=283 iops : min= 1, max= 28, avg=10.11, stdev= 6.74, samples=283 lat (msec) : 10=2.73%, 20=19.95%, 50=44.86%, 100=22.59%, 250=9.67% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=2.18%, ctx=4828, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=165KiB/s (169kB/s), 40.7KiB/s-41.7KiB/s (41.7kB/s-42.7kB/s), io=23.4MiB (24.6MB), run=145138-145826msec WRITE: bw=172KiB/s (177kB/s), 42.0KiB/s-43.5KiB/s (43.0kB/s-44.6kB/s), io=24.6MiB (25.7MB), run=145138-145826msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179641: Tue Sep 8 10:12:33 2026 read: IOPS=11, BW=191KiB/s (196kB/s)(5920KiB/31005msec) clat (usec): min=47, max=133614, avg=42603.38, stdev=24247.92 lat (usec): min=48, max=133615, avg=42604.72, stdev=24247.97 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 110], 10.00th=[ 15926], 20.00th=[ 22938], | 30.00th=[ 27919], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 61080], 90.00th=[ 76022], 95.00th=[ 84411], | 99.00th=[108528], 99.50th=[121111], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 62, max= 411, per=24.51%, avg=189.18, stdev=72.89, samples=61 iops : min= 3, max= 25, avg=11.05, stdev= 4.62, samples=61 write: IOPS=12, BW=205KiB/s (210kB/s)(6368KiB/31005msec); 0 zone resets clat (usec): min=1547, max=199711, avg=37509.51, stdev=33907.29 lat (usec): min=1549, max=199712, avg=37512.49, stdev=33907.32 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2933], 10.00th=[ 4555], 20.00th=[ 7177], | 30.00th=[ 11207], 40.00th=[ 19530], 50.00th=[ 27919], 60.00th=[ 37487], | 70.00th=[ 47973], 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[135267], 99.50th=[147850], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 62, max= 416, per=25.24%, avg=204.92, stdev=78.12, samples=61 iops : min= 3, max= 26, avg=12.03, stdev= 4.98, samples=61 lat (usec) : 50=0.13%, 100=2.21%, 250=0.52% lat (msec) : 2=0.91%, 4=2.99%, 10=10.94%, 20=10.16%, 50=41.41% lat (msec) : 100=26.04%, 250=4.69% cpu : usr=0.10%, sys=7.15%, ctx=1946, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179642: Tue Sep 8 10:12:33 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(5744KiB/30593msec) clat (usec): min=54, max=226936, avg=45761.08, stdev=27962.31 lat (usec): min=55, max=226937, avg=45766.01, stdev=27967.87 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 971], 10.00th=[ 18482], 20.00th=[ 25822], | 30.00th=[ 30802], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 78119], 95.00th=[ 89654], | 99.00th=[143655], 99.50th=[187696], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 28, max= 319, per=24.27%, avg=187.37, stdev=64.14, samples=60 iops : min= 1, max= 19, avg=10.93, stdev= 4.05, samples=60 write: IOPS=13, BW=214KiB/s (219kB/s)(6544KiB/30593msec); 0 zone resets clat (usec): min=1568, max=247022, avg=34327.61, stdev=33039.66 lat (usec): min=1569, max=247024, avg=34330.23, stdev=33039.63 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2442], 10.00th=[ 3589], 20.00th=[ 6128], | 30.00th=[ 10814], 40.00th=[ 17433], 50.00th=[ 25822], 60.00th=[ 32637], | 70.00th=[ 44303], 80.00th=[ 58983], 90.00th=[ 81265], 95.00th=[ 91751], | 99.00th=[141558], 99.50th=[166724], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 63, max= 444, per=26.28%, avg=213.42, stdev=81.64, samples=60 iops : min= 3, max= 27, avg=12.58, stdev= 5.16, samples=60 lat (usec) : 100=1.56%, 250=0.26%, 500=0.26%, 1000=0.26% lat (msec) : 2=2.08%, 4=4.17%, 10=9.11%, 20=9.90%, 50=42.06% lat (msec) : 100=26.95%, 250=3.39% cpu : usr=0.07%, sys=6.98%, ctx=1837, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179643: Tue Sep 8 10:12:33 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6256KiB/30691msec) clat (usec): min=45, max=221121, avg=43131.10, stdev=29516.12 lat (usec): min=45, max=221122, avg=43132.43, stdev=29516.14 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 88], 10.00th=[ 412], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 53216], 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[149947], 99.50th=[156238], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 57, max= 347, per=26.37%, avg=203.60, stdev=61.26, samples=60 iops : min= 3, max= 21, avg=11.97, stdev= 3.87, samples=60 write: IOPS=12, BW=197KiB/s (201kB/s)(6032KiB/30691msec); 0 zone resets clat (usec): min=1549, max=163876, avg=36004.20, stdev=30663.43 lat (usec): min=1550, max=163878, avg=36006.76, stdev=30663.41 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3097], 10.00th=[ 4424], 20.00th=[ 8094], | 30.00th=[ 13829], 40.00th=[ 20841], 50.00th=[ 28443], 60.00th=[ 37487], | 70.00th=[ 45351], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[129500], 99.50th=[143655], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 31, max= 474, per=23.84%, avg=193.62, stdev=78.26, samples=60 iops : min= 1, max= 29, avg=11.33, stdev= 4.96, samples=60 lat (usec) : 50=0.13%, 100=3.65%, 250=0.91%, 500=0.52% lat (msec) : 2=0.78%, 4=3.52%, 10=8.07%, 20=10.16%, 50=41.54% lat (msec) : 100=26.43%, 250=4.30% cpu : usr=0.07%, sys=6.91%, ctx=1923, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179644: Tue Sep 8 10:12:33 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30199msec) clat (usec): min=55, max=270687, avg=43033.11, stdev=29035.54 lat (usec): min=56, max=270687, avg=43034.51, stdev=29035.51 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 87], 10.00th=[ 15664], 20.00th=[ 22938], | 30.00th=[ 27132], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[132645], 99.50th=[173016], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 349, per=25.76%, avg=198.88, stdev=66.33, samples=59 iops : min= 1, max= 21, avg=11.68, stdev= 4.17, samples=59 write: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30199msec); 0 zone resets clat (usec): min=1547, max=188016, avg=35118.59, stdev=32842.15 lat (usec): min=1548, max=188019, avg=35158.71, stdev=32827.63 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2769], 10.00th=[ 3818], 20.00th=[ 7242], | 30.00th=[ 10028], 40.00th=[ 18220], 50.00th=[ 25035], 60.00th=[ 33162], | 70.00th=[ 46924], 80.00th=[ 58983], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[149947], 99.50th=[152044], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 384, per=25.58%, avg=207.68, stdev=84.90, samples=59 iops : min= 1, max= 24, avg=12.22, stdev= 5.38, samples=59 lat (usec) : 100=2.86%, 250=0.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.04%, 4=5.08%, 10=9.24%, 20=8.98%, 50=41.93% lat (msec) : 100=25.00%, 250=4.69%, 500=0.13% cpu : usr=0.09%, sys=7.12%, ctx=1897, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=773KiB/s (791kB/s), 188KiB/s-204KiB/s (192kB/s-209kB/s), io=23.4MiB (24.5MB), run=30199-31005msec WRITE: bw=813KiB/s (832kB/s), 197KiB/s-214KiB/s (201kB/s-219kB/s), io=24.6MiB (25.8MB), run=30199-31005msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179636: Tue Sep 8 10:12:42 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(5920KiB/39219msec) clat (msec): min=6, max=253, avg=41.04, stdev=38.65 lat (msec): min=6, max=253, avg=41.04, stdev=38.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 60], 90.00th=[ 88], 95.00th=[ 128], | 99.00th=[ 192], 99.50th=[ 194], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 31, max= 540, per=25.03%, avg=150.18, stdev=105.10, samples=76 iops : min= 1, max= 33, avg= 8.61, stdev= 6.58, samples=76 write: IOPS=10, BW=162KiB/s (166kB/s)(6368KiB/39219msec); 0 zone resets clat (msec): min=14, max=212, avg=60.23, stdev=39.77 lat (msec): min=14, max=212, avg=60.24, stdev=39.77 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 116], 95.00th=[ 138], | 99.00th=[ 194], 99.50th=[ 209], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 512, per=25.55%, avg=161.21, stdev=99.94, samples=77 iops : min= 1, max= 32, avg= 9.29, stdev= 6.29, samples=77 lat (msec) : 10=1.82%, 20=14.97%, 50=48.18%, 100=22.53%, 250=12.37% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.29%, ctx=1240, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179637: Tue Sep 8 10:12:42 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(5744KiB/39876msec) clat (msec): min=7, max=194, avg=42.15, stdev=37.95 lat (msec): min=7, max=194, avg=42.16, stdev=37.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 68], 90.00th=[ 102], 95.00th=[ 129], | 99.00th=[ 167], 99.50th=[ 192], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 31, max= 446, per=24.63%, avg=147.79, stdev=105.35, samples=77 iops : min= 1, max= 27, avg= 8.44, stdev= 6.63, samples=77 write: IOPS=10, BW=164KiB/s (168kB/s)(6544KiB/39876msec); 0 zone resets clat (msec): min=12, max=239, avg=60.08, stdev=40.46 lat (msec): min=12, max=239, avg=60.08, stdev=40.46 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 86], 90.00th=[ 121], 95.00th=[ 138], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 512, per=25.92%, avg=163.57, stdev=108.12, samples=79 iops : min= 1, max= 32, avg= 9.44, stdev= 6.82, samples=79 lat (msec) : 10=2.60%, 20=16.80%, 50=43.62%, 100=23.70%, 250=13.28% cpu : usr=0.08%, sys=2.21%, ctx=1231, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179638: Tue Sep 8 10:12:42 2026 read: IOPS=9, BW=160KiB/s (163kB/s)(6256KiB/39182msec) clat (msec): min=6, max=230, avg=40.01, stdev=34.07 lat (msec): min=6, max=230, avg=40.01, stdev=34.07 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 92], 95.00th=[ 116], | 99.00th=[ 159], 99.50th=[ 207], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 542, per=27.01%, avg=162.05, stdev=118.00, samples=76 iops : min= 1, max= 33, avg= 9.34, stdev= 7.41, samples=76 write: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39182msec); 0 zone resets clat (msec): min=15, max=234, avg=61.65, stdev=41.63 lat (msec): min=15, max=234, avg=61.65, stdev=41.63 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 94], 90.00th=[ 125], 95.00th=[ 148], | 99.00th=[ 201], 99.50th=[ 215], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 480, per=23.96%, avg=151.21, stdev=95.42, samples=77 iops : min= 1, max= 30, avg= 8.66, stdev= 6.01, samples=77 lat (msec) : 10=1.56%, 20=16.80%, 50=46.22%, 100=22.27%, 250=13.15% cpu : usr=0.06%, sys=2.15%, ctx=1185, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179639: Tue Sep 8 10:12:42 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(6032KiB/39503msec) clat (msec): min=6, max=247, avg=44.82, stdev=42.43 lat (msec): min=6, max=247, avg=44.82, stdev=42.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 103], 95.00th=[ 138], | 99.00th=[ 222], 99.50th=[ 224], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 447, per=25.77%, avg=154.59, stdev=102.16, samples=76 iops : min= 1, max= 27, avg= 8.87, stdev= 6.40, samples=76 write: IOPS=9, BW=158KiB/s (162kB/s)(6256KiB/39503msec); 0 zone resets clat (msec): min=13, max=227, avg=57.41, stdev=38.83 lat (msec): min=13, max=227, avg=57.41, stdev=38.83 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 136], | 99.00th=[ 194], 99.50th=[ 218], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 31, max= 477, per=24.95%, avg=157.46, stdev=102.88, samples=78 iops : min= 1, max= 29, avg= 9.05, stdev= 6.46, samples=78 lat (msec) : 10=1.69%, 20=17.71%, 50=45.05%, 100=22.79%, 250=12.76% cpu : usr=0.07%, sys=2.33%, ctx=1265, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=601KiB/s (615kB/s), 144KiB/s-160KiB/s (148kB/s-163kB/s), io=23.4MiB (24.5MB), run=39182-39876msec WRITE: bw=632KiB/s (647kB/s), 154KiB/s-164KiB/s (158kB/s-168kB/s), io=24.6MiB (25.8MB), run=39182-39876msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179659: Tue Sep 8 10:12:55 2026 read: IOPS=2, BW=2376KiB/s (2433kB/s)(7168KiB/3017msec) clat (usec): min=553, max=258459, avg=132009.77, stdev=98393.50 lat (usec): min=555, max=258461, avg=132011.87, stdev=98393.38 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 693], | 30.00th=[132645], 40.00th=[132645], 50.00th=[145753], 60.00th=[187696], | 70.00th=[187696], 80.00th=[196084], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 2011, max= 4096, per=63.43%, avg=3366.33, stdev=1174.90, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1697KiB/s (1738kB/s)(5120KiB/3017msec); 0 zone resets clat (msec): min=249, max=571, avg=410.46, stdev=141.90 lat (msec): min=249, max=571, avg=410.55, stdev=141.92 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1988, max= 2011, per=26.93%, avg=2000.67, stdev=11.68, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.07%, sys=21.25%, ctx=186, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179660: Tue Sep 8 10:12:55 2026 read: IOPS=0, BW=531KiB/s (543kB/s)(2048KiB/3859msec) clat (msec): min=133, max=244, avg=189.02, stdev=77.85 lat (msec): min=133, max=244, avg=189.02, stdev=77.84 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 1988, max= 2035, per=37.90%, avg=2011.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2654KiB/s (2717kB/s)(10.0MiB/3859msec); 0 zone resets clat (msec): min=122, max=591, avg=338.42, stdev=144.17 lat (msec): min=122, max=592, avg=338.79, stdev=144.18 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 186], | 30.00th=[ 234], 40.00th=[ 247], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 414], 80.00th=[ 426], 90.00th=[ 481], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1988, max= 4007, per=36.01%, avg=2674.83, stdev=1017.05, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.05%, sys=23.25%, ctx=133, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179661: Tue Sep 8 10:12:55 2026 read: IOPS=2, BW=2380KiB/s (2437kB/s)(6144KiB/2582msec) clat (usec): min=472, max=296826, avg=103447.41, stdev=123086.94 lat (usec): min=473, max=296828, avg=103448.85, stdev=123087.19 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[ 799], 50.00th=[ 799], 60.00th=[160433], | 70.00th=[160433], 80.00th=[160433], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 1988, max= 6011, per=63.11%, avg=3349.00, stdev=2305.55, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2380KiB/s (2437kB/s)(6144KiB/2582msec); 0 zone resets clat (msec): min=158, max=563, avg=305.93, stdev=155.38 lat (msec): min=158, max=563, avg=306.03, stdev=155.38 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 313], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1988, max= 4023, per=33.86%, avg=2515.50, stdev=1005.32, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=21.66%, ctx=163, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179662: Tue Sep 8 10:12:55 2026 read: IOPS=1, BW=1848KiB/s (1893kB/s)(5120KiB/2770msec) clat (usec): min=444, max=216900, avg=87451.37, stdev=117591.50 lat (usec): min=446, max=216901, avg=87452.68, stdev=117591.79 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 445], | 30.00th=[ 449], 40.00th=[ 449], 50.00th=[ 3851], 60.00th=[ 3851], | 70.00th=[214959], 80.00th=[214959], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 2003, max= 6131, per=76.63%, avg=4067.00, stdev=2918.94, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2588KiB/s (2650kB/s)(7168KiB/2770msec); 0 zone resets clat (msec): min=197, max=436, avg=316.20, stdev=106.00 lat (msec): min=197, max=436, avg=316.37, stdev=106.08 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 205], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 271], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 435], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1378, max= 4087, per=33.51%, avg=2489.33, stdev=1418.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=16.67% lat (msec) : 4=8.33%, 250=33.33%, 500=41.67% cpu : usr=0.00%, sys=24.63%, ctx=207, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5307KiB/s (5434kB/s), 531KiB/s-2380KiB/s (543kB/s-2437kB/s), io=20.0MiB (20.0MB), run=2582-3859msec WRITE: bw=7430KiB/s (7608kB/s), 1697KiB/s-2654KiB/s (1738kB/s-2717kB/s), io=28.0MiB (29.4MB), run=2582-3859msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179664: Tue Sep 8 10:12:55 2026 read: IOPS=1, BW=1865KiB/s (1909kB/s)(7168KiB/3844msec) clat (msec): min=69, max=926, avg=264.52, stdev=305.94 lat (msec): min=69, max=926, avg=264.52, stdev=305.94 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 106], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 296], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1556, max= 3992, per=60.35%, avg=2886.75, stdev=1277.22, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1332KiB/s (1364kB/s)(5120KiB/3844msec); 0 zone resets clat (msec): min=121, max=522, avg=380.92, stdev=162.98 lat (msec): min=121, max=522, avg=381.10, stdev=162.92 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2031, max= 4079, per=40.61%, avg=2719.33, stdev=1177.54, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=6.79%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179665: Tue Sep 8 10:12:55 2026 read: IOPS=0, BW=501KiB/s (513kB/s)(2048KiB/4086msec) clat (msec): min=402, max=458, avg=430.51, stdev=39.16 lat (msec): min=402, max=458, avg=430.51, stdev=39.16 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1622, max= 2039, per=38.27%, avg=1830.50, stdev=294.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2506KiB/s (2566kB/s)(10.0MiB/4087msec); 0 zone resets clat (msec): min=73, max=711, avg=317.87, stdev=236.14 lat (msec): min=74, max=711, avg=318.10, stdev=236.02 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 89], | 30.00th=[ 114], 40.00th=[ 127], 50.00th=[ 161], 60.00th=[ 363], | 70.00th=[ 414], 80.00th=[ 558], 90.00th=[ 567], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2031, max= 4096, per=45.33%, avg=3035.75, stdev=1151.58, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=25.00% cpu : usr=0.07%, sys=7.78%, ctx=101, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179666: Tue Sep 8 10:12:55 2026 read: IOPS=1, BW=1642KiB/s (1681kB/s)(6144KiB/3742msec) clat (msec): min=67, max=252, avg=139.20, stdev=63.52 lat (msec): min=67, max=252, avg=139.20, stdev=63.52 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 111], 50.00th=[ 111], 60.00th=[ 144], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 2039, max= 4096, per=70.41%, avg=3367.67, stdev=1152.44, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1642KiB/s (1681kB/s)(6144KiB/3742msec); 0 zone resets clat (msec): min=200, max=799, avg=472.51, stdev=267.34 lat (msec): min=202, max=799, avg=472.90, stdev=267.02 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 527], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1553, max= 2048, per=29.00%, avg=1941.83, stdev=192.13, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=8.74%, ctx=109, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179667: Tue Sep 8 10:12:55 2026 read: IOPS=1, BW=1196KiB/s (1225kB/s)(5120KiB/4281msec) clat (msec): min=52, max=456, avg=278.10, stdev=147.48 lat (msec): min=52, max=456, avg=278.10, stdev=147.48 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 53], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2031, max= 4096, per=56.91%, avg=2722.00, stdev=1189.93, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1674KiB/s (1715kB/s)(7168KiB/4281msec); 0 zone resets clat (msec): min=86, max=711, avg=412.48, stdev=306.08 lat (msec): min=86, max=711, avg=412.61, stdev=306.08 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 88], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 567], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 676], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1996, max= 2048, per=30.40%, avg=2035.80, stdev=22.59, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (msec) : 100=33.33%, 250=8.33%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=7.27%, ctx=116, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4784KiB/s (4899kB/s), 501KiB/s-1865KiB/s (513kB/s-1909kB/s), io=20.0MiB (20.0MB), run=3742-4281msec WRITE: bw=6698KiB/s (6858kB/s), 1332KiB/s-2506KiB/s (1364kB/s-2566kB/s), io=28.0MiB (29.4MB), run=3742-4281msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179676: Tue Sep 8 10:13:07 2026 read: IOPS=2, BW=9.80MiB/s (10.3MB/s)(12.0MiB/1225msec) clat (msec): min=193, max=651, avg=387.89, stdev=236.75 lat (msec): min=193, max=651, avg=387.89, stdev=236.74 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min=12583, max=12583, per=99.46%, avg=12583.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=15.03%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179677: Tue Sep 8 10:13:07 2026 read: IOPS=0, BW=3163KiB/s (3239kB/s)(4096KiB/1295msec) clat (nsec): min=403127k, max=403127k, avg=403127101.00, stdev= 0.00 lat (nsec): min=403132k, max=403132k, avg=403131846.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 6747, max= 6747, per=53.33%, avg=6747.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6326KiB/s (6478kB/s)(8192KiB/1295msec); 0 zone resets clat (msec): min=377, max=485, avg=431.36, stdev=76.57 lat (msec): min=377, max=486, avg=431.80, stdev=76.71 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 8192, max= 8192, per=55.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=14.84%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179678: Tue Sep 8 10:13:07 2026 write: IOPS=1, BW=5515KiB/s (5648kB/s)(12.0MiB/2228msec); 0 zone resets clat (msec): min=303, max=1125, avg=723.65, stdev=411.29 lat (msec): min=304, max=1126, avg=724.42, stdev=411.22 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8175, max= 8192, per=55.64%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.63%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179679: Tue Sep 8 10:13:07 2026 write: IOPS=1, BW=7557KiB/s (7739kB/s)(12.0MiB/1626msec); 0 zone resets clat (msec): min=322, max=840, avg=513.53, stdev=284.80 lat (msec): min=322, max=841, avg=514.15, stdev=285.06 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 6410, max= 8192, per=49.64%, avg=7301.00, stdev=1260.06, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=13.97%, ctx=73, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=12.4MiB/s (12.0MB/s), 3163KiB/s-9.80MiB/s (3239kB/s-10.3MB/s), io=16.0MiB (16.8MB), run=1225-1295msec WRITE: bw=14.4MiB/s (15.1MB/s), 5515KiB/s-7557KiB/s (5648kB/s-7739kB/s), io=32.0MiB (33.6MB), run=1295-2228msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179681: Tue Sep 8 10:13:08 2026 read: IOPS=1, BW=6009KiB/s (6153kB/s)(12.0MiB/2045msec) clat (msec): min=627, max=767, avg=680.66, stdev=75.87 lat (msec): min=627, max=767, avg=680.67, stdev=75.87 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=31.21%, ctx=672, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179682: Tue Sep 8 10:13:08 2026 read: IOPS=0, BW=2028KiB/s (2076kB/s)(4096KiB/2020msec) clat (nsec): min=607367k, max=607367k, avg=607366632.00, stdev= 0.00 lat (nsec): min=607368k, max=607368k, avg=607368322.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4055KiB/s (4153kB/s)(8192KiB/2020msec); 0 zone resets clat (msec): min=610, max=798, avg=704.42, stdev=133.27 lat (msec): min=610, max=800, avg=705.53, stdev=133.89 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8047, max= 8047, per=60.17%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.10%, sys=8.42%, ctx=167, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179683: Tue Sep 8 10:13:08 2026 write: IOPS=1, BW=5016KiB/s (5136kB/s)(12.0MiB/2450msec); 0 zone resets clat (msec): min=241, max=1332, avg=814.81, stdev=547.63 lat (msec): min=243, max=1334, avg=816.21, stdev=547.36 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8047, max= 8047, per=60.17%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.10%, ctx=61, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179684: Tue Sep 8 10:13:08 2026 write: IOPS=1, BW=6138KiB/s (6285kB/s)(12.0MiB/2002msec); 0 zone resets clat (msec): min=420, max=931, avg=660.90, stdev=256.64 lat (msec): min=422, max=945, avg=666.63, stdev=263.13 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8192, max= 8192, per=61.25%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.10%, sys=14.09%, ctx=98, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8012KiB/s (8204kB/s), 2028KiB/s-6009KiB/s (2076kB/s-6153kB/s), io=16.0MiB (16.8MB), run=2020-2045msec WRITE: bw=13.1MiB/s (13.7MB/s), 4055KiB/s-6138KiB/s (4153kB/s-6285kB/s), io=32.0MiB (33.6MB), run=2002-2450msec