== sanity test 398b: DIO and buffer IO race ============== 08:50:04 (1786107004) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.28539 s, 9.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145118: Fri Aug 7 08:52:59 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(5992KiB/153372msec) clat (usec): min=36, max=560631, avg=51622.94, stdev=39723.69 lat (usec): min=36, max=560631, avg=51624.53, stdev=39723.74 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 11469], 20.00th=[ 23725], | 30.00th=[ 30278], 40.00th=[ 36963], 50.00th=[ 43779], 60.00th=[ 52167], | 70.00th=[ 62653], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[121111], | 99.00th=[164627], 99.50th=[191890], 99.90th=[371196], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 5, max= 95, per=25.35%, avg=39.29, stdev=17.79, samples=296 iops : min= 1, max= 23, avg= 9.14, stdev= 4.45, samples=296 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6296KiB/153372msec); 0 zone resets clat (usec): min=847, max=456855, avg=48017.80, stdev=49305.96 lat (usec): min=847, max=456857, avg=48023.04, stdev=49304.77 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1565], 10.00th=[ 2442], 20.00th=[ 6194], | 30.00th=[ 11863], 40.00th=[ 23987], 50.00th=[ 36439], 60.00th=[ 47973], | 70.00th=[ 62129], 80.00th=[ 80217], 90.00th=[108528], 95.00th=[139461], | 99.00th=[231736], 99.50th=[270533], 99.90th=[387974], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 103, per=25.24%, avg=40.88, stdev=19.15, samples=299 iops : min= 1, max= 25, avg= 9.55, stdev= 4.81, samples=299 lat (usec) : 50=0.33%, 100=3.32%, 250=0.46%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=4.49%, 4=2.93%, 10=6.77%, 20=7.75%, 50=33.27% lat (msec) : 100=29.17%, 250=10.55%, 500=0.52%, 750=0.03% cpu : usr=0.07%, sys=4.82%, ctx=6840, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145119: Fri Aug 7 08:52:59 2026 read: IOPS=9, BW=39.1KiB/s (40.1kB/s)(5940KiB/151766msec) clat (usec): min=37, max=370402, avg=49968.15, stdev=36877.85 lat (usec): min=37, max=370403, avg=49975.20, stdev=36876.24 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 13960], 20.00th=[ 24773], | 30.00th=[ 30540], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[168821], 99.50th=[206570], 99.90th=[346031], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 5, max= 92, per=25.46%, avg=39.47, stdev=17.68, samples=292 iops : min= 1, max= 23, avg= 9.20, stdev= 4.45, samples=292 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6348KiB/151766msec); 0 zone resets clat (usec): min=955, max=541581, avg=48577.98, stdev=50747.99 lat (usec): min=956, max=541582, avg=48588.74, stdev=50757.03 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1516], 10.00th=[ 2278], 20.00th=[ 5407], | 30.00th=[ 11338], 40.00th=[ 22938], 50.00th=[ 36963], 60.00th=[ 49021], | 70.00th=[ 65274], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[139461], | 99.00th=[221250], 99.50th=[244319], 99.90th=[429917], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 111, per=25.65%, avg=41.56, stdev=19.20, samples=296 iops : min= 1, max= 27, avg= 9.72, stdev= 4.83, samples=296 lat (usec) : 50=0.20%, 100=3.45%, 250=0.42%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.56%, 4=3.74%, 10=6.51%, 20=7.75%, 50=33.01% lat (msec) : 100=29.88%, 250=9.90%, 500=0.33%, 750=0.03% cpu : usr=0.07%, sys=4.86%, ctx=6800, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145120: Fri Aug 7 08:52:59 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(6028KiB/154304msec) clat (usec): min=35, max=367457, avg=50614.93, stdev=37416.08 lat (usec): min=35, max=367458, avg=50617.89, stdev=37415.93 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 13042], 20.00th=[ 23725], | 30.00th=[ 29230], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 51643], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[173016], 99.50th=[225444], 99.90th=[287310], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 94, per=25.04%, avg=38.82, stdev=17.33, samples=299 iops : min= 1, max= 23, avg= 9.03, stdev= 4.37, samples=299 write: IOPS=10, BW=40.6KiB/s (41.5kB/s)(6260KiB/154304msec); 0 zone resets clat (usec): min=831, max=875262, avg=49602.57, stdev=53697.47 lat (usec): min=832, max=875266, avg=49606.63, stdev=53696.18 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1549], 10.00th=[ 2343], 20.00th=[ 6063], | 30.00th=[ 11863], 40.00th=[ 24249], 50.00th=[ 38536], 60.00th=[ 50070], | 70.00th=[ 63177], 80.00th=[ 84411], 90.00th=[112722], 95.00th=[135267], | 99.00th=[225444], 99.50th=[291505], 99.90th=[438305], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 143, per=24.68%, avg=39.98, stdev=19.10, samples=301 iops : min= 1, max= 35, avg= 9.32, stdev= 4.79, samples=301 lat (usec) : 50=0.23%, 100=3.55%, 250=0.26%, 500=0.07%, 1000=0.07% lat (msec) : 2=4.46%, 4=3.29%, 10=6.84%, 20=7.26%, 50=33.17% lat (msec) : 100=28.87%, 250=11.39%, 500=0.52%, 1000=0.03% cpu : usr=0.07%, sys=4.73%, ctx=6919, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145121: Fri Aug 7 08:52:59 2026 read: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6052KiB/153240msec) clat (usec): min=34, max=689753, avg=51554.27, stdev=40011.44 lat (usec): min=34, max=689755, avg=51556.86, stdev=40011.02 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 1598], 20.00th=[ 23462], | 30.00th=[ 30802], 40.00th=[ 37487], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 63177], 80.00th=[ 78119], 90.00th=[ 95945], 95.00th=[115868], | 99.00th=[175113], 99.50th=[206570], 99.90th=[265290], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 111, per=25.29%, avg=39.20, stdev=17.57, samples=300 iops : min= 1, max= 27, avg= 9.13, stdev= 4.44, samples=300 write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6236KiB/153240msec); 0 zone resets clat (usec): min=1029, max=479571, avg=48027.87, stdev=50268.11 lat (usec): min=1031, max=479573, avg=48032.11, stdev=50268.72 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1549], 10.00th=[ 2311], 20.00th=[ 5800], | 30.00th=[ 11076], 40.00th=[ 22152], 50.00th=[ 34866], 60.00th=[ 46924], | 70.00th=[ 63177], 80.00th=[ 82314], 90.00th=[109577], 95.00th=[141558], | 99.00th=[217056], 99.50th=[242222], 99.90th=[459277], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 111, per=24.86%, avg=40.28, stdev=19.16, samples=301 iops : min= 1, max= 27, avg= 9.40, stdev= 4.82, samples=301 lat (usec) : 50=0.39%, 100=3.81%, 250=0.33%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.43%, 4=3.68%, 10=6.35%, 20=8.01%, 50=32.13% lat (msec) : 100=29.33%, 250=11.04%, 500=0.26%, 750=0.03% cpu : usr=0.08%, sys=4.77%, ctx=6814, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (159kB/s), 39.1KiB/s-39.5KiB/s (40.0kB/s-40.4kB/s), io=23.4MiB (24.6MB), run=151766-154304msec WRITE: bw=163KiB/s (167kB/s), 40.6KiB/s-41.8KiB/s (41.5kB/s-42.8kB/s), io=24.6MiB (25.7MB), run=151766-154304msec fio: pid=145117, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=145114: Fri Aug 7 08:55:23 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(5992KiB/297570msec) clat (msec): min=6, max=575, avg=42.14, stdev=48.20 lat (msec): min=6, max=575, avg=42.14, stdev=48.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 92], 95.00th=[ 128], | 99.00th=[ 215], 99.50th=[ 347], 99.90th=[ 435], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 94, per=31.54%, avg=22.71, stdev=16.53, samples=506 iops : min= 1, max= 23, avg= 5.02, stdev= 4.18, samples=506 write: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6296KiB/297570msec); 0 zone resets clat (msec): min=28, max=650, avg=148.69, stdev=79.92 lat (msec): min=28, max=650, avg=148.69, stdev=79.92 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 85], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 205], 90.00th=[ 253], 95.00th=[ 296], | 99.00th=[ 414], 99.50th=[ 493], 99.90th=[ 567], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 56, per=27.98%, avg=20.98, stdev=11.09, samples=573 iops : min= 1, max= 14, avg= 4.58, stdev= 2.81, samples=573 lat (msec) : 10=3.12%, 20=14.55%, 50=20.67%, 100=22.01%, 250=33.98% lat (msec) : 500=5.40%, 750=0.26% cpu : usr=0.04%, sys=1.33%, ctx=5469, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145115: Fri Aug 7 08:55:23 2026 read: IOPS=4, BW=19.9KiB/s (20.4kB/s)(5940KiB/298362msec) clat (msec): min=5, max=697, avg=40.43, stdev=45.32 lat (msec): min=5, max=697, avg=40.43, stdev=45.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 86], 95.00th=[ 120], | 99.00th=[ 224], 99.50th=[ 268], 99.90th=[ 523], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 87, per=32.67%, avg=23.52, stdev=15.84, samples=485 iops : min= 1, max= 21, avg= 5.22, stdev= 3.99, samples=485 write: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6348KiB/298362msec); 0 zone resets clat (msec): min=28, max=655, avg=149.90, stdev=79.38 lat (msec): min=28, max=655, avg=149.91, stdev=79.38 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 70], 20.00th=[ 87], | 30.00th=[ 102], 40.00th=[ 116], 50.00th=[ 132], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 203], 90.00th=[ 255], 95.00th=[ 305], | 99.00th=[ 414], 99.50th=[ 489], 99.90th=[ 634], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 55, per=28.19%, avg=21.14, stdev=10.51, samples=574 iops : min= 1, max= 13, avg= 4.62, stdev= 2.67, samples=574 lat (msec) : 10=2.73%, 20=15.27%, 50=20.21%, 100=21.68%, 250=34.24% lat (msec) : 500=5.60%, 750=0.26% cpu : usr=0.05%, sys=1.32%, ctx=5362, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145116: Fri Aug 7 08:55:23 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6028KiB/296931msec) clat (msec): min=6, max=440, avg=42.40, stdev=45.16 lat (msec): min=6, max=440, avg=42.40, stdev=45.16 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 61], 90.00th=[ 92], 95.00th=[ 128], | 99.00th=[ 209], 99.50th=[ 259], 99.90th=[ 430], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 103, per=31.96%, avg=23.01, stdev=15.15, samples=503 iops : min= 1, max= 25, avg= 5.10, stdev= 3.81, samples=503 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6260KiB/296931msec); 0 zone resets clat (msec): min=29, max=852, avg=148.65, stdev=81.02 lat (msec): min=29, max=852, avg=148.66, stdev=81.02 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 86], | 30.00th=[ 100], 40.00th=[ 114], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 203], 90.00th=[ 251], 95.00th=[ 305], | 99.00th=[ 418], 99.50th=[ 472], 99.90th=[ 701], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 64, per=27.80%, avg=20.85, stdev=11.18, samples=574 iops : min= 1, max= 16, avg= 4.55, stdev= 2.84, samples=574 lat (msec) : 10=2.57%, 20=13.96%, 50=21.88%, 100=22.30%, 250=33.79% lat (msec) : 500=5.27%, 750=0.20%, 1000=0.03% cpu : usr=0.05%, sys=1.38%, ctx=5432, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145117: Fri Aug 7 08:55:23 2026 read: IOPS=4, BW=16.9KiB/s (17.3kB/s)(3584KiB/212029msec) clat (msec): min=6, max=519, avg=54.01, stdev=52.57 lat (msec): min=6, max=519, avg=54.01, stdev=52.57 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 80], 90.00th=[ 112], 95.00th=[ 155], | 99.00th=[ 271], 99.50th=[ 321], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 110, per=28.60%, avg=20.59, stdev=14.97, samples=333 iops : min= 1, max= 27, avg= 4.48, stdev= 3.77, samples=333 write: IOPS=4, BW=17.4KiB/s (17.8kB/s)(3688KiB/212029msec); 0 zone resets clat (msec): min=33, max=954, avg=177.06, stdev=89.35 lat (msec): min=33, max=954, avg=177.07, stdev=89.36 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 72], 10.00th=[ 84], 20.00th=[ 101], | 30.00th=[ 123], 40.00th=[ 140], 50.00th=[ 157], 60.00th=[ 180], | 70.00th=[ 211], 80.00th=[ 247], 90.00th=[ 300], 95.00th=[ 338], | 99.00th=[ 439], 99.50th=[ 489], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 48, per=22.99%, avg=17.24, stdev= 9.10, samples=406 iops : min= 1, max= 12, avg= 3.64, stdev= 2.32, samples=406 lat (msec) : 10=0.99%, 20=9.90%, 50=20.78%, 100=20.89%, 250=37.11% lat (msec) : 500=10.06%, 750=0.16%, 1000=0.05% cpu : usr=0.03%, sys=1.16%, ctx=2900, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=897,922,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=72.2KiB/s (73.9kB/s), 16.9KiB/s-20.3KiB/s (17.3kB/s-20.8kB/s), io=21.0MiB (22.1MB), run=212029-298362msec WRITE: bw=75.7KiB/s (77.5kB/s), 17.4KiB/s-21.3KiB/s (17.8kB/s-21.8kB/s), io=22.1MiB (23.1MB), run=212029-298362msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145186: Fri Aug 7 08:56:10 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(5920KiB/32048msec) clat (usec): min=34, max=192917, avg=41168.07, stdev=31879.62 lat (usec): min=34, max=192918, avg=41173.45, stdev=31881.51 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 68], 10.00th=[ 79], 20.00th=[ 293], | 30.00th=[ 24773], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 56361], 80.00th=[ 64750], 90.00th=[ 80217], 95.00th=[ 92799], | 99.00th=[130548], 99.50th=[187696], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 93, max= 408, per=26.05%, avg=187.03, stdev=74.22, samples=62 iops : min= 5, max= 25, avg=10.94, stdev= 4.72, samples=62 write: IOPS=12, BW=199KiB/s (203kB/s)(6368KiB/32048msec); 0 zone resets clat (usec): min=1734, max=413751, avg=42128.27, stdev=44189.99 lat (usec): min=1736, max=413754, avg=42133.00, stdev=44189.30 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2442], 10.00th=[ 3818], 20.00th=[ 7111], | 30.00th=[ 11338], 40.00th=[ 20317], 50.00th=[ 29754], 60.00th=[ 40633], | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[124257], | 99.00th=[185598], 99.50th=[256902], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 61, max= 380, per=26.28%, avg=198.71, stdev=71.66, samples=63 iops : min= 3, max= 23, avg=11.67, stdev= 4.49, samples=63 lat (usec) : 50=1.04%, 100=6.90%, 250=1.56%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=5.08%, 10=8.07%, 20=7.81%, 50=34.24% lat (msec) : 100=27.34%, 250=6.38%, 500=0.26% cpu : usr=0.10%, sys=5.94%, ctx=1592, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145187: Fri Aug 7 08:56:10 2026 read: IOPS=10, BW=172KiB/s (177kB/s)(5744KiB/33316msec) clat (usec): min=40, max=247545, avg=46502.69, stdev=35114.45 lat (usec): min=40, max=247545, avg=46526.43, stdev=35117.67 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 20841], | 30.00th=[ 27919], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 49546], | 70.00th=[ 57410], 80.00th=[ 71828], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[156238], 99.50th=[217056], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 383, per=24.99%, avg=179.42, stdev=84.30, samples=62 iops : min= 1, max= 23, avg=10.45, stdev= 5.34, samples=62 write: IOPS=12, BW=196KiB/s (201kB/s)(6544KiB/33316msec); 0 zone resets clat (usec): min=1586, max=452265, avg=40360.44, stdev=48515.80 lat (usec): min=1588, max=452270, avg=40383.71, stdev=48526.41 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2442], 10.00th=[ 3720], 20.00th=[ 6521], | 30.00th=[ 9896], 40.00th=[ 15139], 50.00th=[ 25822], 60.00th=[ 34341], | 70.00th=[ 49546], 80.00th=[ 66323], 90.00th=[ 94897], 95.00th=[129500], | 99.00th=[179307], 99.50th=[320865], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 31, max= 436, per=25.77%, avg=194.78, stdev=82.86, samples=65 iops : min= 1, max= 27, avg=11.43, stdev= 5.26, samples=65 lat (usec) : 50=0.13%, 100=5.86%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=1.30%, 4=5.21%, 10=9.90%, 20=10.03%, 50=32.55% lat (msec) : 100=26.43%, 250=7.29%, 500=0.39% cpu : usr=0.08%, sys=5.81%, ctx=1691, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145188: Fri Aug 7 08:56:10 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30403msec) clat (usec): min=39, max=292819, avg=44626.25, stdev=37300.23 lat (usec): min=40, max=292821, avg=44628.19, stdev=37300.23 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 69], 10.00th=[ 86], 20.00th=[ 18220], | 30.00th=[ 28705], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 46400], | 70.00th=[ 53216], 80.00th=[ 63701], 90.00th=[ 80217], 95.00th=[105382], | 99.00th=[206570], 99.50th=[210764], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 413, per=28.62%, avg=205.53, stdev=82.85, samples=59 iops : min= 1, max= 25, avg=12.12, stdev= 5.27, samples=59 write: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30403msec); 0 zone resets clat (usec): min=1731, max=222672, avg=34150.56, stdev=37295.46 lat (usec): min=1734, max=222677, avg=34156.11, stdev=37293.20 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2376], 10.00th=[ 3654], 20.00th=[ 5735], | 30.00th=[ 8455], 40.00th=[ 11863], 50.00th=[ 20317], 60.00th=[ 30278], | 70.00th=[ 40109], 80.00th=[ 61080], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[164627], 99.50th=[202376], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 62, max= 383, per=26.23%, avg=198.33, stdev=77.17, samples=58 iops : min= 3, max= 23, avg=11.66, stdev= 4.86, samples=58 lat (usec) : 50=0.78%, 100=5.21%, 250=2.34%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.17%, 4=5.08%, 10=12.24%, 20=7.55%, 50=35.42% lat (msec) : 100=23.57%, 250=6.25%, 500=0.13% cpu : usr=0.08%, sys=5.64%, ctx=1518, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145189: Fri Aug 7 08:56:10 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(6032KiB/32325msec) clat (usec): min=41, max=241358, avg=45199.90, stdev=37378.93 lat (usec): min=42, max=241359, avg=45202.07, stdev=37378.92 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 13435], | 30.00th=[ 26084], 40.00th=[ 33817], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[185598], 99.50th=[210764], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 348, per=25.74%, avg=184.81, stdev=66.40, samples=63 iops : min= 1, max= 21, avg=10.81, stdev= 4.22, samples=63 write: IOPS=12, BW=194KiB/s (198kB/s)(6256KiB/32325msec); 0 zone resets clat (usec): min=1451, max=372784, avg=38849.27, stdev=45373.19 lat (usec): min=1452, max=372786, avg=38857.67, stdev=45377.63 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2507], 10.00th=[ 3589], 20.00th=[ 5932], | 30.00th=[ 8717], 40.00th=[ 13698], 50.00th=[ 23725], 60.00th=[ 34341], | 70.00th=[ 47973], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[225444], 99.50th=[333448], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 30, max= 438, per=25.55%, avg=193.13, stdev=90.70, samples=63 iops : min= 1, max= 27, avg=11.32, stdev= 5.73, samples=63 lat (usec) : 50=0.65%, 100=6.38%, 250=1.30%, 500=0.39%, 750=0.39% lat (msec) : 2=1.17%, 4=5.34%, 10=10.55%, 20=9.77%, 50=30.73% lat (msec) : 100=25.65%, 250=7.29%, 500=0.39% cpu : usr=0.11%, sys=5.79%, ctx=1618, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=719KiB/s (736kB/s), 172KiB/s-206KiB/s (177kB/s-211kB/s), io=23.4MiB (24.5MB), run=30403-33316msec WRITE: bw=756KiB/s (775kB/s), 194KiB/s-199KiB/s (198kB/s-203kB/s), io=24.6MiB (25.8MB), run=30403-33316msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145181: Fri Aug 7 08:56:57 2026 read: IOPS=4, BW=73.9KiB/s (75.7kB/s)(5920KiB/80083msec) clat (msec): min=8, max=267, avg=43.21, stdev=38.07 lat (msec): min=8, max=267, avg=43.22, stdev=38.07 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 82], 95.00th=[ 114], | 99.00th=[ 207], 99.50th=[ 249], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 287, per=28.32%, avg=83.83, stdev=47.89, samples=138 iops : min= 1, max= 17, avg= 4.43, stdev= 3.03, samples=138 write: IOPS=4, BW=79.5KiB/s (81.4kB/s)(6368KiB/80083msec); 0 zone resets clat (msec): min=37, max=712, avg=160.27, stdev=70.50 lat (msec): min=37, max=712, avg=160.27, stdev=70.50 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 89], 20.00th=[ 107], | 30.00th=[ 121], 40.00th=[ 131], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 182], 80.00th=[ 203], 90.00th=[ 251], 95.00th=[ 284], | 99.00th=[ 393], 99.50th=[ 418], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 25, max= 158, per=25.81%, avg=80.26, stdev=30.90, samples=155 iops : min= 1, max= 9, avg= 4.19, stdev= 1.99, samples=155 lat (msec) : 10=0.26%, 20=8.59%, 50=27.99%, 100=15.23%, 250=42.32% lat (msec) : 500=5.47%, 750=0.13% cpu : usr=0.05%, sys=1.35%, ctx=1341, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145182: Fri Aug 7 08:56:57 2026 read: IOPS=4, BW=71.0KiB/s (72.7kB/s)(5744KiB/80869msec) clat (msec): min=6, max=266, avg=45.32, stdev=44.23 lat (msec): min=6, max=266, avg=45.33, stdev=44.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 104], 95.00th=[ 148], | 99.00th=[ 222], 99.50th=[ 239], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 25, max= 317, per=28.40%, avg=84.06, stdev=55.58, samples=133 iops : min= 1, max= 19, avg= 4.44, stdev= 3.51, samples=133 write: IOPS=5, BW=80.9KiB/s (82.9kB/s)(6544KiB/80869msec); 0 zone resets clat (msec): min=25, max=572, avg=157.06, stdev=70.29 lat (msec): min=25, max=572, avg=157.08, stdev=70.29 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 72], 10.00th=[ 85], 20.00th=[ 102], | 30.00th=[ 122], 40.00th=[ 136], 50.00th=[ 146], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 203], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 414], 99.50th=[ 430], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 25, max= 318, per=26.31%, avg=81.83, stdev=37.79, samples=156 iops : min= 1, max= 19, avg= 4.29, stdev= 2.40, samples=156 lat (msec) : 10=0.65%, 20=11.07%, 50=24.87%, 100=15.49%, 250=44.01% lat (msec) : 500=3.65%, 750=0.26% cpu : usr=0.04%, sys=1.32%, ctx=1334, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145183: Fri Aug 7 08:56:57 2026 read: IOPS=5, BW=81.1KiB/s (83.0kB/s)(6256KiB/77157msec) clat (msec): min=7, max=299, avg=43.45, stdev=38.71 lat (msec): min=7, max=299, avg=43.45, stdev=38.71 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 59], 90.00th=[ 85], 95.00th=[ 126], | 99.00th=[ 207], 99.50th=[ 230], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 285, per=31.36%, avg=92.83, stdev=57.61, samples=133 iops : min= 1, max= 17, avg= 4.98, stdev= 3.64, samples=133 write: IOPS=4, BW=78.2KiB/s (80.1kB/s)(6032KiB/77157msec); 0 zone resets clat (msec): min=63, max=561, avg=158.61, stdev=67.07 lat (msec): min=63, max=561, avg=158.62, stdev=67.07 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 80], 10.00th=[ 89], 20.00th=[ 100], | 30.00th=[ 118], 40.00th=[ 131], 50.00th=[ 148], 60.00th=[ 165], | 70.00th=[ 180], 80.00th=[ 199], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 380], 99.50th=[ 397], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 25, max= 158, per=25.31%, avg=78.73, stdev=31.31, samples=150 iops : min= 1, max= 9, avg= 4.10, stdev= 2.00, samples=150 lat (msec) : 10=0.78%, 20=11.20%, 50=25.65%, 100=19.40%, 250=38.54% lat (msec) : 500=4.30%, 750=0.13% cpu : usr=0.04%, sys=1.43%, ctx=1401, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145184: Fri Aug 7 08:56:57 2026 read: IOPS=4, BW=76.1KiB/s (77.9kB/s)(6032KiB/79285msec) clat (msec): min=9, max=319, avg=43.60, stdev=36.81 lat (msec): min=9, max=319, avg=43.61, stdev=36.81 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 88], 95.00th=[ 121], | 99.00th=[ 194], 99.50th=[ 226], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 286, per=28.81%, avg=85.27, stdev=54.30, samples=138 iops : min= 1, max= 17, avg= 4.51, stdev= 3.40, samples=138 write: IOPS=4, BW=78.9KiB/s (80.8kB/s)(6256KiB/79285msec); 0 zone resets clat (msec): min=56, max=432, avg=160.39, stdev=65.60 lat (msec): min=56, max=432, avg=160.40, stdev=65.60 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 78], 10.00th=[ 90], 20.00th=[ 110], | 30.00th=[ 121], 40.00th=[ 132], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 182], 80.00th=[ 209], 90.00th=[ 245], 95.00th=[ 292], | 99.00th=[ 372], 99.50th=[ 426], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 159, per=25.54%, avg=79.43, stdev=30.89, samples=154 iops : min= 1, max= 9, avg= 4.14, stdev= 1.99, samples=154 lat (msec) : 10=0.26%, 20=8.59%, 50=28.26%, 100=16.02%, 250=42.06% lat (msec) : 500=4.82% cpu : usr=0.04%, sys=1.37%, ctx=1256, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=296KiB/s (303kB/s), 71.0KiB/s-81.1KiB/s (72.7kB/s-83.0kB/s), io=23.4MiB (24.5MB), run=77157-80869msec WRITE: bw=312KiB/s (319kB/s), 78.2KiB/s-80.9KiB/s (80.1kB/s-82.9kB/s), io=24.6MiB (25.8MB), run=77157-80869msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145212: Fri Aug 7 08:57:15 2026 read: IOPS=0, BW=831KiB/s (851kB/s)(7168KiB/8627msec) clat (msec): min=175, max=4749, avg=976.57, stdev=1674.06 lat (msec): min=175, max=4749, avg=976.58, stdev=1674.06 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 234], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 309], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 751], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1957, max= 4063, per=100.00%, avg=3007.25, stdev=1161.53, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=0, BW=593KiB/s (608kB/s)(5120KiB/8627msec); 0 zone resets clat (msec): min=100, max=897, avg=357.74, stdev=318.80 lat (msec): min=101, max=897, avg=357.87, stdev=318.79 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1896, max= 3864, per=82.80%, avg=2580.00, stdev=1112.77, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=7.70%, ctx=668, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145213: Fri Aug 7 08:57:15 2026 read: IOPS=0, BW=232KiB/s (238kB/s)(2048KiB/8829msec) clat (usec): min=925, max=213651, avg=107288.71, stdev=150419.76 lat (usec): min=927, max=213654, avg=107291.29, stdev=150420.41 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 930], 10.00th=[ 930], 20.00th=[ 930], | 30.00th=[ 930], 40.00th=[ 930], 50.00th=[ 930], 60.00th=[212861], | 70.00th=[212861], 80.00th=[212861], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 1389, max= 2019, per=76.55%, avg=1704.00, stdev=445.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1160KiB/s (1188kB/s)(10.0MiB/8829msec); 0 zone resets clat (msec): min=110, max=5051, avg=860.87, stdev=1482.90 lat (msec): min=110, max=5052, avg=861.15, stdev=1483.30 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 209], | 30.00th=[ 243], 40.00th=[ 351], 50.00th=[ 414], 60.00th=[ 456], | 70.00th=[ 535], 80.00th=[ 550], 90.00th=[ 701], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 2015, max= 4096, per=87.01%, avg=2711.17, stdev=1050.81, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=6.32%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145214: Fri Aug 7 08:57:15 2026 read: IOPS=0, BW=721KiB/s (738kB/s)(6144KiB/8523msec) clat (usec): min=880, max=469981, avg=228513.71, stdev=189254.45 lat (usec): min=881, max=469983, avg=228517.33, stdev=189254.90 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 2638], | 30.00th=[ 2638], 40.00th=[254804], 50.00th=[254804], 60.00th=[316670], | 70.00th=[325059], 80.00th=[325059], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 1917, max= 2035, per=89.01%, avg=1981.40, stdev=57.47, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=721KiB/s (738kB/s)(6144KiB/8523msec); 0 zone resets clat (msec): min=300, max=5224, avg=1189.88, stdev=1978.71 lat (msec): min=302, max=5224, avg=1190.50, stdev=1978.52 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 426], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 1503, max= 4031, per=73.24%, avg=2282.20, stdev=998.55, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 500=66.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.80%, ctx=142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145215: Fri Aug 7 08:57:15 2026 read: IOPS=0, BW=557KiB/s (570kB/s)(5120KiB/9199msec) clat (usec): min=558, max=506533, avg=182455.58, stdev=251321.34 lat (usec): min=560, max=506533, avg=182456.80, stdev=251320.79 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 644], 40.00th=[ 644], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[404751], 80.00th=[404751], 90.00th=[505414], 95.00th=[505414], | 99.00th=[505414], 99.50th=[505414], 99.90th=[505414], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 2019, max= 4031, per=100.00%, avg=2695.00, stdev=1157.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=779KiB/s (798kB/s)(7168KiB/9199msec); 0 zone resets clat (msec): min=227, max=5138, avg=1183.29, stdev=1758.54 lat (msec): min=227, max=5139, avg=1183.68, stdev=1758.43 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 239], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 575], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 818], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 1917, max= 2039, per=63.61%, avg=1982.20, stdev=58.42, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 250=16.67%, 500=8.33%, 750=33.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.58%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2226KiB/s (2280kB/s), 232KiB/s-831KiB/s (238kB/s-851kB/s), io=20.0MiB (20.0MB), run=8523-9199msec WRITE: bw=3117KiB/s (3192kB/s), 593KiB/s-1160KiB/s (608kB/s-1188kB/s), io=28.0MiB (29.4MB), run=8523-9199msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145207: Fri Aug 7 08:57:16 2026 read: IOPS=0, BW=855KiB/s (876kB/s)(7168KiB/8380msec) clat (msec): min=162, max=4027, avg=781.54, stdev=1432.95 lat (msec): min=162, max=4027, avg=781.54, stdev=1432.95 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 178], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 271], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 347], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 1771, max= 3908, per=100.00%, avg=2754.00, stdev=1030.82, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=611KiB/s (626kB/s)(5120KiB/8380msec); 0 zone resets clat (msec): min=274, max=1036, avg=576.27, stdev=298.11 lat (msec): min=275, max=1036, avg=576.38, stdev=298.10 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1969, max= 3335, per=88.51%, avg=2443.67, stdev=772.46, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.06%, sys=1.55%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145208: Fri Aug 7 08:57:16 2026 read: IOPS=0, BW=207KiB/s (212kB/s)(2048KiB/9880msec) clat (msec): min=173, max=578, avg=375.63, stdev=286.41 lat (msec): min=173, max=578, avg=375.64, stdev=286.41 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1475, max= 1980, per=87.60%, avg=1727.50, stdev=357.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1036KiB/s (1061kB/s)(10.0MiB/9880msec); 0 zone resets clat (msec): min=182, max=4968, avg=905.66, stdev=1444.83 lat (msec): min=182, max=4968, avg=905.83, stdev=1444.80 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 213], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 414], 60.00th=[ 489], | 70.00th=[ 659], 80.00th=[ 760], 90.00th=[ 802], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 1771, max= 4087, per=100.00%, avg=3003.00, stdev=1173.47, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=1.73%, ctx=135, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145209: Fri Aug 7 08:57:16 2026 read: IOPS=0, BW=630KiB/s (645kB/s)(6144KiB/9757msec) clat (msec): min=68, max=1198, avg=371.76, stdev=423.11 lat (msec): min=68, max=1198, avg=371.76, stdev=423.11 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 251], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1667, max= 2039, per=98.47%, avg=1941.80, stdev=155.89, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=630KiB/s (645kB/s)(6144KiB/9757msec); 0 zone resets clat (msec): min=284, max=5183, avg=1250.37, stdev=1931.09 lat (msec): min=284, max=5183, avg=1250.50, stdev=1931.11 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 489], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 1659, max= 2039, per=65.95%, avg=1821.00, stdev=174.56, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.60%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145210: Fri Aug 7 08:57:16 2026 read: IOPS=0, BW=493KiB/s (505kB/s)(5120KiB/10381msec) clat (msec): min=113, max=1179, avg=500.27, stdev=444.06 lat (msec): min=113, max=1179, avg=500.27, stdev=444.06 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1980, max= 4079, per=100.00%, avg=2702.33, stdev=1192.71, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=690KiB/s (707kB/s)(7168KiB/10381msec); 0 zone resets clat (msec): min=186, max=5387, avg=1117.38, stdev=1898.58 lat (msec): min=186, max=5388, avg=1117.62, stdev=1898.55 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 218], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 279], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 793], 90.00th=[ 5403], 95.00th=[ 5403], | 99.00th=[ 5403], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], | 99.99th=[ 5403] bw ( KiB/s): min= 1595, max= 2048, per=67.16%, avg=1854.20, stdev=208.02, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.78%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1973KiB/s (2020kB/s), 207KiB/s-855KiB/s (212kB/s-876kB/s), io=20.0MiB (20.0MB), run=8380-10381msec WRITE: bw=2762KiB/s (2828kB/s), 611KiB/s-1036KiB/s (626kB/s-1061kB/s), io=28.0MiB (29.4MB), run=8380-10381msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145226: Fri Aug 7 08:57:35 2026 read: IOPS=0, BW=2362KiB/s (2419kB/s)(12.0MiB/5202msec) clat (msec): min=883, max=3189, avg=1665.53, stdev=1320.06 lat (msec): min=883, max=3189, avg=1665.54, stdev=1320.06 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.79%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145228: Fri Aug 7 08:57:35 2026 read: IOPS=0, BW=657KiB/s (673kB/s)(4096KiB/6233msec) clat (nsec): min=3668.5M, max=3668.5M, avg=3668506233.00, stdev= 0.00 lat (nsec): min=3668.5M, max=3668.5M, avg=3668509257.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3675], 5.00th=[ 3675], 10.00th=[ 3675], 20.00th=[ 3675], | 30.00th=[ 3675], 40.00th=[ 3675], 50.00th=[ 3675], 60.00th=[ 3675], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1314KiB/s (1346kB/s)(8192KiB/6233msec); 0 zone resets clat (msec): min=689, max=1630, avg=1159.97, stdev=665.80 lat (msec): min=689, max=1631, avg=1160.39, stdev=665.86 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.91%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145229: Fri Aug 7 08:57:35 2026 write: IOPS=0, BW=2153KiB/s (2204kB/s)(12.0MiB/5708msec); 0 zone resets clat (msec): min=330, max=4093, avg=1848.65, stdev=1983.75 lat (msec): min=330, max=4093, avg=1849.09, stdev=1983.61 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.93%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145230: Fri Aug 7 08:57:35 2026 write: IOPS=0, BW=2349KiB/s (2405kB/s)(12.0MiB/5232msec); 0 zone resets clat (msec): min=310, max=2981, avg=1712.51, stdev=1340.59 lat (msec): min=310, max=2983, avg=1713.45, stdev=1341.36 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.12%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2629KiB/s (2692kB/s), 657KiB/s-2362KiB/s (673kB/s-2419kB/s), io=16.0MiB (16.8MB), run=5202-6233msec WRITE: bw=5257KiB/s (5383kB/s), 1314KiB/s-2349KiB/s (1346kB/s-2405kB/s), io=32.0MiB (33.6MB), run=5232-6233msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145223: Fri Aug 7 08:57:35 2026 read: IOPS=0, BW=2375KiB/s (2432kB/s)(12.0MiB/5174msec) clat (msec): min=843, max=3106, avg=1650.58, stdev=1263.54 lat (msec): min=843, max=3106, avg=1650.59, stdev=1263.54 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.88%, ctx=897, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145224: Fri Aug 7 08:57:35 2026 read: IOPS=0, BW=754KiB/s (773kB/s)(4096KiB/5429msec) clat (nsec): min=636651k, max=636651k, avg=636651357.00, stdev= 0.00 lat (nsec): min=636653k, max=636653k, avg=636652500.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1509KiB/s (1545kB/s)(8192KiB/5429msec); 0 zone resets clat (msec): min=964, max=3529, avg=2246.95, stdev=1813.70 lat (msec): min=964, max=3530, avg=2247.53, stdev=1813.93 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 3540], | 70.00th=[ 3540], 80.00th=[ 3540], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.41%, ctx=117, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145225: Fri Aug 7 08:57:35 2026 write: IOPS=0, BW=1952KiB/s (1999kB/s)(12.0MiB/6294msec); 0 zone resets clat (msec): min=355, max=4664, avg=2046.18, stdev=2299.60 lat (msec): min=356, max=4665, avg=2047.45, stdev=2299.01 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 8015, max= 8175, per=100.00%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.24%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145227: Fri Aug 7 08:57:35 2026 write: IOPS=0, BW=2070KiB/s (2119kB/s)(12.0MiB/5937msec); 0 zone resets clat (msec): min=318, max=3623, avg=1925.06, stdev=1654.43 lat (msec): min=321, max=3624, avg=1927.44, stdev=1653.67 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.39%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3018KiB/s (3090kB/s), 754KiB/s-2375KiB/s (773kB/s-2432kB/s), io=16.0MiB (16.8MB), run=5174-5429msec WRITE: bw=5206KiB/s (5331kB/s), 1509KiB/s-2070KiB/s (1545kB/s-2119kB/s), io=32.0MiB (33.6MB), run=5429-6294msec