== sanity test 398b: DIO and buffer IO race ============== 10:14:42 (1783952082) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.56555 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150541: Mon Jul 13 10:16:51 2026 read: IOPS=13, BW=55.4KiB/s (56.7kB/s)(5992KiB/108156msec) clat (usec): min=36, max=823219, avg=40561.56, stdev=33489.18 lat (usec): min=37, max=823220, avg=40563.70, stdev=33488.56 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8848], 10.00th=[ 15008], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 29754], 50.00th=[ 34341], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[137364], 99.50th=[164627], 99.90th=[223347], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 15, max= 127, per=25.25%, avg=55.30, stdev=19.47, samples=211 iops : min= 3, max= 31, avg=13.18, stdev= 4.90, samples=211 write: IOPS=14, BW=58.2KiB/s (59.6kB/s)(6296KiB/108156msec); 0 zone resets clat (usec): min=796, max=289801, avg=30026.19, stdev=31718.33 lat (usec): min=797, max=289804, avg=30034.19, stdev=31716.53 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1303], 10.00th=[ 1483], 20.00th=[ 3228], | 30.00th=[ 6259], 40.00th=[ 12518], 50.00th=[ 21103], 60.00th=[ 29492], | 70.00th=[ 39060], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[133694], 99.50th=[154141], 99.90th=[227541], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 134, per=25.32%, avg=57.98, stdev=23.48, samples=212 iops : min= 1, max= 33, avg=13.85, stdev= 5.90, samples=212 lat (usec) : 50=0.26%, 100=1.86%, 1000=0.23% lat (msec) : 2=7.26%, 4=4.49%, 10=7.52%, 20=12.27%, 50=42.06% lat (msec) : 100=20.57%, 250=3.42%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.77%, ctx=6317, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150542: Mon Jul 13 10:16:51 2026 read: IOPS=13, BW=55.0KiB/s (57.3kB/s)(5940KiB/106092msec) clat (usec): min=40, max=815298, avg=40601.71, stdev=31477.99 lat (usec): min=40, max=815299, avg=40604.34, stdev=31477.85 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12518], 10.00th=[ 16581], 20.00th=[ 22152], | 30.00th=[ 25822], 40.00th=[ 30278], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 47449], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 84411], | 99.00th=[119014], 99.50th=[147850], 99.90th=[221250], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 15, max= 104, per=25.42%, avg=55.68, stdev=20.44, samples=208 iops : min= 3, max= 26, avg=13.27, stdev= 5.14, samples=208 write: IOPS=14, BW=59.8KiB/s (61.3kB/s)(6348KiB/106092msec); 0 zone resets clat (usec): min=837, max=346861, avg=28788.37, stdev=31818.13 lat (usec): min=838, max=346863, avg=28789.92, stdev=31818.04 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 1450], 20.00th=[ 2868], | 30.00th=[ 5538], 40.00th=[ 11207], 50.00th=[ 21103], 60.00th=[ 28181], | 70.00th=[ 35914], 80.00th=[ 49021], 90.00th=[ 68682], 95.00th=[ 89654], | 99.00th=[139461], 99.50th=[166724], 99.90th=[233833], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 15, max= 128, per=25.93%, avg=59.37, stdev=22.02, samples=208 iops : min= 3, max= 32, avg=14.21, stdev= 5.56, samples=208 lat (usec) : 50=0.33%, 100=1.04%, 250=0.10%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.36% lat (msec) : 2=7.62%, 4=4.92%, 10=7.16%, 20=11.26%, 50=44.47% lat (msec) : 100=19.50%, 250=3.06%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.88%, ctx=6361, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150543: Mon Jul 13 10:16:51 2026 read: IOPS=14, BW=56.5KiB/s (57.9kB/s)(6028KiB/106640msec) clat (usec): min=35, max=282418, avg=39047.00, stdev=25898.67 lat (usec): min=35, max=282419, avg=39048.11, stdev=25898.68 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9634], 10.00th=[ 14877], 20.00th=[ 19530], | 30.00th=[ 23987], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 55313], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[124257], 99.50th=[154141], 99.90th=[270533], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 127, per=25.65%, avg=56.18, stdev=21.13, samples=209 iops : min= 1, max= 31, avg=13.40, stdev= 5.30, samples=209 write: IOPS=14, BW=58.7KiB/s (60.1kB/s)(6260KiB/106640msec); 0 zone resets clat (usec): min=796, max=819070, avg=30463.47, stdev=37946.33 lat (usec): min=796, max=819073, avg=30464.91, stdev=37946.58 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 1418], 20.00th=[ 2933], | 30.00th=[ 5407], 40.00th=[ 11469], 50.00th=[ 21103], 60.00th=[ 27657], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[135267], 99.50th=[158335], 99.90th=[258999], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 143, per=25.58%, avg=58.58, stdev=23.09, samples=208 iops : min= 1, max= 35, avg=14.00, stdev= 5.81, samples=208 lat (usec) : 50=0.33%, 100=1.60%, 250=0.03%, 500=0.03%, 1000=0.29% lat (msec) : 2=7.55%, 4=4.56%, 10=8.07%, 20=12.70%, 50=41.02% lat (msec) : 100=20.70%, 250=2.96%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=5.82%, ctx=6303, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150544: Mon Jul 13 10:16:51 2026 read: IOPS=13, BW=55.3KiB/s (56.6kB/s)(6052KiB/109485msec) clat (usec): min=33, max=322346, avg=39724.04, stdev=28854.00 lat (usec): min=34, max=322347, avg=39726.20, stdev=28854.03 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 857], 10.00th=[ 15008], 20.00th=[ 20317], | 30.00th=[ 24249], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 45876], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[156238], 99.50th=[177210], 99.90th=[248513], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 131, per=25.24%, avg=55.27, stdev=21.69, samples=214 iops : min= 1, max= 32, avg=13.16, stdev= 5.44, samples=214 write: IOPS=14, BW=56.0KiB/s (58.3kB/s)(6236KiB/109485msec); 0 zone resets clat (usec): min=932, max=839214, avg=31572.95, stdev=38104.45 lat (usec): min=934, max=839215, avg=31574.77, stdev=38104.22 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1483], 20.00th=[ 3589], | 30.00th=[ 6587], 40.00th=[ 14484], 50.00th=[ 22152], 60.00th=[ 29754], | 70.00th=[ 40633], 80.00th=[ 54264], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[139461], 99.50th=[158335], 99.90th=[299893], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 170, per=24.83%, avg=56.86, stdev=25.46, samples=214 iops : min= 1, max= 42, avg=13.57, stdev= 6.41, samples=214 lat (usec) : 50=0.52%, 100=1.79%, 250=0.07%, 500=0.07%, 1000=0.16% lat (msec) : 2=6.64%, 4=4.30%, 10=7.52%, 20=12.63%, 50=41.93% lat (msec) : 100=20.77%, 250=3.52%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.53%, ctx=6317, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=219KiB/s (225kB/s), 55.3KiB/s-56.5KiB/s (56.6kB/s-57.9kB/s), io=23.4MiB (24.6MB), run=106092-109485msec WRITE: bw=230KiB/s (235kB/s), 56.0KiB/s-59.8KiB/s (58.3kB/s-61.3kB/s), io=24.6MiB (25.7MB), run=106092-109485msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150536: Mon Jul 13 10:17:35 2026 read: IOPS=9, BW=38.9KiB/s (39.8kB/s)(5992KiB/154223msec) clat (msec): min=5, max=926, avg=39.51, stdev=40.23 lat (msec): min=5, max=926, avg=39.51, stdev=40.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 108], | 99.00th=[ 161], 99.50th=[ 174], 99.90th=[ 338], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 128, per=25.43%, avg=39.41, stdev=25.76, samples=297 iops : min= 1, max= 32, avg= 9.23, stdev= 6.49, samples=297 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6296KiB/154223msec); 0 zone resets clat (msec): min=11, max=424, avg=60.11, stdev=42.07 lat (msec): min=11, max=424, avg=60.11, stdev=42.07 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 117], 95.00th=[ 138], | 99.00th=[ 209], 99.50th=[ 247], 99.90th=[ 347], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 135, per=24.96%, avg=40.69, stdev=24.03, samples=302 iops : min= 1, max= 33, avg= 9.55, stdev= 6.06, samples=302 lat (msec) : 10=2.73%, 20=16.11%, 50=45.61%, 100=24.97%, 250=10.25% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=2.19%, ctx=5120, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150537: Mon Jul 13 10:17:35 2026 read: IOPS=9, BW=38.6KiB/s (39.6kB/s)(5940KiB/153747msec) clat (msec): min=5, max=933, avg=40.90, stdev=41.48 lat (msec): min=5, max=933, avg=40.91, stdev=41.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 88], 95.00th=[ 108], | 99.00th=[ 174], 99.50th=[ 194], 99.90th=[ 266], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 143, per=25.27%, avg=39.17, stdev=25.81, samples=296 iops : min= 1, max= 35, avg= 9.17, stdev= 6.50, samples=296 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6348KiB/153747msec); 0 zone resets clat (msec): min=11, max=422, avg=58.34, stdev=40.22 lat (msec): min=11, max=422, avg=58.34, stdev=40.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 111], 95.00th=[ 131], | 99.00th=[ 201], 99.50th=[ 241], 99.90th=[ 388], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 136, per=25.36%, avg=41.33, stdev=24.21, samples=300 iops : min= 1, max= 34, avg= 9.70, stdev= 6.09, samples=300 lat (msec) : 10=2.41%, 20=15.10%, 50=46.61%, 100=25.78%, 250=9.80% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=2.25%, ctx=5009, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150538: Mon Jul 13 10:17:35 2026 read: IOPS=9, BW=39.1KiB/s (40.1kB/s)(6028KiB/154047msec) clat (msec): min=4, max=257, avg=39.05, stdev=32.27 lat (msec): min=4, max=257, avg=39.05, stdev=32.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 108], | 99.00th=[ 157], 99.50th=[ 178], 99.90th=[ 209], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 151, per=25.48%, avg=39.50, stdev=25.67, samples=297 iops : min= 1, max= 37, avg= 9.25, stdev= 6.45, samples=297 write: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6260KiB/154047msec); 0 zone resets clat (msec): min=11, max=939, avg=60.56, stdev=48.43 lat (msec): min=11, max=939, avg=60.56, stdev=48.43 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 117], 95.00th=[ 144], | 99.00th=[ 215], 99.50th=[ 271], 99.90th=[ 388], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 119, per=24.85%, avg=40.50, stdev=24.49, samples=301 iops : min= 1, max= 29, avg= 9.50, stdev= 6.17, samples=301 lat (msec) : 10=2.38%, 20=15.79%, 50=46.91%, 100=24.48%, 250=10.09% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=2.23%, ctx=5010, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150539: Mon Jul 13 10:17:35 2026 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6052KiB/153998msec) clat (msec): min=5, max=291, avg=39.78, stdev=34.74 lat (msec): min=5, max=291, avg=39.78, stdev=34.74 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 86], 95.00th=[ 111], | 99.00th=[ 176], 99.50th=[ 207], 99.90th=[ 271], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 135, per=25.78%, avg=39.96, stdev=25.58, samples=295 iops : min= 1, max= 33, avg= 9.36, stdev= 6.45, samples=295 write: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6236KiB/153998msec); 0 zone resets clat (msec): min=11, max=943, avg=59.90, stdev=45.81 lat (msec): min=11, max=943, avg=59.91, stdev=45.81 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 110], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 253], 99.90th=[ 351], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 120, per=24.74%, avg=40.33, stdev=23.15, samples=301 iops : min= 1, max= 30, avg= 9.45, stdev= 5.83, samples=301 lat (msec) : 10=2.47%, 20=16.02%, 50=45.51%, 100=25.94%, 250=9.73% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.05%, sys=2.22%, ctx=4972, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (159kB/s), 38.6KiB/s-39.3KiB/s (39.6kB/s-40.2kB/s), io=23.4MiB (24.6MB), run=153747-154223msec WRITE: bw=163KiB/s (167kB/s), 40.5KiB/s-41.3KiB/s (41.5kB/s-42.3kB/s), io=24.6MiB (25.7MB), run=153747-154223msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150587: Mon Jul 13 10:18:19 2026 read: IOPS=11, BW=186KiB/s (191kB/s)(5920KiB/31750msec) clat (usec): min=49, max=214877, avg=46041.44, stdev=29932.04 lat (usec): min=50, max=214879, avg=46042.96, stdev=29931.99 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 73], 10.00th=[ 14877], 20.00th=[ 24249], | 30.00th=[ 29492], 40.00th=[ 35914], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 55837], 80.00th=[ 66847], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[133694], 99.50th=[189793], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 32, max= 379, per=26.13%, avg=185.77, stdev=73.82, samples=62 iops : min= 2, max= 23, avg=10.87, stdev= 4.59, samples=62 write: IOPS=12, BW=201KiB/s (205kB/s)(6368KiB/31750msec); 0 zone resets clat (usec): min=1395, max=253700, avg=36879.94, stdev=36110.28 lat (usec): min=1399, max=253704, avg=36882.39, stdev=36110.24 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2573], 10.00th=[ 3621], 20.00th=[ 7242], | 30.00th=[ 11207], 40.00th=[ 19530], 50.00th=[ 26608], 60.00th=[ 35390], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[168821], 99.50th=[189793], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 383, per=26.89%, avg=201.42, stdev=82.58, samples=62 iops : min= 1, max= 23, avg=11.84, stdev= 5.13, samples=62 lat (usec) : 50=0.13%, 100=2.99%, 250=0.78%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.04%, 4=5.08%, 10=7.81%, 20=10.42%, 50=38.80% lat (msec) : 100=27.08%, 250=5.47%, 500=0.13% cpu : usr=0.09%, sys=6.08%, ctx=1770, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150588: Mon Jul 13 10:18:19 2026 read: IOPS=11, BW=176KiB/s (181kB/s)(5744KiB/32563msec) clat (usec): min=41, max=218836, avg=46395.11, stdev=29973.42 lat (usec): min=41, max=218837, avg=46399.90, stdev=29971.10 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 70], 10.00th=[ 18744], 20.00th=[ 26084], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 54789], 80.00th=[ 61604], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[156238], 99.50th=[175113], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 56, max= 349, per=24.66%, avg=175.31, stdev=68.20, samples=64 iops : min= 3, max= 21, avg=10.20, stdev= 4.22, samples=64 write: IOPS=12, BW=201KiB/s (206kB/s)(6544KiB/32563msec); 0 zone resets clat (usec): min=1427, max=164811, avg=38689.19, stdev=35105.87 lat (usec): min=1428, max=164813, avg=38693.42, stdev=35105.56 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2933], 10.00th=[ 3949], 20.00th=[ 6849], | 30.00th=[ 12387], 40.00th=[ 21103], 50.00th=[ 27919], 60.00th=[ 37487], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[154141], 99.50th=[158335], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 384, per=26.79%, avg=200.69, stdev=74.79, samples=64 iops : min= 3, max= 24, avg=11.81, stdev= 4.71, samples=64 lat (usec) : 50=0.52%, 100=2.34%, 500=0.13% lat (msec) : 2=1.17%, 4=4.56%, 10=8.46%, 20=8.98%, 50=39.71% lat (msec) : 100=27.73%, 250=6.38% cpu : usr=0.09%, sys=6.26%, ctx=1805, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150589: Mon Jul 13 10:18:19 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(6256KiB/33643msec) clat (usec): min=46, max=184896, avg=47341.15, stdev=30527.66 lat (usec): min=48, max=184897, avg=47342.62, stdev=30527.64 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 16188], 20.00th=[ 24773], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 85459], 95.00th=[ 98042], | 99.00th=[145753], 99.50th=[156238], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 345, per=26.24%, avg=186.59, stdev=66.80, samples=66 iops : min= 1, max= 21, avg=10.92, stdev= 4.20, samples=66 write: IOPS=11, BW=179KiB/s (184kB/s)(6032KiB/33643msec); 0 zone resets clat (usec): min=1229, max=269867, avg=39968.55, stdev=38846.14 lat (usec): min=1231, max=269870, avg=39973.82, stdev=38843.54 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2442], 10.00th=[ 4047], 20.00th=[ 8455], | 30.00th=[ 14222], 40.00th=[ 22414], 50.00th=[ 29754], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 63701], 90.00th=[ 89654], 95.00th=[114820], | 99.00th=[179307], 99.50th=[187696], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 350, per=23.63%, avg=177.02, stdev=73.68, samples=66 iops : min= 3, max= 21, avg=10.32, stdev= 4.60, samples=66 lat (usec) : 50=0.26%, 100=3.26%, 250=0.26%, 500=0.13% lat (msec) : 2=1.56%, 4=3.39%, 10=6.64%, 20=10.16%, 50=40.76% lat (msec) : 100=27.34%, 250=6.12%, 500=0.13% cpu : usr=0.07%, sys=5.79%, ctx=1802, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150590: Mon Jul 13 10:18:19 2026 read: IOPS=11, BW=186KiB/s (191kB/s)(6032KiB/32392msec) clat (usec): min=44, max=289219, avg=48188.55, stdev=36691.67 lat (usec): min=44, max=289221, avg=48196.42, stdev=36694.75 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 1696], 20.00th=[ 25297], | 30.00th=[ 30016], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 88605], 95.00th=[107480], | 99.00th=[193987], 99.50th=[258999], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 352, per=26.12%, avg=185.69, stdev=67.82, samples=64 iops : min= 1, max= 22, avg=10.86, stdev= 4.27, samples=64 write: IOPS=12, BW=193KiB/s (198kB/s)(6256KiB/32392msec); 0 zone resets clat (usec): min=1754, max=243968, avg=36266.28, stdev=34365.85 lat (usec): min=1755, max=243972, avg=36268.79, stdev=34365.67 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2802], 10.00th=[ 3818], 20.00th=[ 7373], | 30.00th=[ 12387], 40.00th=[ 19530], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 57934], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[158335], 99.50th=[175113], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 31, max= 381, per=25.78%, avg=193.09, stdev=88.18, samples=64 iops : min= 1, max= 23, avg=11.31, stdev= 5.53, samples=64 lat (usec) : 50=0.13%, 100=3.65%, 250=0.78% lat (msec) : 2=1.17%, 4=4.56%, 10=7.42%, 20=9.64%, 50=39.84% lat (msec) : 100=26.95%, 250=5.60%, 500=0.26% cpu : usr=0.05%, sys=6.34%, ctx=1720, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=712KiB/s (729kB/s), 176KiB/s-186KiB/s (181kB/s-191kB/s), io=23.4MiB (24.5MB), run=31750-33643msec WRITE: bw=749KiB/s (767kB/s), 179KiB/s-201KiB/s (184kB/s-206kB/s), io=24.6MiB (25.8MB), run=31750-33643msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150582: Mon Jul 13 10:18:30 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5920KiB/45484msec) clat (msec): min=9, max=244, avg=50.13, stdev=37.01 lat (msec): min=9, max=244, avg=50.13, stdev=37.01 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 38], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 71], 90.00th=[ 96], 95.00th=[ 133], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 351, per=24.90%, avg=130.74, stdev=69.13, samples=87 iops : min= 1, max= 21, avg= 7.37, stdev= 4.40, samples=87 write: IOPS=8, BW=140KiB/s (143kB/s)(6368KiB/45484msec); 0 zone resets clat (msec): min=15, max=260, avg=67.49, stdev=37.47 lat (msec): min=15, max=260, avg=67.49, stdev=37.47 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 67], | 70.00th=[ 80], 80.00th=[ 95], 90.00th=[ 120], 95.00th=[ 142], | 99.00th=[ 194], 99.50th=[ 201], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 318, per=25.41%, avg=140.27, stdev=62.54, samples=88 iops : min= 1, max= 19, avg= 7.98, stdev= 4.03, samples=88 lat (msec) : 10=0.39%, 20=6.25%, 50=45.44%, 100=34.77%, 250=13.02% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.38%, ctx=1244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150583: Mon Jul 13 10:18:30 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5744KiB/45601msec) clat (msec): min=7, max=216, avg=46.97, stdev=35.23 lat (msec): min=7, max=216, avg=46.98, stdev=35.23 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 100], 95.00th=[ 130], | 99.00th=[ 165], 99.50th=[ 180], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 410, per=24.84%, avg=130.41, stdev=72.36, samples=85 iops : min= 1, max= 25, avg= 7.34, stdev= 4.64, samples=85 write: IOPS=8, BW=144KiB/s (147kB/s)(6544KiB/45601msec); 0 zone resets clat (msec): min=17, max=346, avg=69.87, stdev=42.47 lat (msec): min=17, max=346, avg=69.87, stdev=42.47 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 40], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 94], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 205], 99.50th=[ 228], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 319, per=25.42%, avg=140.29, stdev=66.40, samples=89 iops : min= 1, max= 19, avg= 7.97, stdev= 4.28, samples=89 lat (msec) : 10=0.52%, 20=6.38%, 50=47.53%, 100=31.38%, 250=13.93% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.29%, ctx=1251, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150584: Mon Jul 13 10:18:30 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(6256KiB/44978msec) clat (msec): min=9, max=214, avg=47.21, stdev=33.52 lat (msec): min=9, max=214, avg=47.21, stdev=33.52 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 94], 95.00th=[ 114], | 99.00th=[ 178], 99.50th=[ 213], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 379, per=26.87%, avg=141.08, stdev=76.02, samples=87 iops : min= 1, max= 23, avg= 8.01, stdev= 4.88, samples=87 write: IOPS=8, BW=134KiB/s (137kB/s)(6032KiB/44978msec); 0 zone resets clat (msec): min=19, max=356, avg=69.96, stdev=42.32 lat (msec): min=19, max=356, avg=69.97, stdev=42.32 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 56], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 96], 90.00th=[ 128], 95.00th=[ 155], | 99.00th=[ 218], 99.50th=[ 224], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 315, per=24.22%, avg=133.68, stdev=57.99, samples=87 iops : min= 1, max= 19, avg= 7.55, stdev= 3.73, samples=87 lat (msec) : 10=0.39%, 20=6.51%, 50=48.70%, 100=31.51%, 250=12.76% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.23%, ctx=1204, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150585: Mon Jul 13 10:18:30 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45309msec) clat (msec): min=9, max=335, avg=48.72, stdev=41.59 lat (msec): min=9, max=335, avg=48.72, stdev=41.59 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 131], | 99.00th=[ 205], 99.50th=[ 313], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 415, per=25.70%, avg=134.93, stdev=71.76, samples=87 iops : min= 1, max= 25, avg= 7.63, stdev= 4.55, samples=87 write: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45309msec); 0 zone resets clat (msec): min=14, max=237, avg=68.53, stdev=39.23 lat (msec): min=14, max=237, avg=68.54, stdev=39.23 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 56], 60.00th=[ 63], | 70.00th=[ 77], 80.00th=[ 96], 90.00th=[ 126], 95.00th=[ 150], | 99.00th=[ 197], 99.50th=[ 218], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 377, per=24.92%, avg=137.55, stdev=66.39, samples=89 iops : min= 1, max= 23, avg= 7.80, stdev= 4.30, samples=89 lat (msec) : 10=0.13%, 20=7.03%, 50=47.79%, 100=30.99%, 250=13.80% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=2.31%, ctx=1194, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=525KiB/s (538kB/s), 126KiB/s-139KiB/s (129kB/s-142kB/s), io=23.4MiB (24.5MB), run=44978-45601msec WRITE: bw=553KiB/s (566kB/s), 134KiB/s-144KiB/s (137kB/s-147kB/s), io=24.6MiB (25.8MB), run=44978-45601msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150604: Mon Jul 13 10:18:44 2026 read: IOPS=2, BW=2171KiB/s (2224kB/s)(7168KiB/3301msec) clat (msec): min=137, max=292, avg=233.87, stdev=59.51 lat (msec): min=137, max=292, avg=233.87, stdev=59.51 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 165], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 275], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2043, max= 4726, per=80.52%, avg=3610.67, stdev=1397.53, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1551KiB/s (1588kB/s)(5120KiB/3301msec); 0 zone resets clat (msec): min=124, max=512, avg=315.11, stdev=145.69 lat (msec): min=124, max=512, avg=315.19, stdev=145.69 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2023, max= 4063, per=40.47%, avg=2541.00, stdev=1014.70, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=15.88%, ctx=221, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150605: Mon Jul 13 10:18:44 2026 read: IOPS=0, BW=448KiB/s (459kB/s)(2048KiB/4567msec) clat (msec): min=156, max=259, avg=207.89, stdev=72.88 lat (msec): min=156, max=259, avg=207.89, stdev=72.88 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 259], 95.00th=[ 259], | 99.00th=[ 259], 99.50th=[ 259], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 1615, max= 2007, per=40.39%, avg=1811.00, stdev=277.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2242KiB/s (2296kB/s)(10.0MiB/4567msec); 0 zone resets clat (msec): min=129, max=877, avg=411.51, stdev=230.77 lat (msec): min=129, max=877, avg=411.59, stdev=230.79 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 163], | 30.00th=[ 253], 40.00th=[ 317], 50.00th=[ 330], 60.00th=[ 338], | 70.00th=[ 558], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2007, max= 4087, per=43.01%, avg=2700.33, stdev=1049.55, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=14.85%, ctx=212, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150606: Mon Jul 13 10:18:44 2026 read: IOPS=1, BW=1645KiB/s (1685kB/s)(6144KiB/3734msec) clat (usec): min=471, max=321983, avg=194161.75, stdev=110912.70 lat (usec): min=472, max=321984, avg=194163.15, stdev=110912.73 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[168821], | 30.00th=[168821], 40.00th=[179307], 50.00th=[179307], 60.00th=[225444], | 70.00th=[270533], 80.00th=[270533], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 2031, max= 4063, per=56.71%, avg=2543.00, stdev=1013.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1645KiB/s (1685kB/s)(6144KiB/3734msec); 0 zone resets clat (msec): min=121, max=661, avg=408.16, stdev=210.36 lat (msec): min=121, max=662, avg=408.27, stdev=210.33 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 493], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1577, max= 2043, per=31.09%, avg=1952.00, stdev=184.09, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=13.50%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150607: Mon Jul 13 10:18:44 2026 read: IOPS=1, BW=1342KiB/s (1374kB/s)(5120KiB/3816msec) clat (usec): min=541, max=291924, avg=105305.61, stdev=144776.38 lat (usec): min=542, max=291924, avg=105306.92, stdev=144776.08 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[ 652], 40.00th=[ 652], 50.00th=[ 889], 60.00th=[ 889], | 70.00th=[231736], 80.00th=[231736], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1878KiB/s (1923kB/s)(7168KiB/3816msec); 0 zone resets clat (msec): min=185, max=889, avg=459.32, stdev=273.65 lat (msec): min=185, max=889, avg=459.49, stdev=273.70 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 230], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 351], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 760], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1665, max= 4015, per=37.49%, avg=2353.80, stdev=941.98, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=25.00%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.03%, sys=13.42%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4484KiB/s (4592kB/s), 448KiB/s-2171KiB/s (459kB/s-2224kB/s), io=20.0MiB (20.0MB), run=3301-4567msec WRITE: bw=6278KiB/s (6429kB/s), 1551KiB/s-2242KiB/s (1588kB/s-2296kB/s), io=28.0MiB (29.4MB), run=3301-4567msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150609: Mon Jul 13 10:18:45 2026 read: IOPS=1, BW=1962KiB/s (2009kB/s)(7168KiB/3654msec) clat (msec): min=53, max=218, avg=144.40, stdev=55.48 lat (msec): min=53, max=218, avg=144.40, stdev=55.48 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 100], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 150], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 182], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1943, max= 4219, per=59.56%, avg=2558.25, stdev=1108.07, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1401KiB/s (1435kB/s)(5120KiB/3654msec); 0 zone resets clat (msec): min=296, max=635, avg=520.69, stdev=134.47 lat (msec): min=296, max=635, avg=520.91, stdev=134.50 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1943, max= 2048, per=33.48%, avg=2013.25, stdev=47.96, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=33.33% cpu : usr=0.00%, sys=6.16%, ctx=118, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150610: Mon Jul 13 10:18:45 2026 read: IOPS=0, BW=456KiB/s (467kB/s)(2048KiB/4489msec) clat (msec): min=83, max=576, avg=329.93, stdev=348.49 lat (msec): min=83, max=576, avg=329.93, stdev=348.49 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1501, max= 1996, per=40.71%, avg=1748.50, stdev=350.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2281KiB/s (2336kB/s)(10.0MiB/4489msec); 0 zone resets clat (msec): min=57, max=683, avg=379.74, stdev=225.60 lat (msec): min=58, max=684, avg=379.83, stdev=225.59 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 133], | 30.00th=[ 150], 40.00th=[ 247], 50.00th=[ 359], 60.00th=[ 451], | 70.00th=[ 498], 80.00th=[ 575], 90.00th=[ 651], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1943, max= 6119, per=44.84%, avg=2696.17, stdev=1677.30, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.55, samples=6 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=33.33% cpu : usr=0.02%, sys=6.15%, ctx=117, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150611: Mon Jul 13 10:18:45 2026 read: IOPS=1, BW=1346KiB/s (1378kB/s)(6144KiB/4565msec) clat (msec): min=70, max=1215, avg=428.19, stdev=428.33 lat (msec): min=70, max=1215, avg=428.20, stdev=428.33 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 468], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 2000, max= 2048, per=47.24%, avg=2029.00, stdev=25.51, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 write: IOPS=1, BW=1346KiB/s (1378kB/s)(6144KiB/4565msec); 0 zone resets clat (msec): min=102, max=587, avg=315.63, stdev=180.76 lat (msec): min=102, max=587, avg=316.35, stdev=180.57 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 334], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1943, max= 4096, per=44.78%, avg=2692.67, stdev=1216.27, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.07%, sys=4.93%, ctx=82, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150612: Mon Jul 13 10:18:45 2026 read: IOPS=1, BW=1074KiB/s (1100kB/s)(5120KiB/4768msec) clat (msec): min=64, max=939, avg=306.82, stdev=360.28 lat (msec): min=64, max=939, avg=306.82, stdev=360.28 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2000, max= 4063, per=62.76%, avg=2695.33, stdev=1184.49, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1503KiB/s (1539kB/s)(7168KiB/4768msec); 0 zone resets clat (msec): min=90, max=854, avg=421.34, stdev=348.23 lat (msec): min=91, max=855, avg=421.44, stdev=348.24 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 93], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 326], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 793], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1943, max= 2048, per=33.61%, avg=2020.80, stdev=43.93, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=25.00% cpu : usr=0.00%, sys=4.30%, ctx=88, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4295KiB/s (4398kB/s), 456KiB/s-1962KiB/s (467kB/s-2009kB/s), io=20.0MiB (20.0MB), run=3654-4768msec WRITE: bw=6013KiB/s (6158kB/s), 1346KiB/s-2281KiB/s (1378kB/s-2336kB/s), io=28.0MiB (29.4MB), run=3654-4768msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150619: Mon Jul 13 10:18:58 2026 read: IOPS=1, BW=5616KiB/s (5751kB/s)(12.0MiB/2188msec) clat (msec): min=661, max=728, avg=706.17, stdev=38.50 lat (msec): min=661, max=728, avg=706.17, stdev=38.50 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=15.64%, ctx=418, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150620: Mon Jul 13 10:18:58 2026 read: IOPS=0, BW=1904KiB/s (1950kB/s)(4096KiB/2151msec) clat (nsec): min=687686k, max=687686k, avg=687686360.00, stdev= 0.00 lat (nsec): min=687689k, max=687689k, avg=687689059.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3808KiB/s (3900kB/s)(8192KiB/2151msec); 0 zone resets clat (msec): min=595, max=849, avg=722.51, stdev=180.12 lat (msec): min=595, max=850, avg=723.41, stdev=180.26 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8015, max= 8015, per=63.45%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.74%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150621: Mon Jul 13 10:18:58 2026 write: IOPS=1, BW=4737KiB/s (4851kB/s)(12.0MiB/2594msec); 0 zone resets clat (msec): min=562, max=1008, avg=848.91, stdev=248.43 lat (msec): min=563, max=1008, avg=849.24, stdev=248.44 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8078, max= 8175, per=64.33%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.01%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150622: Mon Jul 13 10:18:58 2026 write: IOPS=1, BW=4997KiB/s (5117kB/s)(12.0MiB/2459msec); 0 zone resets clat (msec): min=209, max=1481, avg=777.80, stdev=646.36 lat (msec): min=210, max=1481, avg=778.29, stdev=646.20 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.68%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7488KiB/s (7668kB/s), 1904KiB/s-5616KiB/s (1950kB/s-5751kB/s), io=16.0MiB (16.8MB), run=2151-2188msec WRITE: bw=12.3MiB/s (12.9MB/s), 3808KiB/s-4997KiB/s (3900kB/s-5117kB/s), io=32.0MiB (33.6MB), run=2151-2594msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150624: Mon Jul 13 10:18:58 2026 read: IOPS=1, BW=5146KiB/s (5269kB/s)(12.0MiB/2388msec) clat (msec): min=352, max=1466, avg=791.76, stdev=593.28 lat (msec): min=352, max=1466, avg=791.76, stdev=593.28 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7953, max= 8047, per=100.00%, avg=8000.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.94%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150625: Mon Jul 13 10:18:58 2026 read: IOPS=0, BW=1607KiB/s (1645kB/s)(4096KiB/2549msec) clat (nsec): min=1150.8M, max=1150.8M, avg=1150841571.00, stdev= 0.00 lat (nsec): min=1150.8M, max=1150.8M, avg=1150843525.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3214KiB/s (3291kB/s)(8192KiB/2549msec); 0 zone resets clat (msec): min=630, max=765, avg=697.92, stdev=95.10 lat (msec): min=631, max=765, avg=698.42, stdev=95.13 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7953, max= 7953, per=61.87%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.71%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150626: Mon Jul 13 10:18:58 2026 write: IOPS=1, BW=4870KiB/s (4987kB/s)(12.0MiB/2523msec); 0 zone resets clat (msec): min=327, max=1625, avg=839.94, stdev=690.66 lat (msec): min=328, max=1626, avg=840.53, stdev=690.75 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7953, max= 7953, per=61.87%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.88%, ctx=32, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150627: Mon Jul 13 10:18:58 2026 write: IOPS=1, BW=5882KiB/s (6023kB/s)(12.0MiB/2089msec); 0 zone resets clat (msec): min=479, max=977, avg=694.94, stdev=255.90 lat (msec): min=480, max=978, avg=695.38, stdev=255.90 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 6965, max= 8047, per=58.39%, avg=7506.00, stdev=765.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.19%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6428KiB/s (6582kB/s), 1607KiB/s-5146KiB/s (1645kB/s-5269kB/s), io=16.0MiB (16.8MB), run=2388-2549msec WRITE: bw=12.6MiB/s (13.2MB/s), 3214KiB/s-5882KiB/s (3291kB/s-6023kB/s), io=32.0MiB (33.6MB), run=2089-2549msec