== sanity test 398b: DIO and buffer IO race ============== 04:59:15 (1780995555) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.05588 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144828: Tue Jun 9 05:02:19 2026 read: IOPS=9, BW=37.1KiB/s (37.9kB/s)(5992KiB/161711msec) clat (usec): min=32, max=477897, avg=52520.39, stdev=41048.88 lat (usec): min=32, max=477898, avg=52533.15, stdev=41055.56 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 14091], 20.00th=[ 25297], | 30.00th=[ 31851], 40.00th=[ 38536], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 63177], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[177210], 99.50th=[240124], 99.90th=[434111], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 95, per=25.76%, avg=37.61, stdev=17.57, samples=309 iops : min= 1, max= 23, avg= 8.74, stdev= 4.43, samples=309 write: IOPS=9, BW=38.9KiB/s (39.9kB/s)(6296KiB/161711msec); 0 zone resets clat (usec): min=1152, max=1338.2k, avg=52308.12, stdev=63401.78 lat (usec): min=1153, max=1338.2k, avg=52326.19, stdev=63395.47 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1500], 10.00th=[ 2376], | 20.00th=[ 6456], 30.00th=[ 13960], 40.00th=[ 26084], | 50.00th=[ 38011], 60.00th=[ 50594], 70.00th=[ 67634], | 80.00th=[ 85459], 90.00th=[ 117965], 95.00th=[ 147850], | 99.00th=[ 227541], 99.50th=[ 274727], 99.90th=[ 809501], | 99.95th=[1333789], 99.99th=[1333789] bw ( KiB/s): min= 7, max= 95, per=25.47%, avg=38.96, stdev=17.45, samples=313 iops : min= 1, max= 23, avg= 9.08, stdev= 4.40, samples=313 lat (usec) : 50=0.16%, 100=3.45%, 250=0.20%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.85%, 4=2.41%, 10=6.18%, 20=7.68%, 50=33.72% lat (msec) : 100=29.04%, 250=11.65%, 500=0.52%, 1000=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.74%, ctx=6677, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144829: Tue Jun 9 05:02:19 2026 read: IOPS=9, BW=36.3KiB/s (37.2kB/s)(5940KiB/163414msec) clat (usec): min=28, max=1351.4k, avg=54932.67, stdev=49364.64 lat (usec): min=29, max=1351.4k, avg=54938.77, stdev=49362.65 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 79], 10.00th=[ 16450], | 20.00th=[ 26346], 30.00th=[ 33162], 40.00th=[ 40633], | 50.00th=[ 48497], 60.00th=[ 56361], 70.00th=[ 66847], | 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[ 119014], | 99.00th=[ 168821], 99.50th=[ 206570], 99.90th=[ 329253], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 103, per=25.01%, avg=36.51, stdev=17.15, samples=315 iops : min= 1, max= 25, avg= 8.46, stdev= 4.34, samples=315 write: IOPS=9, BW=38.8KiB/s (39.8kB/s)(6348KiB/163414msec); 0 zone resets clat (usec): min=1161, max=819943, avg=51138.01, stdev=57330.33 lat (usec): min=1162, max=819945, avg=51147.92, stdev=57326.47 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1565], 10.00th=[ 2868], 20.00th=[ 7111], | 30.00th=[ 12518], 40.00th=[ 22938], 50.00th=[ 35390], 60.00th=[ 46924], | 70.00th=[ 64226], 80.00th=[ 86508], 90.00th=[119014], 95.00th=[158335], | 99.00th=[233833], 99.50th=[274727], 99.90th=[492831], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 107, per=25.33%, avg=38.76, stdev=18.54, samples=316 iops : min= 1, max= 26, avg= 9.04, stdev= 4.68, samples=316 lat (usec) : 50=0.26%, 100=2.64%, 250=0.42%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.00%, 4=2.64%, 10=7.39%, 20=8.27%, 50=31.61% lat (msec) : 100=30.37%, 250=11.85%, 500=0.39%, 1000=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.70%, ctx=6760, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144830: Tue Jun 9 05:02:19 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6028KiB/162206msec) clat (usec): min=39, max=572575, avg=53406.89, stdev=41751.75 lat (usec): min=40, max=572576, avg=53410.59, stdev=41750.58 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 13698], 20.00th=[ 25822], | 30.00th=[ 32375], 40.00th=[ 39060], 50.00th=[ 46924], 60.00th=[ 54264], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[187696], 99.50th=[221250], 99.90th=[566232], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 93, per=25.43%, avg=37.12, stdev=16.81, samples=315 iops : min= 1, max= 23, avg= 8.62, stdev= 4.24, samples=315 write: IOPS=9, BW=38.6KiB/s (39.5kB/s)(6260KiB/162206msec); 0 zone resets clat (usec): min=1106, max=1285.5k, avg=51867.27, stdev=62216.70 lat (usec): min=1108, max=1285.5k, avg=51869.39, stdev=62216.62 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1532], 10.00th=[ 2278], | 20.00th=[ 6849], 30.00th=[ 13042], 40.00th=[ 24511], | 50.00th=[ 38011], 60.00th=[ 52167], 70.00th=[ 66847], | 80.00th=[ 85459], 90.00th=[ 114820], 95.00th=[ 145753], | 99.00th=[ 229639], 99.50th=[ 283116], 99.90th=[ 767558], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 7, max= 103, per=25.16%, avg=38.50, stdev=17.88, samples=315 iops : min= 1, max= 25, avg= 8.97, stdev= 4.51, samples=315 lat (usec) : 50=0.36%, 100=3.22%, 250=0.33%, 500=0.13%, 1000=0.03% lat (msec) : 2=4.82%, 4=2.93%, 10=5.73%, 20=7.62%, 50=31.35% lat (msec) : 100=31.64%, 250=11.36%, 500=0.36%, 750=0.07%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.07%, sys=4.69%, ctx=6696, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144831: Tue Jun 9 05:02:19 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6052KiB/161404msec) clat (usec): min=33, max=335240, avg=52856.92, stdev=37528.04 lat (usec): min=33, max=335242, avg=52862.50, stdev=37528.29 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 11207], 20.00th=[ 26608], | 30.00th=[ 32637], 40.00th=[ 38536], 50.00th=[ 45876], 60.00th=[ 55313], | 70.00th=[ 64750], 80.00th=[ 78119], 90.00th=[ 99091], 95.00th=[117965], | 99.00th=[162530], 99.50th=[223347], 99.90th=[320865], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 87, per=25.95%, avg=37.89, stdev=16.99, samples=309 iops : min= 1, max= 21, avg= 8.81, stdev= 4.28, samples=309 write: IOPS=9, BW=38.6KiB/s (39.6kB/s)(6236KiB/161404msec); 0 zone resets clat (usec): min=1083, max=1325.3k, avg=51837.51, stdev=59834.63 lat (usec): min=1084, max=1325.3k, avg=51843.49, stdev=59833.40 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1516], 10.00th=[ 2606], | 20.00th=[ 6390], 30.00th=[ 12911], 40.00th=[ 25297], | 50.00th=[ 39060], 60.00th=[ 51643], 70.00th=[ 67634], | 80.00th=[ 85459], 90.00th=[ 121111], 95.00th=[ 152044], | 99.00th=[ 214959], 99.50th=[ 250610], 99.90th=[ 383779], | 99.95th=[1317012], 99.99th=[1317012] bw ( KiB/s): min= 7, max= 119, per=25.43%, avg=38.91, stdev=17.83, samples=310 iops : min= 1, max= 29, avg= 9.06, stdev= 4.49, samples=310 lat (usec) : 50=0.33%, 100=3.39%, 250=0.46%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.30%, 4=2.67%, 10=6.97%, 20=7.00%, 50=31.35% lat (msec) : 100=31.09%, 250=11.85%, 500=0.33%, 2000=0.03% cpu : usr=0.08%, sys=4.62%, ctx=6643, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (150kB/s), 36.3KiB/s-37.5KiB/s (37.2kB/s-38.4kB/s), io=23.4MiB (24.6MB), run=161404-163414msec WRITE: bw=154KiB/s (158kB/s), 38.6KiB/s-38.9KiB/s (39.5kB/s-39.9kB/s), io=24.6MiB (25.7MB), run=161404-163414msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144834: Tue Jun 9 05:05:02 2026 read: IOPS=4, BW=18.5KiB/s (18.0kB/s)(5992KiB/323575msec) clat (msec): min=6, max=1394, avg=43.96, stdev=56.38 lat (msec): min=6, max=1394, avg=43.97, stdev=56.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 96], 95.00th=[ 123], | 99.00th=[ 218], 99.50th=[ 279], 99.90th=[ 468], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7, max= 79, per=29.51%, avg=21.54, stdev=14.83, samples=533 iops : min= 1, max= 19, avg= 4.71, stdev= 3.73, samples=533 write: IOPS=4, BW=19.5KiB/s (19.9kB/s)(6296KiB/323575msec); 0 zone resets clat (msec): min=31, max=931, avg=163.62, stdev=87.44 lat (msec): min=31, max=931, avg=163.63, stdev=87.45 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 72], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 110], 40.00th=[ 124], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 188], 80.00th=[ 218], 90.00th=[ 279], 95.00th=[ 326], | 99.00th=[ 460], 99.50th=[ 575], 99.90th=[ 676], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 6, max= 48, per=25.22%, avg=19.42, stdev= 9.59, samples=618 iops : min= 1, max= 12, avg= 4.17, stdev= 2.44, samples=618 lat (msec) : 10=1.79%, 20=13.48%, 50=21.71%, 100=19.21%, 250=36.43% lat (msec) : 500=6.90%, 750=0.42%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.21%, ctx=5065, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144835: Tue Jun 9 05:05:02 2026 read: IOPS=4, BW=18.2KiB/s (18.7kB/s)(5940KiB/326034msec) clat (msec): min=5, max=623, avg=43.15, stdev=53.64 lat (msec): min=5, max=623, avg=43.16, stdev=53.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 90], 95.00th=[ 138], | 99.00th=[ 279], 99.50th=[ 388], 99.90th=[ 600], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 6, max= 102, per=30.49%, avg=22.26, stdev=15.84, samples=511 iops : min= 1, max= 25, avg= 4.89, stdev= 3.98, samples=511 write: IOPS=4, BW=19.5KiB/s (19.9kB/s)(6348KiB/326034msec); 0 zone resets clat (msec): min=31, max=918, avg=164.94, stdev=89.98 lat (msec): min=31, max=918, avg=164.95, stdev=89.98 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 78], 20.00th=[ 94], | 30.00th=[ 109], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 188], 80.00th=[ 228], 90.00th=[ 288], 95.00th=[ 342], | 99.00th=[ 451], 99.50th=[ 527], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 48, per=25.53%, avg=19.66, stdev= 9.77, samples=615 iops : min= 1, max= 12, avg= 4.23, stdev= 2.49, samples=615 lat (msec) : 10=1.92%, 20=14.45%, 50=21.45%, 100=18.55%, 250=35.81% lat (msec) : 500=7.42%, 750=0.33%, 1000=0.07% cpu : usr=0.05%, sys=1.22%, ctx=5286, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144836: Tue Jun 9 05:05:02 2026 read: IOPS=4, BW=18.8KiB/s (19.2kB/s)(6028KiB/321424msec) clat (msec): min=6, max=533, avg=43.49, stdev=46.28 lat (msec): min=6, max=533, avg=43.50, stdev=46.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 96], 95.00th=[ 127], | 99.00th=[ 241], 99.50th=[ 288], 99.90th=[ 527], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 7, max= 87, per=29.48%, avg=21.52, stdev=15.39, samples=536 iops : min= 1, max= 21, avg= 4.71, stdev= 3.88, samples=536 write: IOPS=4, BW=19.5KiB/s (19.9kB/s)(6260KiB/321424msec); 0 zone resets clat (msec): min=36, max=931, avg=163.41, stdev=88.47 lat (msec): min=36, max=931, avg=163.42, stdev=88.47 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 123], 50.00th=[ 144], 60.00th=[ 161], | 70.00th=[ 186], 80.00th=[ 224], 90.00th=[ 279], 95.00th=[ 317], | 99.00th=[ 451], 99.50th=[ 550], 99.90th=[ 785], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 5, max= 55, per=25.13%, avg=19.35, stdev= 9.95, samples=616 iops : min= 1, max= 13, avg= 4.18, stdev= 2.53, samples=616 lat (msec) : 10=1.37%, 20=13.67%, 50=21.97%, 100=19.82%, 250=35.58% lat (msec) : 500=7.16%, 750=0.36%, 1000=0.07% cpu : usr=0.05%, sys=1.20%, ctx=5122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Tue Jun 9 05:05:02 2026 read: IOPS=4, BW=18.8KiB/s (19.2kB/s)(6052KiB/322019msec) clat (msec): min=5, max=544, avg=41.69, stdev=43.67 lat (msec): min=5, max=544, avg=41.69, stdev=43.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 93], 95.00th=[ 127], | 99.00th=[ 201], 99.50th=[ 245], 99.90th=[ 502], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 87, per=30.78%, avg=22.47, stdev=15.66, samples=518 iops : min= 1, max= 21, avg= 4.96, stdev= 3.95, samples=518 write: IOPS=4, BW=19.4KiB/s (19.8kB/s)(6236KiB/322019msec); 0 zone resets clat (msec): min=37, max=814, avg=166.00, stdev=88.85 lat (msec): min=37, max=814, avg=166.01, stdev=88.85 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 127], 50.00th=[ 144], 60.00th=[ 165], | 70.00th=[ 190], 80.00th=[ 224], 90.00th=[ 279], 95.00th=[ 338], | 99.00th=[ 481], 99.50th=[ 550], 99.90th=[ 709], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 5, max= 48, per=24.98%, avg=19.23, stdev= 9.74, samples=619 iops : min= 1, max= 12, avg= 4.15, stdev= 2.48, samples=619 lat (msec) : 10=1.86%, 20=13.93%, 50=22.40%, 100=18.29%, 250=36.04% lat (msec) : 500=7.03%, 750=0.42%, 1000=0.03% cpu : usr=0.04%, sys=1.22%, ctx=5116, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=73.6KiB/s (75.4kB/s), 18.2KiB/s-18.8KiB/s (18.7kB/s-19.2kB/s), io=23.4MiB (24.6MB), run=321424-326034msec WRITE: bw=77.1KiB/s (78.0kB/s), 19.4KiB/s-19.5KiB/s (19.8kB/s-19.9kB/s), io=24.6MiB (25.7MB), run=321424-326034msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144913: Tue Jun 9 05:05:46 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(5920KiB/33663msec) clat (usec): min=37, max=326694, avg=49390.90, stdev=40636.60 lat (usec): min=38, max=326695, avg=49392.33, stdev=40636.66 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 61], 10.00th=[ 74], 20.00th=[ 3851], | 30.00th=[ 29492], 40.00th=[ 37487], 50.00th=[ 44827], 60.00th=[ 54264], | 70.00th=[ 65799], 80.00th=[ 77071], 90.00th=[ 91751], 95.00th=[109577], | 99.00th=[183501], 99.50th=[244319], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 351, per=25.37%, avg=175.53, stdev=69.96, samples=66 iops : min= 1, max= 21, avg=10.18, stdev= 4.42, samples=66 write: IOPS=11, BW=189KiB/s (194kB/s)(6368KiB/33663msec); 0 zone resets clat (usec): min=1600, max=448258, avg=37887.66, stdev=43322.94 lat (usec): min=1602, max=448259, avg=37930.23, stdev=43349.54 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2147], 10.00th=[ 4015], 20.00th=[ 7767], | 30.00th=[ 12125], 40.00th=[ 16581], 50.00th=[ 22152], 60.00th=[ 32900], | 70.00th=[ 42206], 80.00th=[ 65274], 90.00th=[ 88605], 95.00th=[116917], | 99.00th=[187696], 99.50th=[217056], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 30, max= 382, per=26.42%, avg=192.31, stdev=78.87, samples=65 iops : min= 1, max= 23, avg=11.25, stdev= 4.98, samples=65 lat (usec) : 50=0.91%, 100=6.38%, 250=1.17%, 500=0.26% lat (msec) : 2=2.21%, 4=3.78%, 10=9.51%, 20=10.16%, 50=30.34% lat (msec) : 100=27.86%, 250=7.16%, 500=0.26% cpu : usr=0.07%, sys=5.80%, ctx=1548, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144914: Tue Jun 9 05:05:46 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/33908msec) clat (usec): min=38, max=307646, avg=48998.58, stdev=42347.97 lat (usec): min=38, max=307646, avg=49000.03, stdev=42347.90 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 137], | 30.00th=[ 26870], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 54264], | 70.00th=[ 63177], 80.00th=[ 78119], 90.00th=[ 98042], 95.00th=[123208], | 99.00th=[189793], 99.50th=[250610], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 30, max= 411, per=24.26%, avg=167.91, stdev=66.69, samples=66 iops : min= 1, max= 25, avg= 9.70, stdev= 4.23, samples=66 write: IOPS=12, BW=193KiB/s (198kB/s)(6544KiB/33908msec); 0 zone resets clat (usec): min=1606, max=191956, avg=39636.59, stdev=40500.90 lat (usec): min=1607, max=191959, avg=39649.43, stdev=40496.59 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2180], 10.00th=[ 3949], 20.00th=[ 6980], | 30.00th=[ 10814], 40.00th=[ 17171], 50.00th=[ 23987], 60.00th=[ 36439], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[100140], 95.00th=[125305], | 99.00th=[181404], 99.50th=[187696], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 62, max= 415, per=25.99%, avg=189.20, stdev=81.87, samples=66 iops : min= 3, max= 25, avg=11.05, stdev= 5.18, samples=66 lat (usec) : 50=0.78%, 100=7.81%, 250=1.04%, 500=0.13%, 750=0.13% lat (msec) : 2=1.69%, 4=4.17%, 10=9.51%, 20=10.16%, 50=27.86% lat (msec) : 100=27.34%, 250=9.11%, 500=0.26% cpu : usr=0.09%, sys=5.90%, ctx=1551, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144915: Tue Jun 9 05:05:46 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34600msec) clat (usec): min=36, max=328767, avg=47516.27, stdev=43439.08 lat (usec): min=36, max=328769, avg=47517.71, stdev=43439.08 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 167], | 30.00th=[ 27132], 40.00th=[ 34866], 50.00th=[ 43254], 60.00th=[ 52167], | 70.00th=[ 60031], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[114820], | 99.00th=[208667], 99.50th=[316670], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 351, per=26.19%, avg=181.25, stdev=83.00, samples=68 iops : min= 1, max= 21, avg=10.53, stdev= 5.23, samples=68 write: IOPS=10, BW=174KiB/s (179kB/s)(6032KiB/34600msec); 0 zone resets clat (usec): min=1551, max=354902, avg=42000.33, stdev=43646.00 lat (usec): min=1553, max=354903, avg=42026.91, stdev=43641.20 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2040], 10.00th=[ 3589], 20.00th=[ 6652], | 30.00th=[ 9765], 40.00th=[ 15139], 50.00th=[ 29492], 60.00th=[ 41681], | 70.00th=[ 55313], 80.00th=[ 71828], 90.00th=[101188], 95.00th=[121111], | 99.00th=[187696], 99.50th=[214959], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 447, per=23.81%, avg=173.37, stdev=91.32, samples=68 iops : min= 1, max= 27, avg=10.03, stdev= 5.76, samples=68 lat (usec) : 50=0.65%, 100=9.11%, 250=0.78%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.34%, 4=3.26%, 10=9.90%, 20=7.81%, 50=27.47% lat (msec) : 100=29.43%, 250=8.33%, 500=0.52% cpu : usr=0.10%, sys=5.43%, ctx=1579, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144916: Tue Jun 9 05:05:46 2026 read: IOPS=11, BW=184KiB/s (189kB/s)(6032KiB/32748msec) clat (usec): min=30, max=317631, avg=44895.68, stdev=39950.75 lat (usec): min=30, max=317633, avg=44898.33, stdev=39949.46 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 88], | 30.00th=[ 22676], 40.00th=[ 34341], 50.00th=[ 42730], 60.00th=[ 51119], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[166724], 99.50th=[196084], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 349, per=26.40%, avg=182.66, stdev=73.68, samples=64 iops : min= 1, max= 21, avg=10.62, stdev= 4.65, samples=64 write: IOPS=11, BW=191KiB/s (196kB/s)(6256KiB/32748msec); 0 zone resets clat (usec): min=1522, max=291965, avg=39850.23, stdev=43558.78 lat (usec): min=1523, max=291967, avg=39853.19, stdev=43559.03 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2147], 10.00th=[ 3654], 20.00th=[ 6980], | 30.00th=[ 9372], 40.00th=[ 15008], 50.00th=[ 23987], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[233833], 99.50th=[242222], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 62, max= 383, per=26.18%, avg=190.56, stdev=70.23, samples=64 iops : min= 3, max= 23, avg=11.13, stdev= 4.43, samples=64 lat (usec) : 50=1.04%, 100=9.51%, 250=1.56%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.69%, 4=4.30%, 10=10.68%, 20=8.33%, 50=27.21% lat (msec) : 100=26.69%, 250=8.20%, 500=0.26% cpu : usr=0.11%, sys=6.10%, ctx=1498, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=692KiB/s (709kB/s), 169KiB/s-184KiB/s (173kB/s-189kB/s), io=23.4MiB (24.5MB), run=32748-34600msec WRITE: bw=728KiB/s (746kB/s), 174KiB/s-193KiB/s (179kB/s-198kB/s), io=24.6MiB (25.8MB), run=32748-34600msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Tue Jun 9 05:06:30 2026 read: IOPS=4, BW=75.0KiB/s (77.8kB/s)(5920KiB/77916msec) clat (msec): min=7, max=310, avg=47.27, stdev=46.59 lat (msec): min=7, max=310, avg=47.27, stdev=46.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 106], 95.00th=[ 153], | 99.00th=[ 251], 99.50th=[ 268], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 255, per=28.95%, avg=88.88, stdev=54.06, samples=130 iops : min= 1, max= 15, avg= 4.72, stdev= 3.38, samples=130 write: IOPS=5, BW=81.7KiB/s (83.7kB/s)(6368KiB/77916msec); 0 zone resets clat (msec): min=44, max=544, avg=151.54, stdev=69.23 lat (msec): min=44, max=544, avg=151.55, stdev=69.24 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 68], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 108], 40.00th=[ 123], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 194], 90.00th=[ 245], 95.00th=[ 296], | 99.00th=[ 363], 99.50th=[ 401], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 159, per=26.05%, avg=84.13, stdev=35.04, samples=148 iops : min= 1, max= 9, avg= 4.43, stdev= 2.21, samples=148 lat (msec) : 10=1.30%, 20=10.81%, 50=23.31%, 100=19.66%, 250=39.71% lat (msec) : 500=5.08%, 750=0.13% cpu : usr=0.04%, sys=1.49%, ctx=1373, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Tue Jun 9 05:06:30 2026 read: IOPS=4, BW=73.9KiB/s (75.7kB/s)(5744KiB/77692msec) clat (msec): min=8, max=330, avg=45.38, stdev=45.72 lat (msec): min=8, max=330, avg=45.38, stdev=45.72 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 95], 95.00th=[ 134], | 99.00th=[ 288], 99.50th=[ 292], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 26, max= 351, per=29.68%, avg=91.12, stdev=57.44, samples=124 iops : min= 1, max= 21, avg= 4.88, stdev= 3.60, samples=124 write: IOPS=5, BW=84.2KiB/s (86.3kB/s)(6544KiB/77692msec); 0 zone resets clat (msec): min=37, max=693, avg=149.68, stdev=77.19 lat (msec): min=37, max=693, avg=149.69, stdev=77.19 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 197], 90.00th=[ 247], 95.00th=[ 305], | 99.00th=[ 393], 99.50th=[ 435], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 26, max= 191, per=27.02%, avg=87.27, stdev=39.16, samples=147 iops : min= 1, max= 11, avg= 4.63, stdev= 2.47, samples=147 lat (msec) : 10=0.65%, 20=10.68%, 50=24.61%, 100=21.48%, 250=36.98% lat (msec) : 500=5.47%, 750=0.13% cpu : usr=0.04%, sys=1.44%, ctx=1403, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Tue Jun 9 05:06:30 2026 read: IOPS=5, BW=82.9KiB/s (84.9kB/s)(6256KiB/75421msec) clat (msec): min=7, max=313, avg=43.25, stdev=43.38 lat (msec): min=7, max=313, avg=43.25, stdev=43.38 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 96], 95.00th=[ 133], | 99.00th=[ 218], 99.50th=[ 296], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 27, max= 319, per=31.41%, avg=96.44, stdev=62.34, samples=128 iops : min= 1, max= 19, avg= 5.21, stdev= 3.90, samples=128 write: IOPS=4, BW=79.0KiB/s (81.9kB/s)(6032KiB/75421msec); 0 zone resets clat (msec): min=41, max=588, avg=154.72, stdev=84.04 lat (msec): min=41, max=588, avg=154.73, stdev=84.04 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 105], 40.00th=[ 115], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 197], 90.00th=[ 268], 95.00th=[ 334], | 99.00th=[ 443], 99.50th=[ 535], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 25, max= 160, per=25.61%, avg=82.70, stdev=37.64, samples=142 iops : min= 1, max= 10, avg= 4.35, stdev= 2.40, samples=142 lat (msec) : 10=0.52%, 20=13.28%, 50=25.91%, 100=19.66%, 250=33.85% lat (msec) : 500=6.51%, 750=0.26% cpu : usr=0.04%, sys=1.47%, ctx=1418, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144921: Tue Jun 9 05:06:30 2026 read: IOPS=4, BW=79.4KiB/s (81.4kB/s)(6032KiB/75926msec) clat (msec): min=6, max=308, avg=41.52, stdev=39.40 lat (msec): min=6, max=308, avg=41.52, stdev=39.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 85], 95.00th=[ 125], | 99.00th=[ 201], 99.50th=[ 275], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 287, per=30.63%, avg=94.04, stdev=62.85, samples=126 iops : min= 1, max= 17, avg= 5.06, stdev= 3.95, samples=126 write: IOPS=5, BW=82.4KiB/s (84.4kB/s)(6256KiB/75926msec); 0 zone resets clat (msec): min=38, max=637, avg=153.93, stdev=81.56 lat (msec): min=38, max=637, avg=153.94, stdev=81.55 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 72], 10.00th=[ 81], 20.00th=[ 93], | 30.00th=[ 105], 40.00th=[ 121], 50.00th=[ 133], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 205], 90.00th=[ 262], 95.00th=[ 305], | 99.00th=[ 447], 99.50th=[ 558], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 27, max= 159, per=25.77%, avg=83.25, stdev=38.57, samples=148 iops : min= 1, max= 9, avg= 4.38, stdev= 2.41, samples=148 lat (msec) : 10=1.17%, 20=13.93%, 50=22.53%, 100=21.61%, 250=34.38% lat (msec) : 500=6.12%, 750=0.26% cpu : usr=0.04%, sys=1.43%, ctx=1333, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=307KiB/s (315kB/s), 73.9KiB/s-82.9KiB/s (75.7kB/s-84.9kB/s), io=23.4MiB (24.5MB), run=75421-77916msec WRITE: bw=323KiB/s (331kB/s), 79.0KiB/s-84.2KiB/s (81.9kB/s-86.3kB/s), io=24.6MiB (25.8MB), run=75421-77916msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144940: Tue Jun 9 05:06:51 2026 read: IOPS=1, BW=1701KiB/s (1741kB/s)(7168KiB/4215msec) clat (msec): min=160, max=745, avg=298.14, stdev=200.34 lat (msec): min=160, max=745, avg=298.14, stdev=200.34 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 205], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 239], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 271], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1818, max= 4087, per=51.68%, avg=2363.20, stdev=967.23, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1215KiB/s (1244kB/s)(5120KiB/4215msec); 0 zone resets clat (msec): min=110, max=1074, avg=396.81, stdev=385.04 lat (msec): min=110, max=1074, avg=396.98, stdev=385.02 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1906, max= 3856, per=38.48%, avg=2463.25, stdev=930.83, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=11.75%, ctx=254, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Tue Jun 9 05:06:51 2026 read: IOPS=0, BW=457KiB/s (468kB/s)(2048KiB/4478msec) clat (msec): min=217, max=328, avg=272.90, stdev=78.08 lat (msec): min=217, max=328, avg=272.90, stdev=78.08 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1378, max= 2011, per=37.05%, avg=1694.50, stdev=447.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2287KiB/s (2342kB/s)(10.0MiB/4478msec); 0 zone resets clat (msec): min=158, max=844, avg=378.80, stdev=216.45 lat (msec): min=158, max=844, avg=378.91, stdev=216.43 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 218], | 30.00th=[ 251], 40.00th=[ 262], 50.00th=[ 288], 60.00th=[ 321], | 70.00th=[ 372], 80.00th=[ 409], 90.00th=[ 676], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2011, max= 4087, per=54.56%, avg=3493.20, stdev=864.17, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=12.91%, ctx=163, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144942: Tue Jun 9 05:06:51 2026 read: IOPS=1, BW=1514KiB/s (1551kB/s)(6144KiB/4057msec) clat (msec): min=12, max=619, avg=241.62, stdev=226.95 lat (msec): min=12, max=619, avg=241.63, stdev=226.95 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 13], 10.00th=[ 13], 20.00th=[ 34], | 30.00th=[ 34], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 230], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 3813, max= 4000, per=85.43%, avg=3906.50, stdev=132.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1514KiB/s (1551kB/s)(6144KiB/4057msec); 0 zone resets clat (msec): min=157, max=961, avg=428.92, stdev=292.96 lat (msec): min=157, max=961, avg=429.02, stdev=292.96 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 456], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1906, max= 2043, per=30.93%, avg=1980.00, stdev=63.48, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 20=8.33%, 50=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=10.55%, ctx=131, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144943: Tue Jun 9 05:06:51 2026 read: IOPS=1, BW=1174KiB/s (1202kB/s)(5120KiB/4360msec) clat (usec): min=432, max=657660, avg=277139.12, stdev=286694.02 lat (usec): min=434, max=657662, avg=277140.31, stdev=286693.80 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 433], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[274727], 60.00th=[274727], | 70.00th=[450888], 80.00th=[450888], 90.00th=[658506], 95.00th=[658506], | 99.00th=[658506], 99.50th=[658506], 99.90th=[658506], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 1954, max= 4023, per=58.46%, avg=2673.33, stdev=1169.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1644KiB/s (1683kB/s)(7168KiB/4360msec); 0 zone resets clat (msec): min=174, max=712, avg=409.98, stdev=215.27 lat (msec): min=174, max=712, avg=410.11, stdev=215.28 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 207], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 372], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 684], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1367, max= 2043, per=28.61%, avg=1831.60, stdev=289.91, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=25.00% cpu : usr=0.05%, sys=9.80%, ctx=153, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4573KiB/s (4683kB/s), 457KiB/s-1701KiB/s (468kB/s-1741kB/s), io=20.0MiB (20.0MB), run=4057-4478msec WRITE: bw=6403KiB/s (6557kB/s), 1215KiB/s-2287KiB/s (1244kB/s-2342kB/s), io=28.0MiB (29.4MB), run=4057-4478msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144946: Tue Jun 9 05:06:53 2026 read: IOPS=1, BW=1579KiB/s (1616kB/s)(7168KiB/4541msec) clat (msec): min=121, max=679, avg=321.74, stdev=245.01 lat (msec): min=121, max=679, avg=321.74, stdev=245.01 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 131], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 171], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 651], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1831, max= 3555, per=56.89%, avg=2263.60, stdev=727.11, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1128KiB/s (1155kB/s)(5120KiB/4541msec); 0 zone resets clat (msec): min=237, max=632, avg=413.09, stdev=176.39 lat (msec): min=237, max=632, avg=413.51, stdev=176.67 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1935, max= 4055, per=48.04%, avg=2676.33, stdev=1195.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=4.10%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144947: Tue Jun 9 05:06:53 2026 read: IOPS=0, BW=417KiB/s (427kB/s)(2048KiB/4910msec) clat (msec): min=172, max=913, avg=543.24, stdev=524.16 lat (msec): min=172, max=913, avg=543.25, stdev=524.16 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1980, max= 2027, per=50.35%, avg=2003.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2086KiB/s (2136kB/s)(10.0MiB/4910msec); 0 zone resets clat (msec): min=181, max=745, avg=331.82, stdev=165.83 lat (msec): min=181, max=745, avg=331.94, stdev=165.82 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 197], | 30.00th=[ 228], 40.00th=[ 247], 50.00th=[ 262], 60.00th=[ 313], | 70.00th=[ 355], 80.00th=[ 368], 90.00th=[ 430], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1831, max= 4079, per=52.28%, avg=2912.33, stdev=1092.69, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.34%, ctx=74, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144948: Tue Jun 9 05:06:53 2026 read: IOPS=1, BW=1194KiB/s (1223kB/s)(6144KiB/5146msec) clat (msec): min=69, max=716, avg=219.76, stdev=259.00 lat (msec): min=69, max=716, avg=219.76, stdev=259.00 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 79], 50.00th=[ 79], 60.00th=[ 85], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2027, max= 4096, per=85.20%, avg=3390.00, stdev=1180.65, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1194KiB/s (1223kB/s)(6144KiB/5146msec); 0 zone resets clat (msec): min=171, max=1393, avg=604.20, stdev=463.22 lat (msec): min=171, max=1395, avg=605.14, stdev=463.46 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 443], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1851, max= 2048, per=35.15%, avg=1958.40, stdev=98.67, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=33.33%, 250=8.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.73%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144949: Tue Jun 9 05:06:53 2026 read: IOPS=1, BW=1039KiB/s (1064kB/s)(5120KiB/4926msec) clat (msec): min=109, max=284, avg=210.92, stdev=77.15 lat (msec): min=109, max=284, avg=210.93, stdev=77.15 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1851, max= 4055, per=66.42%, avg=2643.00, stdev=1225.85, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1455KiB/s (1490kB/s)(7168KiB/4926msec); 0 zone resets clat (msec): min=204, max=1465, avg=537.90, stdev=434.62 lat (msec): min=204, max=1465, avg=538.00, stdev=434.61 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 251], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 409], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 659], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1828, max= 4096, per=40.89%, avg=2278.00, stdev=894.92, samples=6 iops : min= 1, max= 4, avg= 1.50, stdev= 1.22, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.04%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3980KiB/s (4075kB/s), 417KiB/s-1579KiB/s (427kB/s-1616kB/s), io=20.0MiB (20.0MB), run=4541-5146msec WRITE: bw=5572KiB/s (5705kB/s), 1128KiB/s-2086KiB/s (1155kB/s-2136kB/s), io=28.0MiB (29.4MB), run=4541-5146msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144955: Tue Jun 9 05:07:04 2026 read: IOPS=1, BW=4378KiB/s (4483kB/s)(12.0MiB/2807msec) clat (msec): min=700, max=1032, avg=919.43, stdev=189.61 lat (msec): min=700, max=1032, avg=919.44, stdev=189.61 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7953, max= 8110, per=100.00%, avg=8031.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.08%, ctx=177, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Tue Jun 9 05:07:04 2026 read: IOPS=0, BW=1159KiB/s (1187kB/s)(4096KiB/3533msec) clat (nsec): min=705212k, max=705212k, avg=705211779.00, stdev= 0.00 lat (nsec): min=705214k, max=705214k, avg=705213844.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2319KiB/s (2374kB/s)(8192KiB/3533msec); 0 zone resets clat (msec): min=755, max=1992, avg=1373.94, stdev=874.88 lat (msec): min=755, max=1993, avg=1374.44, stdev=875.13 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 1989], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8175, max= 8175, per=88.15%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.06%, sys=6.94%, ctx=185, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144957: Tue Jun 9 05:07:04 2026 write: IOPS=0, BW=3512KiB/s (3596kB/s)(12.0MiB/3499msec); 0 zone resets clat (msec): min=479, max=1815, avg=1138.86, stdev=668.19 lat (msec): min=479, max=1817, avg=1139.93, stdev=669.21 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8159, max= 8175, per=88.06%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.37%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144958: Tue Jun 9 05:07:04 2026 write: IOPS=1, BW=4635KiB/s (4746kB/s)(12.0MiB/2651msec); 0 zone resets clat (msec): min=397, max=1410, avg=871.29, stdev=509.53 lat (msec): min=398, max=1411, avg=872.41, stdev=509.53 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7953, max= 8143, per=86.78%, avg=8048.00, stdev=134.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=6.60%, ctx=132, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4637KiB/s (4749kB/s), 1159KiB/s-4378KiB/s (1187kB/s-4483kB/s), io=16.0MiB (16.8MB), run=2807-3533msec WRITE: bw=9275KiB/s (9497kB/s), 2319KiB/s-4635KiB/s (2374kB/s-4746kB/s), io=32.0MiB (33.6MB), run=2651-3533msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144960: Tue Jun 9 05:07:06 2026 read: IOPS=1, BW=4672KiB/s (4784kB/s)(12.0MiB/2630msec) clat (msec): min=227, max=2091, avg=872.80, stdev=1056.12 lat (msec): min=227, max=2091, avg=872.80, stdev=1056.12 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 6224, max= 6224, per=100.00%, avg=6224.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.54%, ctx=44, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144961: Tue Jun 9 05:07:06 2026 read: IOPS=0, BW=1078KiB/s (1103kB/s)(4096KiB/3801msec) clat (nsec): min=410744k, max=410744k, avg=410744359.00, stdev= 0.00 lat (nsec): min=410747k, max=410747k, avg=410747032.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 5936, max= 5936, per=100.00%, avg=5936.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2155KiB/s (2207kB/s)(8192KiB/3801msec); 0 zone resets clat (msec): min=1232, max=2098, avg=1665.14, stdev=612.34 lat (msec): min=1232, max=2099, avg=1665.89, stdev=612.71 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 2106], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 7922, max= 7922, per=91.90%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.03%, ctx=47, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144962: Tue Jun 9 05:07:06 2026 write: IOPS=0, BW=3378KiB/s (3459kB/s)(12.0MiB/3638msec); 0 zone resets clat (msec): min=484, max=2342, avg=1211.61, stdev=992.93 lat (msec): min=485, max=2343, avg=1212.10, stdev=992.82 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8094, max= 8159, per=94.27%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.02%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144963: Tue Jun 9 05:07:06 2026 write: IOPS=0, BW=3709KiB/s (3798kB/s)(12.0MiB/3313msec); 0 zone resets clat (msec): min=421, max=2374, avg=1084.57, stdev=1117.62 lat (msec): min=421, max=2377, avg=1085.57, stdev=1118.58 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 5944, max= 8143, per=81.71%, avg=7043.50, stdev=1554.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.77%, ctx=45, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4310KiB/s (4414kB/s), 1078KiB/s-4672KiB/s (1103kB/s-4784kB/s), io=16.0MiB (16.8MB), run=2630-3801msec WRITE: bw=8621KiB/s (8828kB/s), 2155KiB/s-3709KiB/s (2207kB/s-3798kB/s), io=32.0MiB (33.6MB), run=3313-3801msec