== sanity test 398b: DIO and buffer IO race ============== 18:01:49 (1781215309) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.99715 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144279: Thu Jun 11 18:04:44 2026 read: IOPS=9, BW=39.7KiB/s (40.7kB/s)(5992KiB/150822msec) clat (usec): min=37, max=420846, avg=50891.19, stdev=37608.91 lat (usec): min=38, max=420847, avg=50893.94, stdev=37609.84 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 69], 10.00th=[ 13698], 20.00th=[ 23725], | 30.00th=[ 30540], 40.00th=[ 36963], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[183501], 99.50th=[206570], 99.90th=[252707], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 7, max= 102, per=25.20%, avg=39.56, stdev=17.54, samples=293 iops : min= 1, max= 25, avg= 9.23, stdev= 4.43, samples=293 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6296KiB/150822msec); 0 zone resets clat (usec): min=1164, max=1213.0k, avg=47075.46, stdev=54620.83 lat (usec): min=1165, max=1213.0k, avg=47080.34, stdev=54618.82 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1549], 10.00th=[ 2212], | 20.00th=[ 5604], 30.00th=[ 11731], 40.00th=[ 22414], | 50.00th=[ 32900], 60.00th=[ 47449], 70.00th=[ 62129], | 80.00th=[ 81265], 90.00th=[ 107480], 95.00th=[ 137364], | 99.00th=[ 200279], 99.50th=[ 225444], 99.90th=[ 333448], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 110, per=25.14%, avg=41.48, stdev=20.17, samples=294 iops : min= 1, max= 27, avg= 9.70, stdev= 5.08, samples=294 lat (usec) : 50=0.10%, 100=3.71%, 250=0.20%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.85%, 4=3.12%, 10=6.28%, 20=8.46%, 50=32.81% lat (msec) : 100=29.85%, 250=10.19%, 500=0.16%, 2000=0.03% cpu : usr=0.08%, sys=4.60%, ctx=6714, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144280: Thu Jun 11 18:04:44 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(5940KiB/150671msec) clat (usec): min=38, max=1246.2k, avg=51556.27, stdev=48444.92 lat (usec): min=39, max=1246.2k, avg=51560.41, stdev=48445.63 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 76], 10.00th=[ 15795], | 20.00th=[ 24511], 30.00th=[ 31065], 40.00th=[ 36439], | 50.00th=[ 43254], 60.00th=[ 51119], 70.00th=[ 61604], | 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[ 116917], | 99.00th=[ 189793], 99.50th=[ 225444], 99.90th=[ 375391], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 95, per=24.96%, avg=39.18, stdev=17.17, samples=294 iops : min= 1, max= 23, avg= 9.13, stdev= 4.31, samples=294 write: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6348KiB/150671msec); 0 zone resets clat (usec): min=1073, max=302996, avg=46348.71, stdev=44249.80 lat (usec): min=1074, max=302997, avg=46350.83, stdev=44250.46 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1549], 10.00th=[ 1991], 20.00th=[ 5800], | 30.00th=[ 11338], 40.00th=[ 23725], 50.00th=[ 36439], 60.00th=[ 48497], | 70.00th=[ 61080], 80.00th=[ 80217], 90.00th=[108528], 95.00th=[131597], | 99.00th=[179307], 99.50th=[225444], 99.90th=[287310], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 110, per=25.37%, avg=41.86, stdev=19.89, samples=293 iops : min= 1, max= 27, avg= 9.81, stdev= 5.02, samples=293 lat (usec) : 50=0.13%, 100=2.90%, 250=0.36%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.27%, 4=2.93%, 10=6.77%, 20=7.49%, 50=33.46% lat (msec) : 100=29.88%, 250=10.25%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=4.75%, ctx=6716, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144281: Thu Jun 11 18:04:44 2026 read: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6028KiB/152055msec) clat (usec): min=39, max=401663, avg=49515.60, stdev=35024.87 lat (usec): min=39, max=401665, avg=49521.46, stdev=35029.40 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 13566], 20.00th=[ 23987], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 60031], 80.00th=[ 74974], 90.00th=[ 92799], 95.00th=[108528], | 99.00th=[152044], 99.50th=[181404], 99.90th=[304088], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 102, per=25.40%, avg=39.87, stdev=17.81, samples=293 iops : min= 1, max= 25, avg= 9.30, stdev= 4.49, samples=293 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6260KiB/152055msec); 0 zone resets clat (usec): min=1118, max=1249.7k, avg=49135.61, stdev=57766.96 lat (usec): min=1120, max=1249.7k, avg=49138.60, stdev=57766.70 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1532], 10.00th=[ 2606], | 20.00th=[ 6652], 30.00th=[ 13304], 40.00th=[ 24249], | 50.00th=[ 36439], 60.00th=[ 47973], 70.00th=[ 63701], | 80.00th=[ 82314], 90.00th=[ 111674], 95.00th=[ 137364], | 99.00th=[ 240124], 99.50th=[ 287310], 99.90th=[ 367002], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 110, per=24.76%, avg=40.86, stdev=18.32, samples=297 iops : min= 1, max= 27, avg= 9.55, stdev= 4.60, samples=297 lat (usec) : 50=0.20%, 100=3.42%, 250=0.46%, 750=0.03% lat (msec) : 2=4.36%, 4=3.06%, 10=5.89%, 20=8.72%, 50=34.21% lat (msec) : 100=29.56%, 250=9.57%, 500=0.49%, 2000=0.03% cpu : usr=0.08%, sys=4.62%, ctx=6720, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144282: Thu Jun 11 18:04:44 2026 read: IOPS=10, BW=40.2KiB/s (41.1kB/s)(6052KiB/150639msec) clat (usec): min=34, max=247219, avg=49314.91, stdev=34279.95 lat (usec): min=34, max=247220, avg=49318.30, stdev=34280.45 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 14353], 20.00th=[ 24249], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[170918], 99.50th=[202376], 99.90th=[210764], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 109, per=25.81%, avg=40.52, stdev=18.04, samples=290 iops : min= 1, max= 27, avg= 9.46, stdev= 4.53, samples=290 write: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6236KiB/150639msec); 0 zone resets clat (usec): min=944, max=1268.4k, avg=48396.18, stdev=56392.20 lat (usec): min=946, max=1268.4k, avg=48399.29, stdev=56393.43 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1549], 10.00th=[ 2376], | 20.00th=[ 6521], 30.00th=[ 12518], 40.00th=[ 24249], | 50.00th=[ 35914], 60.00th=[ 49021], 70.00th=[ 63701], | 80.00th=[ 81265], 90.00th=[ 110625], 95.00th=[ 131597], | 99.00th=[ 206570], 99.50th=[ 242222], 99.90th=[ 400557], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 7, max= 103, per=25.00%, avg=41.24, stdev=18.19, samples=293 iops : min= 1, max= 25, avg= 9.65, stdev= 4.58, samples=293 lat (usec) : 50=0.39%, 100=3.32%, 250=0.29%, 500=0.07%, 1000=0.07% lat (msec) : 2=4.39%, 4=3.12%, 10=6.25%, 20=7.94%, 50=33.89% lat (msec) : 100=29.88%, 250=10.16%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=4.59%, ctx=6641, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (162kB/s), 39.4KiB/s-40.2KiB/s (40.4kB/s-41.1kB/s), io=23.4MiB (24.6MB), run=150639-152055msec WRITE: bw=165KiB/s (169kB/s), 41.2KiB/s-42.1KiB/s (42.2kB/s-43.1kB/s), io=24.6MiB (25.7MB), run=150639-152055msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144284: Thu Jun 11 18:07:01 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(5992KiB/286791msec) clat (msec): min=6, max=1307, avg=42.72, stdev=57.36 lat (msec): min=6, max=1307, avg=42.73, stdev=57.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 94], 95.00th=[ 136], | 99.00th=[ 239], 99.50th=[ 300], 99.90th=[ 456], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 80, per=28.39%, avg=23.56, stdev=15.63, samples=489 iops : min= 1, max= 20, avg= 5.21, stdev= 3.95, samples=489 write: IOPS=5, BW=21.0KiB/s (22.5kB/s)(6296KiB/286791msec); 0 zone resets clat (msec): min=41, max=853, avg=141.42, stdev=72.28 lat (msec): min=41, max=853, avg=141.43, stdev=72.28 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 186], 90.00th=[ 230], 95.00th=[ 279], | 99.00th=[ 418], 99.50th=[ 456], 99.90th=[ 575], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 6, max= 55, per=25.24%, avg=21.96, stdev=10.44, samples=550 iops : min= 1, max= 13, avg= 4.81, stdev= 2.65, samples=550 lat (msec) : 10=1.99%, 20=15.49%, 50=20.70%, 100=22.04%, 250=35.55% lat (msec) : 500=4.07%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5045, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144285: Thu Jun 11 18:07:01 2026 read: IOPS=5, BW=20.6KiB/s (21.1kB/s)(5940KiB/287829msec) clat (msec): min=6, max=1361, avg=40.91, stdev=55.41 lat (msec): min=6, max=1361, avg=40.92, stdev=55.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 57], 90.00th=[ 90], 95.00th=[ 124], | 99.00th=[ 211], 99.50th=[ 262], 99.90th=[ 447], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 6, max= 87, per=28.42%, avg=23.59, stdev=16.20, samples=484 iops : min= 1, max= 21, avg= 5.21, stdev= 4.08, samples=484 write: IOPS=5, BW=22.1KiB/s (22.6kB/s)(6348KiB/287829msec); 0 zone resets clat (msec): min=37, max=702, avg=142.94, stdev=71.56 lat (msec): min=37, max=702, avg=142.95, stdev=71.56 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 190], 90.00th=[ 239], 95.00th=[ 279], | 99.00th=[ 384], 99.50th=[ 443], 99.90th=[ 609], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 6, max= 55, per=25.05%, avg=21.80, stdev=10.44, samples=558 iops : min= 1, max= 13, avg= 4.77, stdev= 2.64, samples=558 lat (msec) : 10=2.51%, 20=16.37%, 50=19.14%, 100=22.56%, 250=34.80% lat (msec) : 500=4.49%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.31%, ctx=5164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144286: Thu Jun 11 18:07:01 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6028KiB/288010msec) clat (msec): min=5, max=464, avg=42.35, stdev=46.02 lat (msec): min=5, max=464, avg=42.36, stdev=46.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 60], 90.00th=[ 99], 95.00th=[ 132], | 99.00th=[ 230], 99.50th=[ 309], 99.90th=[ 414], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 96, per=28.30%, avg=23.49, stdev=16.49, samples=493 iops : min= 1, max= 24, avg= 5.19, stdev= 4.16, samples=493 write: IOPS=5, BW=21.7KiB/s (22.3kB/s)(6260KiB/288010msec); 0 zone resets clat (msec): min=36, max=1543, avg=143.08, stdev=82.18 lat (msec): min=36, max=1543, avg=143.09, stdev=82.18 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 126], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 241], 95.00th=[ 292], | 99.00th=[ 393], 99.50th=[ 464], 99.90th=[ 860], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 6, max= 55, per=24.84%, avg=21.61, stdev=10.72, samples=554 iops : min= 1, max= 13, avg= 4.72, stdev= 2.71, samples=554 lat (msec) : 10=2.05%, 20=15.69%, 50=20.31%, 100=22.49%, 250=34.83% lat (msec) : 500=4.46%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.32%, ctx=5155, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144287: Thu Jun 11 18:07:01 2026 read: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6052KiB/284486msec) clat (msec): min=5, max=491, avg=40.66, stdev=46.25 lat (msec): min=5, max=491, avg=40.66, stdev=46.25 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 54], 90.00th=[ 90], 95.00th=[ 136], | 99.00th=[ 241], 99.50th=[ 279], 99.90th=[ 388], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 6, max= 128, per=29.29%, avg=24.31, stdev=17.16, samples=479 iops : min= 1, max= 32, avg= 5.40, stdev= 4.32, samples=479 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6236KiB/284486msec); 0 zone resets clat (msec): min=34, max=1528, avg=142.90, stdev=78.44 lat (msec): min=34, max=1528, avg=142.90, stdev=78.44 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 241], 95.00th=[ 284], | 99.00th=[ 388], 99.50th=[ 435], 99.90th=[ 527], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 6, max= 55, per=25.11%, avg=21.85, stdev=10.32, samples=547 iops : min= 1, max= 13, avg= 4.78, stdev= 2.63, samples=547 lat (msec) : 10=2.31%, 20=16.34%, 50=20.28%, 100=21.97%, 250=34.38% lat (msec) : 500=4.65%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.34%, ctx=5227, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=83.4KiB/s (85.4kB/s), 20.6KiB/s-21.3KiB/s (21.1kB/s-21.8kB/s), io=23.4MiB (24.6MB), run=284486-288010msec WRITE: bw=87.3KiB/s (89.4kB/s), 21.7KiB/s-22.1KiB/s (22.3kB/s-22.6kB/s), io=24.6MiB (25.7MB), run=284486-288010msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144345: Thu Jun 11 18:07:51 2026 read: IOPS=9, BW=157KiB/s (160kB/s)(5920KiB/37788msec) clat (usec): min=31, max=489974, avg=51797.22, stdev=45619.12 lat (usec): min=31, max=489975, avg=51798.81, stdev=45619.07 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 17695], | 30.00th=[ 32113], 40.00th=[ 39060], 50.00th=[ 46924], 60.00th=[ 54264], | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[204473], 99.50th=[287310], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 31, max= 344, per=24.98%, avg=154.85, stdev=71.12, samples=74 iops : min= 1, max= 21, avg= 8.89, stdev= 4.52, samples=74 write: IOPS=10, BW=169KiB/s (173kB/s)(6368KiB/37788msec); 0 zone resets clat (usec): min=1530, max=443752, avg=46367.75, stdev=52481.15 lat (usec): min=1533, max=443756, avg=46370.44, stdev=52481.68 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2073], 10.00th=[ 3720], 20.00th=[ 7963], | 30.00th=[ 12649], 40.00th=[ 17695], 50.00th=[ 27657], 60.00th=[ 37487], | 70.00th=[ 55837], 80.00th=[ 78119], 90.00th=[115868], 95.00th=[152044], | 99.00th=[214959], 99.50th=[308282], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 31, max= 411, per=26.03%, avg=169.95, stdev=82.29, samples=73 iops : min= 1, max= 25, avg= 9.84, stdev= 5.18, samples=73 lat (usec) : 50=0.78%, 100=6.77%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=1.82%, 4=4.30%, 10=7.03%, 20=10.03%, 50=28.78% lat (msec) : 100=27.86%, 250=10.94%, 500=0.65% cpu : usr=0.04%, sys=4.97%, ctx=1503, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144346: Thu Jun 11 18:07:51 2026 read: IOPS=9, BW=149KiB/s (152kB/s)(5744KiB/38572msec) clat (usec): min=38, max=208276, avg=56405.64, stdev=39471.59 lat (usec): min=38, max=208278, avg=56407.91, stdev=39472.46 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 26084], | 30.00th=[ 35390], 40.00th=[ 45351], 50.00th=[ 53740], 60.00th=[ 61604], | 70.00th=[ 71828], 80.00th=[ 85459], 90.00th=[105382], 95.00th=[126354], | 99.00th=[183501], 99.50th=[196084], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 29, max= 407, per=23.65%, avg=146.64, stdev=66.79, samples=75 iops : min= 1, max= 25, avg= 8.36, stdev= 4.24, samples=75 write: IOPS=10, BW=170KiB/s (174kB/s)(6544KiB/38572msec); 0 zone resets clat (usec): min=1736, max=335452, avg=43902.87, stdev=49128.64 lat (usec): min=1740, max=335455, avg=43905.27, stdev=49128.58 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2040], 10.00th=[ 2769], 20.00th=[ 6587], | 30.00th=[ 10421], 40.00th=[ 18482], 50.00th=[ 26870], 60.00th=[ 40109], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[108528], 95.00th=[141558], | 99.00th=[233833], 99.50th=[256902], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 58, max= 411, per=25.88%, avg=169.03, stdev=81.78, samples=73 iops : min= 3, max= 25, avg= 9.78, stdev= 5.19, samples=73 lat (usec) : 50=0.39%, 100=5.21%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=1.69%, 4=6.38%, 10=7.68%, 20=7.81%, 50=27.47% lat (msec) : 100=30.34%, 250=11.46%, 500=0.39% cpu : usr=0.07%, sys=4.63%, ctx=1525, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144347: Thu Jun 11 18:07:51 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37444msec) clat (usec): min=38, max=289045, avg=52327.54, stdev=42623.74 lat (usec): min=38, max=289047, avg=52348.65, stdev=42644.24 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 115], | 30.00th=[ 30278], 40.00th=[ 42730], 50.00th=[ 49546], 60.00th=[ 60556], | 70.00th=[ 69731], 80.00th=[ 81265], 90.00th=[ 95945], 95.00th=[123208], | 99.00th=[196084], 99.50th=[283116], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 506, per=27.48%, avg=170.35, stdev=79.31, samples=72 iops : min= 1, max= 31, avg= 9.85, stdev= 5.02, samples=72 write: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37444msec); 0 zone resets clat (usec): min=1688, max=353647, avg=43544.20, stdev=49194.36 lat (usec): min=1690, max=353650, avg=43546.65, stdev=49194.48 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2057], 10.00th=[ 3326], 20.00th=[ 6849], | 30.00th=[ 10421], 40.00th=[ 16909], 50.00th=[ 26608], 60.00th=[ 39584], | 70.00th=[ 52691], 80.00th=[ 73925], 90.00th=[106431], 95.00th=[137364], | 99.00th=[233833], 99.50th=[329253], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 348, per=25.28%, avg=165.07, stdev=74.86, samples=71 iops : min= 1, max= 21, avg= 9.52, stdev= 4.72, samples=71 lat (usec) : 50=1.04%, 100=8.98%, 250=0.65% lat (msec) : 2=2.21%, 4=3.78%, 10=8.20%, 20=9.11%, 50=24.61% lat (msec) : 100=31.38%, 250=9.51%, 500=0.52% cpu : usr=0.07%, sys=4.66%, ctx=1461, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144348: Thu Jun 11 18:07:51 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(6032KiB/37770msec) clat (usec): min=32, max=294851, avg=55949.45, stdev=44950.79 lat (usec): min=33, max=294852, avg=55954.76, stdev=44949.99 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 971], | 30.00th=[ 33817], 40.00th=[ 43254], 50.00th=[ 52167], 60.00th=[ 60031], | 70.00th=[ 69731], 80.00th=[ 87557], 90.00th=[112722], 95.00th=[130548], | 99.00th=[185598], 99.50th=[263193], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 380, per=25.76%, avg=159.70, stdev=76.13, samples=73 iops : min= 1, max= 23, avg= 9.18, stdev= 4.84, samples=73 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37770msec); 0 zone resets clat (usec): min=1697, max=502193, avg=41588.92, stdev=47877.77 lat (usec): min=1700, max=502195, avg=41591.45, stdev=47877.65 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2057], 10.00th=[ 3032], 20.00th=[ 6259], | 30.00th=[ 9896], 40.00th=[ 14877], 50.00th=[ 22414], 60.00th=[ 35914], | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[102237], 95.00th=[133694], | 99.00th=[170918], 99.50th=[202376], 99.90th=[501220], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 31, max= 344, per=25.30%, avg=165.19, stdev=75.77, samples=74 iops : min= 1, max= 21, avg= 9.53, stdev= 4.78, samples=74 lat (usec) : 50=0.78%, 100=8.07%, 250=0.52%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.69%, 4=5.21%, 10=8.72%, 20=8.98%, 50=23.18% lat (msec) : 100=29.82%, 250=11.98%, 500=0.39%, 750=0.13% cpu : usr=0.06%, sys=4.63%, ctx=1535, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=621KiB/s (636kB/s), 149KiB/s-167KiB/s (152kB/s-171kB/s), io=23.4MiB (24.5MB), run=37444-38572msec WRITE: bw=653KiB/s (669kB/s), 161KiB/s-170KiB/s (165kB/s-174kB/s), io=24.6MiB (25.8MB), run=37444-38572msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144349: Thu Jun 11 18:08:31 2026 read: IOPS=4, BW=76.9KiB/s (78.7kB/s)(5920KiB/77015msec) clat (msec): min=7, max=289, avg=46.96, stdev=49.04 lat (msec): min=7, max=289, avg=46.96, stdev=49.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 64], 90.00th=[ 99], 95.00th=[ 163], | 99.00th=[ 253], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 29, max= 350, per=28.32%, avg=86.36, stdev=55.54, samples=133 iops : min= 1, max= 21, avg= 4.56, stdev= 3.53, samples=133 write: IOPS=5, BW=82.7KiB/s (84.7kB/s)(6368KiB/77015msec); 0 zone resets clat (msec): min=49, max=479, avg=149.55, stdev=78.18 lat (msec): min=49, max=479, avg=149.56, stdev=78.18 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 144], | 70.00th=[ 171], 80.00th=[ 201], 90.00th=[ 271], 95.00th=[ 317], | 99.00th=[ 426], 99.50th=[ 456], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 29, max= 220, per=26.27%, avg=84.33, stdev=42.23, samples=147 iops : min= 1, max= 13, avg= 4.44, stdev= 2.69, samples=147 lat (msec) : 10=1.30%, 20=11.85%, 50=22.79%, 100=23.70%, 250=33.20% lat (msec) : 500=7.16% cpu : usr=0.04%, sys=1.26%, ctx=1322, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144350: Thu Jun 11 18:08:31 2026 read: IOPS=4, BW=73.2KiB/s (74.0kB/s)(5744KiB/78433msec) clat (msec): min=5, max=291, avg=46.38, stdev=44.37 lat (msec): min=5, max=291, avg=46.39, stdev=44.37 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 69], 90.00th=[ 110], 95.00th=[ 148], | 99.00th=[ 209], 99.50th=[ 279], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 28, max= 318, per=28.88%, avg=88.07, stdev=60.53, samples=127 iops : min= 1, max= 19, avg= 4.69, stdev= 3.82, samples=127 write: IOPS=5, BW=83.4KiB/s (85.4kB/s)(6544KiB/78433msec); 0 zone resets clat (msec): min=42, max=683, avg=150.03, stdev=85.38 lat (msec): min=42, max=683, avg=150.04, stdev=85.39 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 126], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 197], 90.00th=[ 268], 95.00th=[ 321], | 99.00th=[ 435], 99.50th=[ 506], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 29, max= 224, per=26.84%, avg=86.16, stdev=42.81, samples=148 iops : min= 1, max= 14, avg= 4.57, stdev= 2.77, samples=148 lat (msec) : 10=1.17%, 20=12.89%, 50=20.83%, 100=20.96%, 250=37.76% lat (msec) : 500=5.99%, 750=0.39% cpu : usr=0.04%, sys=1.27%, ctx=1386, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144351: Thu Jun 11 18:08:31 2026 read: IOPS=5, BW=82.5KiB/s (84.5kB/s)(6256KiB/75829msec) clat (msec): min=7, max=311, avg=46.57, stdev=45.76 lat (msec): min=7, max=311, avg=46.57, stdev=45.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 105], 95.00th=[ 146], | 99.00th=[ 232], 99.50th=[ 259], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 29, max= 288, per=31.07%, avg=94.75, stdev=66.19, samples=130 iops : min= 1, max= 18, avg= 5.10, stdev= 4.19, samples=130 write: IOPS=4, BW=79.5KiB/s (81.5kB/s)(6032KiB/75829msec); 0 zone resets clat (msec): min=39, max=547, avg=151.98, stdev=76.32 lat (msec): min=39, max=547, avg=151.98, stdev=76.32 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 120], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 163], 80.00th=[ 201], 90.00th=[ 266], 95.00th=[ 305], | 99.00th=[ 405], 99.50th=[ 464], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 28, max= 189, per=25.27%, avg=81.11, stdev=36.67, samples=145 iops : min= 1, max= 11, avg= 4.24, stdev= 2.36, samples=145 lat (msec) : 10=1.04%, 20=13.80%, 50=22.66%, 100=19.66%, 250=37.11% lat (msec) : 500=5.60%, 750=0.13% cpu : usr=0.03%, sys=1.28%, ctx=1296, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144352: Thu Jun 11 18:08:31 2026 read: IOPS=4, BW=78.0KiB/s (79.9kB/s)(6032KiB/77295msec) clat (msec): min=6, max=276, avg=47.26, stdev=46.34 lat (msec): min=6, max=276, avg=47.26, stdev=46.34 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 68], 90.00th=[ 107], 95.00th=[ 153], | 99.00th=[ 239], 99.50th=[ 247], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 254, per=30.58%, avg=93.26, stdev=55.65, samples=126 iops : min= 1, max= 15, avg= 5.00, stdev= 3.50, samples=126 write: IOPS=5, BW=80.9KiB/s (82.9kB/s)(6256KiB/77295msec); 0 zone resets clat (msec): min=43, max=606, avg=151.01, stdev=77.79 lat (msec): min=43, max=606, avg=151.01, stdev=77.79 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 102], 40.00th=[ 114], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 326], | 99.00th=[ 393], 99.50th=[ 422], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 30, max= 191, per=26.12%, avg=83.84, stdev=40.18, samples=146 iops : min= 1, max= 11, avg= 4.41, stdev= 2.58, samples=146 lat (msec) : 10=0.65%, 20=12.50%, 50=22.40%, 100=23.05%, 250=36.59% lat (msec) : 500=4.69%, 750=0.13% cpu : usr=0.04%, sys=1.22%, ctx=1288, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=305KiB/s (313kB/s), 73.2KiB/s-82.5KiB/s (74.0kB/s-84.5kB/s), io=23.4MiB (24.5MB), run=75829-78433msec WRITE: bw=321KiB/s (329kB/s), 79.5KiB/s-83.4KiB/s (81.5kB/s-85.4kB/s), io=24.6MiB (25.8MB), run=75829-78433msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144377: Thu Jun 11 18:08:50 2026 read: IOPS=1, BW=1119KiB/s (1146kB/s)(7168KiB/6404msec) clat (msec): min=109, max=336, avg=214.12, stdev=87.84 lat (msec): min=109, max=336, avg=214.12, stdev=87.84 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 144], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 192], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 317], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2031, max= 3992, per=96.72%, avg=2787.50, stdev=940.73, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=0, BW=800KiB/s (819kB/s)(5120KiB/6404msec); 0 zone resets clat (msec): min=173, max=2779, avg=919.78, stdev=1077.82 lat (msec): min=173, max=2779, avg=919.88, stdev=1077.84 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 2015, max= 4071, per=62.85%, avg=2536.00, stdev=1023.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.18%, ctx=158, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144378: Thu Jun 11 18:08:50 2026 read: IOPS=0, BW=302KiB/s (309kB/s)(2048KiB/6786msec) clat (msec): min=2, max=2623, avg=1313.03, stdev=1852.85 lat (msec): min=2, max=2623, avg=1313.04, stdev=1852.85 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 2635], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1831, max= 1950, per=65.60%, avg=1890.50, stdev=84.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1509KiB/s (1545kB/s)(10.0MiB/6786msec); 0 zone resets clat (msec): min=133, max=1158, avg=406.27, stdev=314.24 lat (msec): min=133, max=1158, avg=406.90, stdev=314.17 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 138], | 30.00th=[ 178], 40.00th=[ 190], 50.00th=[ 338], 60.00th=[ 376], | 70.00th=[ 405], 80.00th=[ 489], 90.00th=[ 659], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1950, max= 6083, per=99.36%, avg=4009.00, stdev=2340.47, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 2.31, samples=4 lat (msec) : 4=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=7.55%, ctx=615, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144379: Thu Jun 11 18:08:50 2026 read: IOPS=0, BW=865KiB/s (885kB/s)(6144KiB/7105msec) clat (usec): min=501, max=383197, avg=128706.97, stdev=156410.06 lat (usec): min=503, max=383197, avg=128708.18, stdev=156409.81 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[ 1778], 50.00th=[ 1778], 60.00th=[181404], | 70.00th=[204473], 80.00th=[204473], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 3900, max= 6119, per=100.00%, avg=5009.50, stdev=1569.07, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=0, BW=865KiB/s (885kB/s)(6144KiB/7105msec); 0 zone resets clat (msec): min=251, max=2980, avg=1007.73, stdev=1054.75 lat (msec): min=252, max=2980, avg=1007.84, stdev=1054.75 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 726], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1950, max= 4031, per=62.25%, avg=2511.75, stdev=1013.60, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 250=16.67%, 500=33.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.72%, ctx=145, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144380: Thu Jun 11 18:08:50 2026 read: IOPS=0, BW=829KiB/s (849kB/s)(5120KiB/6173msec) clat (usec): min=1667, max=404445, avg=211682.13, stdev=199320.21 lat (usec): min=1668, max=404446, avg=211683.14, stdev=199320.15 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1663], 10.00th=[ 1663], 20.00th=[ 1663], | 30.00th=[ 2835], 40.00th=[ 2835], 50.00th=[258999], 60.00th=[258999], | 70.00th=[387974], 80.00th=[387974], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 1950, max= 4063, per=93.08%, avg=2682.67, stdev=1196.16, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1161KiB/s (1189kB/s)(7168KiB/6173msec); 0 zone resets clat (msec): min=148, max=2877, avg=704.79, stdev=988.36 lat (msec): min=148, max=2877, avg=704.87, stdev=988.35 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 201], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1831, max= 4063, per=73.57%, avg=2968.75, stdev=1246.07, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 2=8.33%, 4=8.33%, 250=33.33%, 500=33.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=5.96%, ctx=107, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2882KiB/s (2952kB/s), 302KiB/s-1119KiB/s (309kB/s-1146kB/s), io=20.0MiB (20.0MB), run=6173-7105msec WRITE: bw=4035KiB/s (4132kB/s), 800KiB/s-1509KiB/s (819kB/s-1545kB/s), io=28.0MiB (29.4MB), run=6173-7105msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144372: Thu Jun 11 18:08:51 2026 read: IOPS=1, BW=1189KiB/s (1217kB/s)(7168KiB/6030msec) clat (msec): min=94, max=259, avg=157.28, stdev=54.56 lat (msec): min=94, max=259, avg=157.28, stdev=54.56 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 108], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 259], 95.00th=[ 259], | 99.00th=[ 259], 99.50th=[ 259], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 2003, max= 5636, per=100.00%, avg=3691.67, stdev=1829.94, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=0, BW=849KiB/s (869kB/s)(5120KiB/6030msec); 0 zone resets clat (msec): min=391, max=2832, avg=972.86, stdev=1050.98 lat (msec): min=391, max=2833, avg=972.97, stdev=1051.01 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1718, max= 2031, per=53.82%, avg=1942.75, stdev=150.27, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.37%, ctx=46, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144374: Thu Jun 11 18:08:51 2026 read: IOPS=0, BW=262KiB/s (268kB/s)(2048KiB/7830msec) clat (msec): min=127, max=2689, avg=1408.70, stdev=1811.78 lat (msec): min=127, max=2689, avg=1408.70, stdev=1811.78 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 2702], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1992, max= 2043, per=78.26%, avg=2017.50, stdev=36.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1308KiB/s (1339kB/s)(10.0MiB/7830msec); 0 zone resets clat (msec): min=248, max=1072, avg=478.29, stdev=279.87 lat (msec): min=248, max=1072, avg=478.39, stdev=279.85 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 271], | 30.00th=[ 309], 40.00th=[ 338], 50.00th=[ 359], 60.00th=[ 393], | 70.00th=[ 426], 80.00th=[ 460], 90.00th=[ 911], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1973, max= 4031, per=70.76%, avg=2554.43, stdev=927.65, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.76%, ctx=80, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144375: Thu Jun 11 18:08:51 2026 read: IOPS=0, BW=904KiB/s (925kB/s)(6144KiB/6798msec) clat (msec): min=136, max=575, avg=306.56, stdev=207.05 lat (msec): min=136, max=575, avg=306.56, stdev=207.05 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 207], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1892, max= 2043, per=77.46%, avg=1996.80, stdev=60.53, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=904KiB/s (925kB/s)(6144KiB/6798msec); 0 zone resets clat (msec): min=218, max=2745, avg=763.97, stdev=980.29 lat (msec): min=218, max=2745, avg=764.07, stdev=980.29 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 405], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 2003, max= 4087, per=79.92%, avg=2885.25, stdev=1046.14, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=1.66%, ctx=114, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144376: Thu Jun 11 18:08:51 2026 read: IOPS=0, BW=645KiB/s (660kB/s)(5120KiB/7942msec) clat (msec): min=96, max=1031, avg=339.01, stdev=392.87 lat (msec): min=96, max=1031, avg=339.01, stdev=392.87 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1892, max= 6047, per=100.00%, avg=3969.50, stdev=2938.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=903KiB/s (924kB/s)(7168KiB/7942msec); 0 zone resets clat (msec): min=227, max=3297, avg=838.09, stdev=1104.58 lat (msec): min=227, max=3297, avg=838.60, stdev=1104.56 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 230], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 506], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 802], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 2003, max= 3946, per=66.56%, avg=2402.80, stdev=862.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.88%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2579KiB/s (2641kB/s), 262KiB/s-1189KiB/s (268kB/s-1217kB/s), io=20.0MiB (20.0MB), run=6030-7942msec WRITE: bw=3610KiB/s (3697kB/s), 849KiB/s-1308KiB/s (869kB/s-1339kB/s), io=28.0MiB (29.4MB), run=6030-7942msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144387: Thu Jun 11 18:09:08 2026 read: IOPS=1, BW=5684KiB/s (5820kB/s)(12.0MiB/2162msec) clat (msec): min=553, max=799, avg=681.74, stdev=123.71 lat (msec): min=553, max=799, avg=681.74, stdev=123.71 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7892, max= 8175, per=100.00%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.77%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144389: Thu Jun 11 18:09:08 2026 read: IOPS=0, BW=2186KiB/s (2238kB/s)(4096KiB/1874msec) clat (nsec): min=235355k, max=235355k, avg=235354905.00, stdev= 0.00 lat (nsec): min=235356k, max=235356k, avg=235356361.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 7037, max= 7037, per=92.86%, avg=7037.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4371KiB/s (4476kB/s)(8192KiB/1874msec); 0 zone resets clat (msec): min=716, max=771, avg=743.88, stdev=38.87 lat (msec): min=764, max=771, avg=768.16, stdev= 5.29 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8175, max= 8175, per=91.27%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=4.38%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144390: Thu Jun 11 18:09:08 2026 write: IOPS=0, BW=3359KiB/s (3440kB/s)(12.0MiB/3658msec); 0 zone resets clat (msec): min=474, max=2141, avg=1180.42, stdev=862.34 lat (msec): min=475, max=2142, avg=1180.80, stdev=862.39 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 8031, max= 8047, per=89.75%, avg=8039.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.64%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144391: Thu Jun 11 18:09:08 2026 write: IOPS=1, BW=4588KiB/s (4699kB/s)(12.0MiB/2678msec); 0 zone resets clat (msec): min=394, max=1579, avg=844.48, stdev=641.71 lat (msec): min=394, max=1590, avg=848.45, stdev=647.84 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 6759, max= 7892, per=81.79%, avg=7325.50, stdev=801.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.22%, sys=4.48%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7578KiB/s (7760kB/s), 2186KiB/s-5684KiB/s (2238kB/s-5820kB/s), io=16.0MiB (16.8MB), run=1874-2162msec WRITE: bw=8958KiB/s (9173kB/s), 3359KiB/s-4588KiB/s (3440kB/s-4699kB/s), io=32.0MiB (33.6MB), run=1874-3658msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144392: Thu Jun 11 18:09:08 2026 read: IOPS=1, BW=4460KiB/s (4567kB/s)(12.0MiB/2755msec) clat (msec): min=751, max=1057, avg=917.87, stdev=154.66 lat (msec): min=751, max=1057, avg=917.87, stdev=154.66 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8078, max= 8094, per=100.00%, avg=8086.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.31%, ctx=246, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144393: Thu Jun 11 18:09:08 2026 read: IOPS=0, BW=1365KiB/s (1398kB/s)(4096KiB/3000msec) clat (nsec): min=858973k, max=858973k, avg=858973016.00, stdev= 0.00 lat (nsec): min=858975k, max=858975k, avg=858974750.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2731KiB/s (2796kB/s)(8192KiB/3000msec); 0 zone resets clat (msec): min=920, max=1218, avg=1069.57, stdev=210.95 lat (msec): min=920, max=1219, avg=1070.07, stdev=210.86 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8094, max= 8094, per=86.31%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.43%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144394: Thu Jun 11 18:09:08 2026 write: IOPS=0, BW=3517KiB/s (3601kB/s)(12.0MiB/3494msec); 0 zone resets clat (msec): min=325, max=2294, avg=1163.60, stdev=1016.61 lat (msec): min=326, max=2295, avg=1164.22, stdev=1016.57 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7772, max= 8143, per=84.85%, avg=7957.50, stdev=262.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.84%, ctx=61, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144395: Thu Jun 11 18:09:08 2026 write: IOPS=1, BW=4103KiB/s (4201kB/s)(12.0MiB/2995msec); 0 zone resets clat (msec): min=702, max=1337, avg=997.34, stdev=320.04 lat (msec): min=702, max=1338, avg=997.96, stdev=320.37 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8015, max= 8126, per=86.06%, avg=8070.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.17%, sys=5.18%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5461KiB/s (5592kB/s), 1365KiB/s-4460KiB/s (1398kB/s-4567kB/s), io=16.0MiB (16.8MB), run=2755-3000msec WRITE: bw=9378KiB/s (9603kB/s), 2731KiB/s-4103KiB/s (2796kB/s-4201kB/s), io=32.0MiB (33.6MB), run=2995-3494msec