== sanity test 398b: DIO and buffer IO race ============== 11:59:24 (1783353564) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.63609 s, 19.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181334: Mon Jul 6 12:00:29 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(5992KiB/55558msec) clat (usec): min=41, max=736415, avg=20022.70, stdev=21395.86 lat (usec): min=42, max=736416, avg=20023.46, stdev=21395.98 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7308], 10.00th=[ 9110], 20.00th=[ 11076], | 30.00th=[ 13304], 40.00th=[ 15270], 50.00th=[ 17433], 60.00th=[ 19530], | 70.00th=[ 22676], 80.00th=[ 26870], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 57934], 99.50th=[ 62129], 99.90th=[ 88605], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 13, max= 184, per=24.91%, avg=107.10, stdev=35.33, samples=110 iops : min= 3, max= 46, avg=26.41, stdev= 8.91, samples=110 write: IOPS=28, BW=113KiB/s (116kB/s)(6296KiB/55558msec); 0 zone resets clat (usec): min=748, max=81934, avg=16095.58, stdev=11840.19 lat (usec): min=748, max=81935, avg=16096.47, stdev=11840.27 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2835], 10.00th=[ 3490], 20.00th=[ 5473], | 30.00th=[ 8455], 40.00th=[11076], 50.00th=[13566], 60.00th=[16450], | 70.00th=[20317], 80.00th=[24511], 90.00th=[31327], 95.00th=[38011], | 99.00th=[56886], 99.50th=[63701], 99.90th=[81265], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 39, max= 224, per=25.17%, avg=113.27, stdev=36.21, samples=109 iops : min= 9, max= 56, avg=27.94, stdev= 9.08, samples=109 lat (usec) : 50=0.03%, 100=0.33%, 250=0.55%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.39% lat (msec) : 2=0.59%, 4=6.45%, 10=16.83%, 20=39.94%, 50=33.14% lat (msec) : 100=1.53%, 750=0.03% cpu : usr=0.10%, sys=26.24%, ctx=10301, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181335: Mon Jul 6 12:00:29 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(5940KiB/55269msec) clat (usec): min=43, max=76857, avg=19809.32, stdev=10561.41 lat (usec): min=43, max=76858, avg=19810.08, stdev=10561.46 clat percentiles (usec): | 1.00th=[ 124], 5.00th=[ 7635], 10.00th=[ 9110], 20.00th=[11338], | 30.00th=[13435], 40.00th=[15664], 50.00th=[17957], 60.00th=[20317], | 70.00th=[22938], 80.00th=[27132], 90.00th=[33424], 95.00th=[40109], | 99.00th=[54789], 99.50th=[61604], 99.90th=[73925], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 6, max= 200, per=24.98%, avg=107.42, stdev=35.74, samples=110 iops : min= 1, max= 50, avg=26.48, stdev= 9.03, samples=110 write: IOPS=28, BW=115KiB/s (118kB/s)(6348KiB/55269msec); 0 zone resets clat (usec): min=723, max=736473, avg=16149.33, stdev=21650.22 lat (usec): min=723, max=736474, avg=16150.25, stdev=21650.19 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 2868], 10.00th=[ 3392], 20.00th=[ 4948], | 30.00th=[ 7832], 40.00th=[ 10159], 50.00th=[ 12911], 60.00th=[ 15795], | 70.00th=[ 19792], 80.00th=[ 25035], 90.00th=[ 31589], 95.00th=[ 38536], | 99.00th=[ 53740], 99.50th=[ 59507], 99.90th=[110625], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 32, max= 224, per=25.75%, avg=115.89, stdev=38.94, samples=109 iops : min= 8, max= 56, avg=28.61, stdev= 9.77, samples=109 lat (usec) : 50=0.03%, 100=0.23%, 250=0.78%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=0.55%, 4=7.16%, 10=17.90%, 20=37.79%, 50=33.59% lat (msec) : 100=1.50%, 250=0.03%, 750=0.03% cpu : usr=0.10%, sys=26.36%, ctx=10115, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181336: Mon Jul 6 12:00:29 2026 read: IOPS=28, BW=112KiB/s (115kB/s)(6028KiB/53819msec) clat (usec): min=27, max=729228, avg=19347.49, stdev=20776.54 lat (usec): min=28, max=729229, avg=19348.25, stdev=20776.59 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 7373], 10.00th=[ 8979], 20.00th=[ 10945], | 30.00th=[ 12911], 40.00th=[ 15008], 50.00th=[ 17171], 60.00th=[ 19530], | 70.00th=[ 21890], 80.00th=[ 25560], 90.00th=[ 31851], 95.00th=[ 36963], | 99.00th=[ 52167], 99.50th=[ 62129], 99.90th=[ 76022], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 6, max= 207, per=26.06%, avg=112.07, stdev=39.44, samples=107 iops : min= 1, max= 51, avg=27.64, stdev= 9.96, samples=107 write: IOPS=29, BW=116KiB/s (119kB/s)(6260KiB/53819msec); 0 zone resets clat (usec): min=739, max=71977, avg=15608.78, stdev=11620.80 lat (usec): min=739, max=71978, avg=15609.74, stdev=11620.84 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2933], 10.00th=[ 3326], 20.00th=[ 5145], | 30.00th=[ 7504], 40.00th=[10028], 50.00th=[12387], 60.00th=[16057], | 70.00th=[19792], 80.00th=[25035], 90.00th=[32375], 95.00th=[37487], | 99.00th=[52167], 99.50th=[57934], 99.90th=[68682], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 19, max= 208, per=25.85%, avg=116.31, stdev=35.82, samples=107 iops : min= 4, max= 52, avg=28.70, stdev= 8.98, samples=107 lat (usec) : 50=0.07%, 100=0.39%, 250=0.49%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=0.49%, 4=6.90%, 10=18.91%, 20=39.00%, 50=32.36% lat (msec) : 100=1.07%, 750=0.03% cpu : usr=0.10%, sys=26.69%, ctx=10062, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181337: Mon Jul 6 12:00:29 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(6052KiB/55826msec) clat (usec): min=28, max=714226, avg=20269.50, stdev=20925.94 lat (usec): min=29, max=714227, avg=20270.20, stdev=20925.99 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 7242], 10.00th=[ 8717], 20.00th=[ 11076], | 30.00th=[ 13173], 40.00th=[ 15533], 50.00th=[ 17957], 60.00th=[ 20055], | 70.00th=[ 22938], 80.00th=[ 27132], 90.00th=[ 34341], 95.00th=[ 41157], | 99.00th=[ 56886], 99.50th=[ 65274], 99.90th=[ 87557], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 6, max= 232, per=25.16%, avg=108.18, stdev=36.17, samples=111 iops : min= 1, max= 58, avg=26.68, stdev= 9.13, samples=111 write: IOPS=27, BW=112KiB/s (114kB/s)(6236KiB/55826msec); 0 zone resets clat (usec): min=822, max=75639, avg=16005.80, stdev=11638.78 lat (usec): min=823, max=75640, avg=16006.80, stdev=11638.71 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2900], 10.00th=[ 3425], 20.00th=[ 5342], | 30.00th=[ 8291], 40.00th=[10945], 50.00th=[13566], 60.00th=[16450], | 70.00th=[20055], 80.00th=[24773], 90.00th=[31851], 95.00th=[38536], | 99.00th=[53740], 99.50th=[59507], 99.90th=[67634], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 26, max= 216, per=24.70%, avg=111.15, stdev=39.85, samples=111 iops : min= 6, max= 54, avg=27.42, stdev=10.02, samples=111 lat (usec) : 50=0.03%, 100=0.26%, 250=0.85%, 500=0.03%, 1000=0.16% lat (msec) : 2=0.55%, 4=6.41%, 10=17.32%, 20=39.19%, 50=33.53% lat (msec) : 100=1.63%, 750=0.03% cpu : usr=0.10%, sys=26.13%, ctx=10297, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=430KiB/s (440kB/s), 107KiB/s-112KiB/s (110kB/s-115kB/s), io=23.4MiB (24.6MB), run=53819-55826msec WRITE: bw=450KiB/s (461kB/s), 112KiB/s-116KiB/s (114kB/s-119kB/s), io=24.6MiB (25.7MB), run=53819-55826msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181339: Mon Jul 6 12:00:35 2026 read: IOPS=24, BW=96.5KiB/s (98.8kB/s)(5992KiB/62083msec) clat (msec): min=2, max=745, avg=18.36, stdev=23.35 lat (msec): min=2, max=745, avg=18.36, stdev=23.35 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 69], 99.50th=[ 81], 99.90th=[ 116], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 15, max= 359, per=25.03%, avg=96.63, stdev=66.59, samples=122 iops : min= 3, max= 89, avg=23.75, stdev=16.71, samples=122 write: IOPS=25, BW=101KiB/s (104kB/s)(6296KiB/62083msec); 0 zone resets clat (usec): min=4347, max=94168, avg=21861.69, stdev=14260.42 lat (usec): min=4347, max=94170, avg=21862.67, stdev=14260.45 clat percentiles (usec): | 1.00th=[ 5080], 5.00th=[ 6063], 10.00th=[ 6915], 20.00th=[ 8356], | 30.00th=[11600], 40.00th=[15139], 50.00th=[18482], 60.00th=[22676], | 70.00th=[27657], 80.00th=[32900], 90.00th=[41157], 95.00th=[50594], | 99.00th=[64226], 99.50th=[73925], 99.90th=[89654], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 24, max= 392, per=25.12%, avg=101.48, stdev=68.51, samples=122 iops : min= 6, max= 98, avg=24.96, stdev=17.22, samples=122 lat (msec) : 4=0.94%, 10=29.62%, 20=29.39%, 50=35.81%, 100=4.17% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.10%, sys=14.89%, ctx=6769, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181340: Mon Jul 6 12:00:35 2026 read: IOPS=23, BW=95.9KiB/s (98.2kB/s)(5940KiB/61914msec) clat (msec): min=2, max=718, avg=17.89, stdev=22.48 lat (msec): min=2, max=718, avg=17.89, stdev=22.48 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 63], 99.50th=[ 70], 99.90th=[ 97], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 16, max= 399, per=25.03%, avg=96.63, stdev=71.20, samples=122 iops : min= 4, max= 99, avg=23.75, stdev=17.86, samples=122 write: IOPS=25, BW=103KiB/s (105kB/s)(6348KiB/61914msec); 0 zone resets clat (msec): min=4, max=131, avg=22.17, stdev=15.28 lat (msec): min=4, max=131, avg=22.17, stdev=15.28 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 71], 99.50th=[ 81], 99.90th=[ 94], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 39, max= 376, per=25.53%, avg=103.12, stdev=68.29, samples=122 iops : min= 9, max= 94, avg=25.37, stdev=17.16, samples=122 lat (msec) : 4=0.94%, 10=29.69%, 20=30.53%, 50=34.51%, 100=4.26% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=14.96%, ctx=6685, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181341: Mon Jul 6 12:00:35 2026 read: IOPS=24, BW=97.3KiB/s (99.7kB/s)(6028KiB/61943msec) clat (msec): min=3, max=105, avg=18.05, stdev=13.77 lat (msec): min=3, max=105, avg=18.05, stdev=13.77 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 37], 95.00th=[ 47], | 99.00th=[ 62], 99.50th=[ 70], 99.90th=[ 89], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 31, max= 400, per=25.36%, avg=97.88, stdev=73.55, samples=122 iops : min= 7, max= 100, avg=24.06, stdev=18.45, samples=122 write: IOPS=25, BW=101KiB/s (103kB/s)(6260KiB/61943msec); 0 zone resets clat (msec): min=4, max=728, avg=22.10, stdev=23.14 lat (msec): min=4, max=728, avg=22.10, stdev=23.14 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 74], 99.50th=[ 83], 99.90th=[ 99], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 24, max= 368, per=25.15%, avg=101.61, stdev=66.68, samples=122 iops : min= 6, max= 92, avg=24.99, stdev=16.76, samples=122 lat (msec) : 4=1.24%, 10=29.85%, 20=28.78%, 50=35.68%, 100=4.39% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=14.82%, ctx=6741, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181342: Mon Jul 6 12:00:35 2026 read: IOPS=24, BW=97.6KiB/s (99.9kB/s)(6052KiB/62015msec) clat (usec): min=2827, max=93182, avg=18176.49, stdev=14019.54 lat (usec): min=2827, max=93182, avg=18177.26, stdev=14019.55 clat percentiles (usec): | 1.00th=[ 3490], 5.00th=[ 4424], 10.00th=[ 5014], 20.00th=[ 6390], | 30.00th=[ 8979], 40.00th=[11469], 50.00th=[13698], 60.00th=[17171], | 70.00th=[21627], 80.00th=[27657], 90.00th=[37487], 95.00th=[45876], | 99.00th=[68682], 99.50th=[77071], 99.90th=[83362], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 31, max= 392, per=25.32%, avg=97.73, stdev=66.89, samples=122 iops : min= 7, max= 98, avg=24.02, stdev=16.79, samples=122 write: IOPS=25, BW=101KiB/s (103kB/s)(6236KiB/62015msec); 0 zone resets clat (msec): min=4, max=732, avg=22.05, stdev=23.43 lat (msec): min=4, max=732, avg=22.05, stdev=23.43 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 42], 95.00th=[ 50], | 99.00th=[ 77], 99.50th=[ 90], 99.90th=[ 136], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 39, max= 400, per=24.97%, avg=100.89, stdev=69.48, samples=122 iops : min= 9, max= 100, avg=24.81, stdev=17.44, samples=122 lat (msec) : 4=1.30%, 10=28.68%, 20=30.79%, 50=35.25%, 100=3.87% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=14.85%, ctx=6848, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=387KiB/s (396kB/s), 95.9KiB/s-97.6KiB/s (98.2kB/s-99.9kB/s), io=23.4MiB (24.6MB), run=61914-62083msec WRITE: bw=405KiB/s (415kB/s), 101KiB/s-103KiB/s (103kB/s-105kB/s), io=24.6MiB (25.7MB), run=61914-62083msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181370: Mon Jul 6 12:01:01 2026 read: IOPS=18, BW=290KiB/s (297kB/s)(5920KiB/20417msec) clat (usec): min=76, max=88643, avg=28166.59, stdev=13909.47 lat (usec): min=77, max=88643, avg=28167.58, stdev=13909.46 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 297], 10.00th=[14353], 20.00th=[17957], | 30.00th=[20055], 40.00th=[23987], 50.00th=[26870], 60.00th=[30016], | 70.00th=[34341], 80.00th=[38536], 90.00th=[44827], 95.00th=[50594], | 99.00th=[70779], 99.50th=[85459], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 159, max= 479, per=24.74%, avg=285.98, stdev=82.57, samples=40 iops : min= 9, max= 29, avg=17.25, stdev= 5.23, samples=40 write: IOPS=19, BW=312KiB/s (319kB/s)(6368KiB/20417msec); 0 zone resets clat (usec): min=2387, max=85268, avg=25015.75, stdev=14762.22 lat (usec): min=2388, max=85270, avg=25019.72, stdev=14759.57 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5997], 10.00th=[ 7635], 20.00th=[11207], | 30.00th=[14746], 40.00th=[19006], 50.00th=[22676], 60.00th=[27132], | 70.00th=[31589], 80.00th=[36963], 90.00th=[44827], 95.00th=[52691], | 99.00th=[66847], 99.50th=[74974], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 127, max= 638, per=25.54%, avg=310.60, stdev=94.48, samples=40 iops : min= 7, max= 39, avg=18.80, stdev= 5.90, samples=40 lat (usec) : 100=0.13%, 250=2.08%, 500=0.26% lat (msec) : 4=0.13%, 10=9.51%, 20=24.74%, 50=57.16%, 100=5.99% cpu : usr=0.10%, sys=28.74%, ctx=3378, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181371: Mon Jul 6 12:01:01 2026 read: IOPS=17, BW=280KiB/s (287kB/s)(5744KiB/20506msec) clat (usec): min=110, max=85496, avg=28804.10, stdev=14113.78 lat (usec): min=111, max=85497, avg=28805.14, stdev=14113.92 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 9372], 10.00th=[12518], 20.00th=[18220], | 30.00th=[21365], 40.00th=[23987], 50.00th=[27919], 60.00th=[30540], | 70.00th=[34341], 80.00th=[39060], 90.00th=[45876], 95.00th=[55313], | 99.00th=[70779], 99.50th=[73925], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 64, max= 479, per=24.05%, avg=277.98, stdev=90.10, samples=40 iops : min= 4, max= 29, avg=16.75, stdev= 5.53, samples=40 write: IOPS=19, BW=319KiB/s (327kB/s)(6544KiB/20506msec); 0 zone resets clat (usec): min=4040, max=88268, avg=24621.16, stdev=15098.66 lat (usec): min=4042, max=88269, avg=24623.09, stdev=15098.82 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 6849], 10.00th=[ 8029], 20.00th=[10814], | 30.00th=[14484], 40.00th=[17957], 50.00th=[21365], 60.00th=[25297], | 70.00th=[30802], 80.00th=[35914], 90.00th=[45876], 95.00th=[53740], | 99.00th=[67634], 99.50th=[76022], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 127, max= 542, per=25.59%, avg=311.18, stdev=71.80, samples=40 iops : min= 7, max= 33, avg=18.85, stdev= 4.50, samples=40 lat (usec) : 250=1.56%, 500=0.39% lat (msec) : 10=9.38%, 20=23.57%, 50=58.59%, 100=6.51% cpu : usr=0.11%, sys=29.00%, ctx=3343, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181372: Mon Jul 6 12:01:01 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(6256KiB/20708msec) clat (usec): min=96, max=84943, avg=27984.72, stdev=14628.61 lat (usec): min=97, max=84944, avg=27985.76, stdev=14628.63 clat percentiles (usec): | 1.00th=[ 126], 5.00th=[ 247], 10.00th=[11338], 20.00th=[17171], | 30.00th=[20579], 40.00th=[23987], 50.00th=[27132], 60.00th=[30016], | 70.00th=[34341], 80.00th=[38011], 90.00th=[44827], 95.00th=[52167], | 99.00th=[76022], 99.50th=[84411], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 127, max= 574, per=26.20%, avg=302.88, stdev=102.04, samples=41 iops : min= 7, max= 35, avg=18.34, stdev= 6.39, samples=41 write: IOPS=18, BW=291KiB/s (298kB/s)(6032KiB/20708msec); 0 zone resets clat (usec): min=1937, max=93106, avg=25707.84, stdev=15753.19 lat (usec): min=1938, max=93108, avg=25709.87, stdev=15753.21 clat percentiles (usec): | 1.00th=[ 2868], 5.00th=[ 5800], 10.00th=[ 8291], 20.00th=[11600], | 30.00th=[15664], 40.00th=[18482], 50.00th=[23200], 60.00th=[26608], | 70.00th=[31327], 80.00th=[38011], 90.00th=[46924], 95.00th=[60031], | 99.00th=[69731], 99.50th=[76022], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 127, max= 800, per=23.86%, avg=290.20, stdev=106.83, samples=41 iops : min= 7, max= 50, avg=17.54, stdev= 6.76, samples=41 lat (usec) : 100=0.13%, 250=2.47%, 500=0.52% lat (msec) : 2=0.13%, 4=0.65%, 10=6.90%, 20=24.48%, 50=57.29% lat (msec) : 100=7.42% cpu : usr=0.08%, sys=28.30%, ctx=3403, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181373: Mon Jul 6 12:01:01 2026 read: IOPS=18, BW=296KiB/s (304kB/s)(6032KiB/20347msec) clat (usec): min=85, max=87657, avg=27593.06, stdev=14070.12 lat (usec): min=86, max=87658, avg=27593.97, stdev=14070.11 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 217], 10.00th=[11469], 20.00th=[17957], | 30.00th=[20841], 40.00th=[23725], 50.00th=[26870], 60.00th=[29492], | 70.00th=[33817], 80.00th=[38536], 90.00th=[44827], 95.00th=[52691], | 99.00th=[65274], 99.50th=[72877], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 64, max= 479, per=25.34%, avg=292.92, stdev=88.42, samples=40 iops : min= 4, max= 29, avg=17.70, stdev= 5.52, samples=40 write: IOPS=19, BW=307KiB/s (315kB/s)(6256KiB/20347msec); 0 zone resets clat (usec): min=1512, max=100014, avg=25108.97, stdev=15690.63 lat (usec): min=1514, max=100018, avg=25110.92, stdev=15690.72 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 46], 95.00th=[ 53], | 99.00th=[ 80], 99.50th=[ 94], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 160, max= 544, per=25.13%, avg=305.60, stdev=91.79, samples=40 iops : min= 10, max= 34, avg=18.50, stdev= 5.72, samples=40 lat (usec) : 100=0.13%, 250=2.86%, 500=0.52% lat (msec) : 2=0.39%, 4=0.65%, 10=8.33%, 20=22.92%, 50=58.20% lat (msec) : 100=5.86%, 250=0.13% cpu : usr=0.08%, sys=28.89%, ctx=3215, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1157KiB/s (1184kB/s), 280KiB/s-302KiB/s (287kB/s-309kB/s), io=23.4MiB (24.5MB), run=20347-20708msec WRITE: bw=1217KiB/s (1246kB/s), 291KiB/s-319KiB/s (298kB/s-327kB/s), io=24.6MiB (25.8MB), run=20347-20708msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181366: Mon Jul 6 12:01:02 2026 read: IOPS=17, BW=272KiB/s (279kB/s)(5920KiB/21747msec) clat (usec): min=4137, max=88367, avg=25255.45, stdev=16521.89 lat (usec): min=4137, max=88368, avg=25256.34, stdev=16521.93 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 6128], 10.00th=[ 7177], 20.00th=[11469], | 30.00th=[15008], 40.00th=[17957], 50.00th=[20579], 60.00th=[24511], | 70.00th=[29492], 80.00th=[37487], 90.00th=[48497], 95.00th=[60031], | 99.00th=[73925], 99.50th=[77071], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 159, max= 992, per=24.59%, avg=269.28, stdev=161.36, samples=43 iops : min= 9, max= 62, avg=16.21, stdev=10.22, samples=43 write: IOPS=18, BW=293KiB/s (300kB/s)(6368KiB/21747msec); 0 zone resets clat (msec): min=6, max=110, avg=30.93, stdev=19.39 lat (msec): min=6, max=110, avg=30.94, stdev=19.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 46], 90.00th=[ 62], 95.00th=[ 72], | 99.00th=[ 94], 99.50th=[ 96], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 63, max= 960, per=25.34%, avg=291.93, stdev=159.67, samples=43 iops : min= 3, max= 60, avg=17.63, stdev=10.17, samples=43 lat (msec) : 10=13.93%, 20=26.43%, 50=46.48%, 100=13.02%, 250=0.13% cpu : usr=0.08%, sys=15.61%, ctx=2040, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181367: Mon Jul 6 12:01:02 2026 read: IOPS=16, BW=263KiB/s (270kB/s)(5744KiB/21809msec) clat (msec): min=3, max=131, avg=24.92, stdev=18.28 lat (msec): min=3, max=131, avg=24.92, stdev=18.28 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 38], 90.00th=[ 50], 95.00th=[ 61], | 99.00th=[ 91], 99.50th=[ 113], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 52, max= 928, per=23.80%, avg=260.65, stdev=154.72, samples=43 iops : min= 3, max= 58, avg=15.67, stdev= 9.86, samples=43 write: IOPS=18, BW=300KiB/s (307kB/s)(6544KiB/21809msec); 0 zone resets clat (usec): min=5696, max=94980, avg=31114.53, stdev=19232.47 lat (usec): min=5698, max=94981, avg=31116.90, stdev=19232.63 clat percentiles (usec): | 1.00th=[ 6456], 5.00th=[ 7767], 10.00th=[ 9110], 20.00th=[13042], | 30.00th=[17695], 40.00th=[21890], 50.00th=[26346], 60.00th=[33424], | 70.00th=[39584], 80.00th=[46924], 90.00th=[58983], 95.00th=[67634], | 99.00th=[86508], 99.50th=[88605], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 127, max= 1120, per=25.59%, avg=294.77, stdev=188.01, samples=43 iops : min= 7, max= 70, avg=17.79, stdev=11.91, samples=43 lat (msec) : 4=0.13%, 10=14.84%, 20=27.99%, 50=43.62%, 100=13.15% lat (msec) : 250=0.26% cpu : usr=0.11%, sys=15.10%, ctx=2176, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181368: Mon Jul 6 12:01:02 2026 read: IOPS=17, BW=286KiB/s (293kB/s)(6256KiB/21862msec) clat (msec): min=3, max=136, avg=25.01, stdev=19.05 lat (msec): min=3, max=136, avg=25.01, stdev=19.05 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 52], 95.00th=[ 65], | 99.00th=[ 94], 99.50th=[ 97], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 95, max= 1216, per=25.69%, avg=281.26, stdev=204.68, samples=43 iops : min= 5, max= 76, avg=16.95, stdev=12.96, samples=43 write: IOPS=17, BW=276KiB/s (283kB/s)(6032KiB/21862msec); 0 zone resets clat (usec): min=5479, max=99846, avg=31925.71, stdev=20244.41 lat (usec): min=5481, max=99848, avg=31927.79, stdev=20244.32 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 92], 99.50th=[ 101], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 126, max= 896, per=23.18%, avg=267.00, stdev=149.78, samples=43 iops : min= 7, max= 56, avg=16.07, stdev= 9.51, samples=43 lat (msec) : 4=0.26%, 10=17.45%, 20=23.05%, 50=44.14%, 100=14.97% lat (msec) : 250=0.13% cpu : usr=0.09%, sys=14.99%, ctx=2092, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181369: Mon Jul 6 12:01:02 2026 read: IOPS=17, BW=278KiB/s (285kB/s)(6032KiB/21683msec) clat (msec): min=4, max=109, avg=24.07, stdev=17.08 lat (msec): min=4, max=109, avg=24.07, stdev=17.08 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 45], 95.00th=[ 59], | 99.00th=[ 92], 99.50th=[ 109], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 31, max= 736, per=23.66%, avg=259.07, stdev=124.86, samples=42 iops : min= 1, max= 46, avg=15.55, stdev= 7.93, samples=42 write: IOPS=18, BW=289KiB/s (295kB/s)(6256KiB/21683msec); 0 zone resets clat (msec): min=6, max=109, avg=32.18, stdev=19.62 lat (msec): min=6, max=109, avg=32.18, stdev=19.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 93], 99.50th=[ 107], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 95, max= 896, per=23.72%, avg=273.21, stdev=120.49, samples=42 iops : min= 5, max= 56, avg=16.45, stdev= 7.69, samples=42 lat (msec) : 10=12.63%, 20=29.17%, 50=45.57%, 100=11.98%, 250=0.65% cpu : usr=0.07%, sys=15.70%, ctx=2027, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1096KiB/s (1122kB/s), 263KiB/s-286KiB/s (270kB/s-293kB/s), io=23.4MiB (24.5MB), run=21683-21862msec WRITE: bw=1153KiB/s (1180kB/s), 276KiB/s-300KiB/s (283kB/s-307kB/s), io=24.6MiB (25.8MB), run=21683-21862msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181394: Mon Jul 6 12:01:11 2026 read: IOPS=2, BW=2097KiB/s (2147kB/s)(7168KiB/3418msec) clat (msec): min=56, max=851, avg=241.48, stdev=274.75 lat (msec): min=56, max=851, avg=241.48, stdev=274.75 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 82], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 161], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 215], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 2048, max= 6144, per=72.62%, avg=4026.00, stdev=2051.59, samples=3 iops : min= 2, max= 6, avg= 3.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1498KiB/s (1534kB/s)(5120KiB/3418msec); 0 zone resets clat (msec): min=106, max=596, avg=340.48, stdev=216.48 lat (msec): min=106, max=596, avg=340.54, stdev=216.48 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1943, max= 4096, per=34.71%, avg=2694.00, stdev=1215.20, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=40.91%, ctx=1285, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181395: Mon Jul 6 12:01:11 2026 read: IOPS=0, BW=554KiB/s (568kB/s)(2048KiB/3694msec) clat (usec): min=500, max=144586, avg=72543.62, stdev=101884.13 lat (usec): min=501, max=144587, avg=72544.78, stdev=101883.94 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[143655], | 70.00th=[143655], 80.00th=[143655], 90.00th=[143655], 95.00th=[143655], | 99.00th=[143655], 99.50th=[143655], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 1700, max= 2048, per=33.80%, avg=1874.00, stdev=246.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2772KiB/s (2839kB/s)(10.0MiB/3694msec); 0 zone resets clat (msec): min=135, max=992, avg=351.32, stdev=274.55 lat (msec): min=135, max=992, avg=351.41, stdev=274.54 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 142], | 30.00th=[ 165], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 255], | 70.00th=[ 284], 80.00th=[ 384], 90.00th=[ 676], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 2048, max= 4096, per=46.91%, avg=3640.80, stdev=894.78, samples=5 iops : min= 2, max= 4, avg= 3.00, stdev= 0.71, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=45.55%, ctx=341, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181396: Mon Jul 6 12:01:11 2026 read: IOPS=1, BW=1952KiB/s (1999kB/s)(6144KiB/3148msec) clat (usec): min=517, max=219661, avg=101185.68, stdev=87308.79 lat (usec): min=518, max=219662, avg=101186.81, stdev=87308.79 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 96994], 50.00th=[ 96994], 60.00th=[141558], | 70.00th=[147850], 80.00th=[147850], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 1943, max= 4096, per=45.68%, avg=2532.50, stdev=1043.45, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1952KiB/s (1999kB/s)(6144KiB/3148msec); 0 zone resets clat (msec): min=111, max=1067, avg=421.93, stdev=364.54 lat (msec): min=111, max=1067, avg=421.99, stdev=364.54 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 447], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1943, max= 3401, per=30.39%, avg=2358.75, stdev=696.51, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=31.43%, ctx=360, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181397: Mon Jul 6 12:01:11 2026 read: IOPS=1, BW=1710KiB/s (1751kB/s)(5120KiB/2995msec) clat (usec): min=407, max=296707, avg=100752.28, stdev=139513.38 lat (usec): min=408, max=296708, avg=100753.44, stdev=139513.65 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 408], 10.00th=[ 408], 20.00th=[ 408], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[ 4817], 60.00th=[ 4817], | 70.00th=[202376], 80.00th=[202376], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 2043, max= 6144, per=73.84%, avg=4093.50, stdev=2899.84, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2393KiB/s (2451kB/s)(7168KiB/2995msec); 0 zone resets clat (msec): min=210, max=929, avg=351.78, stdev=263.98 lat (msec): min=210, max=929, avg=351.84, stdev=263.99 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 213], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 226], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 405], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1700, max= 4096, per=37.77%, avg=2931.25, stdev=1234.66, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 500=16.67% lat (msec) : 10=8.33%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.07%, sys=48.31%, ctx=449, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5544KiB/s (5677kB/s), 554KiB/s-2097KiB/s (568kB/s-2147kB/s), io=20.0MiB (20.0MB), run=2995-3694msec WRITE: bw=7762KiB/s (7948kB/s), 1498KiB/s-2772KiB/s (1534kB/s-2839kB/s), io=28.0MiB (29.4MB), run=2995-3694msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181399: Mon Jul 6 12:01:11 2026 read: IOPS=1, BW=1786KiB/s (1829kB/s)(7168KiB/4014msec) clat (msec): min=48, max=1337, avg=436.44, stdev=473.30 lat (msec): min=48, max=1337, avg=436.44, stdev=473.30 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 296], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 760], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1976, max= 4047, per=49.40%, avg=2520.50, stdev=1018.09, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1276KiB/s (1306kB/s)(5120KiB/4014msec); 0 zone resets clat (msec): min=80, max=264, avg=178.14, stdev=75.25 lat (msec): min=80, max=264, avg=178.21, stdev=75.24 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 2023, max= 4023, per=42.33%, avg=3023.00, stdev=1414.21, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=25.00%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=14.23%, ctx=161, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181400: Mon Jul 6 12:01:11 2026 read: IOPS=0, BW=520KiB/s (532kB/s)(2048KiB/3939msec) clat (usec): min=56151, max=57899, avg=57025.59, stdev=1236.02 lat (usec): min=56153, max=57900, avg=57026.68, stdev=1235.07 clat percentiles (usec): | 1.00th=[56361], 5.00th=[56361], 10.00th=[56361], 20.00th=[56361], | 30.00th=[56361], 40.00th=[56361], 50.00th=[56361], 60.00th=[57934], | 70.00th=[57934], 80.00th=[57934], 90.00th=[57934], 95.00th=[57934], | 99.00th=[57934], 99.50th=[57934], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 1762, max= 2011, per=36.98%, avg=1886.50, stdev=176.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2600KiB/s (2662kB/s)(10.0MiB/3939msec); 0 zone resets clat (msec): min=54, max=1590, avg=364.73, stdev=452.95 lat (msec): min=54, max=1590, avg=364.81, stdev=452.97 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 77], | 30.00th=[ 138], 40.00th=[ 163], 50.00th=[ 253], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 296], 90.00th=[ 550], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1976, max= 6071, per=49.42%, avg=3529.50, stdev=1941.73, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 100=33.33%, 250=16.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=19.96%, ctx=179, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181401: Mon Jul 6 12:01:11 2026 read: IOPS=1, BW=1552KiB/s (1590kB/s)(6144KiB/3958msec) clat (msec): min=69, max=450, avg=223.93, stdev=163.66 lat (msec): min=69, max=450, avg=223.93, stdev=163.66 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 230], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 3953, max= 4023, per=78.17%, avg=3988.00, stdev=49.50, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1552KiB/s (1590kB/s)(6144KiB/3958msec); 0 zone resets clat (msec): min=66, max=1675, avg=413.21, stdev=631.97 lat (msec): min=66, max=1675, avg=413.27, stdev=631.98 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 134], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 2011, max= 3806, per=34.61%, avg=2472.00, stdev=889.47, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=16.30%, ctx=149, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181402: Mon Jul 6 12:01:11 2026 read: IOPS=1, BW=1290KiB/s (1321kB/s)(5120KiB/3969msec) clat (msec): min=53, max=214, avg=143.24, stdev=72.80 lat (msec): min=53, max=214, avg=143.24, stdev=72.80 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 4023, max= 4047, per=79.09%, avg=4035.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1806KiB/s (1849kB/s)(7168KiB/3969msec); 0 zone resets clat (msec): min=80, max=1462, avg=457.95, stdev=472.16 lat (msec): min=80, max=1462, avg=458.01, stdev=472.17 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 188], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 296], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 609], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1828, max= 2048, per=27.68%, avg=1977.20, stdev=87.34, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=18.09%, ctx=219, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5102KiB/s (5225kB/s), 520KiB/s-1786KiB/s (532kB/s-1829kB/s), io=20.0MiB (20.0MB), run=3939-4014msec WRITE: bw=7143KiB/s (7314kB/s), 1276KiB/s-2600KiB/s (1306kB/s-2662kB/s), io=28.0MiB (29.4MB), run=3939-4014msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181408: Mon Jul 6 12:01:20 2026 read: IOPS=1, BW=6508KiB/s (6665kB/s)(12.0MiB/1888msec) clat (msec): min=430, max=927, avg=617.91, stdev=269.69 lat (msec): min=430, max=927, avg=617.91, stdev=269.69 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7198, max= 8047, per=92.54%, avg=7622.50, stdev=600.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.46%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181409: Mon Jul 6 12:01:20 2026 read: IOPS=0, BW=2059KiB/s (2109kB/s)(4096KiB/1989msec) clat (nsec): min=893885k, max=893885k, avg=893885319.00, stdev= 0.00 lat (nsec): min=893888k, max=893888k, avg=893887622.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8047, max= 8047, per=97.69%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4119KiB/s (4218kB/s)(8192KiB/1989msec); 0 zone resets clat (msec): min=215, max=815, avg=515.62, stdev=424.39 lat (msec): min=215, max=815, avg=515.83, stdev=424.34 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.13%, ctx=92, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181410: Mon Jul 6 12:01:20 2026 write: IOPS=1, BW=7651KiB/s (7835kB/s)(12.0MiB/1606msec); 0 zone resets clat (msec): min=228, max=1020, avg=529.34, stdev=428.77 lat (msec): min=228, max=1020, avg=529.65, stdev=428.72 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7160, max= 8047, per=46.15%, avg=7603.50, stdev=627.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.12%, sys=18.13%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181411: Mon Jul 6 12:01:20 2026 write: IOPS=1, BW=7723KiB/s (7909kB/s)(12.0MiB/1591msec); 0 zone resets clat (msec): min=168, max=1059, avg=514.47, stdev=477.42 lat (msec): min=168, max=1059, avg=514.72, stdev=477.43 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7173, max= 8192, per=46.63%, avg=7682.50, stdev=720.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.81%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8237KiB/s (8435kB/s), 2059KiB/s-6508KiB/s (2109kB/s-6665kB/s), io=16.0MiB (16.8MB), run=1888-1989msec WRITE: bw=16.1MiB/s (16.9MB/s), 4119KiB/s-7723KiB/s (4218kB/s-7909kB/s), io=32.0MiB (33.6MB), run=1591-1989msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181413: Mon Jul 6 12:01:20 2026 read: IOPS=2, BW=9049KiB/s (9266kB/s)(12.0MiB/1358msec) clat (msec): min=396, max=526, avg=445.86, stdev=70.55 lat (msec): min=396, max=526, avg=445.87, stdev=70.55 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7123, max= 8192, per=83.99%, avg=7657.50, stdev=755.90, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=55.78%, ctx=2837, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181414: Mon Jul 6 12:01:20 2026 read: IOPS=0, BW=2279KiB/s (2334kB/s)(4096KiB/1797msec) clat (nsec): min=382299k, max=382299k, avg=382299413.00, stdev= 0.00 lat (nsec): min=382302k, max=382302k, avg=382301578.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7613, max= 7613, per=83.50%, avg=7613.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4559KiB/s (4668kB/s)(8192KiB/1797msec); 0 zone resets clat (msec): min=549, max=847, avg=698.90, stdev=210.84 lat (msec): min=550, max=848, avg=699.16, stdev=210.79 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=47.38%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.06%, sys=19.54%, ctx=1077, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181415: Mon Jul 6 12:01:20 2026 write: IOPS=1, BW=6484KiB/s (6640kB/s)(12.0MiB/1895msec); 0 zone resets clat (msec): min=251, max=1205, avg=624.98, stdev=509.85 lat (msec): min=252, max=1206, avg=625.21, stdev=509.85 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8192, max= 8192, per=47.38%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=16.05%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181416: Mon Jul 6 12:01:20 2026 write: IOPS=1, BW=7362KiB/s (7539kB/s)(12.0MiB/1669msec); 0 zone resets clat (msec): min=178, max=820, avg=550.70, stdev=332.83 lat (msec): min=179, max=821, avg=551.02, stdev=332.87 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8192, max= 8192, per=47.38%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.97%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9117KiB/s (9336kB/s), 2279KiB/s-9049KiB/s (2334kB/s-9266kB/s), io=16.0MiB (16.8MB), run=1358-1797msec WRITE: bw=16.9MiB/s (17.7MB/s), 4559KiB/s-7362KiB/s (4668kB/s-7539kB/s), io=32.0MiB (33.6MB), run=1669-1895msec