== sanity test 398b: DIO and buffer IO race ============== 21:11:15 (1782868275) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.51724 s, 20.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194211: Tue Jun 30 21:12:11 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(5992KiB/47890msec) clat (usec): min=31, max=606654, avg=17506.87, stdev=17132.92 lat (usec): min=31, max=606655, avg=17510.29, stdev=17132.45 clat percentiles (usec): | 1.00th=[ 113], 5.00th=[ 7635], 10.00th=[ 8979], 20.00th=[ 10814], | 30.00th=[ 12518], 40.00th=[ 14353], 50.00th=[ 16188], 60.00th=[ 18220], | 70.00th=[ 20055], 80.00th=[ 22676], 90.00th=[ 26870], 95.00th=[ 30278], | 99.00th=[ 42206], 99.50th=[ 49021], 99.90th=[ 72877], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 63, max= 190, per=25.51%, avg=126.04, stdev=24.16, samples=94 iops : min= 15, max= 47, avg=31.15, stdev= 6.07, samples=94 write: IOPS=32, BW=131KiB/s (135kB/s)(6296KiB/47890msec); 0 zone resets clat (usec): min=752, max=71942, avg=13738.55, stdev=10203.66 lat (usec): min=753, max=71943, avg=13739.16, stdev=10203.69 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 2933], 10.00th=[ 3326], 20.00th=[ 4047], | 30.00th=[ 6783], 40.00th=[ 9634], 50.00th=[11600], 60.00th=[13698], | 70.00th=[16909], 80.00th=[21627], 90.00th=[27919], 95.00th=[32900], | 99.00th=[47973], 99.50th=[52691], 99.90th=[70779], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 79, max= 200, per=25.66%, avg=132.68, stdev=29.55, samples=94 iops : min= 19, max= 50, avg=32.81, stdev= 7.45, samples=94 lat (usec) : 50=0.07%, 100=0.16%, 250=0.85%, 1000=0.62% lat (msec) : 2=0.33%, 4=9.31%, 10=18.00%, 20=44.53%, 50=25.68% lat (msec) : 100=0.42%, 750=0.03% cpu : usr=0.05%, sys=25.55%, ctx=9537, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194212: Tue Jun 30 21:12:11 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(5940KiB/48123msec) clat (usec): min=30, max=606728, avg=17746.22, stdev=17435.26 lat (usec): min=31, max=606728, avg=17746.66, stdev=17435.26 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 8225], 10.00th=[ 9372], 20.00th=[ 10683], | 30.00th=[ 12256], 40.00th=[ 13829], 50.00th=[ 15795], 60.00th=[ 18220], | 70.00th=[ 20055], 80.00th=[ 22676], 90.00th=[ 27132], 95.00th=[ 32375], | 99.00th=[ 45876], 99.50th=[ 54264], 99.90th=[ 77071], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 47, max= 192, per=25.12%, avg=124.11, stdev=26.44, samples=94 iops : min= 11, max= 48, avg=30.66, stdev= 6.56, samples=94 write: IOPS=32, BW=132KiB/s (135kB/s)(6348KiB/48123msec); 0 zone resets clat (usec): min=710, max=72976, avg=13686.53, stdev=10125.03 lat (usec): min=711, max=72977, avg=13689.51, stdev=10124.98 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 2769], 10.00th=[ 3294], 20.00th=[ 4293], | 30.00th=[ 6783], 40.00th=[ 9634], 50.00th=[11600], 60.00th=[14222], | 70.00th=[17171], 80.00th=[20841], 90.00th=[27395], 95.00th=[33162], | 99.00th=[47449], 99.50th=[52167], 99.90th=[63177], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 71, max= 223, per=25.45%, avg=131.55, stdev=33.43, samples=94 iops : min= 17, max= 55, avg=32.53, stdev= 8.44, samples=94 lat (usec) : 50=0.03%, 100=0.33%, 250=0.36%, 750=0.23%, 1000=0.55% lat (msec) : 2=0.68%, 4=8.01%, 10=18.85%, 20=45.15%, 50=25.00% lat (msec) : 100=0.78%, 750=0.03% cpu : usr=0.03%, sys=25.52%, ctx=9480, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194213: Tue Jun 30 21:12:11 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(6028KiB/47870msec) clat (usec): min=31, max=71483, avg=16851.65, stdev=8050.27 lat (usec): min=32, max=71484, avg=16852.60, stdev=8050.40 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 7963], 10.00th=[ 8979], 20.00th=[10421], | 30.00th=[11731], 40.00th=[13435], 50.00th=[15664], 60.00th=[17957], | 70.00th=[19792], 80.00th=[22414], 90.00th=[26870], 95.00th=[31589], | 99.00th=[40109], 99.50th=[51119], 99.90th=[68682], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 71, max= 176, per=25.73%, avg=127.09, stdev=25.81, samples=94 iops : min= 17, max= 44, avg=31.40, stdev= 6.52, samples=94 write: IOPS=32, BW=131KiB/s (134kB/s)(6260KiB/47870msec); 0 zone resets clat (usec): min=730, max=619374, avg=14334.27, stdev=18491.24 lat (usec): min=731, max=619375, avg=14334.80, stdev=18491.24 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 2802], 10.00th=[ 3359], 20.00th=[ 4015], | 30.00th=[ 6325], 40.00th=[ 9765], 50.00th=[ 11863], 60.00th=[ 14615], | 70.00th=[ 17695], 80.00th=[ 21627], 90.00th=[ 27919], 95.00th=[ 32637], | 99.00th=[ 45876], 99.50th=[ 56886], 99.90th=[ 78119], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 56, max= 215, per=25.45%, avg=131.59, stdev=31.10, samples=94 iops : min= 14, max= 53, avg=32.53, stdev= 7.76, samples=94 lat (usec) : 50=0.07%, 100=0.23%, 250=0.62%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.46% lat (msec) : 2=0.81%, 4=8.92%, 10=17.81%, 20=44.76%, 50=25.55% lat (msec) : 100=0.65%, 750=0.03% cpu : usr=0.04%, sys=25.48%, ctx=9676, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194214: Tue Jun 30 21:12:11 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(6052KiB/48555msec) clat (usec): min=30, max=86431, avg=16879.97, stdev=8567.61 lat (usec): min=30, max=86431, avg=16880.44, stdev=8567.61 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 7242], 10.00th=[ 8717], 20.00th=[10421], | 30.00th=[11863], 40.00th=[13566], 50.00th=[15270], 60.00th=[17433], | 70.00th=[20055], 80.00th=[22938], 90.00th=[26346], 95.00th=[30802], | 99.00th=[45876], 99.50th=[54264], 99.90th=[63701], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 56, max= 199, per=25.33%, avg=125.15, stdev=26.96, samples=95 iops : min= 14, max= 49, avg=30.93, stdev= 6.80, samples=95 write: IOPS=32, BW=128KiB/s (132kB/s)(6236KiB/48555msec); 0 zone resets clat (usec): min=753, max=623530, avg=14736.34, stdev=18621.70 lat (usec): min=753, max=623531, avg=14736.84, stdev=18621.71 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2835], 10.00th=[ 3326], 20.00th=[ 4146], | 30.00th=[ 7242], 40.00th=[ 10028], 50.00th=[ 11994], 60.00th=[ 14746], | 70.00th=[ 18220], 80.00th=[ 22414], 90.00th=[ 28967], 95.00th=[ 33817], | 99.00th=[ 47449], 99.50th=[ 54264], 99.90th=[ 73925], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 63, max= 215, per=25.01%, avg=129.28, stdev=29.46, samples=95 iops : min= 15, max= 53, avg=31.96, stdev= 7.36, samples=95 lat (usec) : 50=0.07%, 100=0.33%, 250=0.85%, 750=0.03%, 1000=0.33% lat (msec) : 2=0.68%, 4=8.79%, 10=17.71%, 20=43.62%, 50=26.82% lat (msec) : 100=0.75%, 750=0.03% cpu : usr=0.05%, sys=25.21%, ctx=9652, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=495KiB/s (506kB/s), 123KiB/s-126KiB/s (126kB/s-129kB/s), io=23.4MiB (24.6MB), run=47870-48555msec WRITE: bw=518KiB/s (530kB/s), 128KiB/s-132KiB/s (132kB/s-135kB/s), io=24.6MiB (25.7MB), run=47870-48555msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194206: Tue Jun 30 21:12:20 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(5992KiB/57182msec) clat (msec): min=2, max=676, avg=16.39, stdev=20.64 lat (msec): min=2, max=676, avg=16.39, stdev=20.64 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 41], | 99.00th=[ 55], 99.50th=[ 60], 99.90th=[ 130], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 24, max= 312, per=25.15%, avg=105.39, stdev=61.12, samples=112 iops : min= 6, max= 78, avg=26.01, stdev=15.38, samples=112 write: IOPS=27, BW=110KiB/s (113kB/s)(6296KiB/57182msec); 0 zone resets clat (usec): min=4787, max=93401, avg=20620.13, stdev=13025.05 lat (usec): min=4787, max=93402, avg=20620.70, stdev=13025.03 clat percentiles (usec): | 1.00th=[ 5669], 5.00th=[ 6915], 10.00th=[ 7898], 20.00th=[ 9372], | 30.00th=[11076], 40.00th=[13829], 50.00th=[17433], 60.00th=[21103], | 70.00th=[25035], 80.00th=[30278], 90.00th=[37487], 95.00th=[44303], | 99.00th=[67634], 99.50th=[74974], 99.90th=[85459], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 16, max= 368, per=25.23%, avg=110.75, stdev=61.91, samples=112 iops : min= 4, max= 92, avg=27.35, stdev=15.53, samples=112 lat (msec) : 4=0.42%, 10=30.14%, 20=35.32%, 50=31.87%, 100=2.18% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.05%, sys=13.87%, ctx=6035, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194207: Tue Jun 30 21:12:20 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(5940KiB/56448msec) clat (msec): min=3, max=679, avg=16.26, stdev=20.75 lat (msec): min=3, max=679, avg=16.26, stdev=20.75 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 42], | 99.00th=[ 57], 99.50th=[ 65], 99.90th=[ 89], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 15, max= 328, per=25.35%, avg=106.20, stdev=61.05, samples=111 iops : min= 3, max= 82, avg=26.21, stdev=15.35, samples=111 write: IOPS=28, BW=112KiB/s (115kB/s)(6348KiB/56448msec); 0 zone resets clat (usec): min=4558, max=76487, avg=20243.16, stdev=12429.35 lat (usec): min=4558, max=76487, avg=20243.75, stdev=12429.35 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 7111], 10.00th=[ 8029], 20.00th=[ 9634], | 30.00th=[11338], 40.00th=[13698], 50.00th=[17171], 60.00th=[20579], | 70.00th=[24511], 80.00th=[28967], 90.00th=[36963], 95.00th=[44303], | 99.00th=[63701], 99.50th=[69731], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 39, max= 328, per=25.77%, avg=113.12, stdev=59.17, samples=111 iops : min= 9, max= 82, avg=27.94, stdev=14.88, samples=111 lat (msec) : 4=0.33%, 10=28.32%, 20=38.61%, 50=30.50%, 100=2.21% lat (msec) : 750=0.03% cpu : usr=0.05%, sys=13.97%, ctx=6334, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194208: Tue Jun 30 21:12:20 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(6028KiB/56884msec) clat (usec): min=2813, max=88667, avg=16292.92, stdev=11793.85 lat (usec): min=2814, max=88668, avg=16293.42, stdev=11793.83 clat percentiles (usec): | 1.00th=[ 3851], 5.00th=[ 5014], 10.00th=[ 5669], 20.00th=[ 6980], | 30.00th=[ 8586], 40.00th=[10421], 50.00th=[12387], 60.00th=[14877], | 70.00th=[18744], 80.00th=[23987], 90.00th=[33424], 95.00th=[39584], | 99.00th=[55837], 99.50th=[63701], 99.90th=[85459], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 24, max= 360, per=25.49%, avg=106.82, stdev=64.14, samples=112 iops : min= 6, max= 90, avg=26.37, stdev=16.12, samples=112 write: IOPS=27, BW=110KiB/s (113kB/s)(6260KiB/56884msec); 0 zone resets clat (msec): min=3, max=682, avg=20.55, stdev=21.11 lat (msec): min=3, max=682, avg=20.55, stdev=21.11 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 38], 95.00th=[ 45], | 99.00th=[ 69], 99.50th=[ 77], 99.90th=[ 93], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 31, max= 303, per=25.28%, avg=110.96, stdev=59.71, samples=112 iops : min= 7, max= 75, avg=27.40, stdev=14.99, samples=112 lat (msec) : 4=0.68%, 10=30.34%, 20=35.12%, 50=31.38%, 100=2.44% lat (msec) : 750=0.03% cpu : usr=0.05%, sys=13.89%, ctx=6169, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194209: Tue Jun 30 21:12:20 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(6052KiB/57064msec) clat (msec): min=2, max=127, avg=16.12, stdev=11.87 lat (msec): min=2, max=127, avg=16.12, stdev=11.87 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 33], 95.00th=[ 40], | 99.00th=[ 54], 99.50th=[ 61], 99.90th=[ 85], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 47, max= 335, per=25.44%, avg=106.61, stdev=61.92, samples=112 iops : min= 11, max= 83, avg=26.31, stdev=15.56, samples=112 write: IOPS=27, BW=109KiB/s (112kB/s)(6236KiB/57064msec); 0 zone resets clat (msec): min=4, max=682, avg=20.84, stdev=21.22 lat (msec): min=4, max=682, avg=20.84, stdev=21.22 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 44], | 99.00th=[ 68], 99.50th=[ 79], 99.90th=[ 87], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 39, max= 312, per=25.07%, avg=110.04, stdev=60.75, samples=112 iops : min= 9, max= 78, avg=27.17, stdev=15.26, samples=112 lat (msec) : 4=0.42%, 10=29.92%, 20=35.94%, 50=31.35%, 100=2.31% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.02%, sys=13.94%, ctx=6184, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=420KiB/s (430kB/s), 105KiB/s-106KiB/s (107kB/s-109kB/s), io=23.4MiB (24.6MB), run=56448-57182msec WRITE: bw=440KiB/s (450kB/s), 109KiB/s-112KiB/s (112kB/s-115kB/s), io=24.6MiB (25.7MB), run=56448-57182msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194237: Tue Jun 30 21:12:40 2026 read: IOPS=25, BW=410KiB/s (420kB/s)(5920KiB/14425msec) clat (usec): min=89, max=114031, avg=19970.30, stdev=11285.95 lat (usec): min=90, max=114031, avg=19970.72, stdev=11285.94 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7570], 10.00th=[ 10421], 20.00th=[ 12649], | 30.00th=[ 14484], 40.00th=[ 16188], 50.00th=[ 18220], 60.00th=[ 20579], | 70.00th=[ 22938], 80.00th=[ 25822], 90.00th=[ 32113], 95.00th=[ 38536], | 99.00th=[ 47973], 99.50th=[ 99091], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 192, max= 576, per=24.65%, avg=406.96, stdev=92.34, samples=28 iops : min= 12, max= 36, avg=24.96, stdev= 5.75, samples=28 write: IOPS=27, BW=441KiB/s (452kB/s)(6368KiB/14425msec); 0 zone resets clat (usec): min=998, max=101945, avg=17514.76, stdev=13914.61 lat (usec): min=998, max=101945, avg=17515.51, stdev=13914.60 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 3523], 10.00th=[ 4424], 20.00th=[ 5604], | 30.00th=[ 7570], 40.00th=[ 11207], 50.00th=[ 14091], 60.00th=[ 17433], | 70.00th=[ 21627], 80.00th=[ 27132], 90.00th=[ 35390], 95.00th=[ 44303], | 99.00th=[ 61604], 99.50th=[ 81265], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 287, max= 640, per=25.44%, avg=441.96, stdev=94.65, samples=28 iops : min= 17, max= 40, avg=27.14, stdev= 6.13, samples=28 lat (usec) : 100=0.13%, 250=1.56%, 500=0.13%, 1000=0.26% lat (msec) : 2=1.30%, 4=2.60%, 10=16.80%, 20=39.06%, 50=36.33% lat (msec) : 100=1.56%, 250=0.26% cpu : usr=0.03%, sys=26.10%, ctx=2709, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194239: Tue Jun 30 21:12:40 2026 read: IOPS=25, BW=403KiB/s (412kB/s)(5744KiB/14265msec) clat (usec): min=70, max=97580, avg=20489.43, stdev=12295.63 lat (usec): min=71, max=97580, avg=20489.85, stdev=12295.64 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 125], 10.00th=[ 9896], 20.00th=[12256], | 30.00th=[13960], 40.00th=[16319], 50.00th=[18482], 60.00th=[21365], | 70.00th=[24249], 80.00th=[28181], 90.00th=[32637], 95.00th=[42730], | 99.00th=[70779], 99.50th=[79168], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 191, max= 576, per=24.35%, avg=401.96, stdev=78.93, samples=28 iops : min= 11, max= 36, avg=24.64, stdev= 5.07, samples=28 write: IOPS=28, BW=459KiB/s (470kB/s)(6544KiB/14265msec); 0 zone resets clat (usec): min=946, max=64344, avg=16846.08, stdev=12819.34 lat (usec): min=946, max=64345, avg=16846.79, stdev=12819.32 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 2245], 10.00th=[ 4228], 20.00th=[ 5604], | 30.00th=[ 7635], 40.00th=[11338], 50.00th=[13173], 60.00th=[15926], | 70.00th=[20841], 80.00th=[28443], 90.00th=[35390], 95.00th=[41681], | 99.00th=[55313], 99.50th=[57934], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 254, max= 670, per=26.31%, avg=456.93, stdev=103.32, samples=28 iops : min= 15, max= 41, avg=28.11, stdev= 6.51, samples=28 lat (usec) : 100=0.52%, 250=2.34%, 1000=0.13% lat (msec) : 2=1.82%, 4=2.60%, 10=16.15%, 20=39.06%, 50=35.03% lat (msec) : 100=2.34% cpu : usr=0.03%, sys=26.16%, ctx=2584, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194240: Tue Jun 30 21:12:40 2026 read: IOPS=26, BW=431KiB/s (442kB/s)(6256KiB/14501msec) clat (usec): min=35, max=70293, avg=20349.71, stdev=11012.15 lat (usec): min=35, max=70294, avg=20350.17, stdev=11012.13 clat percentiles (usec): | 1.00th=[ 84], 5.00th=[ 127], 10.00th=[ 9372], 20.00th=[12518], | 30.00th=[14222], 40.00th=[16581], 50.00th=[19530], 60.00th=[21890], | 70.00th=[24249], 80.00th=[26870], 90.00th=[33424], 95.00th=[40633], | 99.00th=[57410], 99.50th=[60556], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 223, max= 608, per=26.15%, avg=431.75, stdev=87.22, samples=28 iops : min= 13, max= 38, avg=26.54, stdev= 5.48, samples=28 write: IOPS=25, BW=416KiB/s (426kB/s)(6032KiB/14501msec); 0 zone resets clat (usec): min=1102, max=70980, avg=17244.52, stdev=12344.58 lat (usec): min=1103, max=70980, avg=17245.26, stdev=12344.57 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 4359], 10.00th=[ 5014], 20.00th=[ 6128], | 30.00th=[ 8848], 40.00th=[11994], 50.00th=[14353], 60.00th=[16712], | 70.00th=[20579], 80.00th=[27395], 90.00th=[33424], 95.00th=[43779], | 99.00th=[55837], 99.50th=[66323], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 223, max= 576, per=23.56%, avg=409.32, stdev=101.71, samples=28 iops : min= 13, max= 36, avg=25.11, stdev= 6.52, samples=28 lat (usec) : 50=0.26%, 100=0.91%, 250=1.95% lat (msec) : 2=1.04%, 4=0.52%, 10=17.19%, 20=38.93%, 50=36.72% lat (msec) : 100=2.47% cpu : usr=0.07%, sys=26.20%, ctx=2691, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194241: Tue Jun 30 21:12:40 2026 read: IOPS=26, BW=417KiB/s (427kB/s)(6032KiB/14474msec) clat (usec): min=68, max=90082, avg=19697.08, stdev=11178.86 lat (usec): min=68, max=90083, avg=19697.50, stdev=11178.86 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 118], 10.00th=[ 9634], 20.00th=[11600], | 30.00th=[13960], 40.00th=[15926], 50.00th=[18482], 60.00th=[21365], | 70.00th=[23987], 80.00th=[27132], 90.00th=[32375], 95.00th=[38536], | 99.00th=[52691], 99.50th=[65274], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 255, max= 573, per=24.96%, avg=412.07, stdev=80.68, samples=28 iops : min= 15, max= 35, avg=25.29, stdev= 4.99, samples=28 write: IOPS=27, BW=432KiB/s (443kB/s)(6256KiB/14474msec); 0 zone resets clat (usec): min=1185, max=70319, avg=17785.51, stdev=12874.25 lat (usec): min=1186, max=70320, avg=17786.21, stdev=12874.25 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3949], 10.00th=[ 4621], 20.00th=[ 5538], | 30.00th=[ 8291], 40.00th=[12256], 50.00th=[15139], 60.00th=[17957], | 70.00th=[22938], 80.00th=[27395], 90.00th=[35390], 95.00th=[43254], | 99.00th=[58459], 99.50th=[65274], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 287, max= 670, per=24.81%, avg=430.96, stdev=94.44, samples=28 iops : min= 17, max= 41, avg=26.46, stdev= 6.04, samples=28 lat (usec) : 100=1.69%, 250=2.08% lat (msec) : 2=0.65%, 4=2.08%, 10=17.06%, 20=36.72%, 50=37.76% lat (msec) : 100=1.95% cpu : usr=0.04%, sys=26.13%, ctx=2648, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1652KiB/s (1691kB/s), 403KiB/s-431KiB/s (412kB/s-442kB/s), io=23.4MiB (24.5MB), run=14265-14501msec WRITE: bw=1738KiB/s (1780kB/s), 416KiB/s-459KiB/s (426kB/s-470kB/s), io=24.6MiB (25.8MB), run=14265-14501msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194242: Tue Jun 30 21:12:43 2026 read: IOPS=21, BW=339KiB/s (347kB/s)(5920KiB/17483msec) clat (usec): min=4366, max=87052, avg=19451.47, stdev=14286.62 lat (usec): min=4367, max=87053, avg=19452.02, stdev=14286.57 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 5932], 10.00th=[ 6652], 20.00th=[ 8717], | 30.00th=[10159], 40.00th=[12256], 50.00th=[14615], 60.00th=[17433], | 70.00th=[20841], 80.00th=[28181], 90.00th=[41681], 95.00th=[50594], | 99.00th=[63701], 99.50th=[68682], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 160, max= 894, per=23.79%, avg=325.97, stdev=190.47, samples=34 iops : min= 10, max= 55, avg=20.03, stdev=11.92, samples=34 write: IOPS=22, BW=364KiB/s (373kB/s)(6368KiB/17483msec); 0 zone resets clat (msec): min=5, max=120, avg=25.79, stdev=19.01 lat (msec): min=5, max=120, avg=25.79, stdev=19.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 52], 95.00th=[ 63], | 99.00th=[ 111], 99.50th=[ 117], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 127, max= 896, per=24.73%, avg=356.41, stdev=185.27, samples=34 iops : min= 7, max= 56, avg=21.91, stdev=11.65, samples=34 lat (msec) : 10=21.74%, 20=37.37%, 50=33.07%, 100=7.16%, 250=0.65% cpu : usr=0.04%, sys=13.18%, ctx=1692, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194243: Tue Jun 30 21:12:43 2026 read: IOPS=20, BW=330KiB/s (338kB/s)(5744KiB/17384msec) clat (usec): min=4512, max=77561, avg=19746.45, stdev=15422.55 lat (usec): min=4512, max=77561, avg=19746.92, stdev=15422.52 clat percentiles (usec): | 1.00th=[ 4817], 5.00th=[ 6194], 10.00th=[ 7177], 20.00th=[ 8586], | 30.00th=[ 9896], 40.00th=[11994], 50.00th=[13566], 60.00th=[16581], | 70.00th=[20841], 80.00th=[29230], 90.00th=[43779], 95.00th=[52691], | 99.00th=[72877], 99.50th=[77071], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 126, max= 894, per=23.93%, avg=327.88, stdev=192.85, samples=34 iops : min= 7, max= 55, avg=20.15, stdev=12.09, samples=34 write: IOPS=23, BW=376KiB/s (385kB/s)(6544KiB/17384msec); 0 zone resets clat (msec): min=6, max=101, avg=24.83, stdev=16.50 lat (msec): min=6, max=101, avg=24.83, stdev=16.50 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 48], 95.00th=[ 56], | 99.00th=[ 86], 99.50th=[ 92], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 128, max= 960, per=25.61%, avg=369.00, stdev=202.84, samples=34 iops : min= 8, max= 60, avg=22.71, stdev=12.76, samples=34 lat (msec) : 10=22.14%, 20=36.20%, 50=33.98%, 100=7.55%, 250=0.13% cpu : usr=0.03%, sys=13.25%, ctx=1762, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194244: Tue Jun 30 21:12:43 2026 read: IOPS=22, BW=358KiB/s (367kB/s)(6256KiB/17460msec) clat (usec): min=3162, max=70061, avg=19040.19, stdev=13679.69 lat (usec): min=3162, max=70062, avg=19040.66, stdev=13679.69 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 6521], 10.00th=[ 7570], 20.00th=[ 8848], | 30.00th=[10028], 40.00th=[11600], 50.00th=[13566], 60.00th=[16188], | 70.00th=[20317], 80.00th=[28705], 90.00th=[42206], 95.00th=[49546], | 99.00th=[61604], 99.50th=[67634], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 95, max= 958, per=25.89%, avg=354.68, stdev=213.96, samples=34 iops : min= 5, max= 59, avg=21.82, stdev=13.41, samples=34 write: IOPS=21, BW=345KiB/s (354kB/s)(6032KiB/17460msec); 0 zone resets clat (msec): min=5, max=120, avg=26.20, stdev=19.41 lat (msec): min=5, max=120, avg=26.20, stdev=19.41 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 54], 95.00th=[ 61], | 99.00th=[ 108], 99.50th=[ 118], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 126, max= 1024, per=23.08%, avg=332.56, stdev=187.43, samples=34 iops : min= 7, max= 64, avg=20.44, stdev=11.77, samples=34 lat (msec) : 4=0.13%, 10=22.40%, 20=37.50%, 50=32.16%, 100=7.16% lat (msec) : 250=0.65% cpu : usr=0.01%, sys=13.38%, ctx=1711, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194245: Tue Jun 30 21:12:43 2026 read: IOPS=21, BW=349KiB/s (358kB/s)(6032KiB/17270msec) clat (msec): min=4, max=106, avg=19.42, stdev=14.49 lat (msec): min=4, max=106, avg=19.42, stdev=14.49 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 74], 99.50th=[ 87], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 158, max= 928, per=25.34%, avg=347.15, stdev=191.81, samples=34 iops : min= 9, max= 58, avg=21.35, stdev=12.08, samples=34 write: IOPS=22, BW=362KiB/s (371kB/s)(6256KiB/17270msec); 0 zone resets clat (msec): min=6, max=102, avg=25.05, stdev=16.55 lat (msec): min=6, max=102, avg=25.06, stdev=16.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 47], 95.00th=[ 55], | 99.00th=[ 81], 99.50th=[ 85], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 158, max= 1117, per=25.12%, avg=362.03, stdev=205.49, samples=34 iops : min= 9, max= 69, avg=22.26, stdev=12.86, samples=34 lat (msec) : 10=21.48%, 20=36.33%, 50=35.03%, 100=6.90%, 250=0.26% cpu : usr=0.03%, sys=13.37%, ctx=1745, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1370KiB/s (1403kB/s), 330KiB/s-358KiB/s (338kB/s-367kB/s), io=23.4MiB (24.5MB), run=17270-17483msec WRITE: bw=1441KiB/s (1476kB/s), 345KiB/s-376KiB/s (354kB/s-385kB/s), io=24.6MiB (25.8MB), run=17270-17483msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194252: Tue Jun 30 21:12:52 2026 read: IOPS=2, BW=2690KiB/s (2754kB/s)(7168KiB/2665msec) clat (msec): min=77, max=1146, avg=283.69, stdev=383.90 lat (msec): min=77, max=1146, avg=283.70, stdev=383.90 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 103], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 138], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 236], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2048, max= 5145, per=73.33%, avg=3746.67, stdev=1570.19, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1921KiB/s (1967kB/s)(5120KiB/2665msec); 0 zone resets clat (msec): min=65, max=218, avg=125.81, stdev=77.32 lat (msec): min=66, max=218, avg=125.85, stdev=77.32 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 75], 60.00th=[ 75], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1715, max= 6144, per=46.05%, avg=3294.00, stdev=2472.97, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 lat (msec) : 100=33.33%, 250=58.33%, 2000=8.33% cpu : usr=0.00%, sys=16.03%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194253: Tue Jun 30 21:12:52 2026 read: IOPS=0, BW=538KiB/s (551kB/s)(2048KiB/3804msec) clat (msec): min=117, max=203, avg=160.46, stdev=60.20 lat (msec): min=117, max=203, avg=160.46, stdev=60.20 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 203], 95.00th=[ 203], | 99.00th=[ 203], 99.50th=[ 203], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 1715, max= 2048, per=36.83%, avg=1881.50, stdev=235.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2692KiB/s (2757kB/s)(10.0MiB/3804msec); 0 zone resets clat (msec): min=47, max=1539, avg=342.53, stdev=452.52 lat (msec): min=48, max=1539, avg=342.58, stdev=452.52 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 53], | 30.00th=[ 55], 40.00th=[ 146], 50.00th=[ 180], 60.00th=[ 215], | 70.00th=[ 255], 80.00th=[ 334], 90.00th=[ 600], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 1715, max= 6144, per=56.10%, avg=4012.75, stdev=2464.71, samples=4 iops : min= 1, max= 6, avg= 3.75, stdev= 2.63, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=17.90%, ctx=160, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194254: Tue Jun 30 21:12:52 2026 read: IOPS=1, BW=1533KiB/s (1570kB/s)(6144KiB/4008msec) clat (msec): min=26, max=405, avg=270.44, stdev=131.03 lat (msec): min=26, max=405, avg=270.44, stdev=131.03 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 27], 10.00th=[ 27], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 284], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2023, max= 4096, per=53.29%, avg=2722.33, stdev=1189.70, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1533KiB/s (1570kB/s)(6144KiB/4008msec); 0 zone resets clat (msec): min=28, max=1194, avg=395.56, stdev=440.19 lat (msec): min=28, max=1194, avg=395.63, stdev=440.21 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 29], 10.00th=[ 29], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 359], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 2023, max= 3407, per=33.29%, avg=2381.50, stdev=683.77, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 50=16.67%, 250=16.67%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=9.93%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194255: Tue Jun 30 21:12:52 2026 read: IOPS=1, BW=1534KiB/s (1571kB/s)(5120KiB/3338msec) clat (msec): min=65, max=205, avg=114.58, stdev=54.39 lat (msec): min=65, max=205, avg=114.58, stdev=54.39 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 93], 60.00th=[ 93], | 70.00th=[ 120], 80.00th=[ 120], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 2048, max= 6144, per=80.17%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2147KiB/s (2199kB/s)(7168KiB/3338msec); 0 zone resets clat (msec): min=62, max=1423, avg=384.87, stdev=466.59 lat (msec): min=62, max=1423, avg=384.92, stdev=466.58 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 133], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 253], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1715, max= 4047, per=34.45%, avg=2464.50, stdev=1066.61, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=25.00%, 2000=8.33% cpu : usr=0.03%, sys=19.90%, ctx=114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5110KiB/s (5232kB/s), 538KiB/s-2690KiB/s (551kB/s-2754kB/s), io=20.0MiB (20.0MB), run=2665-4008msec WRITE: bw=7154KiB/s (7325kB/s), 1533KiB/s-2692KiB/s (1570kB/s-2757kB/s), io=28.0MiB (29.4MB), run=2665-4008msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194257: Tue Jun 30 21:12:52 2026 read: IOPS=2, BW=2185KiB/s (2237kB/s)(7168KiB/3281msec) clat (usec): min=391, max=1205.9k, avg=288784.84, stdev=431408.48 lat (usec): min=392, max=1205.9k, avg=288785.81, stdev=431408.37 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 392], 10.00th=[ 392], | 20.00th=[ 478], 30.00th=[ 113771], 40.00th=[ 113771], | 50.00th=[ 124257], 60.00th=[ 126354], 70.00th=[ 126354], | 80.00th=[ 450888], 90.00th=[1199571], 95.00th=[1199571], | 99.00th=[1199571], 99.50th=[1199571], 99.90th=[1199571], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 1723, max= 4055, per=45.23%, avg=2369.40, stdev=951.68, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=1, BW=1560KiB/s (1598kB/s)(5120KiB/3281msec); 0 zone resets clat (msec): min=143, max=355, avg=218.65, stdev=93.69 lat (msec): min=143, max=355, avg=218.69, stdev=93.67 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1973, max= 4096, per=36.80%, avg=2698.67, stdev=1210.43, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 500=16.67% lat (msec) : 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=37.41%, ctx=1377, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194258: Tue Jun 30 21:12:52 2026 read: IOPS=0, BW=524KiB/s (536kB/s)(2048KiB/3909msec) clat (usec): min=465, max=350868, avg=175667.08, stdev=247772.63 lat (usec): min=465, max=350869, avg=175667.73, stdev=247772.97 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 465], | 30.00th=[ 465], 40.00th=[ 465], 50.00th=[ 465], 60.00th=[350225], | 70.00th=[350225], 80.00th=[350225], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 1709, max= 2027, per=35.66%, avg=1868.00, stdev=224.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2620KiB/s (2682kB/s)(10.0MiB/3909msec); 0 zone resets clat (msec): min=61, max=1651, avg=337.50, stdev=503.98 lat (msec): min=61, max=1651, avg=337.55, stdev=503.97 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 65], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 131], 60.00th=[ 131], | 70.00th=[ 161], 80.00th=[ 230], 90.00th=[ 751], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 2027, max= 8192, per=65.06%, avg=4771.67, stdev=3137.55, samples=3 iops : min= 1, max= 8, avg= 4.33, stdev= 3.51, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=31.88%, ctx=344, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194259: Tue Jun 30 21:12:52 2026 read: IOPS=2, BW=2158KiB/s (2210kB/s)(6144KiB/2847msec) clat (usec): min=346, max=219051, avg=60641.04, stdev=96365.39 lat (usec): min=347, max=219051, avg=60641.69, stdev=96365.31 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 437], 50.00th=[ 437], 60.00th=[ 437], | 70.00th=[143655], 80.00th=[143655], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 3946, max= 4055, per=76.36%, avg=4000.50, stdev=77.07, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2158KiB/s (2210kB/s)(6144KiB/2847msec); 0 zone resets clat (msec): min=132, max=1224, avg=391.13, stdev=417.59 lat (msec): min=132, max=1224, avg=391.17, stdev=417.61 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 313], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1698, max= 4055, per=33.32%, avg=2443.50, stdev=1084.82, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=33.33% lat (msec) : 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=33.49%, ctx=550, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194260: Tue Jun 30 21:12:52 2026 read: IOPS=1, BW=1396KiB/s (1430kB/s)(5120KiB/3667msec) clat (usec): min=336, max=198374, avg=94426.89, stdev=91170.78 lat (usec): min=337, max=198375, avg=94427.61, stdev=91170.98 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[111674], 60.00th=[111674], | 70.00th=[160433], 80.00th=[160433], 90.00th=[198181], 95.00th=[198181], | 99.00th=[198181], 99.50th=[198181], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 2027, max= 6144, per=77.98%, avg=4085.50, stdev=2911.16, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1955KiB/s (2002kB/s)(7168KiB/3667msec); 0 zone resets clat (msec): min=161, max=1176, avg=448.82, stdev=342.68 lat (msec): min=161, max=1176, avg=448.86, stdev=342.69 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 192], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 372], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 518], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1692, max= 4096, per=37.66%, avg=2761.80, stdev=1159.35, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (usec) : 500=16.67% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=32.19%, ctx=688, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5239KiB/s (5365kB/s), 524KiB/s-2185KiB/s (536kB/s-2237kB/s), io=20.0MiB (20.0MB), run=2847-3909msec WRITE: bw=7335KiB/s (7511kB/s), 1560KiB/s-2620KiB/s (1598kB/s-2682kB/s), io=28.0MiB (29.4MB), run=2847-3909msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194268: Tue Jun 30 21:13:02 2026 read: IOPS=1, BW=5194KiB/s (5318kB/s)(12.0MiB/2366msec) clat (msec): min=708, max=711, avg=710.34, stdev= 2.02 lat (msec): min=708, max=711, avg=710.34, stdev= 2.02 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=55.31%, ctx=2954, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194270: Tue Jun 30 21:13:02 2026 read: IOPS=0, BW=1268KiB/s (1299kB/s)(4096KiB/3230msec) clat (nsec): min=722448k, max=722448k, avg=722448021.00, stdev= 0.00 lat (nsec): min=722450k, max=722450k, avg=722450132.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2536KiB/s (2597kB/s)(8192KiB/3230msec); 0 zone resets clat (msec): min=940, max=1334, avg=1137.48, stdev=277.96 lat (msec): min=941, max=1334, avg=1137.74, stdev=278.15 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8192, max= 8192, per=80.76%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.60%, ctx=961, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194272: Tue Jun 30 21:13:02 2026 write: IOPS=0, BW=3857KiB/s (3949kB/s)(12.0MiB/3186msec); 0 zone resets clat (msec): min=350, max=1607, avg=982.47, stdev=628.10 lat (msec): min=351, max=1607, avg=982.84, stdev=628.02 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7641, max= 8192, per=78.04%, avg=7916.50, stdev=389.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.06%, sys=17.46%, ctx=123, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194274: Tue Jun 30 21:13:02 2026 write: IOPS=0, BW=3972KiB/s (4067kB/s)(12.0MiB/3094msec); 0 zone resets clat (msec): min=187, max=2304, avg=956.13, stdev=1171.18 lat (msec): min=187, max=2304, avg=956.46, stdev=1171.20 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7488, max= 8192, per=77.29%, avg=7840.00, stdev=497.80, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=17.14%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5072KiB/s (5194kB/s), 1268KiB/s-5194KiB/s (1299kB/s-5318kB/s), io=16.0MiB (16.8MB), run=2366-3230msec WRITE: bw=9.91MiB/s (10.4MB/s), 2536KiB/s-3972KiB/s (2597kB/s-4067kB/s), io=32.0MiB (33.6MB), run=3094-3230msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194267: Tue Jun 30 21:13:03 2026 read: IOPS=1, BW=4923KiB/s (5041kB/s)(12.0MiB/2496msec) clat (msec): min=716, max=810, avg=749.85, stdev=53.01 lat (msec): min=716, max=810, avg=749.85, stdev=53.01 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=24.85%, ctx=92, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194269: Tue Jun 30 21:13:03 2026 read: IOPS=0, BW=1147KiB/s (1175kB/s)(4096KiB/3571msec) clat (nsec): min=2233.0M, max=2233.0M, avg=2233952262.00, stdev= 0.00 lat (nsec): min=2233.0M, max=2233.0M, avg=2233953051.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2232], 5.00th=[ 2232], 10.00th=[ 2232], 20.00th=[ 2232], | 30.00th=[ 2232], 40.00th=[ 2232], 50.00th=[ 2232], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2294KiB/s (2349kB/s)(8192KiB/3571msec); 0 zone resets clat (msec): min=387, max=712, avg=549.78, stdev=229.77 lat (msec): min=387, max=712, avg=550.08, stdev=229.83 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8159, max= 8159, per=88.92%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=15.52%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194271: Tue Jun 30 21:13:03 2026 write: IOPS=0, BW=3447KiB/s (3530kB/s)(12.0MiB/3565msec); 0 zone resets clat (msec): min=211, max=2559, avg=1110.89, stdev=1266.51 lat (msec): min=211, max=2559, avg=1111.25, stdev=1266.48 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8159, max= 8159, per=88.92%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=18.04%, ctx=158, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194273: Tue Jun 30 21:13:03 2026 write: IOPS=0, BW=3733KiB/s (3822kB/s)(12.0MiB/3292msec); 0 zone resets clat (msec): min=766, max=1393, avg=1018.97, stdev=330.75 lat (msec): min=766, max=1393, avg=1019.31, stdev=330.69 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8175, max= 8192, per=89.18%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.03%, sys=16.13%, ctx=113, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4588KiB/s (4698kB/s), 1147KiB/s-4923KiB/s (1175kB/s-5041kB/s), io=16.0MiB (16.8MB), run=2496-3571msec WRITE: bw=9176KiB/s (9396kB/s), 2294KiB/s-3733KiB/s (2349kB/s-3822kB/s), io=32.0MiB (33.6MB), run=3292-3571msec