== sanity test 398b: DIO and buffer IO race ============== 07:51:04 (1781610664) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.6405 s, 19.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=167709: Tue Jun 16 07:52:01 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(5992KiB/48472msec) clat (usec): min=26, max=74715, avg=17351.51, stdev=8657.97 lat (usec): min=26, max=74715, avg=17352.04, stdev=8657.97 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 7635], 10.00th=[ 8848], 20.00th=[10421], | 30.00th=[11994], 40.00th=[13566], 50.00th=[15926], 60.00th=[18220], | 70.00th=[20317], 80.00th=[23200], 90.00th=[27395], 95.00th=[32375], | 99.00th=[47449], 99.50th=[53216], 99.90th=[63177], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 32, max= 184, per=24.84%, avg=122.97, stdev=25.02, samples=96 iops : min= 8, max= 46, avg=30.35, stdev= 6.22, samples=96 write: IOPS=32, BW=130KiB/s (133kB/s)(6296KiB/48472msec); 0 zone resets clat (usec): min=756, max=669290, avg=14155.55, stdev=19144.44 lat (usec): min=756, max=669291, avg=14156.21, stdev=19144.48 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 3097], 10.00th=[ 3425], 20.00th=[ 4080], | 30.00th=[ 6718], 40.00th=[ 10028], 50.00th=[ 11863], 60.00th=[ 14222], | 70.00th=[ 16909], 80.00th=[ 21365], 90.00th=[ 27919], 95.00th=[ 32375], | 99.00th=[ 41681], 99.50th=[ 44303], 99.90th=[ 54789], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 56, max= 224, per=24.94%, avg=129.17, stdev=30.20, samples=96 iops : min= 14, max= 56, avg=31.90, stdev= 7.61, samples=96 lat (usec) : 50=0.07%, 100=0.10%, 250=0.81%, 1000=0.26% lat (msec) : 2=0.62%, 4=9.05%, 10=17.84%, 20=43.68%, 50=27.05% lat (msec) : 100=0.49%, 750=0.03% cpu : usr=0.06%, sys=25.94%, ctx=9712, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167710: Tue Jun 16 07:52:01 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(5940KiB/48132msec) clat (usec): min=31, max=672487, avg=17469.30, stdev=18845.69 lat (usec): min=31, max=672488, avg=17469.95, stdev=18845.73 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 7504], 10.00th=[ 8979], 20.00th=[ 10683], | 30.00th=[ 12125], 40.00th=[ 13829], 50.00th=[ 15533], 60.00th=[ 17695], | 70.00th=[ 20317], 80.00th=[ 22414], 90.00th=[ 26870], 95.00th=[ 31065], | 99.00th=[ 44303], 99.50th=[ 51643], 99.90th=[ 80217], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 32, max= 176, per=24.86%, avg=123.04, stdev=26.00, samples=95 iops : min= 8, max= 44, avg=30.36, stdev= 6.52, samples=95 write: IOPS=32, BW=132KiB/s (135kB/s)(6348KiB/48132msec); 0 zone resets clat (usec): min=754, max=70783, avg=13861.42, stdev=10011.00 lat (usec): min=754, max=70784, avg=13862.08, stdev=10011.00 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 2933], 10.00th=[ 3326], 20.00th=[ 4146], | 30.00th=[ 6521], 40.00th=[ 9765], 50.00th=[11994], 60.00th=[14484], | 70.00th=[17695], 80.00th=[21627], 90.00th=[27919], 95.00th=[32900], | 99.00th=[43779], 99.50th=[47973], 99.90th=[59507], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 32, max= 207, per=25.24%, avg=130.74, stdev=33.10, samples=95 iops : min= 8, max= 51, avg=32.29, stdev= 8.26, samples=95 lat (usec) : 50=0.10%, 100=0.20%, 250=0.65%, 1000=0.39% lat (msec) : 2=0.78%, 4=8.50%, 10=18.20%, 20=43.91%, 50=26.82% lat (msec) : 100=0.42%, 750=0.03% cpu : usr=0.10%, sys=26.27%, ctx=9436, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167711: Tue Jun 16 07:52:01 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(6028KiB/48080msec) clat (usec): min=43, max=672806, avg=17718.13, stdev=18706.50 lat (usec): min=44, max=672807, avg=17718.75, stdev=18706.48 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 7570], 10.00th=[ 8979], 20.00th=[ 10945], | 30.00th=[ 12518], 40.00th=[ 14484], 50.00th=[ 16450], 60.00th=[ 18220], | 70.00th=[ 20317], 80.00th=[ 22938], 90.00th=[ 26870], 95.00th=[ 30802], | 99.00th=[ 42730], 99.50th=[ 51119], 99.90th=[ 76022], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 24, max= 192, per=25.31%, avg=125.27, stdev=26.91, samples=95 iops : min= 6, max= 48, avg=30.93, stdev= 6.75, samples=95 write: IOPS=32, BW=130KiB/s (133kB/s)(6260KiB/48080msec); 0 zone resets clat (usec): min=771, max=67062, avg=13545.12, stdev=10063.27 lat (usec): min=772, max=67063, avg=13545.80, stdev=10063.31 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2802], 10.00th=[ 3326], 20.00th=[ 3851], | 30.00th=[ 5473], 40.00th=[ 9241], 50.00th=[11338], 60.00th=[13698], | 70.00th=[17433], 80.00th=[22414], 90.00th=[27657], 95.00th=[32113], | 99.00th=[45351], 99.50th=[48497], 99.90th=[62129], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 40, max= 200, per=25.09%, avg=129.95, stdev=31.23, samples=95 iops : min= 10, max= 50, avg=32.09, stdev= 7.81, samples=95 lat (usec) : 50=0.03%, 100=0.26%, 250=0.75%, 500=0.07%, 1000=0.29% lat (msec) : 2=0.78%, 4=9.73%, 10=17.45%, 20=42.77%, 50=27.41% lat (msec) : 100=0.42%, 750=0.03% cpu : usr=0.09%, sys=25.90%, ctx=9443, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167712: Tue Jun 16 07:52:01 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(6052KiB/48073msec) clat (usec): min=30, max=670245, avg=17651.22, stdev=18673.14 lat (usec): min=31, max=670246, avg=17651.82, stdev=18673.12 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 7701], 10.00th=[ 8979], 20.00th=[ 10945], | 30.00th=[ 12387], 40.00th=[ 13960], 50.00th=[ 15926], 60.00th=[ 18220], | 70.00th=[ 20317], 80.00th=[ 22676], 90.00th=[ 26346], 95.00th=[ 31851], | 99.00th=[ 45876], 99.50th=[ 50594], 99.90th=[ 70779], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 40, max= 192, per=25.29%, avg=125.20, stdev=23.44, samples=95 iops : min= 10, max= 48, avg=30.91, stdev= 5.89, samples=95 write: IOPS=32, BW=130KiB/s (133kB/s)(6236KiB/48073msec); 0 zone resets clat (usec): min=737, max=60940, avg=13591.14, stdev=9717.22 lat (usec): min=737, max=60940, avg=13591.77, stdev=9717.25 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 3064], 10.00th=[ 3458], 20.00th=[ 4015], | 30.00th=[ 6390], 40.00th=[ 9634], 50.00th=[11863], 60.00th=[14091], | 70.00th=[16909], 80.00th=[20841], 90.00th=[26870], 95.00th=[32113], | 99.00th=[42730], 99.50th=[47973], 99.90th=[56886], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 48, max= 224, per=24.96%, avg=129.29, stdev=32.33, samples=95 iops : min= 12, max= 56, avg=31.93, stdev= 8.09, samples=95 lat (usec) : 50=0.07%, 100=0.13%, 250=0.68%, 750=0.03%, 1000=0.33% lat (msec) : 2=0.65%, 4=8.85%, 10=17.81%, 20=44.53%, 50=26.46% lat (msec) : 100=0.42%, 750=0.03% cpu : usr=0.06%, sys=26.30%, ctx=9614, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=495KiB/s (507kB/s), 123KiB/s-126KiB/s (126kB/s-129kB/s), io=23.4MiB (24.6MB), run=48073-48472msec WRITE: bw=519KiB/s (531kB/s), 130KiB/s-132KiB/s (133kB/s-135kB/s), io=24.6MiB (25.7MB), run=48073-48472msec rand-rw: (groupid=0, jobs=1): err= 0: pid=167714: Tue Jun 16 07:52:08 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(5992KiB/55293msec) clat (msec): min=2, max=684, avg=16.17, stdev=20.65 lat (msec): min=2, max=684, avg=16.17, stdev=20.65 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 33], 95.00th=[ 39], | 99.00th=[ 55], 99.50th=[ 63], 99.90th=[ 84], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5, max= 344, per=24.98%, avg=108.16, stdev=66.98, samples=109 iops : min= 1, max= 86, avg=26.71, stdev=16.84, samples=109 write: IOPS=28, BW=114KiB/s (117kB/s)(6296KiB/55293msec); 0 zone resets clat (usec): min=5172, max=86589, avg=19706.95, stdev=12992.40 lat (usec): min=5173, max=86590, avg=19707.62, stdev=12992.41 clat percentiles (usec): | 1.00th=[ 5669], 5.00th=[ 6521], 10.00th=[ 7177], 20.00th=[ 8586], | 30.00th=[10421], 40.00th=[12780], 50.00th=[15926], 60.00th=[20055], | 70.00th=[23725], 80.00th=[28967], 90.00th=[36963], 95.00th=[44827], | 99.00th=[64750], 99.50th=[70779], 99.90th=[80217], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 47, max= 335, per=25.21%, avg=114.21, stdev=66.26, samples=108 iops : min= 11, max= 83, avg=28.22, stdev=16.66, samples=108 lat (msec) : 4=0.39%, 10=32.75%, 20=33.43%, 50=30.73%, 100=2.67% lat (msec) : 750=0.03% cpu : usr=0.06%, sys=14.63%, ctx=6224, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167715: Tue Jun 16 07:52:08 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(5940KiB/55433msec) clat (msec): min=2, max=676, avg=16.43, stdev=20.68 lat (msec): min=2, max=676, avg=16.43, stdev=20.68 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 34], 95.00th=[ 41], | 99.00th=[ 54], 99.50th=[ 61], 99.90th=[ 73], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 5, max= 344, per=24.78%, avg=107.30, stdev=67.11, samples=110 iops : min= 1, max= 86, avg=26.50, stdev=16.89, samples=110 write: IOPS=28, BW=115KiB/s (117kB/s)(6348KiB/55433msec); 0 zone resets clat (usec): min=4017, max=91934, avg=19524.05, stdev=12885.26 lat (usec): min=4017, max=91934, avg=19524.74, stdev=12885.24 clat percentiles (usec): | 1.00th=[ 5276], 5.00th=[ 6325], 10.00th=[ 6980], 20.00th=[ 8356], | 30.00th=[10421], 40.00th=[12649], 50.00th=[16057], 60.00th=[19792], | 70.00th=[23725], 80.00th=[28705], 90.00th=[36963], 95.00th=[43254], | 99.00th=[65274], 99.50th=[71828], 99.90th=[90702], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 5, max= 359, per=25.23%, avg=114.29, stdev=68.25, samples=110 iops : min= 1, max= 89, avg=28.25, stdev=17.16, samples=110 lat (msec) : 4=0.62%, 10=33.20%, 20=32.75%, 50=31.38%, 100=2.02% lat (msec) : 750=0.03% cpu : usr=0.05%, sys=14.46%, ctx=6343, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167716: Tue Jun 16 07:52:08 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6028KiB/55272msec) clat (usec): min=3083, max=74171, avg=15686.33, stdev=11015.30 lat (usec): min=3083, max=74172, avg=15686.89, stdev=11015.29 clat percentiles (usec): | 1.00th=[ 3884], 5.00th=[ 4883], 10.00th=[ 5342], 20.00th=[ 6390], | 30.00th=[ 8356], 40.00th=[10421], 50.00th=[12125], 60.00th=[14222], | 70.00th=[17957], 80.00th=[24773], 90.00th=[32113], 95.00th=[38536], | 99.00th=[47973], 99.50th=[53216], 99.90th=[70779], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 39, max= 336, per=25.32%, avg=109.63, stdev=68.42, samples=108 iops : min= 9, max= 84, avg=27.07, stdev=17.19, samples=108 write: IOPS=28, BW=113KiB/s (116kB/s)(6260KiB/55272msec); 0 zone resets clat (msec): min=4, max=689, avg=20.18, stdev=21.38 lat (msec): min=4, max=689, avg=20.19, stdev=21.38 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 38], 95.00th=[ 45], | 99.00th=[ 65], 99.50th=[ 72], 99.90th=[ 96], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 10, max= 320, per=24.81%, avg=112.37, stdev=64.45, samples=109 iops : min= 2, max= 80, avg=27.76, stdev=16.23, samples=109 lat (msec) : 4=0.59%, 10=31.84%, 20=35.19%, 50=30.40%, 100=1.95% lat (msec) : 750=0.03% cpu : usr=0.05%, sys=14.58%, ctx=6316, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167717: Tue Jun 16 07:52:08 2026 read: IOPS=27, BW=110KiB/s (112kB/s)(6052KiB/55129msec) clat (usec): min=2969, max=78551, avg=15710.56, stdev=11114.62 lat (usec): min=2969, max=78551, avg=15711.12, stdev=11114.63 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 4948], 10.00th=[ 5473], 20.00th=[ 6718], | 30.00th=[ 8586], 40.00th=[10421], 50.00th=[12125], 60.00th=[14091], | 70.00th=[17957], 80.00th=[23462], 90.00th=[32375], 95.00th=[38536], | 99.00th=[52691], 99.50th=[58983], 99.90th=[73925], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 31, max= 352, per=25.55%, avg=110.65, stdev=65.01, samples=108 iops : min= 7, max= 88, avg=27.33, stdev=16.35, samples=108 write: IOPS=28, BW=113KiB/s (116kB/s)(6236KiB/55129msec); 0 zone resets clat (msec): min=4, max=687, avg=20.08, stdev=21.34 lat (msec): min=4, max=687, avg=20.08, stdev=21.34 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 65], 99.50th=[ 71], 99.90th=[ 132], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5, max= 368, per=24.96%, avg=113.06, stdev=67.04, samples=109 iops : min= 1, max= 92, avg=27.94, stdev=16.85, samples=109 lat (msec) : 4=0.36%, 10=32.52%, 20=34.54%, 50=30.44%, 100=2.08% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=14.65%, ctx=6421, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=433KiB/s (444kB/s), 107KiB/s-110KiB/s (110kB/s-112kB/s), io=23.4MiB (24.6MB), run=55129-55433msec WRITE: bw=454KiB/s (464kB/s), 113KiB/s-115KiB/s (116kB/s-117kB/s), io=24.6MiB (25.7MB), run=55129-55433msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=167744: Tue Jun 16 07:52:29 2026 read: IOPS=26, BW=417KiB/s (427kB/s)(5920KiB/14198msec) clat (usec): min=67, max=64476, avg=19076.45, stdev=9079.39 lat (usec): min=68, max=64477, avg=19076.98, stdev=9079.40 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 8848], 10.00th=[10552], 20.00th=[12387], | 30.00th=[14091], 40.00th=[15795], 50.00th=[17957], 60.00th=[19268], | 70.00th=[22152], 80.00th=[24773], 90.00th=[30540], 95.00th=[37487], | 99.00th=[50070], 99.50th=[51119], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 255, max= 605, per=25.75%, avg=417.14, stdev=88.54, samples=28 iops : min= 15, max= 37, avg=25.54, stdev= 5.55, samples=28 write: IOPS=28, BW=449KiB/s (459kB/s)(6368KiB/14198msec); 0 zone resets clat (usec): min=1351, max=54750, avg=17873.28, stdev=10831.21 lat (usec): min=1352, max=54751, avg=17874.40, stdev=10831.03 clat percentiles (usec): | 1.00th=[ 3195], 5.00th=[ 5080], 10.00th=[ 5669], 20.00th=[ 7767], | 30.00th=[10683], 40.00th=[13304], 50.00th=[15533], 60.00th=[18744], | 70.00th=[22152], 80.00th=[27395], 90.00th=[32375], 95.00th=[38011], | 99.00th=[49546], 99.50th=[52167], 99.90th=[54789], 99.95th=[54789], | 99.99th=[54789] bw ( KiB/s): min= 159, max= 672, per=26.33%, avg=448.71, stdev=103.86, samples=28 iops : min= 9, max= 42, avg=27.50, stdev= 6.50, samples=28 lat (usec) : 100=0.78%, 250=0.52%, 500=0.13%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.26%, 4=0.91%, 10=14.84%, 20=45.44%, 50=36.07% lat (msec) : 100=0.78% cpu : usr=0.05%, sys=28.08%, ctx=3097, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167745: Tue Jun 16 07:52:29 2026 read: IOPS=25, BW=412KiB/s (422kB/s)(5744KiB/13926msec) clat (usec): min=67, max=59733, avg=20215.76, stdev=9108.45 lat (usec): min=67, max=59734, avg=20216.28, stdev=9108.46 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 9372], 10.00th=[10683], 20.00th=[13173], | 30.00th=[14746], 40.00th=[16909], 50.00th=[19006], 60.00th=[21627], | 70.00th=[23725], 80.00th=[26346], 90.00th=[31589], 95.00th=[37487], | 99.00th=[48497], 99.50th=[53740], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 224, max= 638, per=25.55%, avg=413.93, stdev=94.17, samples=27 iops : min= 14, max= 39, avg=25.33, stdev= 5.79, samples=27 write: IOPS=29, BW=470KiB/s (481kB/s)(6544KiB/13926msec); 0 zone resets clat (usec): min=1287, max=62619, avg=16072.93, stdev=9918.05 lat (usec): min=1288, max=62619, avg=16073.90, stdev=9918.01 clat percentiles (usec): | 1.00th=[ 2933], 5.00th=[ 4883], 10.00th=[ 5342], 20.00th=[ 7046], | 30.00th=[ 9765], 40.00th=[11863], 50.00th=[13698], 60.00th=[16057], | 70.00th=[19792], 80.00th=[23462], 90.00th=[31327], 95.00th=[36439], | 99.00th=[42730], 99.50th=[46924], 99.90th=[62653], 99.95th=[62653], | 99.99th=[62653] bw ( KiB/s): min= 286, max= 733, per=27.39%, avg=466.70, stdev=97.07, samples=27 iops : min= 17, max= 45, avg=28.63, stdev= 6.10, samples=27 lat (usec) : 100=0.13%, 250=1.17% lat (msec) : 2=0.26%, 4=1.04%, 10=17.84%, 20=42.45%, 50=36.72% lat (msec) : 100=0.39% cpu : usr=0.06%, sys=28.98%, ctx=3110, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167746: Tue Jun 16 07:52:29 2026 read: IOPS=26, BW=423KiB/s (433kB/s)(6256KiB/14781msec) clat (usec): min=89, max=55153, avg=20624.08, stdev=9794.06 lat (usec): min=90, max=55153, avg=20624.61, stdev=9794.06 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 7308], 10.00th=[10683], 20.00th=[13566], | 30.00th=[15533], 40.00th=[17171], 50.00th=[19268], 60.00th=[20841], | 70.00th=[23725], 80.00th=[27395], 90.00th=[33817], 95.00th=[39060], | 99.00th=[54264], 99.50th=[54789], 99.90th=[55313], 99.95th=[55313], | 99.99th=[55313] bw ( KiB/s): min= 256, max= 672, per=26.17%, avg=424.00, stdev=95.85, samples=29 iops : min= 16, max= 42, avg=25.97, stdev= 5.86, samples=29 write: IOPS=25, BW=408KiB/s (418kB/s)(6032KiB/14781msec); 0 zone resets clat (usec): min=2254, max=60477, avg=17627.43, stdev=11035.05 lat (usec): min=2255, max=60478, avg=17628.39, stdev=11035.12 clat percentiles (usec): | 1.00th=[ 3785], 5.00th=[ 4686], 10.00th=[ 5276], 20.00th=[ 8225], | 30.00th=[10945], 40.00th=[12911], 50.00th=[15401], 60.00th=[18220], | 70.00th=[20579], 80.00th=[25822], 90.00th=[32113], 95.00th=[38011], | 99.00th=[57934], 99.50th=[60031], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 223, max= 704, per=23.56%, avg=401.52, stdev=100.22, samples=29 iops : min= 13, max= 44, avg=24.55, stdev= 6.52, samples=29 lat (usec) : 100=0.39%, 250=1.56% lat (msec) : 2=0.13%, 4=0.91%, 10=13.67%, 20=44.40%, 50=37.24% lat (msec) : 100=1.69% cpu : usr=0.07%, sys=27.38%, ctx=3219, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167747: Tue Jun 16 07:52:29 2026 read: IOPS=26, BW=424KiB/s (435kB/s)(6032KiB/14212msec) clat (usec): min=36, max=74590, avg=20194.04, stdev=9983.54 lat (usec): min=36, max=74590, avg=20198.03, stdev=9981.27 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 7832], 10.00th=[10814], 20.00th=[13304], | 30.00th=[15008], 40.00th=[16581], 50.00th=[19006], 60.00th=[21365], | 70.00th=[23200], 80.00th=[26608], 90.00th=[30802], 95.00th=[37487], | 99.00th=[56361], 99.50th=[58983], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 255, max= 608, per=26.06%, avg=422.11, stdev=77.78, samples=28 iops : min= 15, max= 38, avg=25.82, stdev= 4.99, samples=28 write: IOPS=27, BW=440KiB/s (451kB/s)(6256KiB/14212msec); 0 zone resets clat (usec): min=1826, max=51782, avg=16734.84, stdev=9974.97 lat (usec): min=1826, max=51783, avg=16736.46, stdev=9974.40 clat percentiles (usec): | 1.00th=[ 3621], 5.00th=[ 4817], 10.00th=[ 5473], 20.00th=[ 7177], | 30.00th=[10683], 40.00th=[13042], 50.00th=[14877], 60.00th=[17433], | 70.00th=[19792], 80.00th=[24511], 90.00th=[30016], 95.00th=[35914], | 99.00th=[48497], 99.50th=[51119], 99.90th=[51643], 99.95th=[51643], | 99.99th=[51643] bw ( KiB/s): min= 287, max= 764, per=25.94%, avg=442.07, stdev=104.71, samples=28 iops : min= 17, max= 47, avg=27.07, stdev= 6.59, samples=28 lat (usec) : 50=0.13%, 100=0.13%, 250=1.95% lat (msec) : 2=0.13%, 4=0.65%, 10=14.84%, 20=44.79%, 50=36.20% lat (msec) : 100=1.17% cpu : usr=0.08%, sys=28.08%, ctx=3109, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1620KiB/s (1659kB/s), 412KiB/s-424KiB/s (422kB/s-435kB/s), io=23.4MiB (24.5MB), run=13926-14781msec WRITE: bw=1705KiB/s (1746kB/s), 408KiB/s-470KiB/s (418kB/s-481kB/s), io=24.6MiB (25.8MB), run=13926-14781msec rand-rw: (groupid=0, jobs=1): err= 0: pid=167739: Tue Jun 16 07:52:30 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(5920KiB/15906msec) clat (usec): min=3957, max=69183, avg=18035.86, stdev=12011.25 lat (usec): min=3958, max=69183, avg=18036.36, stdev=12011.26 clat percentiles (usec): | 1.00th=[ 5014], 5.00th=[ 6259], 10.00th=[ 7373], 20.00th=[ 8979], | 30.00th=[10552], 40.00th=[12256], 50.00th=[13698], 60.00th=[16319], | 70.00th=[19792], 80.00th=[24249], 90.00th=[35914], 95.00th=[45876], | 99.00th=[56886], 99.50th=[60556], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 159, max= 830, per=24.08%, avg=359.71, stdev=152.34, samples=31 iops : min= 9, max= 51, avg=21.94, stdev= 9.57, samples=31 write: IOPS=25, BW=400KiB/s (410kB/s)(6368KiB/15906msec); 0 zone resets clat (usec): min=6413, max=82909, avg=23120.20, stdev=13864.92 lat (usec): min=6414, max=82910, avg=23121.32, stdev=13865.00 clat percentiles (usec): | 1.00th=[ 6980], 5.00th=[ 8094], 10.00th=[ 8848], 20.00th=[11338], | 30.00th=[13435], 40.00th=[16909], 50.00th=[20055], 60.00th=[23200], | 70.00th=[27395], 80.00th=[33424], 90.00th=[41681], 95.00th=[49021], | 99.00th=[74974], 99.50th=[76022], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 127, max= 1021, per=25.12%, avg=394.94, stdev=174.81, samples=31 iops : min= 7, max= 63, avg=24.13, stdev=10.96, samples=31 lat (msec) : 4=0.13%, 10=20.05%, 20=39.71%, 50=36.59%, 100=3.52% cpu : usr=0.04%, sys=14.95%, ctx=1791, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167740: Tue Jun 16 07:52:30 2026 read: IOPS=22, BW=358KiB/s (367kB/s)(5744KiB/16023msec) clat (usec): min=3222, max=70840, avg=18304.05, stdev=12217.08 lat (usec): min=3223, max=70841, avg=18305.10, stdev=12216.52 clat percentiles (usec): | 1.00th=[ 3785], 5.00th=[ 5866], 10.00th=[ 6718], 20.00th=[ 8979], | 30.00th=[10814], 40.00th=[12387], 50.00th=[14353], 60.00th=[16450], | 70.00th=[20317], 80.00th=[26084], 90.00th=[36439], 95.00th=[45351], | 99.00th=[56361], 99.50th=[59507], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 191, max= 830, per=22.98%, avg=343.26, stdev=130.28, samples=31 iops : min= 11, max= 51, avg=20.90, stdev= 8.19, samples=31 write: IOPS=25, BW=408KiB/s (418kB/s)(6544KiB/16023msec); 0 zone resets clat (usec): min=4970, max=71147, avg=22988.30, stdev=13317.45 lat (usec): min=4971, max=71148, avg=22989.30, stdev=13317.50 clat percentiles (usec): | 1.00th=[ 5604], 5.00th=[ 7308], 10.00th=[ 8586], 20.00th=[11076], | 30.00th=[14222], 40.00th=[16319], 50.00th=[20317], 60.00th=[22676], | 70.00th=[27657], 80.00th=[34341], 90.00th=[43254], 95.00th=[49021], | 99.00th=[60556], 99.50th=[61604], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 223, max= 1056, per=24.72%, avg=388.58, stdev=176.99, samples=31 iops : min= 13, max= 66, avg=23.74, stdev=11.14, samples=31 lat (msec) : 4=0.91%, 10=19.01%, 20=37.89%, 50=38.67%, 100=3.52% cpu : usr=0.06%, sys=14.64%, ctx=1820, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167741: Tue Jun 16 07:52:30 2026 read: IOPS=24, BW=392KiB/s (401kB/s)(6256KiB/15964msec) clat (usec): min=3435, max=73178, avg=18992.63, stdev=12776.70 lat (usec): min=3435, max=73179, avg=18993.28, stdev=12776.70 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 6128], 10.00th=[ 6915], 20.00th=[ 8717], | 30.00th=[11076], 40.00th=[12911], 50.00th=[14353], 60.00th=[17957], | 70.00th=[21627], 80.00th=[28705], 90.00th=[36439], 95.00th=[45351], | 99.00th=[63177], 99.50th=[67634], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 192, max= 1341, per=25.81%, avg=385.61, stdev=218.01, samples=31 iops : min= 12, max= 83, avg=23.55, stdev=13.61, samples=31 write: IOPS=23, BW=378KiB/s (387kB/s)(6032KiB/15964msec); 0 zone resets clat (usec): min=5238, max=76720, avg=22538.67, stdev=13011.26 lat (usec): min=5239, max=76721, avg=22539.79, stdev=13011.29 clat percentiles (usec): | 1.00th=[ 5473], 5.00th=[ 7701], 10.00th=[ 8979], 20.00th=[11076], | 30.00th=[13960], 40.00th=[16188], 50.00th=[19530], 60.00th=[23200], | 70.00th=[26608], 80.00th=[32113], 90.00th=[40109], 95.00th=[48497], | 99.00th=[67634], 99.50th=[69731], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 191, max= 800, per=22.95%, avg=360.74, stdev=132.44, samples=31 iops : min= 11, max= 50, avg=22.00, stdev= 8.41, samples=31 lat (msec) : 4=0.39%, 10=19.79%, 20=38.54%, 50=37.50%, 100=3.78% cpu : usr=0.06%, sys=14.83%, ctx=1781, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167742: Tue Jun 16 07:52:30 2026 read: IOPS=23, BW=379KiB/s (388kB/s)(6032KiB/15907msec) clat (usec): min=3717, max=60350, avg=18326.97, stdev=11558.49 lat (usec): min=3718, max=60350, avg=18327.68, stdev=11558.38 clat percentiles (usec): | 1.00th=[ 5211], 5.00th=[ 5997], 10.00th=[ 7177], 20.00th=[ 8979], | 30.00th=[10683], 40.00th=[12387], 50.00th=[14484], 60.00th=[16909], | 70.00th=[20317], 80.00th=[28181], 90.00th=[35914], 95.00th=[43254], | 99.00th=[53740], 99.50th=[55837], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 159, max= 990, per=24.70%, avg=369.00, stdev=183.11, samples=31 iops : min= 9, max= 61, avg=22.52, stdev=11.59, samples=31 write: IOPS=24, BW=393KiB/s (403kB/s)(6256KiB/15907msec); 0 zone resets clat (usec): min=6354, max=82009, avg=22968.90, stdev=13201.06 lat (usec): min=6355, max=82010, avg=22970.18, stdev=13200.96 clat percentiles (usec): | 1.00th=[ 6521], 5.00th=[ 7701], 10.00th=[ 8717], 20.00th=[11600], | 30.00th=[13829], 40.00th=[16712], 50.00th=[20317], 60.00th=[22676], | 70.00th=[27395], 80.00th=[33424], 90.00th=[40109], 95.00th=[47973], | 99.00th=[66847], 99.50th=[74974], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 160, max= 1053, per=24.53%, avg=385.65, stdev=168.70, samples=31 iops : min= 10, max= 65, avg=23.55, stdev=10.52, samples=31 lat (msec) : 4=0.13%, 10=19.79%, 20=38.67%, 50=39.06%, 100=2.34% cpu : usr=0.10%, sys=14.82%, ctx=1872, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1495KiB/s (1531kB/s), 358KiB/s-392KiB/s (367kB/s-401kB/s), io=23.4MiB (24.5MB), run=15906-16023msec WRITE: bw=1573KiB/s (1610kB/s), 378KiB/s-408KiB/s (387kB/s-418kB/s), io=24.6MiB (25.8MB), run=15906-16023msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=167755: Tue Jun 16 07:52:42 2026 read: IOPS=1, BW=2006KiB/s (2054kB/s)(7168KiB/3573msec) clat (usec): min=652, max=426144, avg=132643.34, stdev=143291.18 lat (usec): min=653, max=426145, avg=132644.37, stdev=143290.99 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 734], | 30.00th=[ 87557], 40.00th=[ 87557], 50.00th=[132645], 60.00th=[135267], | 70.00th=[135267], 80.00th=[145753], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 2048, max= 5840, per=87.79%, avg=3884.00, stdev=1898.85, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1433KiB/s (1467kB/s)(5120KiB/3573msec); 0 zone resets clat (msec): min=283, max=796, avg=525.06, stdev=203.18 lat (msec): min=283, max=796, avg=525.11, stdev=203.19 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1892, max= 2048, per=32.12%, avg=1989.25, stdev=74.77, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=46.08%, ctx=689, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167757: Tue Jun 16 07:52:42 2026 read: IOPS=0, BW=442KiB/s (453kB/s)(2048KiB/4629msec) clat (msec): min=59, max=148, avg=104.23, stdev=62.83 lat (msec): min=59, max=148, avg=104.23, stdev=62.83 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 148], 95.00th=[ 148], | 99.00th=[ 148], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 1892, max= 1906, per=42.92%, avg=1899.00, stdev= 9.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2212KiB/s (2265kB/s)(10.0MiB/4629msec); 0 zone resets clat (msec): min=246, max=1012, avg=437.22, stdev=227.67 lat (msec): min=246, max=1012, avg=437.31, stdev=227.66 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 271], | 30.00th=[ 326], 40.00th=[ 334], 50.00th=[ 342], 60.00th=[ 351], | 70.00th=[ 380], 80.00th=[ 542], 90.00th=[ 575], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1802, max= 4096, per=41.93%, avg=2597.00, stdev=1048.56, samples=6 iops : min= 1, max= 4, avg= 2.00, stdev= 1.26, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=49.42%, ctx=299, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167759: Tue Jun 16 07:52:42 2026 read: IOPS=1, BW=1619KiB/s (1658kB/s)(6144KiB/3794msec) clat (usec): min=693, max=339989, avg=206232.54, stdev=139930.27 lat (usec): min=695, max=339991, avg=206233.76, stdev=139930.30 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 61604], | 30.00th=[ 61604], 40.00th=[250610], 50.00th=[250610], 60.00th=[287310], | 70.00th=[295699], 80.00th=[295699], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 1969, max= 3785, per=71.71%, avg=3172.67, stdev=1042.46, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1619KiB/s (1658kB/s)(6144KiB/3794msec); 0 zone resets clat (msec): min=172, max=963, avg=423.68, stdev=302.46 lat (msec): min=173, max=963, avg=423.75, stdev=302.44 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 334], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1802, max= 3750, per=37.01%, avg=2292.20, stdev=820.02, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=47.43%, ctx=346, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167760: Tue Jun 16 07:52:42 2026 read: IOPS=1, BW=1436KiB/s (1471kB/s)(5120KiB/3565msec) clat (usec): min=471, max=340021, avg=68472.37, stdev=151800.63 lat (usec): min=471, max=340022, avg=68473.15, stdev=151800.98 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 474], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 627], 60.00th=[ 627], | 70.00th=[ 734], 80.00th=[ 734], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7571, max= 7571, per=100.00%, avg=7571.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2011KiB/s (2059kB/s)(7168KiB/3565msec); 0 zone resets clat (msec): min=213, max=696, avg=450.61, stdev=176.34 lat (msec): min=213, max=696, avg=450.68, stdev=176.35 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 284], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 447], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 651], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1889, max= 4096, per=39.75%, avg=2461.50, stdev=1090.30, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 500=8.33%, 750=25.00% lat (msec) : 250=8.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=43.74%, ctx=250, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4424KiB/s (4530kB/s), 442KiB/s-2006KiB/s (453kB/s-2054kB/s), io=20.0MiB (20.0MB), run=3565-4629msec WRITE: bw=6194KiB/s (6343kB/s), 1433KiB/s-2212KiB/s (1467kB/s-2265kB/s), io=28.0MiB (29.4MB), run=3565-4629msec rand-rw: (groupid=0, jobs=1): err= 0: pid=167756: Tue Jun 16 07:52:42 2026 read: IOPS=1, BW=1712KiB/s (1753kB/s)(7168KiB/4186msec) clat (msec): min=54, max=419, avg=232.96, stdev=157.29 lat (msec): min=54, max=419, avg=232.97, stdev=157.29 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 108], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 161], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 405], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1825, max= 5862, per=76.21%, avg=3245.00, stdev=2269.13, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1223KiB/s (1252kB/s)(5120KiB/4186msec); 0 zone resets clat (msec): min=149, max=1161, avg=506.29, stdev=415.23 lat (msec): min=149, max=1161, avg=506.36, stdev=415.21 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1973, max= 2048, per=33.83%, avg=2016.75, stdev=35.44, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=20.84%, ctx=209, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167758: Tue Jun 16 07:52:42 2026 read: IOPS=0, BW=426KiB/s (436kB/s)(2048KiB/4809msec) clat (msec): min=148, max=486, avg=317.22, stdev=238.77 lat (msec): min=148, max=486, avg=317.23, stdev=238.77 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1973, max= 2048, per=47.22%, avg=2010.50, stdev=53.03, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2129KiB/s (2180kB/s)(10.0MiB/4809msec); 0 zone resets clat (msec): min=25, max=720, avg=409.97, stdev=251.73 lat (msec): min=25, max=720, avg=410.04, stdev=251.74 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 26], 10.00th=[ 26], 20.00th=[ 29], | 30.00th=[ 199], 40.00th=[ 368], 50.00th=[ 447], 60.00th=[ 498], | 70.00th=[ 527], 80.00th=[ 609], 90.00th=[ 676], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1783, max= 2048, per=32.88%, avg=1960.43, stdev=111.02, samples=7 iops : min= 1, max= 2, avg= 1.29, stdev= 0.49, samples=7 lat (msec) : 50=16.67%, 250=16.67%, 500=33.33%, 750=33.33% cpu : usr=0.02%, sys=23.27%, ctx=189, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167761: Tue Jun 16 07:52:42 2026 read: IOPS=1, BW=1293KiB/s (1325kB/s)(6144KiB/4750msec) clat (msec): min=50, max=1032, avg=337.98, stdev=392.73 lat (msec): min=50, max=1032, avg=337.98, stdev=392.73 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 165], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1825, max= 4096, per=58.55%, avg=2493.00, stdev=1073.00, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1293KiB/s (1325kB/s)(6144KiB/4750msec); 0 zone resets clat (msec): min=59, max=917, avg=444.47, stdev=298.43 lat (msec): min=59, max=917, avg=444.55, stdev=298.42 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 502], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1825, max= 4096, per=41.98%, avg=2503.00, stdev=1067.08, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=25.00%, 250=16.67%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=17.56%, ctx=221, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167762: Tue Jun 16 07:52:42 2026 read: IOPS=1, BW=1121KiB/s (1148kB/s)(5120KiB/4567msec) clat (msec): min=92, max=356, avg=175.81, stdev=106.89 lat (msec): min=92, max=356, avg=175.81, stdev=106.89 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 3946, max= 4087, per=94.33%, avg=4016.50, stdev=99.70, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1570KiB/s (1607kB/s)(7168KiB/4567msec); 0 zone resets clat (msec): min=177, max=855, avg=518.33, stdev=269.92 lat (msec): min=177, max=855, avg=518.42, stdev=269.90 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 205], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 477], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 810], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1825, max= 2048, per=33.18%, avg=1978.40, stdev=91.08, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=21.59%, ctx=449, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4259KiB/s (4361kB/s), 426KiB/s-1712KiB/s (436kB/s-1753kB/s), io=20.0MiB (20.0MB), run=4186-4809msec WRITE: bw=5962KiB/s (6105kB/s), 1223KiB/s-2129KiB/s (1252kB/s-2180kB/s), io=28.0MiB (29.4MB), run=4186-4809msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=167768: Tue Jun 16 07:52:50 2026 read: IOPS=2, BW=8911KiB/s (9125kB/s)(12.0MiB/1379msec) clat (msec): min=371, max=522, avg=446.76, stdev=75.54 lat (msec): min=371, max=522, avg=446.76, stdev=75.54 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7223, max= 8110, per=85.92%, avg=7666.50, stdev=627.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=59.94%, ctx=2763, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167769: Tue Jun 16 07:52:50 2026 read: IOPS=0, BW=2231KiB/s (2284kB/s)(4096KiB/1836msec) clat (nsec): min=392908k, max=392908k, avg=392907763.00, stdev= 0.00 lat (nsec): min=392909k, max=392909k, avg=392909497.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7249, max= 7249, per=81.24%, avg=7249.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4462KiB/s (4569kB/s)(8192KiB/1836msec); 0 zone resets clat (msec): min=636, max=792, avg=714.50, stdev=110.87 lat (msec): min=636, max=793, avg=714.76, stdev=110.86 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8159, max= 8159, per=50.87%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.35%, ctx=1039, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167770: Tue Jun 16 07:52:50 2026 write: IOPS=1, BW=6015KiB/s (6159kB/s)(12.0MiB/2043msec); 0 zone resets clat (msec): min=135, max=1303, avg=665.68, stdev=591.14 lat (msec): min=135, max=1303, avg=665.97, stdev=591.15 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8159, max= 8159, per=50.87%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.61%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167771: Tue Jun 16 07:52:50 2026 write: IOPS=1, BW=8165KiB/s (8361kB/s)(12.0MiB/1505msec); 0 zone resets clat (msec): min=444, max=560, avg=491.39, stdev=61.44 lat (msec): min=444, max=561, avg=491.71, stdev=61.45 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7393, max= 8110, per=48.33%, avg=7751.50, stdev=507.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=25.66%, ctx=157, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8924KiB/s (9138kB/s), 2231KiB/s-8911KiB/s (2284kB/s-9125kB/s), io=16.0MiB (16.8MB), run=1379-1836msec WRITE: bw=15.7MiB/s (16.4MB/s), 4462KiB/s-8165KiB/s (4569kB/s-8361kB/s), io=32.0MiB (33.6MB), run=1505-2043msec rand-rw: (groupid=0, jobs=1): err= 0: pid=167773: Tue Jun 16 07:52:50 2026 read: IOPS=1, BW=6888KiB/s (7053kB/s)(12.0MiB/1784msec) clat (msec): min=139, max=879, avg=584.50, stdev=392.52 lat (msec): min=139, max=879, avg=584.50, stdev=392.52 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8192, max= 8192, per=98.96%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.03%, ctx=70, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167774: Tue Jun 16 07:52:50 2026 read: IOPS=0, BW=2070KiB/s (2119kB/s)(4096KiB/1979msec) clat (nsec): min=387666k, max=387666k, avg=387665748.00, stdev= 0.00 lat (nsec): min=387667k, max=387667k, avg=387667356.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7249, max= 7249, per=87.57%, avg=7249.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4139KiB/s (4239kB/s)(8192KiB/1979msec); 0 zone resets clat (msec): min=545, max=1032, avg=788.81, stdev=344.11 lat (msec): min=545, max=1032, avg=789.10, stdev=344.08 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8159, max= 8159, per=49.28%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.40%, ctx=90, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167775: Tue Jun 16 07:52:50 2026 write: IOPS=1, BW=7461KiB/s (7640kB/s)(12.0MiB/1647msec); 0 zone resets clat (msec): min=178, max=734, avg=540.50, stdev=313.63 lat (msec): min=178, max=735, avg=540.76, stdev=313.72 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8159, max= 8192, per=49.38%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.06%, sys=18.47%, ctx=95, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=167776: Tue Jun 16 07:52:50 2026 write: IOPS=1, BW=7539KiB/s (7720kB/s)(12.0MiB/1630msec); 0 zone resets clat (msec): min=381, max=731, avg=537.64, stdev=177.91 lat (msec): min=381, max=731, avg=537.94, stdev=177.87 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8159, max= 8192, per=49.38%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=17.56%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8279KiB/s (8478kB/s), 2070KiB/s-6888KiB/s (2119kB/s-7053kB/s), io=16.0MiB (16.8MB), run=1784-1979msec WRITE: bw=16.2MiB/s (16.0MB/s), 4139KiB/s-7539KiB/s (4239kB/s-7720kB/s), io=32.0MiB (33.6MB), run=1630-1979msec