== sanity test 398b: DIO and buffer IO race ============== 01:18:27 (1780809507) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.11904 s, 16.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154680: Sun Jun 7 01:19:24 2026 read: IOPS=31, BW=124KiB/s (127kB/s)(5992KiB/48153msec) clat (usec): min=30, max=712511, avg=16929.50, stdev=20969.62 lat (usec): min=31, max=712512, avg=16930.19, stdev=20969.64 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 4686], 10.00th=[ 6980], 20.00th=[ 8979], | 30.00th=[ 10421], 40.00th=[ 12125], 50.00th=[ 14222], 60.00th=[ 16712], | 70.00th=[ 19006], 80.00th=[ 22152], 90.00th=[ 29492], 95.00th=[ 36439], | 99.00th=[ 54264], 99.50th=[ 60031], 99.90th=[114820], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 216, per=24.59%, avg=122.46, stdev=41.28, samples=95 iops : min= 1, max= 54, avg=30.20, stdev=10.45, samples=95 write: IOPS=32, BW=131KiB/s (134kB/s)(6296KiB/48153msec); 0 zone resets clat (usec): min=610, max=85323, avg=14358.01, stdev=11471.30 lat (usec): min=611, max=85323, avg=14358.78, stdev=11471.32 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 2507], 10.00th=[ 3032], 20.00th=[ 4047], | 30.00th=[ 6325], 40.00th=[ 9241], 50.00th=[11600], 60.00th=[14615], | 70.00th=[18220], 80.00th=[22938], 90.00th=[29230], 95.00th=[35914], | 99.00th=[53216], 99.50th=[61604], 99.90th=[81265], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 47, max= 223, per=24.96%, avg=130.04, stdev=41.63, samples=94 iops : min= 11, max= 55, avg=32.11, stdev=10.51, samples=94 lat (usec) : 50=0.29%, 100=0.68%, 250=1.17%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.62% lat (msec) : 2=0.65%, 4=8.76%, 10=22.95%, 20=38.09%, 50=25.39% lat (msec) : 100=1.17%, 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=28.25%, ctx=9399, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154682: Sun Jun 7 01:19:24 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(5940KiB/47410msec) clat (usec): min=28, max=61243, avg=16173.44, stdev=9459.38 lat (usec): min=28, max=61244, avg=16174.12, stdev=9459.43 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 5145], 10.00th=[ 7308], 20.00th=[ 8979], | 30.00th=[10421], 40.00th=[12256], 50.00th=[14353], 60.00th=[16450], | 70.00th=[19006], 80.00th=[22414], 90.00th=[28705], 95.00th=[35390], | 99.00th=[46924], 99.50th=[51643], 99.90th=[60031], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 7, max= 247, per=25.09%, avg=124.95, stdev=43.73, samples=94 iops : min= 1, max= 61, avg=30.82, stdev=11.02, samples=94 write: IOPS=33, BW=134KiB/s (137kB/s)(6348KiB/47410msec); 0 zone resets clat (usec): min=689, max=710032, avg=14626.63, stdev=21117.30 lat (usec): min=690, max=710033, avg=14627.49, stdev=21117.29 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 2311], 10.00th=[ 2933], 20.00th=[ 3884], | 30.00th=[ 5932], 40.00th=[ 8848], 50.00th=[ 11731], 60.00th=[ 14484], | 70.00th=[ 18220], 80.00th=[ 22414], 90.00th=[ 29230], 95.00th=[ 35390], | 99.00th=[ 49021], 99.50th=[ 58983], 99.90th=[162530], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 47, max= 240, per=25.84%, avg=134.65, stdev=42.96, samples=93 iops : min= 11, max= 60, avg=33.25, stdev=10.87, samples=93 lat (usec) : 50=0.07%, 100=0.65%, 250=1.30%, 500=0.03%, 750=0.20% lat (usec) : 1000=0.42% lat (msec) : 2=1.40%, 4=8.76%, 10=23.31%, 20=37.37%, 50=25.72% lat (msec) : 100=0.68%, 250=0.07%, 750=0.03% cpu : usr=0.11%, sys=28.50%, ctx=9218, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154684: Sun Jun 7 01:19:24 2026 read: IOPS=31, BW=127KiB/s (130kB/s)(6028KiB/47504msec) clat (usec): min=27, max=144763, avg=16029.34, stdev=9885.23 lat (usec): min=28, max=144763, avg=16030.09, stdev=9885.26 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 302], 10.00th=[ 7046], 20.00th=[ 9241], | 30.00th=[ 10814], 40.00th=[ 12518], 50.00th=[ 14353], 60.00th=[ 16450], | 70.00th=[ 18744], 80.00th=[ 21890], 90.00th=[ 28181], 95.00th=[ 32900], | 99.00th=[ 45351], 99.50th=[ 52167], 99.90th=[ 89654], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 31, max= 232, per=25.66%, avg=127.76, stdev=43.94, samples=93 iops : min= 7, max= 58, avg=31.53, stdev=11.09, samples=93 write: IOPS=32, BW=132KiB/s (135kB/s)(6260KiB/47504msec); 0 zone resets clat (usec): min=684, max=694042, avg=14802.60, stdev=20725.75 lat (usec): min=684, max=694044, avg=14803.52, stdev=20725.80 clat percentiles (usec): | 1.00th=[ 955], 5.00th=[ 2573], 10.00th=[ 3064], 20.00th=[ 4113], | 30.00th=[ 6325], 40.00th=[ 9110], 50.00th=[ 11994], 60.00th=[ 14615], | 70.00th=[ 18220], 80.00th=[ 21890], 90.00th=[ 28705], 95.00th=[ 36439], | 99.00th=[ 53216], 99.50th=[ 62129], 99.90th=[111674], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 39, max= 223, per=25.39%, avg=132.30, stdev=39.39, samples=93 iops : min= 9, max= 55, avg=32.67, stdev= 9.94, samples=93 lat (usec) : 50=0.23%, 100=0.75%, 250=1.46%, 500=0.03%, 750=0.20% lat (usec) : 1000=0.33% lat (msec) : 2=0.94%, 4=8.53%, 10=21.61%, 20=40.98%, 50=24.09% lat (msec) : 100=0.72%, 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=28.48%, ctx=9141, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154686: Sun Jun 7 01:19:24 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(6052KiB/48216msec) clat (usec): min=38, max=144276, avg=16676.17, stdev=11020.56 lat (usec): min=39, max=144277, avg=16677.14, stdev=11020.61 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 4178], 10.00th=[ 7111], 20.00th=[ 9110], | 30.00th=[ 10683], 40.00th=[ 12518], 50.00th=[ 14615], 60.00th=[ 16909], | 70.00th=[ 19268], 80.00th=[ 22938], 90.00th=[ 28967], 95.00th=[ 35914], | 99.00th=[ 51643], 99.50th=[ 69731], 99.90th=[100140], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 24, max= 240, per=25.39%, avg=126.42, stdev=41.73, samples=95 iops : min= 6, max= 60, avg=31.19, stdev=10.51, samples=95 write: IOPS=32, BW=129KiB/s (132kB/s)(6236KiB/48216msec); 0 zone resets clat (usec): min=694, max=701219, avg=14612.87, stdev=20565.03 lat (usec): min=694, max=701220, avg=14613.67, stdev=20565.09 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 2606], 10.00th=[ 3130], 20.00th=[ 4178], | 30.00th=[ 6521], 40.00th=[ 9503], 50.00th=[ 11600], 60.00th=[ 14484], | 70.00th=[ 18482], 80.00th=[ 22414], 90.00th=[ 28443], 95.00th=[ 33817], | 99.00th=[ 50594], 99.50th=[ 62129], 99.90th=[ 90702], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 32, max= 239, per=24.98%, avg=130.13, stdev=41.56, samples=95 iops : min= 8, max= 59, avg=32.12, stdev=10.48, samples=95 lat (usec) : 50=0.10%, 100=0.91%, 250=1.24%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=0.81%, 4=8.43%, 10=22.27%, 20=38.74%, 50=25.65% lat (msec) : 100=1.20%, 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=28.55%, ctx=9499, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=498KiB/s (510kB/s), 124KiB/s-127KiB/s (127kB/s-130kB/s), io=23.4MiB (24.6MB), run=47410-48216msec WRITE: bw=521KiB/s (534kB/s), 129KiB/s-134KiB/s (132kB/s-137kB/s), io=24.6MiB (25.7MB), run=47410-48216msec fio: pid=154687, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=154681: Sun Jun 7 01:19:46 2026 read: IOPS=21, BW=85.4KiB/s (87.5kB/s)(5992KiB/70141msec) clat (msec): min=2, max=720, avg=14.15, stdev=22.31 lat (msec): min=2, max=720, avg=14.15, stdev=22.31 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 40], | 99.00th=[ 61], 99.50th=[ 73], 99.90th=[ 146], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 23, max= 232, per=25.34%, avg=85.64, stdev=43.21, samples=138 iops : min= 5, max= 58, avg=21.20, stdev=10.94, samples=138 write: IOPS=22, BW=89.8KiB/s (91.9kB/s)(6296KiB/70141msec); 0 zone resets clat (msec): min=11, max=174, avg=30.98, stdev=15.05 lat (msec): min=11, max=174, avg=30.98, stdev=15.05 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 30], | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 60], | 99.00th=[ 90], 99.50th=[ 97], 99.90th=[ 130], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 24, max= 184, per=25.38%, avg=89.86, stdev=40.55, samples=138 iops : min= 6, max= 46, avg=22.26, stdev=10.28, samples=138 lat (msec) : 4=6.15%, 10=19.89%, 20=22.82%, 50=44.95%, 100=5.89% lat (msec) : 250=0.26%, 750=0.03% cpu : usr=0.06%, sys=10.90%, ctx=6191, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154683: Sun Jun 7 01:19:46 2026 read: IOPS=21, BW=84.2KiB/s (86.2kB/s)(5940KiB/70539msec) clat (msec): min=2, max=676, avg=14.25, stdev=21.23 lat (msec): min=2, max=676, avg=14.26, stdev=21.23 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 41], | 99.00th=[ 58], 99.50th=[ 70], 99.90th=[ 106], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 216, per=25.03%, avg=84.60, stdev=46.21, samples=139 iops : min= 1, max= 54, avg=20.95, stdev=11.67, samples=139 write: IOPS=22, BW=89.0KiB/s (92.2kB/s)(6348KiB/70539msec); 0 zone resets clat (msec): min=11, max=145, avg=31.00, stdev=14.86 lat (msec): min=11, max=145, avg=31.00, stdev=14.86 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 89], 99.50th=[ 106], 99.90th=[ 129], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 24, max= 176, per=25.45%, avg=90.09, stdev=39.89, samples=139 iops : min= 6, max= 44, avg=22.32, stdev=10.12, samples=139 lat (msec) : 4=4.79%, 10=21.22%, 20=22.72%, 50=45.21%, 100=5.70% lat (msec) : 250=0.33%, 750=0.03% cpu : usr=0.08%, sys=10.72%, ctx=6003, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154685: Sun Jun 7 01:19:46 2026 read: IOPS=21, BW=85.3KiB/s (87.4kB/s)(6028KiB/70643msec) clat (usec): min=2515, max=93478, avg=13944.04, stdev=12999.27 lat (usec): min=2515, max=93479, avg=13944.73, stdev=12999.26 clat percentiles (usec): | 1.00th=[ 2999], 5.00th=[ 3490], 10.00th=[ 3851], 20.00th=[ 4817], | 30.00th=[ 5800], 40.00th=[ 6980], 50.00th=[ 8979], 60.00th=[11469], | 70.00th=[15533], 80.00th=[20841], 90.00th=[30802], 95.00th=[39060], | 99.00th=[66847], 99.50th=[73925], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 15, max= 256, per=25.27%, avg=85.42, stdev=45.13, samples=139 iops : min= 3, max= 64, avg=21.15, stdev=11.41, samples=139 write: IOPS=22, BW=88.6KiB/s (90.7kB/s)(6260KiB/70643msec); 0 zone resets clat (msec): min=10, max=688, avg=31.60, stdev=22.65 lat (msec): min=10, max=688, avg=31.60, stdev=22.65 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 27], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 59], | 99.00th=[ 88], 99.50th=[ 105], 99.90th=[ 176], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 23, max= 168, per=24.99%, avg=88.46, stdev=40.30, samples=139 iops : min= 5, max= 42, avg=21.91, stdev=10.23, samples=139 lat (msec) : 4=5.47%, 10=21.16%, 20=22.07%, 50=45.05%, 100=5.89% lat (msec) : 250=0.33%, 750=0.03% cpu : usr=0.08%, sys=10.72%, ctx=6105, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=154687: Sun Jun 7 01:19:46 2026 read: IOPS=21, BW=85.0KiB/s (88.0kB/s)(5976KiB/69503msec) clat (msec): min=2, max=130, avg=13.83, stdev=13.25 lat (msec): min=2, max=130, avg=13.83, stdev=13.25 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 31], 95.00th=[ 41], | 99.00th=[ 64], 99.50th=[ 74], 99.90th=[ 93], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 15, max= 216, per=25.57%, avg=86.44, stdev=45.33, samples=137 iops : min= 3, max= 54, avg=21.40, stdev=11.46, samples=137 write: IOPS=22, BW=88.8KiB/s (90.9kB/s)(6172KiB/69503msec); 0 zone resets clat (msec): min=11, max=686, avg=31.54, stdev=22.37 lat (msec): min=11, max=686, avg=31.54, stdev=22.37 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 34], 80.00th=[ 41], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 85], 99.50th=[ 94], 99.90th=[ 174], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 23, max= 168, per=25.18%, avg=89.12, stdev=40.08, samples=137 iops : min= 5, max= 42, avg=22.07, stdev=10.17, samples=137 lat (msec) : 4=5.89%, 10=20.61%, 20=21.79%, 50=45.56%, 100=5.89% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.08%, sys=10.94%, ctx=6128, majf=0, minf=22 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1495,1543,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=339KiB/s (347kB/s), 84.2KiB/s-85.0KiB/s (86.2kB/s-88.0kB/s), io=23.4MiB (24.5MB), run=69503-70643msec WRITE: bw=355KiB/s (363kB/s), 88.6KiB/s-89.0KiB/s (90.7kB/s-92.2kB/s), io=24.5MiB (25.7MB), run=69503-70643msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154716: Sun Jun 7 01:20:08 2026 read: IOPS=22, BW=366KiB/s (375kB/s)(5920KiB/16185msec) clat (usec): min=64, max=80649, avg=21876.47, stdev=13599.32 lat (usec): min=65, max=80650, avg=21877.40, stdev=13599.80 clat percentiles (usec): | 1.00th=[ 86], 5.00th=[ 206], 10.00th=[ 7832], 20.00th=[10945], | 30.00th=[14615], 40.00th=[17433], 50.00th=[19792], 60.00th=[22938], | 70.00th=[26608], 80.00th=[31065], 90.00th=[38011], 95.00th=[45876], | 99.00th=[70779], 99.50th=[80217], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 127, max= 640, per=24.79%, avg=361.66, stdev=140.23, samples=32 iops : min= 7, max= 40, avg=22.13, stdev= 8.86, samples=32 write: IOPS=24, BW=393KiB/s (403kB/s)(6368KiB/16185msec); 0 zone resets clat (usec): min=1125, max=68013, avg=20272.10, stdev=14032.85 lat (usec): min=1126, max=68014, avg=20273.27, stdev=14032.90 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 4146], 10.00th=[ 4686], 20.00th=[ 7308], | 30.00th=[10028], 40.00th=[13698], 50.00th=[17171], 60.00th=[20841], | 70.00th=[26084], 80.00th=[32637], 90.00th=[39060], 95.00th=[47449], | 99.00th=[62653], 99.50th=[65274], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 127, max= 704, per=25.44%, avg=390.44, stdev=140.14, samples=32 iops : min= 7, max= 44, avg=23.91, stdev= 8.84, samples=32 lat (usec) : 100=0.91%, 250=1.82%, 500=0.26% lat (msec) : 2=0.65%, 4=1.95%, 10=17.58%, 20=30.86%, 50=42.58% lat (msec) : 100=3.39% cpu : usr=0.08%, sys=30.35%, ctx=3136, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154717: Sun Jun 7 01:20:08 2026 read: IOPS=22, BW=361KiB/s (370kB/s)(5744KiB/15892msec) clat (usec): min=54, max=74608, avg=23064.53, stdev=13172.76 lat (usec): min=55, max=74609, avg=23067.16, stdev=13170.98 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 7439], 10.00th=[ 9241], 20.00th=[11863], | 30.00th=[15008], 40.00th=[18220], 50.00th=[20841], 60.00th=[24511], | 70.00th=[28443], 80.00th=[32900], 90.00th=[40633], 95.00th=[48497], | 99.00th=[60556], 99.50th=[74974], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 127, max= 702, per=24.61%, avg=359.10, stdev=143.43, samples=31 iops : min= 7, max= 43, avg=21.94, stdev= 8.98, samples=31 write: IOPS=25, BW=412KiB/s (422kB/s)(6544KiB/15892msec); 0 zone resets clat (usec): min=901, max=80688, avg=18427.99, stdev=12835.08 lat (usec): min=902, max=80689, avg=18429.21, stdev=12835.20 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 4228], 10.00th=[ 4948], 20.00th=[ 7504], | 30.00th=[10028], 40.00th=[12256], 50.00th=[15795], 60.00th=[18482], | 70.00th=[22676], 80.00th=[28181], 90.00th=[35914], 95.00th=[42730], | 99.00th=[59507], 99.50th=[61604], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 160, max= 823, per=26.39%, avg=405.03, stdev=163.51, samples=31 iops : min= 10, max= 51, avg=24.84, stdev=10.22, samples=31 lat (usec) : 100=0.26%, 250=1.69%, 500=0.13%, 1000=0.26% lat (msec) : 2=0.13%, 4=1.56%, 10=18.75%, 20=33.85%, 50=40.23% lat (msec) : 100=3.12% cpu : usr=0.11%, sys=31.26%, ctx=3079, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154718: Sun Jun 7 01:20:08 2026 read: IOPS=23, BW=381KiB/s (390kB/s)(6256KiB/16410msec) clat (usec): min=56, max=82328, avg=21442.83, stdev=12739.79 lat (usec): min=56, max=82329, avg=21443.56, stdev=12739.90 clat percentiles (usec): | 1.00th=[ 86], 5.00th=[ 182], 10.00th=[ 5866], 20.00th=[11469], | 30.00th=[14615], 40.00th=[17171], 50.00th=[20317], 60.00th=[23462], | 70.00th=[27395], 80.00th=[31327], 90.00th=[37487], 95.00th=[43779], | 99.00th=[54789], 99.50th=[76022], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 194, max= 768, per=25.30%, avg=369.19, stdev=134.00, samples=32 iops : min= 12, max= 48, avg=22.59, stdev= 8.43, samples=32 write: IOPS=22, BW=368KiB/s (376kB/s)(6032KiB/16410msec); 0 zone resets clat (usec): min=957, max=92738, avg=21151.17, stdev=15320.11 lat (usec): min=957, max=92739, avg=21152.47, stdev=15320.21 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 3392], 10.00th=[ 4883], 20.00th=[ 8356], | 30.00th=[11469], 40.00th=[14484], 50.00th=[17695], 60.00th=[20317], | 70.00th=[26346], 80.00th=[32900], 90.00th=[41157], 95.00th=[50594], | 99.00th=[71828], 99.50th=[80217], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 601, per=22.54%, avg=346.03, stdev=108.68, samples=32 iops : min= 9, max= 37, avg=21.12, stdev= 6.85, samples=32 lat (usec) : 100=0.91%, 250=2.73%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=2.60%, 10=14.06%, 20=32.68%, 50=42.58% lat (msec) : 100=3.39% cpu : usr=0.07%, sys=29.57%, ctx=3008, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154719: Sun Jun 7 01:20:08 2026 read: IOPS=23, BW=376KiB/s (385kB/s)(6032KiB/16033msec) clat (usec): min=44, max=85057, avg=23190.75, stdev=13577.18 lat (usec): min=44, max=85058, avg=23191.40, stdev=13577.24 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 233], 10.00th=[ 9110], 20.00th=[12125], | 30.00th=[15795], 40.00th=[18482], 50.00th=[21365], 60.00th=[24249], | 70.00th=[27919], 80.00th=[33424], 90.00th=[40633], 95.00th=[49546], | 99.00th=[61604], 99.50th=[83362], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 96, max= 638, per=25.07%, avg=365.81, stdev=131.10, samples=31 iops : min= 6, max= 39, avg=22.35, stdev= 8.17, samples=31 write: IOPS=24, BW=390KiB/s (400kB/s)(6256KiB/16033msec); 0 zone resets clat (usec): min=993, max=68429, avg=18438.97, stdev=13200.40 lat (usec): min=994, max=68430, avg=18440.23, stdev=13200.54 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3916], 10.00th=[ 5014], 20.00th=[ 7767], | 30.00th=[ 9372], 40.00th=[11863], 50.00th=[15008], 60.00th=[18482], | 70.00th=[22676], 80.00th=[27657], 90.00th=[35390], 95.00th=[45876], | 99.00th=[61080], 99.50th=[67634], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 191, max= 702, per=24.87%, avg=381.77, stdev=136.90, samples=31 iops : min= 11, max= 43, avg=23.35, stdev= 8.57, samples=31 lat (usec) : 50=0.13%, 100=0.52%, 250=2.08%, 1000=0.13% lat (msec) : 2=0.65%, 4=2.08%, 10=17.97%, 20=30.60%, 50=42.06% lat (msec) : 100=3.78% cpu : usr=0.07%, sys=31.11%, ctx=3058, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1460KiB/s (1495kB/s), 361KiB/s-381KiB/s (370kB/s-390kB/s), io=23.4MiB (24.5MB), run=15892-16410msec WRITE: bw=1536KiB/s (1573kB/s), 368KiB/s-412KiB/s (376kB/s-422kB/s), io=24.6MiB (25.8MB), run=15892-16410msec fio: pid=154721, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=154720: Sun Jun 7 01:20:13 2026 read: IOPS=17, BW=280KiB/s (287kB/s)(5920KiB/21136msec) clat (msec): min=2, max=114, avg=18.69, stdev=19.64 lat (msec): min=2, max=114, avg=18.69, stdev=19.64 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 68], | 99.00th=[ 89], 99.50th=[ 103], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 95, max= 864, per=25.45%, avg=270.59, stdev=174.47, samples=41 iops : min= 5, max= 54, avg=16.37, stdev=11.13, samples=41 write: IOPS=18, BW=301KiB/s (309kB/s)(6368KiB/21136msec); 0 zone resets clat (msec): min=11, max=139, avg=35.38, stdev=20.24 lat (msec): min=11, max=139, avg=35.38, stdev=20.24 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 64], 95.00th=[ 81], | 99.00th=[ 107], 99.50th=[ 122], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 63, max= 704, per=26.27%, avg=290.32, stdev=166.22, samples=41 iops : min= 3, max= 44, avg=17.61, stdev=10.67, samples=41 lat (msec) : 4=7.42%, 10=14.71%, 20=20.70%, 50=43.62%, 100=12.76% lat (msec) : 250=0.78% cpu : usr=0.05%, sys=11.87%, ctx=1842, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=154721: Sun Jun 7 01:20:13 2026 read: IOPS=14, BW=236KiB/s (241kB/s)(4272KiB/18125msec) clat (msec): min=3, max=111, avg=22.25, stdev=19.28 lat (msec): min=3, max=111, avg=22.25, stdev=19.28 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 24], 80.00th=[ 36], 90.00th=[ 48], 95.00th=[ 63], | 99.00th=[ 94], 99.50th=[ 99], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 55, max= 672, per=21.64%, avg=230.06, stdev=132.73, samples=35 iops : min= 3, max= 42, avg=13.74, stdev= 8.46, samples=35 write: IOPS=16, BW=260KiB/s (266kB/s)(4704KiB/18125msec); 0 zone resets clat (msec): min=16, max=135, avg=41.05, stdev=20.24 lat (msec): min=16, max=135, avg=41.05, stdev=20.24 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 56], 90.00th=[ 68], 95.00th=[ 79], | 99.00th=[ 125], 99.50th=[ 134], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 95, max= 576, per=22.96%, avg=253.74, stdev=107.12, samples=35 iops : min= 5, max= 36, avg=15.23, stdev= 6.89, samples=35 lat (msec) : 4=1.42%, 10=12.28%, 20=18.33%, 50=50.89%, 100=15.66% lat (msec) : 250=1.25% cpu : usr=0.06%, sys=12.71%, ctx=1442, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=268,294,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154722: Sun Jun 7 01:20:13 2026 read: IOPS=18, BW=300KiB/s (307kB/s)(6256KiB/20884msec) clat (msec): min=2, max=107, avg=18.21, stdev=19.36 lat (msec): min=2, max=107, avg=18.21, stdev=19.36 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 11], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 60], | 99.00th=[ 93], 99.50th=[ 95], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 94, max= 1152, per=28.12%, avg=298.88, stdev=220.93, samples=41 iops : min= 5, max= 72, avg=18.15, stdev=14.05, samples=41 write: IOPS=18, BW=289KiB/s (296kB/s)(6032KiB/20884msec); 0 zone resets clat (msec): min=14, max=133, avg=36.44, stdev=19.42 lat (msec): min=14, max=133, avg=36.45, stdev=19.43 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 65], 95.00th=[ 77], | 99.00th=[ 112], 99.50th=[ 118], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 95, max= 672, per=25.68%, avg=283.76, stdev=155.39, samples=41 iops : min= 5, max= 42, avg=17.20, stdev=10.00, samples=41 lat (msec) : 4=7.29%, 10=17.84%, 20=16.41%, 50=44.79%, 100=12.89% lat (msec) : 250=0.78% cpu : usr=0.07%, sys=12.12%, ctx=1856, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154723: Sun Jun 7 01:20:13 2026 read: IOPS=17, BW=287KiB/s (294kB/s)(6032KiB/21031msec) clat (msec): min=2, max=106, avg=19.20, stdev=18.97 lat (msec): min=2, max=106, avg=19.21, stdev=18.97 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 47], 95.00th=[ 59], | 99.00th=[ 88], 99.50th=[ 102], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 110, max= 960, per=26.08%, avg=277.27, stdev=178.79, samples=41 iops : min= 6, max= 60, avg=16.78, stdev=11.41, samples=41 write: IOPS=18, BW=297KiB/s (305kB/s)(6256KiB/21031msec); 0 zone resets clat (msec): min=13, max=119, avg=34.96, stdev=18.33 lat (msec): min=13, max=119, avg=34.96, stdev=18.33 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 59], 95.00th=[ 75], | 99.00th=[ 103], 99.50th=[ 112], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 126, max= 640, per=26.20%, avg=289.51, stdev=158.73, samples=41 iops : min= 7, max= 40, avg=17.56, stdev=10.24, samples=41 lat (msec) : 4=6.51%, 10=15.63%, 20=19.14%, 50=46.35%, 100=11.46% lat (msec) : 250=0.91% cpu : usr=0.05%, sys=11.95%, ctx=1852, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1064KiB/s (1089kB/s), 236KiB/s-300KiB/s (241kB/s-307kB/s), io=21.0MiB (23.0MB), run=18125-21136msec WRITE: bw=1105KiB/s (1132kB/s), 260KiB/s-301KiB/s (266kB/s-309kB/s), io=22.8MiB (23.9MB), run=18125-21136msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154731: Sun Jun 7 01:20:20 2026 read: IOPS=3, BW=3749KiB/s (3839kB/s)(7168KiB/1912msec) clat (usec): min=522, max=208629, avg=125402.83, stdev=70940.93 lat (usec): min=524, max=208631, avg=125403.86, stdev=70940.85 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 83362], | 30.00th=[112722], 40.00th=[112722], 50.00th=[121111], 60.00th=[156238], | 70.00th=[156238], 80.00th=[193987], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 4096, max= 5094, per=62.92%, avg=4595.00, stdev=705.69, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2678KiB/s (2742kB/s)(5120KiB/1912msec); 0 zone resets clat (msec): min=123, max=264, avg=201.17, stdev=52.41 lat (msec): min=123, max=264, avg=201.21, stdev=52.41 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 2048, max= 6144, per=40.06%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=52.96%, ctx=724, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154732: Sun Jun 7 01:20:20 2026 read: IOPS=0, BW=730KiB/s (748kB/s)(2048KiB/2804msec) clat (usec): min=561, max=99332, avg=49947.12, stdev=69842.01 lat (usec): min=562, max=99334, avg=49948.47, stdev=69841.75 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[ 562], 60.00th=[99091], | 70.00th=[99091], 80.00th=[99091], 90.00th=[99091], 95.00th=[99091], | 99.00th=[99091], 99.50th=[99091], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 1703, max= 2048, per=25.68%, avg=1875.50, stdev=243.95, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3652KiB/s (3740kB/s)(10.0MiB/2804msec); 0 zone resets clat (msec): min=166, max=381, avg=268.29, stdev=79.80 lat (msec): min=167, max=381, avg=268.37, stdev=79.75 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 176], | 30.00th=[ 205], 40.00th=[ 224], 50.00th=[ 230], 60.00th=[ 268], | 70.00th=[ 326], 80.00th=[ 334], 90.00th=[ 372], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1703, max= 6131, per=35.19%, avg=3598.20, stdev=1814.51, samples=5 iops : min= 1, max= 5, avg= 3.00, stdev= 1.87, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=41.67% cpu : usr=0.07%, sys=40.35%, ctx=141, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154733: Sun Jun 7 01:20:20 2026 read: IOPS=2, BW=2737KiB/s (2802kB/s)(6144KiB/2245msec) clat (usec): min=422, max=222514, avg=70476.51, stdev=94556.89 lat (usec): min=423, max=222516, avg=70477.43, stdev=94556.99 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 429], | 30.00th=[ 429], 40.00th=[ 7373], 50.00th=[ 7373], 60.00th=[ 39060], | 70.00th=[152044], 80.00th=[152044], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 1965, max= 4096, per=46.36%, avg=3385.67, stdev=1230.33, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2737KiB/s (2802kB/s)(6144KiB/2245msec); 0 zone resets clat (msec): min=135, max=629, avg=301.79, stdev=179.70 lat (msec): min=135, max=629, avg=301.84, stdev=179.69 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 321], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2048, max= 3930, per=27.93%, avg=2855.50, stdev=957.57, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 lat (usec) : 500=16.67% lat (msec) : 10=8.33%, 50=8.33%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=33.87%, ctx=354, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154734: Sun Jun 7 01:20:20 2026 read: IOPS=2, BW=2424KiB/s (2482kB/s)(5120KiB/2112msec) clat (usec): min=359, max=280615, avg=133990.11, stdev=127369.07 lat (usec): min=360, max=280615, avg=133990.89, stdev=127369.08 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 408], 40.00th=[ 408], 50.00th=[179307], 60.00th=[179307], | 70.00th=[208667], 80.00th=[208667], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 4096, max= 4096, per=56.09%, avg=4096.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3394KiB/s (3475kB/s)(7168KiB/2112msec); 0 zone resets clat (msec): min=88, max=324, avg=201.54, stdev=85.97 lat (msec): min=88, max=324, avg=201.60, stdev=85.99 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 153], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 178], 60.00th=[ 209], | 70.00th=[ 209], 80.00th=[ 309], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 3413, max= 4096, per=36.72%, avg=3754.50, stdev=482.95, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 lat (usec) : 500=16.67% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=46.90%, ctx=487, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7304KiB/s (7479kB/s), 730KiB/s-3749KiB/s (748kB/s-3839kB/s), io=20.0MiB (20.0MB), run=1912-2804msec WRITE: bw=9.99MiB/s (10.5MB/s), 2678KiB/s-3652KiB/s (2742kB/s-3740kB/s), io=28.0MiB (29.4MB), run=1912-2804msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154736: Sun Jun 7 01:20:20 2026 read: IOPS=2, BW=2902KiB/s (2972kB/s)(7168KiB/2470msec) clat (msec): min=44, max=381, avg=172.98, stdev=137.39 lat (msec): min=44, max=381, avg=172.98, stdev=137.39 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 74], 50.00th=[ 130], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 351], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 2048, max= 4096, per=42.12%, avg=3152.33, stdev=1033.41, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2073KiB/s (2123kB/s)(5120KiB/2470msec); 0 zone resets clat (msec): min=134, max=396, avg=247.12, stdev=107.15 lat (msec): min=134, max=396, avg=247.18, stdev=107.16 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2048, max= 4096, per=29.32%, avg=3072.00, stdev=1448.15, samples=2 iops : min= 2, max= 4, avg= 3.00, stdev= 1.41, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=41.67% cpu : usr=0.04%, sys=16.52%, ctx=136, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154737: Sun Jun 7 01:20:20 2026 read: IOPS=0, BW=749KiB/s (767kB/s)(2048KiB/2736msec) clat (msec): min=105, max=158, avg=131.80, stdev=37.71 lat (msec): min=105, max=158, avg=131.81, stdev=37.71 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 1812, max= 2048, per=25.78%, avg=1930.00, stdev=166.88, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3743KiB/s (3833kB/s)(10.0MiB/2736msec); 0 zone resets clat (msec): min=83, max=409, avg=232.23, stdev=110.21 lat (msec): min=83, max=409, avg=232.31, stdev=110.20 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 103], | 30.00th=[ 120], 40.00th=[ 211], 50.00th=[ 218], 60.00th=[ 245], | 70.00th=[ 259], 80.00th=[ 313], 90.00th=[ 368], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1812, max= 4096, per=30.82%, avg=3229.60, stdev=1189.30, samples=5 iops : min= 1, max= 4, avg= 3.00, stdev= 1.41, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=19.38%, ctx=597, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154738: Sun Jun 7 01:20:20 2026 read: IOPS=2, BW=2489KiB/s (2549kB/s)(6144KiB/2468msec) clat (msec): min=49, max=215, avg=96.00, stdev=65.54 lat (msec): min=49, max=215, avg=96.01, stdev=65.54 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 50], 40.00th=[ 63], 50.00th=[ 63], 60.00th=[ 71], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 4096, max= 4096, per=54.72%, avg=4096.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2489KiB/s (2549kB/s)(6144KiB/2468msec); 0 zone resets clat (msec): min=81, max=545, avg=288.02, stdev=211.62 lat (msec): min=81, max=545, avg=288.09, stdev=211.62 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 279], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1762, max= 2048, per=18.86%, avg=1976.50, stdev=143.00, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (msec) : 50=16.67%, 100=33.33%, 250=25.00%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=15.36%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154739: Sun Jun 7 01:20:20 2026 read: IOPS=1, BW=1893KiB/s (1939kB/s)(5120KiB/2704msec) clat (msec): min=51, max=180, avg=102.05, stdev=53.27 lat (msec): min=51, max=180, avg=102.05, stdev=53.27 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 54], 40.00th=[ 54], 50.00th=[ 108], 60.00th=[ 108], | 70.00th=[ 117], 80.00th=[ 117], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 4096, max= 4096, per=54.72%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2651KiB/s (2715kB/s)(7168KiB/2704msec); 0 zone resets clat (msec): min=131, max=721, avg=288.05, stdev=211.98 lat (msec): min=131, max=721, avg=288.10, stdev=211.98 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 146], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 182], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 397], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1721, max= 4096, per=22.83%, avg=2392.20, stdev=962.92, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=17.49%, ctx=135, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7485KiB/s (7665kB/s), 749KiB/s-2902KiB/s (767kB/s-2972kB/s), io=20.0MiB (20.0MB), run=2468-2736msec WRITE: bw=10.2MiB/s (10.7MB/s), 2073KiB/s-3743KiB/s (2123kB/s-3833kB/s), io=28.0MiB (29.4MB), run=2468-2736msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154744: Sun Jun 7 01:20:28 2026 read: IOPS=2, BW=8354KiB/s (8554kB/s)(12.0MiB/1471msec) clat (msec): min=373, max=676, avg=480.84, stdev=169.55 lat (msec): min=373, max=676, avg=480.84, stdev=169.55 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8192, max= 8192, per=73.55%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=16.60%, ctx=84, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154745: Sun Jun 7 01:20:28 2026 read: IOPS=1, BW=4802KiB/s (4917kB/s)(4096KiB/853msec) clat (nsec): min=185917k, max=185917k, avg=185917396.00, stdev= 0.00 lat (nsec): min=185920k, max=185920k, avg=185919701.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 7249, max= 7249, per=65.08%, avg=7249.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=2, BW=9604KiB/s (9834kB/s)(8192KiB/853msec); 0 zone resets clat (msec): min=257, max=378, avg=318.26, stdev=85.57 lat (msec): min=257, max=379, avg=318.47, stdev=85.62 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=31.34%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154746: Sun Jun 7 01:20:28 2026 write: IOPS=1, BW=6080KiB/s (6226kB/s)(12.0MiB/2021msec); 0 zone resets clat (msec): min=84, max=1671, avg=663.02, stdev=876.75 lat (msec): min=85, max=1672, avg=663.30, stdev=876.76 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] lat (msec) : 100=33.33%, 250=33.33%, 2000=33.33% cpu : usr=0.10%, sys=14.16%, ctx=95, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154747: Sun Jun 7 01:20:28 2026 write: IOPS=2, BW=8504KiB/s (8708kB/s)(12.0MiB/1445msec); 0 zone resets clat (msec): min=107, max=1134, avg=472.05, stdev=574.41 lat (msec): min=107, max=1134, avg=472.39, stdev=574.32 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min=14550, max=14550, per=89.74%, avg=14550.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.07%, sys=16.34%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.9MiB/s (11.4MB/s), 4802KiB/s-8354KiB/s (4917kB/s-8554kB/s), io=16.0MiB (16.8MB), run=853-1471msec WRITE: bw=15.8MiB/s (16.6MB/s), 6080KiB/s-9604KiB/s (6226kB/s-9834kB/s), io=32.0MiB (33.6MB), run=853-2021msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154749: Sun Jun 7 01:20:28 2026 read: IOPS=2, BW=9630KiB/s (9861kB/s)(12.0MiB/1276msec) clat (msec): min=381, max=466, avg=410.58, stdev=48.68 lat (msec): min=381, max=466, avg=410.58, stdev=48.68 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7713, max= 8175, per=61.87%, avg=7944.00, stdev=326.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=61.49%, ctx=2835, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154750: Sun Jun 7 01:20:28 2026 read: IOPS=0, BW=3290KiB/s (3369kB/s)(4096KiB/1245msec) clat (nsec): min=426648k, max=426648k, avg=426648390.00, stdev= 0.00 lat (nsec): min=426651k, max=426651k, avg=426650640.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 5618, max= 5618, per=43.75%, avg=5618.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6580KiB/s (6738kB/s)(8192KiB/1245msec); 0 zone resets clat (msec): min=303, max=488, avg=395.84, stdev=131.15 lat (msec): min=303, max=488, avg=396.15, stdev=131.12 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 8175, max= 8175, per=44.83%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.08%, sys=15.76%, ctx=882, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154751: Sun Jun 7 01:20:28 2026 write: IOPS=1, BW=6838KiB/s (7002kB/s)(12.0MiB/1797msec); 0 zone resets clat (msec): min=323, max=974, avg=587.48, stdev=342.69 lat (msec): min=324, max=975, avg=587.68, stdev=342.69 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8175, max= 8175, per=44.83%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=21.83%, ctx=94, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154752: Sun Jun 7 01:20:28 2026 write: IOPS=1, BW=6853KiB/s (7018kB/s)(12.0MiB/1793msec); 0 zone resets clat (msec): min=220, max=1315, avg=594.03, stdev=624.85 lat (msec): min=220, max=1315, avg=594.26, stdev=624.88 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min=14921, max=14921, per=81.83%, avg=14921.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=16.52%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=12.5MiB/s (13.1MB/s), 3290KiB/s-9630KiB/s (3369kB/s-9861kB/s), io=16.0MiB (16.8MB), run=1245-1276msec WRITE: bw=17.8MiB/s (18.7MB/s), 6580KiB/s-6853KiB/s (6738kB/s-7018kB/s), io=32.0MiB (33.6MB), run=1245-1797msec