== sanity test 398b: DIO and buffer IO race ============== 18:07:21 (1781215641) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.64413 s, 6.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179645: Thu Jun 11 18:10:19 2026 read: IOPS=9, BW=38.5KiB/s (39.4kB/s)(5992KiB/155589msec) clat (usec): min=35, max=919042, avg=58413.95, stdev=46390.45 lat (usec): min=35, max=919043, avg=58419.26, stdev=46388.71 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 12518], 10.00th=[ 19792], 20.00th=[ 28181], | 30.00th=[ 34341], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 57934], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[106431], 95.00th=[131597], | 99.00th=[217056], 99.50th=[240124], 99.90th=[371196], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 6, max= 103, per=24.80%, avg=38.20, stdev=16.87, samples=304 iops : min= 1, max= 25, avg= 8.90, stdev= 4.25, samples=304 write: IOPS=10, BW=40.5KiB/s (41.4kB/s)(6296KiB/155589msec); 0 zone resets clat (usec): min=991, max=285236, avg=42982.94, stdev=45489.28 lat (usec): min=993, max=285237, avg=42986.24, stdev=45489.09 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1483], 20.00th=[ 4293], | 30.00th=[ 8717], 40.00th=[ 18482], 50.00th=[ 29492], 60.00th=[ 39584], | 70.00th=[ 55313], 80.00th=[ 76022], 90.00th=[107480], 95.00th=[135267], | 99.00th=[191890], 99.50th=[223347], 99.90th=[267387], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 116, per=25.07%, avg=40.37, stdev=20.32, samples=302 iops : min= 1, max= 29, avg= 9.46, stdev= 5.13, samples=302 lat (usec) : 50=0.39%, 100=1.60%, 250=0.13%, 1000=0.03% lat (msec) : 2=6.93%, 4=2.80%, 10=6.90%, 20=7.19%, 50=33.37% lat (msec) : 100=28.65%, 250=11.69%, 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=4.41%, ctx=6179, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179646: Thu Jun 11 18:10:19 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(5940KiB/153461msec) clat (usec): min=35, max=308326, avg=56598.85, stdev=37527.17 lat (usec): min=35, max=308327, avg=56605.76, stdev=37525.86 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 233], 10.00th=[ 18744], 20.00th=[ 27132], | 30.00th=[ 34866], 40.00th=[ 42206], 50.00th=[ 50594], 60.00th=[ 58983], | 70.00th=[ 68682], 80.00th=[ 81265], 90.00th=[103285], 95.00th=[125305], | 99.00th=[175113], 99.50th=[210764], 99.90th=[283116], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 6, max= 93, per=24.86%, avg=38.28, stdev=17.53, samples=301 iops : min= 1, max= 23, avg= 8.93, stdev= 4.42, samples=301 write: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6348KiB/153461msec); 0 zone resets clat (usec): min=919, max=861589, avg=43459.76, stdev=50166.45 lat (usec): min=920, max=861590, avg=43462.43, stdev=50165.68 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1614], 20.00th=[ 4490], | 30.00th=[ 8848], 40.00th=[ 17433], 50.00th=[ 29230], 60.00th=[ 41681], | 70.00th=[ 56361], 80.00th=[ 74974], 90.00th=[106431], 95.00th=[135267], | 99.00th=[189793], 99.50th=[233833], 99.90th=[387974], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 133, per=25.57%, avg=41.17, stdev=20.29, samples=300 iops : min= 1, max= 33, avg= 9.66, stdev= 5.12, samples=300 lat (usec) : 50=0.29%, 100=2.08%, 250=0.07%, 500=0.03%, 1000=0.07% lat (msec) : 2=5.89%, 4=3.71%, 10=7.32%, 20=7.81%, 50=31.35% lat (msec) : 100=30.18%, 250=10.90%, 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=4.54%, ctx=6329, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179649: Thu Jun 11 18:10:19 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6028KiB/155807msec) clat (usec): min=36, max=363958, avg=56294.59, stdev=39527.62 lat (usec): min=36, max=363959, avg=56296.16, stdev=39527.50 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9241], 10.00th=[ 19530], 20.00th=[ 27657], | 30.00th=[ 33162], 40.00th=[ 40633], 50.00th=[ 47973], 60.00th=[ 56886], | 70.00th=[ 65274], 80.00th=[ 79168], 90.00th=[104334], 95.00th=[129500], | 99.00th=[191890], 99.50th=[219153], 99.90th=[308282], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 95, per=25.06%, avg=38.60, stdev=17.60, samples=302 iops : min= 1, max= 23, avg= 9.01, stdev= 4.43, samples=302 write: IOPS=10, BW=40.2KiB/s (41.1kB/s)(6260KiB/155807msec); 0 zone resets clat (usec): min=981, max=1052.0k, avg=45089.91, stdev=54555.11 lat (usec): min=984, max=1052.0k, avg=45092.56, stdev=54555.78 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 1467], | 20.00th=[ 3982], 30.00th=[ 8455], 40.00th=[ 18482], | 50.00th=[ 30540], 60.00th=[ 42730], 70.00th=[ 55313], | 80.00th=[ 78119], 90.00th=[ 111674], 95.00th=[ 139461], | 99.00th=[ 204473], 99.50th=[ 246416], 99.90th=[ 362808], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 110, per=24.77%, avg=39.87, stdev=19.17, samples=303 iops : min= 1, max= 27, avg= 9.33, stdev= 4.82, samples=303 lat (usec) : 50=0.36%, 100=1.79%, 250=0.03%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.97%, 4=3.26%, 10=6.77%, 20=6.80%, 50=33.89% lat (msec) : 100=27.96%, 250=11.69%, 500=0.33%, 2000=0.03% cpu : usr=0.06%, sys=4.38%, ctx=6206, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179650: Thu Jun 11 18:10:19 2026 read: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6052KiB/153269msec) clat (usec): min=36, max=332641, avg=56658.09, stdev=38200.51 lat (usec): min=37, max=332642, avg=56660.29, stdev=38200.37 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11469], 10.00th=[ 19792], 20.00th=[ 26870], | 30.00th=[ 33817], 40.00th=[ 41681], 50.00th=[ 49021], 60.00th=[ 58459], | 70.00th=[ 67634], 80.00th=[ 81265], 90.00th=[103285], 95.00th=[128451], | 99.00th=[179307], 99.50th=[219153], 99.90th=[320865], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 95, per=25.67%, avg=39.53, stdev=16.46, samples=297 iops : min= 1, max= 23, avg= 9.24, stdev= 4.15, samples=297 write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6236KiB/153269msec); 0 zone resets clat (usec): min=887, max=1001.9k, avg=43137.69, stdev=51813.75 lat (usec): min=889, max=1001.9k, avg=43139.60, stdev=51813.94 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1336], 10.00th=[ 1467], | 20.00th=[ 3949], 30.00th=[ 8979], 40.00th=[ 17957], | 50.00th=[ 28967], 60.00th=[ 40633], 70.00th=[ 55313], | 80.00th=[ 74974], 90.00th=[ 104334], 95.00th=[ 133694], | 99.00th=[ 200279], 99.50th=[ 252707], 99.90th=[ 316670], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 120, per=25.22%, avg=40.60, stdev=19.21, samples=298 iops : min= 1, max= 30, avg= 9.50, stdev= 4.83, samples=298 lat (usec) : 50=0.16%, 100=1.63%, 250=0.10%, 500=0.07%, 1000=0.07% lat (msec) : 2=7.00%, 4=3.32%, 10=6.05%, 20=7.62%, 50=33.07% lat (msec) : 100=29.95%, 250=10.55%, 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=4.42%, ctx=6202, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=154KiB/s (158kB/s), 38.5KiB/s-39.5KiB/s (39.4kB/s-40.4kB/s), io=23.4MiB (24.6MB), run=153269-155807msec WRITE: bw=161KiB/s (165kB/s), 40.2KiB/s-41.4KiB/s (41.1kB/s-42.4kB/s), io=24.6MiB (25.7MB), run=153269-155807msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179643: Thu Jun 11 18:11:14 2026 read: IOPS=7, BW=28.8KiB/s (29.4kB/s)(5992KiB/208358msec) clat (msec): min=6, max=927, avg=54.73, stdev=54.39 lat (msec): min=6, max=927, avg=54.74, stdev=54.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 79], 90.00th=[ 118], 95.00th=[ 165], | 99.00th=[ 249], 99.50th=[ 275], 99.90th=[ 376], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 112, per=26.52%, avg=30.23, stdev=20.38, samples=384 iops : min= 1, max= 28, avg= 6.89, stdev= 5.15, samples=384 write: IOPS=7, BW=30.2KiB/s (30.9kB/s)(6296KiB/208358msec); 0 zone resets clat (msec): min=13, max=497, avg=80.03, stdev=56.78 lat (msec): min=13, max=497, avg=80.04, stdev=56.78 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 73], | 70.00th=[ 92], 80.00th=[ 118], 90.00th=[ 157], 95.00th=[ 199], | 99.00th=[ 292], 99.50th=[ 330], 99.90th=[ 405], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7, max= 126, per=25.51%, avg=30.35, stdev=19.60, samples=401 iops : min= 1, max= 31, avg= 6.93, stdev= 4.94, samples=401 lat (msec) : 10=0.91%, 20=8.95%, 50=41.67%, 100=28.55%, 250=18.65% lat (msec) : 500=1.24%, 1000=0.03% cpu : usr=0.05%, sys=1.72%, ctx=4969, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179644: Thu Jun 11 18:11:14 2026 read: IOPS=7, BW=28.3KiB/s (28.0kB/s)(5940KiB/209910msec) clat (msec): min=5, max=1001, avg=53.92, stdev=54.84 lat (msec): min=5, max=1001, avg=53.92, stdev=54.84 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 78], 90.00th=[ 120], 95.00th=[ 167], | 99.00th=[ 247], 99.50th=[ 271], 99.90th=[ 305], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 166, per=26.15%, avg=29.81, stdev=21.27, samples=385 iops : min= 1, max= 41, avg= 6.79, stdev= 5.35, samples=385 write: IOPS=7, BW=30.2KiB/s (30.0kB/s)(6348KiB/209910msec); 0 zone resets clat (msec): min=9, max=442, avg=81.56, stdev=60.48 lat (msec): min=9, max=442, avg=81.56, stdev=60.48 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 62], 60.00th=[ 74], | 70.00th=[ 91], 80.00th=[ 116], 90.00th=[ 159], 95.00th=[ 197], | 99.00th=[ 326], 99.50th=[ 363], 99.90th=[ 414], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 93, per=25.62%, avg=30.49, stdev=19.18, samples=402 iops : min= 1, max= 23, avg= 6.96, stdev= 4.84, samples=402 lat (msec) : 10=0.91%, 20=9.57%, 50=40.56%, 100=29.10%, 250=18.00% lat (msec) : 500=1.82%, 2000=0.03% cpu : usr=0.05%, sys=1.70%, ctx=4937, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179647: Thu Jun 11 18:11:14 2026 read: IOPS=7, BW=28.7KiB/s (29.4kB/s)(6028KiB/209766msec) clat (msec): min=5, max=392, avg=54.08, stdev=50.23 lat (msec): min=5, max=392, avg=54.08, stdev=50.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 121], 95.00th=[ 161], | 99.00th=[ 243], 99.50th=[ 275], 99.90th=[ 388], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 126, per=25.56%, avg=29.14, stdev=20.43, samples=400 iops : min= 1, max= 31, avg= 6.62, stdev= 5.15, samples=400 write: IOPS=7, BW=29.8KiB/s (30.6kB/s)(6260KiB/209766msec); 0 zone resets clat (msec): min=15, max=1024, avg=81.71, stdev=63.52 lat (msec): min=15, max=1024, avg=81.71, stdev=63.52 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 74], | 70.00th=[ 93], 80.00th=[ 121], 90.00th=[ 161], 95.00th=[ 197], | 99.00th=[ 305], 99.50th=[ 342], 99.90th=[ 401], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 104, per=25.46%, avg=30.29, stdev=19.83, samples=400 iops : min= 1, max= 26, avg= 6.90, stdev= 5.00, samples=400 lat (msec) : 10=1.01%, 20=9.31%, 50=41.93%, 100=27.25%, 250=18.85% lat (msec) : 500=1.63%, 2000=0.03% cpu : usr=0.05%, sys=1.68%, ctx=4976, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179648: Thu Jun 11 18:11:14 2026 read: IOPS=7, BW=28.9KiB/s (29.6kB/s)(6052KiB/209234msec) clat (msec): min=5, max=384, avg=52.95, stdev=50.45 lat (msec): min=5, max=384, avg=52.96, stdev=50.45 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 73], 90.00th=[ 120], 95.00th=[ 163], | 99.00th=[ 257], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 126, per=26.84%, avg=30.60, stdev=20.93, samples=383 iops : min= 1, max= 31, avg= 6.98, stdev= 5.28, samples=383 write: IOPS=7, BW=29.8KiB/s (30.5kB/s)(6236KiB/209234msec); 0 zone resets clat (msec): min=9, max=1057, avg=82.53, stdev=65.92 lat (msec): min=9, max=1057, avg=82.53, stdev=65.92 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 52], 50.00th=[ 62], 60.00th=[ 74], | 70.00th=[ 92], 80.00th=[ 117], 90.00th=[ 163], 95.00th=[ 205], | 99.00th=[ 347], 99.50th=[ 376], 99.90th=[ 481], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 95, per=25.30%, avg=30.10, stdev=18.59, samples=401 iops : min= 1, max= 23, avg= 6.86, stdev= 4.67, samples=401 lat (msec) : 10=1.11%, 20=9.31%, 50=41.44%, 100=28.55%, 250=17.84% lat (msec) : 500=1.73%, 2000=0.03% cpu : usr=0.05%, sys=1.71%, ctx=4978, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=114KiB/s (117kB/s), 28.3KiB/s-28.9KiB/s (28.0kB/s-29.6kB/s), io=23.4MiB (24.6MB), run=208358-209910msec WRITE: bw=120KiB/s (123kB/s), 29.8KiB/s-30.2KiB/s (30.5kB/s-30.0kB/s), io=24.6MiB (25.7MB), run=208358-209910msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179702: Thu Jun 11 18:12:06 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(5920KiB/36136msec) clat (usec): min=36, max=254953, avg=52596.74, stdev=37615.44 lat (usec): min=36, max=254954, avg=52599.17, stdev=37615.74 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 65], 10.00th=[ 83], 20.00th=[ 27395], | 30.00th=[ 33424], 40.00th=[ 40109], 50.00th=[ 46400], 60.00th=[ 54789], | 70.00th=[ 62129], 80.00th=[ 77071], 90.00th=[ 99091], 95.00th=[110625], | 99.00th=[208667], 99.50th=[225444], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 383, per=27.66%, avg=167.04, stdev=72.03, samples=69 iops : min= 1, max= 23, avg= 9.65, stdev= 4.52, samples=69 write: IOPS=11, BW=176KiB/s (180kB/s)(6368KiB/36136msec); 0 zone resets clat (usec): min=1480, max=359948, avg=41739.32, stdev=49605.50 lat (usec): min=1483, max=359952, avg=41746.57, stdev=49602.65 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2147], 10.00th=[ 3097], 20.00th=[ 6783], | 30.00th=[ 11600], 40.00th=[ 19268], 50.00th=[ 27919], 60.00th=[ 36439], | 70.00th=[ 46924], 80.00th=[ 63177], 90.00th=[ 98042], 95.00th=[135267], | 99.00th=[308282], 99.50th=[341836], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 375, per=27.89%, avg=177.13, stdev=73.01, samples=70 iops : min= 1, max= 23, avg=10.31, stdev= 4.62, samples=70 lat (usec) : 50=0.52%, 100=4.69%, 250=0.26% lat (msec) : 2=1.69%, 4=4.56%, 10=7.03%, 20=9.38%, 50=36.20% lat (msec) : 100=26.43%, 250=8.59%, 500=0.65% cpu : usr=0.07%, sys=5.08%, ctx=1562, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179703: Thu Jun 11 18:12:06 2026 read: IOPS=9, BW=145KiB/s (148kB/s)(5744KiB/39655msec) clat (usec): min=42, max=414370, avg=58186.65, stdev=40306.49 lat (usec): min=43, max=414370, avg=58187.91, stdev=40306.45 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 78], 10.00th=[ 20841], 20.00th=[ 30278], | 30.00th=[ 38536], 40.00th=[ 45876], 50.00th=[ 52691], 60.00th=[ 59507], | 70.00th=[ 68682], 80.00th=[ 80217], 90.00th=[103285], 95.00th=[123208], | 99.00th=[187696], 99.50th=[238027], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 30, max= 287, per=23.99%, avg=144.92, stdev=61.79, samples=77 iops : min= 1, max= 17, avg= 8.26, stdev= 3.92, samples=77 write: IOPS=10, BW=165KiB/s (169kB/s)(6544KiB/39655msec); 0 zone resets clat (usec): min=1614, max=291060, avg=45759.22, stdev=45763.16 lat (usec): min=1617, max=291062, avg=45761.99, stdev=45762.81 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2474], 10.00th=[ 3720], 20.00th=[ 9241], | 30.00th=[ 16450], 40.00th=[ 23987], 50.00th=[ 31851], 60.00th=[ 40633], | 70.00th=[ 53216], 80.00th=[ 72877], 90.00th=[113771], 95.00th=[147850], | 99.00th=[187696], 99.50th=[204473], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 445, per=26.69%, avg=169.47, stdev=69.70, samples=75 iops : min= 1, max= 27, avg= 9.83, stdev= 4.36, samples=75 lat (usec) : 50=0.13%, 100=2.86%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.82%, 4=3.78%, 10=6.25%, 20=7.03%, 50=34.38% lat (msec) : 100=31.77%, 250=11.07%, 500=0.26% cpu : usr=0.06%, sys=4.87%, ctx=1608, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179704: Thu Jun 11 18:12:06 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(6256KiB/39157msec) clat (usec): min=38, max=314788, avg=57769.56, stdev=44649.58 lat (usec): min=39, max=314789, avg=57770.87, stdev=44649.61 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 717], 20.00th=[ 26084], | 30.00th=[ 34866], 40.00th=[ 43254], 50.00th=[ 50594], 60.00th=[ 57934], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[103285], 95.00th=[137364], | 99.00th=[231736], 99.50th=[274727], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 447, per=26.51%, avg=160.09, stdev=79.22, samples=76 iops : min= 1, max= 27, avg= 9.22, stdev= 4.97, samples=76 write: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39157msec); 0 zone resets clat (usec): min=1748, max=197559, avg=43819.50, stdev=43965.50 lat (usec): min=1753, max=197562, avg=43821.76, stdev=43965.57 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2073], 10.00th=[ 3556], 20.00th=[ 7111], | 30.00th=[ 12387], 40.00th=[ 19268], 50.00th=[ 28967], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 83362], 90.00th=[111674], 95.00th=[135267], | 99.00th=[183501], 99.50th=[191890], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 30, max= 345, per=23.89%, avg=151.67, stdev=68.71, samples=76 iops : min= 1, max= 21, avg= 8.68, stdev= 4.36, samples=76 lat (usec) : 50=0.39%, 100=4.30%, 250=0.39%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.34%, 4=3.91%, 10=6.51%, 20=9.51%, 50=31.25% lat (msec) : 100=28.78%, 250=12.11%, 500=0.26% cpu : usr=0.07%, sys=4.66%, ctx=1576, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179705: Thu Jun 11 18:12:06 2026 read: IOPS=10, BW=162KiB/s (165kB/s)(6032KiB/37343msec) clat (usec): min=41, max=310318, avg=56288.01, stdev=40246.94 lat (usec): min=41, max=310319, avg=56320.72, stdev=40246.00 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 70], 10.00th=[ 17433], 20.00th=[ 30540], | 30.00th=[ 36963], 40.00th=[ 42206], 50.00th=[ 47973], 60.00th=[ 57410], | 70.00th=[ 66847], 80.00th=[ 78119], 90.00th=[ 99091], 95.00th=[126354], | 99.00th=[202376], 99.50th=[291505], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 308, per=26.68%, avg=161.15, stdev=67.48, samples=73 iops : min= 1, max= 19, avg= 9.29, stdev= 4.27, samples=73 write: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37343msec); 0 zone resets clat (usec): min=1526, max=221152, avg=41055.95, stdev=43177.41 lat (usec): min=1529, max=221154, avg=41065.86, stdev=43182.42 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2057], 10.00th=[ 2802], 20.00th=[ 6718], | 30.00th=[ 11338], 40.00th=[ 17433], 50.00th=[ 28181], 60.00th=[ 36439], | 70.00th=[ 50070], 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[133694], | 99.00th=[200279], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 30, max= 351, per=26.70%, avg=169.57, stdev=81.20, samples=72 iops : min= 1, max= 21, avg= 9.82, stdev= 5.09, samples=72 lat (usec) : 50=0.13%, 100=3.52%, 250=0.26%, 500=0.39%, 750=0.13% lat (msec) : 2=1.95%, 4=5.08%, 10=6.90%, 20=8.33%, 50=34.64% lat (msec) : 100=29.04%, 250=9.38%, 500=0.26% cpu : usr=0.06%, sys=5.12%, ctx=1587, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=604KiB/s (619kB/s), 145KiB/s-164KiB/s (148kB/s-168kB/s), io=23.4MiB (24.5MB), run=36136-39655msec WRITE: bw=635KiB/s (651kB/s), 154KiB/s-176KiB/s (158kB/s-180kB/s), io=24.6MiB (25.8MB), run=36136-39655msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Thu Jun 11 18:12:23 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(5920KiB/56550msec) clat (msec): min=10, max=373, avg=59.67, stdev=51.39 lat (msec): min=10, max=373, avg=59.68, stdev=51.39 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 60], 80.00th=[ 90], 90.00th=[ 138], 95.00th=[ 165], | 99.00th=[ 251], 99.50th=[ 279], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 319, per=26.53%, avg=111.16, stdev=68.91, samples=104 iops : min= 1, max= 19, avg= 6.09, stdev= 4.33, samples=104 write: IOPS=7, BW=113KiB/s (115kB/s)(6368KiB/56550msec); 0 zone resets clat (msec): min=22, max=444, avg=86.16, stdev=55.65 lat (msec): min=22, max=444, avg=86.17, stdev=55.66 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 35], 10.00th=[ 40], 20.00th=[ 50], | 30.00th=[ 55], 40.00th=[ 61], 50.00th=[ 68], 60.00th=[ 79], | 70.00th=[ 92], 80.00th=[ 121], 90.00th=[ 153], 95.00th=[ 190], | 99.00th=[ 321], 99.50th=[ 439], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 288, per=25.37%, avg=111.90, stdev=59.53, samples=111 iops : min= 1, max= 18, avg= 6.14, stdev= 3.77, samples=111 lat (msec) : 20=5.34%, 50=36.72%, 100=35.42%, 250=20.96%, 500=1.56% cpu : usr=0.05%, sys=1.49%, ctx=1154, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Thu Jun 11 18:12:23 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(5744KiB/57138msec) clat (msec): min=9, max=423, avg=60.71, stdev=50.38 lat (msec): min=9, max=423, avg=60.71, stdev=50.38 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 53], | 70.00th=[ 69], 80.00th=[ 93], 90.00th=[ 127], 95.00th=[ 161], | 99.00th=[ 257], 99.50th=[ 342], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 23, max= 317, per=25.01%, avg=104.79, stdev=66.52, samples=106 iops : min= 1, max= 19, avg= 5.70, stdev= 4.21, samples=106 write: IOPS=7, BW=115KiB/s (117kB/s)(6544KiB/57138msec); 0 zone resets clat (msec): min=17, max=495, avg=85.99, stdev=55.10 lat (msec): min=17, max=495, avg=86.00, stdev=55.10 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 33], 10.00th=[ 36], 20.00th=[ 44], | 30.00th=[ 52], 40.00th=[ 61], 50.00th=[ 68], 60.00th=[ 84], | 70.00th=[ 101], 80.00th=[ 124], 90.00th=[ 155], 95.00th=[ 194], | 99.00th=[ 257], 99.50th=[ 279], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 30, max= 318, per=25.82%, avg=113.87, stdev=63.02, samples=111 iops : min= 1, max= 19, avg= 6.26, stdev= 3.97, samples=111 lat (msec) : 10=0.26%, 20=5.47%, 50=36.72%, 100=33.33%, 250=23.05% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.49%, ctx=1092, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Thu Jun 11 18:12:23 2026 read: IOPS=6, BW=110KiB/s (112kB/s)(6256KiB/57042msec) clat (msec): min=7, max=367, avg=55.63, stdev=46.55 lat (msec): min=7, max=367, avg=55.63, stdev=46.55 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 266], 99.50th=[ 292], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 30, max= 319, per=26.87%, avg=112.59, stdev=74.74, samples=109 iops : min= 1, max= 19, avg= 6.17, stdev= 4.70, samples=109 write: IOPS=6, BW=106KiB/s (108kB/s)(6032KiB/57042msec); 0 zone resets clat (msec): min=19, max=510, avg=93.44, stdev=62.45 lat (msec): min=19, max=510, avg=93.44, stdev=62.45 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 33], 10.00th=[ 39], 20.00th=[ 46], | 30.00th=[ 54], 40.00th=[ 65], 50.00th=[ 78], 60.00th=[ 88], | 70.00th=[ 106], 80.00th=[ 131], 90.00th=[ 176], 95.00th=[ 215], | 99.00th=[ 321], 99.50th=[ 447], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 30, max= 255, per=24.03%, avg=105.96, stdev=54.89, samples=110 iops : min= 1, max= 15, avg= 5.76, stdev= 3.48, samples=110 lat (msec) : 10=0.26%, 20=5.47%, 50=38.80%, 100=32.94%, 250=20.96% lat (msec) : 500=1.43%, 750=0.13% cpu : usr=0.05%, sys=1.63%, ctx=1152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179700: Thu Jun 11 18:12:23 2026 read: IOPS=6, BW=106KiB/s (108kB/s)(6032KiB/57006msec) clat (msec): min=8, max=448, avg=60.74, stdev=48.87 lat (msec): min=8, max=448, avg=60.74, stdev=48.87 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 87], 90.00th=[ 130], 95.00th=[ 165], | 99.00th=[ 213], 99.50th=[ 241], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 377, per=26.53%, avg=111.17, stdev=63.01, samples=105 iops : min= 1, max= 23, avg= 6.09, stdev= 4.01, samples=105 write: IOPS=6, BW=110KiB/s (112kB/s)(6256KiB/57006msec); 0 zone resets clat (msec): min=13, max=460, avg=86.83, stdev=54.22 lat (msec): min=13, max=460, avg=86.84, stdev=54.22 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 35], 10.00th=[ 40], 20.00th=[ 47], | 30.00th=[ 54], 40.00th=[ 62], 50.00th=[ 70], 60.00th=[ 81], | 70.00th=[ 95], 80.00th=[ 118], 90.00th=[ 159], 95.00th=[ 199], | 99.00th=[ 257], 99.50th=[ 321], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 31, max= 319, per=25.44%, avg=112.18, stdev=59.92, samples=109 iops : min= 1, max= 19, avg= 6.16, stdev= 3.77, samples=109 lat (msec) : 10=0.13%, 20=3.39%, 50=37.11%, 100=37.50%, 250=21.09% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.63%, ctx=1200, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=419KiB/s (429kB/s), 101KiB/s-110KiB/s (103kB/s-112kB/s), io=23.4MiB (24.5MB), run=56550-57138msec WRITE: bw=441KiB/s (452kB/s), 106KiB/s-115KiB/s (108kB/s-117kB/s), io=24.6MiB (25.8MB), run=56550-57138msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179728: Thu Jun 11 18:12:44 2026 read: IOPS=1, BW=1165KiB/s (1193kB/s)(7168KiB/6153msec) clat (msec): min=2, max=3493, avg=686.34, stdev=1242.06 lat (msec): min=2, max=3493, avg=686.34, stdev=1242.06 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 211], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 271], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 321], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1935, max= 3447, per=84.76%, avg=2328.25, stdev=746.20, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=832KiB/s (852kB/s)(5120KiB/6153msec); 0 zone resets clat (msec): min=176, max=343, avg=260.58, stdev=59.96 lat (msec): min=177, max=343, avg=261.11, stdev=59.58 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1935, max= 3923, per=67.98%, avg=2615.33, stdev=1132.78, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=33.33%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=8.26%, ctx=621, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179729: Thu Jun 11 18:12:44 2026 read: IOPS=0, BW=285KiB/s (292kB/s)(2048KiB/7193msec) clat (msec): min=2, max=214, avg=108.21, stdev=150.04 lat (msec): min=2, max=214, avg=108.21, stdev=150.04 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 1878, max= 2015, per=70.86%, avg=1946.50, stdev=96.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1424KiB/s (1458kB/s)(10.0MiB/7193msec); 0 zone resets clat (msec): min=141, max=4115, avg=688.64, stdev=1216.75 lat (msec): min=141, max=4115, avg=688.74, stdev=1216.75 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 169], | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 300], 60.00th=[ 305], | 70.00th=[ 334], 80.00th=[ 384], 90.00th=[ 751], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 1961, max= 4000, per=71.93%, avg=2767.00, stdev=1067.83, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 4=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=6.66%, ctx=180, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179730: Thu Jun 11 18:12:44 2026 read: IOPS=0, BW=897KiB/s (918kB/s)(6144KiB/6851msec) clat (usec): min=493, max=327261, avg=140132.16, stdev=153382.08 lat (usec): min=494, max=327263, avg=140133.62, stdev=153382.02 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 2671], | 30.00th=[ 2671], 40.00th=[ 5014], 50.00th=[ 5014], 60.00th=[233833], | 70.00th=[270533], 80.00th=[270533], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 1961, max= 3871, per=89.62%, avg=2461.75, stdev=939.78, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=897KiB/s (918kB/s)(6144KiB/6851msec); 0 zone resets clat (msec): min=158, max=3701, avg=972.63, stdev=1350.08 lat (msec): min=158, max=3701, avg=972.75, stdev=1350.08 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 506], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1935, max= 4000, per=61.94%, avg=2382.80, stdev=904.61, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 10=8.33%, 250=16.67%, 500=33.33%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.91%, ctx=158, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179731: Thu Jun 11 18:12:44 2026 read: IOPS=0, BW=687KiB/s (703kB/s)(5120KiB/7453msec) clat (usec): min=490, max=214542, avg=48763.56, stdev=93348.18 lat (usec): min=491, max=214544, avg=48765.02, stdev=93348.39 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 938], 40.00th=[ 938], 50.00th=[ 1139], 60.00th=[ 1139], | 70.00th=[ 26608], 80.00th=[ 26608], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=0, BW=962KiB/s (985kB/s)(7168KiB/7453msec); 0 zone resets clat (msec): min=320, max=3762, avg=1017.18, stdev=1236.12 lat (msec): min=321, max=3762, avg=1017.36, stdev=1236.13 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 527], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 902], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 1935, max= 4000, per=61.86%, avg=2379.80, stdev=906.21, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=8.33%, 500=25.00%, 750=8.33% lat (msec) : 1000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=4.97%, ctx=100, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2748KiB/s (2814kB/s), 285KiB/s-1165KiB/s (292kB/s-1193kB/s), io=20.0MiB (20.0MB), run=6153-7453msec WRITE: bw=3847KiB/s (3939kB/s), 832KiB/s-1424KiB/s (852kB/s-1458kB/s), io=28.0MiB (29.4MB), run=6153-7453msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179733: Thu Jun 11 18:12:45 2026 read: IOPS=0, BW=914KiB/s (936kB/s)(7168KiB/7843msec) clat (msec): min=91, max=3244, avg=908.76, stdev=1172.95 lat (msec): min=91, max=3244, avg=908.76, stdev=1172.95 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 159], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 472], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 1720], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1828, max= 2015, per=76.31%, avg=1955.00, stdev=77.96, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=653KiB/s (668kB/s)(5120KiB/7843msec); 0 zone resets clat (msec): min=124, max=648, avg=253.59, stdev=221.83 lat (msec): min=124, max=648, avg=253.70, stdev=221.83 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2000, max= 4000, per=83.61%, avg=3000.00, stdev=1414.21, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=1.82%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179734: Thu Jun 11 18:12:45 2026 read: IOPS=0, BW=256KiB/s (263kB/s)(2048KiB/7987msec) clat (msec): min=163, max=724, avg=444.02, stdev=396.80 lat (msec): min=163, max=724, avg=444.02, stdev=396.80 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2000, max= 2048, per=79.00%, avg=2024.00, stdev=33.94, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1282KiB/s (1313kB/s)(10.0MiB/7987msec); 0 zone resets clat (msec): min=119, max=3984, avg=699.99, stdev=1196.04 lat (msec): min=119, max=3984, avg=700.42, stdev=1195.94 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 138], | 30.00th=[ 165], 40.00th=[ 169], 50.00th=[ 171], 60.00th=[ 222], | 70.00th=[ 255], 80.00th=[ 684], 90.00th=[ 1099], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 2000, max= 6131, per=100.00%, avg=3632.40, stdev=1722.39, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.44%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179735: Thu Jun 11 18:12:45 2026 read: IOPS=0, BW=769KiB/s (787kB/s)(6144KiB/7991msec) clat (msec): min=162, max=834, avg=356.31, stdev=264.17 lat (msec): min=162, max=834, avg=356.31, stdev=264.17 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 284], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1828, max= 4000, per=96.32%, avg=2467.75, stdev=1025.71, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=769KiB/s (787kB/s)(6144KiB/7991msec); 0 zone resets clat (msec): min=120, max=4037, avg=936.03, stdev=1530.08 lat (msec): min=120, max=4037, avg=936.12, stdev=1530.08 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 359], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 2000, max= 4096, per=84.99%, avg=3049.50, stdev=1203.22, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=3.02%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179736: Thu Jun 11 18:12:45 2026 read: IOPS=0, BW=644KiB/s (659kB/s)(5120KiB/7955msec) clat (msec): min=92, max=296, avg=151.43, stdev=82.27 lat (msec): min=92, max=296, avg=151.43, stdev=82.27 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 133], 80.00th=[ 133], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 2015, max= 6000, per=100.00%, avg=4007.50, stdev=2817.82, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=901KiB/s (923kB/s)(7168KiB/7955msec); 0 zone resets clat (msec): min=137, max=3960, avg=1013.10, stdev=1333.24 lat (msec): min=137, max=3960, avg=1013.23, stdev=1333.23 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 271], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 642], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 1036], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 2000, max= 4087, per=67.73%, avg=2430.00, stdev=926.50, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=1.97%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2563KiB/s (2624kB/s), 256KiB/s-914KiB/s (263kB/s-936kB/s), io=20.0MiB (20.0MB), run=7843-7991msec WRITE: bw=3588KiB/s (3674kB/s), 653KiB/s-1282KiB/s (668kB/s-1313kB/s), io=28.0MiB (29.4MB), run=7843-7991msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179743: Thu Jun 11 18:13:04 2026 read: IOPS=0, BW=1962KiB/s (2009kB/s)(12.0MiB/6264msec) clat (msec): min=904, max=4276, avg=2048.99, stdev=1929.04 lat (msec): min=904, max=4276, avg=2048.99, stdev=1929.05 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 4279], 80.00th=[ 4279], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=7.31%, ctx=767, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179744: Thu Jun 11 18:13:04 2026 read: IOPS=0, BW=592KiB/s (606kB/s)(4096KiB/6923msec) clat (nsec): min=829160k, max=829160k, avg=829160134.00, stdev= 0.00 lat (nsec): min=829164k, max=829164k, avg=829163825.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1183KiB/s (1212kB/s)(8192KiB/6923msec); 0 zone resets clat (msec): min=1438, max=4463, avg=2950.87, stdev=2138.56 lat (msec): min=1439, max=4463, avg=2951.47, stdev=2138.72 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 4463], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.01%, sys=2.40%, ctx=100, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179745: Thu Jun 11 18:13:04 2026 write: IOPS=0, BW=1963KiB/s (2010kB/s)(12.0MiB/6260msec); 0 zone resets clat (msec): min=830, max=4431, avg=2068.15, stdev=2047.31 lat (msec): min=831, max=4431, avg=2068.67, stdev=2047.17 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.57%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179746: Thu Jun 11 18:13:04 2026 write: IOPS=0, BW=1956KiB/s (2003kB/s)(12.0MiB/6281msec); 0 zone resets clat (msec): min=921, max=3771, avg=2027.40, stdev=1528.02 lat (msec): min=922, max=3771, avg=2028.58, stdev=1527.83 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 7699, max= 7937, per=100.00%, avg=7818.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.04%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2367KiB/s (2423kB/s), 592KiB/s-1962KiB/s (606kB/s-2009kB/s), io=16.0MiB (16.8MB), run=6264-6923msec WRITE: bw=4733KiB/s (4847kB/s), 1183KiB/s-1963KiB/s (1212kB/s-2010kB/s), io=32.0MiB (33.6MB), run=6260-6923msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179748: Thu Jun 11 18:13:05 2026 read: IOPS=0, BW=2033KiB/s (2082kB/s)(12.0MiB/6043msec) clat (msec): min=300, max=4516, avg=2001.66, stdev=2222.81 lat (msec): min=300, max=4516, avg=2001.67, stdev=2222.81 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 4530], 80.00th=[ 4530], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 7937, max= 8175, per=100.00%, avg=8056.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.42%, ctx=41, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179749: Thu Jun 11 18:13:05 2026 read: IOPS=0, BW=627KiB/s (642kB/s)(4096KiB/6534msec) clat (nsec): min=4025.5M, max=4025.5M, avg=4025549329.00, stdev= 0.00 lat (nsec): min=4025.6M, max=4025.6M, avg=4025551629.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4010], 5.00th=[ 4010], 10.00th=[ 4010], 20.00th=[ 4010], | 30.00th=[ 4010], 40.00th=[ 4010], 50.00th=[ 4010], 60.00th=[ 4010], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1254KiB/s (1284kB/s)(8192KiB/6534msec); 0 zone resets clat (msec): min=745, max=1759, avg=1252.73, stdev=717.27 lat (msec): min=746, max=1760, avg=1253.56, stdev=717.58 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.04%, ctx=47, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179750: Thu Jun 11 18:13:05 2026 write: IOPS=0, BW=1879KiB/s (1924kB/s)(12.0MiB/6541msec); 0 zone resets clat (msec): min=316, max=4997, avg=2176.10, stdev=2484.55 lat (msec): min=326, max=4998, avg=2179.94, stdev=2481.03 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 5000], 80.00th=[ 5000], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.41%, ctx=25, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179751: Thu Jun 11 18:13:05 2026 write: IOPS=0, BW=2116KiB/s (2167kB/s)(12.0MiB/5807msec); 0 zone resets clat (msec): min=333, max=4054, avg=1910.28, stdev=1924.58 lat (msec): min=335, max=4055, avg=1911.31, stdev=1924.19 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 8015, max= 8159, per=100.00%, avg=8087.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.20%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2507KiB/s (2568kB/s), 627KiB/s-2033KiB/s (642kB/s-2082kB/s), io=16.0MiB (16.8MB), run=6043-6534msec WRITE: bw=5010KiB/s (5130kB/s), 1254KiB/s-2116KiB/s (1284kB/s-2167kB/s), io=32.0MiB (33.6MB), run=5807-6541msec