== sanity test 398b: DIO and buffer IO race ============== 16:44:07 (1789073047) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.67567 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179309: Thu Sep 10 16:47:32 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(5992KiB/184274msec) clat (usec): min=36, max=741163, avg=67225.67, stdev=47341.14 lat (usec): min=37, max=741165, avg=67231.14, stdev=47338.60 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 15270], 10.00th=[ 23200], 20.00th=[ 33424], | 30.00th=[ 40633], 40.00th=[ 49021], 50.00th=[ 57934], 60.00th=[ 68682], | 70.00th=[ 81265], 80.00th=[ 94897], 90.00th=[119014], 95.00th=[156238], | 99.00th=[223347], 99.50th=[246416], 99.90th=[350225], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 5, max= 87, per=24.90%, avg=32.13, stdev=15.41, samples=360 iops : min= 1, max= 21, avg= 7.36, stdev= 3.88, samples=360 write: IOPS=8, BW=34.2KiB/s (34.0kB/s)(6296KiB/184274msec); 0 zone resets clat (usec): min=1047, max=445404, avg=52861.82, stdev=56978.46 lat (usec): min=1049, max=445407, avg=52867.06, stdev=56977.12 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1369], 10.00th=[ 1942], 20.00th=[ 5997], | 30.00th=[ 11600], 40.00th=[ 23725], 50.00th=[ 36963], 60.00th=[ 50594], | 70.00th=[ 66847], 80.00th=[ 88605], 90.00th=[126354], 95.00th=[158335], | 99.00th=[270533], 99.50th=[291505], 99.90th=[400557], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 111, per=25.32%, avg=34.18, stdev=17.81, samples=356 iops : min= 1, max= 27, avg= 7.88, stdev= 4.48, samples=356 lat (usec) : 50=0.07%, 100=1.53%, 250=0.13%, 500=0.07% lat (msec) : 2=5.27%, 4=2.99%, 10=6.22%, 20=6.80%, 50=27.57% lat (msec) : 100=32.55%, 250=15.89%, 500=0.88%, 750=0.03% cpu : usr=0.06%, sys=3.53%, ctx=6417, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179310: Thu Sep 10 16:47:32 2026 read: IOPS=8, BW=32.1KiB/s (32.9kB/s)(5940KiB/185079msec) clat (usec): min=44, max=934414, avg=68242.29, stdev=50659.60 lat (usec): min=44, max=934415, avg=68246.77, stdev=50659.23 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 15401], 10.00th=[ 23725], 20.00th=[ 32900], | 30.00th=[ 41681], 40.00th=[ 49021], 50.00th=[ 57410], 60.00th=[ 68682], | 70.00th=[ 79168], 80.00th=[ 95945], 90.00th=[123208], 95.00th=[156238], | 99.00th=[238027], 99.50th=[270533], 99.90th=[325059], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 80, per=25.10%, avg=32.37, stdev=14.94, samples=355 iops : min= 1, max= 20, avg= 7.42, stdev= 3.75, samples=355 write: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6348KiB/185079msec); 0 zone resets clat (usec): min=961, max=469927, avg=52607.62, stdev=56955.25 lat (usec): min=962, max=469929, avg=52611.65, stdev=56954.59 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1369], 10.00th=[ 2212], 20.00th=[ 5866], | 30.00th=[ 11207], 40.00th=[ 21627], 50.00th=[ 36439], 60.00th=[ 49546], | 70.00th=[ 68682], 80.00th=[ 87557], 90.00th=[127402], 95.00th=[164627], | 99.00th=[250610], 99.50th=[287310], 99.90th=[467665], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 103, per=25.50%, avg=34.43, stdev=18.38, samples=357 iops : min= 1, max= 25, avg= 7.94, stdev= 4.61, samples=357 lat (usec) : 50=0.20%, 100=1.40%, 250=0.10%, 500=0.07%, 1000=0.10% lat (msec) : 2=4.79%, 4=3.16%, 10=6.51%, 20=7.16%, 50=27.41% lat (msec) : 100=31.80%, 250=16.44%, 500=0.85%, 1000=0.03% cpu : usr=0.07%, sys=3.44%, ctx=6397, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179311: Thu Sep 10 16:47:32 2026 read: IOPS=8, BW=33.3KiB/s (34.1kB/s)(6028KiB/180847msec) clat (usec): min=43, max=360900, avg=66436.57, stdev=44400.55 lat (usec): min=43, max=360902, avg=66442.91, stdev=44400.40 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 14615], 10.00th=[ 23462], 20.00th=[ 32900], | 30.00th=[ 41157], 40.00th=[ 48497], 50.00th=[ 57410], 60.00th=[ 67634], | 70.00th=[ 79168], 80.00th=[ 95945], 90.00th=[120062], 95.00th=[143655], | 99.00th=[212861], 99.50th=[295699], 99.90th=[333448], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 79, per=25.69%, avg=33.14, stdev=15.21, samples=351 iops : min= 1, max= 19, avg= 7.61, stdev= 3.82, samples=351 write: IOPS=8, BW=34.6KiB/s (35.4kB/s)(6260KiB/180847msec); 0 zone resets clat (usec): min=977, max=938918, avg=51389.67, stdev=58383.26 lat (usec): min=978, max=938920, avg=51393.11, stdev=58382.39 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1336], 10.00th=[ 1991], 20.00th=[ 5211], | 30.00th=[ 10552], 40.00th=[ 20579], 50.00th=[ 33817], 60.00th=[ 49546], | 70.00th=[ 65799], 80.00th=[ 87557], 90.00th=[124257], 95.00th=[162530], | 99.00th=[238027], 99.50th=[261096], 99.90th=[325059], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 118, per=25.50%, avg=34.42, stdev=17.52, samples=351 iops : min= 1, max= 29, avg= 7.94, stdev= 4.44, samples=351 lat (usec) : 50=0.13%, 100=1.73%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.08%, 4=2.96%, 10=7.00%, 20=6.67%, 50=27.15% lat (msec) : 100=32.23%, 250=16.02%, 500=0.68%, 1000=0.03% cpu : usr=0.07%, sys=3.59%, ctx=6476, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179312: Thu Sep 10 16:47:32 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6052KiB/186077msec) clat (usec): min=37, max=430231, avg=69379.73, stdev=49754.65 lat (usec): min=37, max=430232, avg=69383.73, stdev=49754.19 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 9896], 10.00th=[ 22676], 20.00th=[ 33162], | 30.00th=[ 41157], 40.00th=[ 49546], 50.00th=[ 58983], 60.00th=[ 69731], | 70.00th=[ 82314], 80.00th=[ 99091], 90.00th=[128451], 95.00th=[156238], | 99.00th=[248513], 99.50th=[304088], 99.90th=[417334], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 87, per=25.23%, avg=32.55, stdev=15.23, samples=358 iops : min= 1, max= 21, avg= 7.46, stdev= 3.83, samples=358 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6236KiB/186077msec); 0 zone resets clat (usec): min=1029, max=941384, avg=51874.31, stdev=58599.37 lat (usec): min=1029, max=941387, avg=51878.87, stdev=58599.47 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1434], 10.00th=[ 2147], 20.00th=[ 4948], | 30.00th=[ 9634], 40.00th=[ 22676], 50.00th=[ 36439], 60.00th=[ 50070], | 70.00th=[ 66323], 80.00th=[ 87557], 90.00th=[126354], 95.00th=[164627], | 99.00th=[227541], 99.50th=[267387], 99.90th=[425722], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 95, per=24.97%, avg=33.71, stdev=16.95, samples=356 iops : min= 1, max= 23, avg= 7.76, stdev= 4.29, samples=356 lat (usec) : 50=0.13%, 100=1.79%, 250=0.26%, 750=0.03%, 1000=0.10% lat (msec) : 2=4.85%, 4=3.78%, 10=7.00%, 20=5.66%, 50=26.73% lat (msec) : 100=31.61%, 250=17.25%, 500=0.78%, 1000=0.03% cpu : usr=0.07%, sys=3.45%, ctx=6535, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (132kB/s), 32.1KiB/s-33.3KiB/s (32.9kB/s-34.1kB/s), io=23.4MiB (24.6MB), run=180847-186077msec WRITE: bw=135KiB/s (138kB/s), 33.5KiB/s-34.6KiB/s (34.3kB/s-35.4kB/s), io=24.6MiB (25.7MB), run=180847-186077msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179304: Thu Sep 10 16:48:19 2026 read: IOPS=6, BW=25.7KiB/s (26.3kB/s)(5992KiB/233153msec) clat (msec): min=5, max=831, avg=60.64, stdev=63.71 lat (msec): min=5, max=831, avg=60.65, stdev=63.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 47], | 70.00th=[ 64], 80.00th=[ 95], 90.00th=[ 148], 95.00th=[ 194], | 99.00th=[ 275], 99.50th=[ 338], 99.90th=[ 426], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 119, per=26.78%, avg=27.31, stdev=21.91, samples=420 iops : min= 1, max= 29, avg= 6.13, stdev= 5.51, samples=420 write: IOPS=6, BW=27.0KiB/s (27.7kB/s)(6296KiB/233153msec); 0 zone resets clat (msec): min=12, max=553, avg=90.08, stdev=72.21 lat (msec): min=12, max=553, avg=90.09, stdev=72.21 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 82], | 70.00th=[ 105], 80.00th=[ 136], 90.00th=[ 188], 95.00th=[ 232], | 99.00th=[ 351], 99.50th=[ 430], 99.90th=[ 542], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 95, per=25.60%, avg=27.39, stdev=20.08, samples=441 iops : min= 1, max= 23, avg= 6.15, stdev= 5.06, samples=441 lat (msec) : 10=1.30%, 20=10.61%, 50=37.50%, 100=25.42%, 250=22.20% lat (msec) : 500=2.83%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=4727, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179305: Thu Sep 10 16:48:19 2026 read: IOPS=6, BW=25.7KiB/s (26.3kB/s)(5940KiB/231223msec) clat (msec): min=4, max=1016, avg=59.77, stdev=65.78 lat (msec): min=4, max=1016, avg=59.77, stdev=65.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 62], 80.00th=[ 89], 90.00th=[ 140], 95.00th=[ 182], | 99.00th=[ 321], 99.50th=[ 384], 99.90th=[ 535], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 112, per=26.73%, avg=27.27, stdev=21.61, samples=420 iops : min= 1, max= 28, avg= 6.12, stdev= 5.44, samples=420 write: IOPS=6, BW=27.5KiB/s (28.1kB/s)(6348KiB/231223msec); 0 zone resets clat (msec): min=10, max=575, avg=89.44, stdev=70.18 lat (msec): min=10, max=575, avg=89.46, stdev=70.18 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 81], | 70.00th=[ 106], 80.00th=[ 136], 90.00th=[ 184], 95.00th=[ 230], | 99.00th=[ 347], 99.50th=[ 376], 99.90th=[ 550], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 111, per=25.99%, avg=27.81, stdev=20.16, samples=440 iops : min= 1, max= 27, avg= 6.26, stdev= 5.08, samples=440 lat (msec) : 10=1.37%, 20=9.96%, 50=39.45%, 100=24.09%, 250=22.30% lat (msec) : 500=2.70%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.27%, ctx=4687, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179306: Thu Sep 10 16:48:19 2026 read: IOPS=6, BW=26.0KiB/s (26.6kB/s)(6028KiB/231842msec) clat (msec): min=6, max=438, avg=60.45, stdev=61.36 lat (msec): min=6, max=438, avg=60.46, stdev=61.36 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 38], 60.00th=[ 50], | 70.00th=[ 65], 80.00th=[ 89], 90.00th=[ 136], 95.00th=[ 192], | 99.00th=[ 305], 99.50th=[ 368], 99.90th=[ 414], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 119, per=26.90%, avg=27.44, stdev=21.33, samples=423 iops : min= 1, max= 29, avg= 6.16, stdev= 5.36, samples=423 write: IOPS=6, BW=27.0KiB/s (27.6kB/s)(6260KiB/231842msec); 0 zone resets clat (msec): min=13, max=1016, avg=89.60, stdev=74.90 lat (msec): min=13, max=1016, avg=89.60, stdev=74.90 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 82], | 70.00th=[ 105], 80.00th=[ 140], 90.00th=[ 194], 95.00th=[ 230], | 99.00th=[ 347], 99.50th=[ 401], 99.90th=[ 575], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 103, per=25.92%, avg=27.73, stdev=20.92, samples=435 iops : min= 1, max= 25, avg= 6.24, stdev= 5.28, samples=435 lat (msec) : 10=1.30%, 20=10.45%, 50=38.22%, 100=25.46%, 250=21.91% lat (msec) : 500=2.57%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=4664, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179307: Thu Sep 10 16:48:19 2026 read: IOPS=6, BW=25.9KiB/s (26.6kB/s)(6052KiB/233356msec) clat (msec): min=6, max=548, avg=61.10, stdev=65.40 lat (msec): min=6, max=548, avg=61.10, stdev=65.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 37], 60.00th=[ 47], | 70.00th=[ 66], 80.00th=[ 90], 90.00th=[ 148], 95.00th=[ 201], | 99.00th=[ 313], 99.50th=[ 376], 99.90th=[ 506], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 111, per=27.62%, avg=28.18, stdev=22.45, samples=414 iops : min= 1, max= 27, avg= 6.35, stdev= 5.64, samples=414 write: IOPS=6, BW=26.7KiB/s (27.4kB/s)(6236KiB/233356msec); 0 zone resets clat (msec): min=10, max=1011, avg=90.03, stdev=77.32 lat (msec): min=10, max=1011, avg=90.03, stdev=77.32 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 51], 50.00th=[ 63], 60.00th=[ 80], | 70.00th=[ 104], 80.00th=[ 136], 90.00th=[ 190], 95.00th=[ 239], | 99.00th=[ 372], 99.50th=[ 430], 99.90th=[ 567], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 104, per=25.52%, avg=27.31, stdev=20.76, samples=439 iops : min= 1, max= 26, avg= 6.13, stdev= 5.23, samples=439 lat (msec) : 10=1.69%, 20=11.43%, 50=37.47%, 100=25.29%, 250=21.06% lat (msec) : 500=2.86%, 750=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.24%, ctx=4796, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=103KiB/s (105kB/s), 25.7KiB/s-26.0KiB/s (26.3kB/s-26.6kB/s), io=23.4MiB (24.6MB), run=231223-233356msec WRITE: bw=108KiB/s (110kB/s), 26.7KiB/s-27.5KiB/s (27.4kB/s-28.1kB/s), io=24.6MiB (25.7MB), run=231223-233356msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179358: Thu Sep 10 16:49:27 2026 read: IOPS=6, BW=106KiB/s (108kB/s)(5920KiB/55944msec) clat (usec): min=39, max=295806, avg=78641.94, stdev=55007.60 lat (usec): min=39, max=295808, avg=78644.09, stdev=55007.37 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 71], 10.00th=[ 97], 20.00th=[ 37487], | 30.00th=[ 50070], 40.00th=[ 58983], 50.00th=[ 69731], 60.00th=[ 82314], | 70.00th=[ 96994], 80.00th=[116917], 90.00th=[152044], 95.00th=[179307], | 99.00th=[278922], 99.50th=[291505], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 29, max= 247, per=25.99%, avg=107.34, stdev=51.50, samples=107 iops : min= 1, max= 15, avg= 5.88, stdev= 3.28, samples=107 write: IOPS=7, BW=114KiB/s (117kB/s)(6368KiB/55944msec); 0 zone resets clat (usec): min=1516, max=527595, avg=66316.15, stdev=67075.21 lat (usec): min=1519, max=527598, avg=66320.94, stdev=67076.05 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2147], 10.00th=[ 5342], 20.00th=[ 11076], | 30.00th=[ 18744], 40.00th=[ 32375], 50.00th=[ 45351], 60.00th=[ 65799], | 70.00th=[ 84411], 80.00th=[114820], 90.00th=[158335], 95.00th=[179307], | 99.00th=[299893], 99.50th=[425722], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 27, max= 318, per=26.94%, avg=116.92, stdev=57.16, samples=106 iops : min= 1, max= 19, avg= 6.50, stdev= 3.63, samples=106 lat (usec) : 50=0.39%, 100=4.82%, 250=0.26%, 1000=0.13% lat (msec) : 2=1.95%, 4=2.21%, 10=5.99%, 20=6.77%, 50=18.62% lat (msec) : 100=32.29%, 250=24.87%, 500=1.56%, 750=0.13% cpu : usr=0.06%, sys=3.28%, ctx=1747, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179359: Thu Sep 10 16:49:27 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(5744KiB/56288msec) clat (usec): min=56, max=432050, avg=87587.98, stdev=62312.90 lat (usec): min=56, max=432052, avg=87591.50, stdev=62311.98 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 86], 10.00th=[ 25297], 20.00th=[ 40109], | 30.00th=[ 53216], 40.00th=[ 65799], 50.00th=[ 74974], 60.00th=[ 86508], | 70.00th=[104334], 80.00th=[125305], 90.00th=[166724], 95.00th=[208667], | 99.00th=[299893], 99.50th=[346031], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 29, max= 220, per=25.12%, avg=103.74, stdev=46.70, samples=108 iops : min= 1, max= 13, avg= 5.65, stdev= 2.96, samples=108 write: IOPS=7, BW=116KiB/s (119kB/s)(6544KiB/56288msec); 0 zone resets clat (usec): min=1587, max=362728, avg=60432.81, stdev=57063.76 lat (usec): min=1590, max=362731, avg=60486.80, stdev=57084.70 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2507], 10.00th=[ 5407], 20.00th=[ 12125], | 30.00th=[ 20055], 40.00th=[ 31589], 50.00th=[ 48497], 60.00th=[ 62653], | 70.00th=[ 76022], 80.00th=[ 95945], 90.00th=[137364], 95.00th=[179307], | 99.00th=[244319], 99.50th=[278922], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 30, max= 318, per=27.70%, avg=120.24, stdev=62.18, samples=106 iops : min= 1, max= 19, avg= 6.70, stdev= 3.93, samples=106 lat (usec) : 100=2.47%, 250=0.52% lat (msec) : 2=1.82%, 4=2.08%, 10=5.86%, 20=7.16%, 50=19.92% lat (msec) : 100=35.94%, 250=22.53%, 500=1.69% cpu : usr=0.04%, sys=3.55%, ctx=1794, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179360: Thu Sep 10 16:49:27 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6256KiB/57962msec) clat (usec): min=35, max=418675, avg=83868.83, stdev=62251.37 lat (usec): min=35, max=418677, avg=83884.31, stdev=62265.68 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 75], 10.00th=[ 21103], 20.00th=[ 36963], | 30.00th=[ 47973], 40.00th=[ 58459], 50.00th=[ 69731], 60.00th=[ 85459], | 70.00th=[103285], 80.00th=[124257], 90.00th=[166724], 95.00th=[204473], | 99.00th=[291505], 99.50th=[362808], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 29, max= 250, per=26.64%, avg=110.01, stdev=51.45, samples=111 iops : min= 1, max= 15, avg= 6.05, stdev= 3.28, samples=111 write: IOPS=6, BW=104KiB/s (107kB/s)(6032KiB/57962msec); 0 zone resets clat (usec): min=1495, max=369511, avg=65498.91, stdev=61772.79 lat (usec): min=1497, max=369515, avg=65502.32, stdev=61772.60 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2835], 10.00th=[ 4817], 20.00th=[ 11469], | 30.00th=[ 20317], 40.00th=[ 36963], 50.00th=[ 49546], 60.00th=[ 64226], | 70.00th=[ 86508], 80.00th=[111674], 90.00th=[143655], 95.00th=[183501], | 99.00th=[299893], 99.50th=[337642], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 30, max= 347, per=25.05%, avg=108.70, stdev=58.96, samples=107 iops : min= 1, max= 21, avg= 5.98, stdev= 3.75, samples=107 lat (usec) : 50=0.13%, 100=3.78%, 250=0.39%, 1000=0.13% lat (msec) : 2=1.17%, 4=2.99%, 10=5.73%, 20=5.21%, 50=21.48% lat (msec) : 100=30.86%, 250=26.30%, 500=1.82% cpu : usr=0.05%, sys=3.31%, ctx=1807, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179361: Thu Sep 10 16:49:27 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55752msec) clat (usec): min=39, max=592637, avg=80365.28, stdev=62208.34 lat (usec): min=39, max=592638, avg=80366.96, stdev=62208.48 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 75], 10.00th=[ 135], 20.00th=[ 35390], | 30.00th=[ 44303], 40.00th=[ 57934], 50.00th=[ 69731], 60.00th=[ 84411], | 70.00th=[100140], 80.00th=[120062], 90.00th=[156238], 95.00th=[187696], | 99.00th=[267387], 99.50th=[337642], 99.90th=[591397], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 29, max= 279, per=27.19%, avg=112.28, stdev=48.65, samples=103 iops : min= 1, max= 17, avg= 6.19, stdev= 3.08, samples=103 write: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55752msec); 0 zone resets clat (usec): min=1653, max=307090, avg=64022.38, stdev=62537.43 lat (usec): min=1656, max=307094, avg=64028.53, stdev=62534.23 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2540], 10.00th=[ 5080], 20.00th=[ 10159], | 30.00th=[ 19530], 40.00th=[ 32375], 50.00th=[ 47973], 60.00th=[ 60031], | 70.00th=[ 77071], 80.00th=[106431], 90.00th=[152044], 95.00th=[200279], | 99.00th=[263193], 99.50th=[283116], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 30, max= 286, per=26.48%, avg=114.93, stdev=57.96, samples=105 iops : min= 1, max= 17, avg= 6.35, stdev= 3.67, samples=105 lat (usec) : 50=0.39%, 100=3.91%, 250=0.91% lat (msec) : 2=1.04%, 4=2.73%, 10=6.64%, 20=6.12%, 50=21.35% lat (msec) : 100=30.86%, 250=24.48%, 500=1.43%, 750=0.13% cpu : usr=0.05%, sys=3.66%, ctx=1764, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=413KiB/s (423kB/s), 102KiB/s-108KiB/s (104kB/s-111kB/s), io=23.4MiB (24.5MB), run=55752-57962msec WRITE: bw=435KiB/s (445kB/s), 104KiB/s-116KiB/s (107kB/s-119kB/s), io=24.6MiB (25.8MB), run=55752-57962msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179363: Thu Sep 10 16:49:51 2026 read: IOPS=4, BW=72.8KiB/s (74.6kB/s)(5920KiB/81272msec) clat (msec): min=8, max=426, avg=91.19, stdev=73.13 lat (msec): min=8, max=426, avg=91.20, stdev=73.13 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 60], 50.00th=[ 69], 60.00th=[ 82], | 70.00th=[ 96], 80.00th=[ 123], 90.00th=[ 182], 95.00th=[ 253], | 99.00th=[ 368], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 223, per=28.25%, avg=82.77, stdev=45.17, samples=138 iops : min= 1, max= 13, avg= 4.33, stdev= 2.86, samples=138 write: IOPS=4, BW=78.4KiB/s (80.2kB/s)(6368KiB/81272msec); 0 zone resets clat (msec): min=23, max=490, avg=117.68, stdev=74.41 lat (msec): min=23, max=490, avg=117.68, stdev=74.41 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 41], 10.00th=[ 50], 20.00th=[ 60], | 30.00th=[ 73], 40.00th=[ 83], 50.00th=[ 97], 60.00th=[ 114], | 70.00th=[ 134], 80.00th=[ 174], 90.00th=[ 211], 95.00th=[ 253], | 99.00th=[ 397], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 30, max= 191, per=26.84%, avg=82.66, stdev=40.63, samples=149 iops : min= 1, max= 11, avg= 4.33, stdev= 2.55, samples=149 lat (msec) : 10=0.26%, 20=1.69%, 50=18.49%, 100=40.76%, 250=33.33% lat (msec) : 500=5.47% cpu : usr=0.04%, sys=1.19%, ctx=1297, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179365: Thu Sep 10 16:49:51 2026 read: IOPS=4, BW=70.3KiB/s (71.0kB/s)(5744KiB/81734msec) clat (msec): min=11, max=449, avg=86.82, stdev=68.13 lat (msec): min=11, max=449, avg=86.83, stdev=68.13 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 48], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 77], | 70.00th=[ 91], 80.00th=[ 114], 90.00th=[ 182], 95.00th=[ 228], | 99.00th=[ 380], 99.50th=[ 401], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 30, max= 254, per=27.67%, avg=81.07, stdev=50.22, samples=137 iops : min= 1, max= 15, avg= 4.22, stdev= 3.18, samples=137 write: IOPS=5, BW=80.1KiB/s (81.0kB/s)(6544KiB/81734msec); 0 zone resets clat (msec): min=17, max=719, avg=122.04, stdev=89.83 lat (msec): min=17, max=719, avg=122.06, stdev=89.83 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 38], 10.00th=[ 45], 20.00th=[ 55], | 30.00th=[ 67], 40.00th=[ 81], 50.00th=[ 97], 60.00th=[ 116], | 70.00th=[ 146], 80.00th=[ 176], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 439], 99.50th=[ 506], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 30, max= 382, per=27.95%, avg=86.09, stdev=52.08, samples=148 iops : min= 1, max= 23, avg= 4.53, stdev= 3.29, samples=148 lat (msec) : 20=1.30%, 50=22.53%, 100=38.93%, 250=31.38%, 500=5.47% lat (msec) : 750=0.39% cpu : usr=0.04%, sys=1.06%, ctx=1205, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179366: Thu Sep 10 16:49:51 2026 read: IOPS=4, BW=78.0KiB/s (79.9kB/s)(6256KiB/80205msec) clat (msec): min=12, max=512, avg=86.00, stdev=67.57 lat (msec): min=12, max=512, avg=86.00, stdev=67.57 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 48], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 94], 80.00th=[ 117], 90.00th=[ 171], 95.00th=[ 226], | 99.00th=[ 351], 99.50th=[ 460], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 29, max= 252, per=28.57%, avg=83.72, stdev=48.78, samples=146 iops : min= 1, max= 15, avg= 4.40, stdev= 3.11, samples=146 write: IOPS=4, BW=75.2KiB/s (77.0kB/s)(6032KiB/80205msec); 0 zone resets clat (msec): min=22, max=465, avg=123.19, stdev=79.86 lat (msec): min=22, max=465, avg=123.21, stdev=79.86 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 40], 10.00th=[ 50], 20.00th=[ 64], | 30.00th=[ 71], 40.00th=[ 85], 50.00th=[ 97], 60.00th=[ 117], | 70.00th=[ 142], 80.00th=[ 174], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 426], 99.50th=[ 435], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 30, max= 222, per=25.38%, avg=78.17, stdev=41.87, samples=149 iops : min= 1, max= 13, avg= 4.05, stdev= 2.64, samples=149 lat (msec) : 20=1.17%, 50=20.44%, 100=40.89%, 250=32.29%, 500=5.08% lat (msec) : 750=0.13% cpu : usr=0.04%, sys=1.04%, ctx=1128, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179367: Thu Sep 10 16:49:51 2026 read: IOPS=4, BW=74.7KiB/s (76.5kB/s)(6032KiB/80708msec) clat (msec): min=13, max=497, avg=82.40, stdev=67.00 lat (msec): min=13, max=497, avg=82.41, stdev=67.00 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 23], 10.00th=[ 30], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 55], 50.00th=[ 64], 60.00th=[ 77], | 70.00th=[ 86], 80.00th=[ 109], 90.00th=[ 153], 95.00th=[ 218], | 99.00th=[ 380], 99.50th=[ 493], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 29, max= 284, per=30.10%, avg=88.20, stdev=52.76, samples=132 iops : min= 1, max= 17, avg= 4.68, stdev= 3.32, samples=132 write: IOPS=4, BW=77.5KiB/s (79.4kB/s)(6256KiB/80708msec); 0 zone resets clat (msec): min=19, max=722, avg=125.87, stdev=94.57 lat (msec): min=19, max=722, avg=125.87, stdev=94.57 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 39], 10.00th=[ 46], 20.00th=[ 57], | 30.00th=[ 67], 40.00th=[ 81], 50.00th=[ 97], 60.00th=[ 115], | 70.00th=[ 142], 80.00th=[ 171], 90.00th=[ 255], 95.00th=[ 326], | 99.00th=[ 426], 99.50th=[ 518], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 29, max= 223, per=26.66%, avg=82.12, stdev=45.74, samples=148 iops : min= 1, max= 13, avg= 4.30, stdev= 2.90, samples=148 lat (msec) : 20=1.69%, 50=21.48%, 100=41.67%, 250=28.52%, 500=6.25% lat (msec) : 750=0.39% cpu : usr=0.04%, sys=1.05%, ctx=1179, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=293KiB/s (300kB/s), 70.3KiB/s-78.0KiB/s (71.0kB/s-79.9kB/s), io=23.4MiB (24.5MB), run=80205-81734msec WRITE: bw=308KiB/s (316kB/s), 75.2KiB/s-80.1KiB/s (77.0kB/s-81.0kB/s), io=24.6MiB (25.8MB), run=80205-81734msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179392: Thu Sep 10 16:50:08 2026 read: IOPS=1, BW=1837KiB/s (1881kB/s)(7168KiB/3902msec) clat (usec): min=616, max=455555, avg=290818.70, stdev=152138.64 lat (usec): min=618, max=455558, avg=290820.16, stdev=152138.99 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[196084], | 30.00th=[295699], 40.00th=[295699], 50.00th=[316670], 60.00th=[371196], | 70.00th=[371196], 80.00th=[396362], 90.00th=[455082], 95.00th=[455082], | 99.00th=[455082], 99.50th=[455082], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 1872, max= 4087, per=69.16%, avg=2489.75, stdev=1066.77, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1312KiB/s (1344kB/s)(5120KiB/3902msec); 0 zone resets clat (msec): min=191, max=410, avg=307.83, stdev=85.18 lat (msec): min=192, max=410, avg=308.18, stdev=84.79 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1872, max= 1973, per=38.10%, avg=1920.25, stdev=50.70, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=75.00% cpu : usr=0.00%, sys=16.84%, ctx=157, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179393: Thu Sep 10 16:50:08 2026 read: IOPS=0, BW=360KiB/s (369kB/s)(2048KiB/5688msec) clat (msec): min=442, max=539, avg=490.96, stdev=68.97 lat (msec): min=442, max=539, avg=490.97, stdev=68.97 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2027, max= 2035, per=56.42%, avg=2031.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1800KiB/s (1843kB/s)(10.0MiB/5688msec); 0 zone resets clat (msec): min=211, max=818, avg=413.65, stdev=210.34 lat (msec): min=211, max=818, avg=413.74, stdev=210.33 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 226], | 30.00th=[ 234], 40.00th=[ 296], 50.00th=[ 313], 60.00th=[ 347], | 70.00th=[ 464], 80.00th=[ 535], 90.00th=[ 701], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1954, max= 5616, per=50.19%, avg=2529.71, stdev=1361.43, samples=7 iops : min= 1, max= 5, avg= 1.71, stdev= 1.50, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=13.89%, ctx=180, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179394: Thu Sep 10 16:50:08 2026 read: IOPS=1, BW=1396KiB/s (1429kB/s)(6144KiB/4402msec) clat (usec): min=701, max=306194, avg=223562.60, stdev=124016.10 lat (usec): min=702, max=306195, avg=223563.69, stdev=124016.24 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[152044], | 30.00th=[152044], 40.00th=[274727], 50.00th=[274727], 60.00th=[304088], | 70.00th=[304088], 80.00th=[304088], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 2035, max= 3764, per=88.36%, avg=3181.00, stdev=992.52, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1396KiB/s (1429kB/s)(6144KiB/4402msec); 0 zone resets clat (msec): min=285, max=892, avg=494.86, stdev=226.85 lat (msec): min=285, max=892, avg=494.96, stdev=226.82 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 468], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1675, max= 2035, per=38.18%, avg=1924.33, stdev=134.16, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=8.33%, 500=66.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=13.47%, ctx=216, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179395: Thu Sep 10 16:50:08 2026 read: IOPS=0, BW=965KiB/s (988kB/s)(5120KiB/5308msec) clat (usec): min=739, max=737660, avg=240551.49, stdev=320528.93 lat (usec): min=740, max=737661, avg=240552.89, stdev=320528.97 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 742], | 30.00th=[ 11600], 40.00th=[ 11600], 50.00th=[ 62653], 60.00th=[ 62653], | 70.00th=[387974], 80.00th=[387974], 90.00th=[734004], 95.00th=[734004], | 99.00th=[734004], 99.50th=[734004], 99.90th=[734004], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 4071, max= 4079, per=100.00%, avg=4075.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1350KiB/s (1383kB/s)(7168KiB/5308msec); 0 zone resets clat (msec): min=192, max=918, avg=506.53, stdev=290.99 lat (msec): min=192, max=918, avg=506.62, stdev=290.96 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 201], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 485], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 810], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1882, max= 3744, per=46.63%, avg=2350.20, stdev=782.22, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=16.67% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=10.95%, ctx=207, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3601KiB/s (3687kB/s), 360KiB/s-1837KiB/s (369kB/s-1881kB/s), io=20.0MiB (20.0MB), run=3902-5688msec WRITE: bw=5041KiB/s (5162kB/s), 1312KiB/s-1800KiB/s (1344kB/s-1843kB/s), io=28.0MiB (29.4MB), run=3902-5688msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179388: Thu Sep 10 16:50:08 2026 read: IOPS=1, BW=1788KiB/s (1831kB/s)(7168KiB/4008msec) clat (msec): min=107, max=355, avg=221.72, stdev=93.59 lat (msec): min=107, max=355, avg=221.73, stdev=93.59 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 118], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 241], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 292], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1822, max= 4055, per=79.46%, avg=2718.25, stdev=1052.16, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1277KiB/s (1308kB/s)(5120KiB/4008msec); 0 zone resets clat (msec): min=127, max=707, avg=456.83, stdev=243.83 lat (msec): min=127, max=707, avg=457.04, stdev=243.89 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1822, max= 4079, per=52.08%, avg=2494.00, stdev=1061.57, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.05%, sys=5.19%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179389: Thu Sep 10 16:50:08 2026 read: IOPS=0, BW=360KiB/s (368kB/s)(2048KiB/5692msec) clat (msec): min=236, max=739, avg=487.67, stdev=355.80 lat (msec): min=236, max=739, avg=487.68, stdev=355.79 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1759, max= 2035, per=55.45%, avg=1897.00, stdev=195.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1799KiB/s (1842kB/s)(10.0MiB/5692msec); 0 zone resets clat (msec): min=235, max=770, avg=462.45, stdev=173.21 lat (msec): min=235, max=770, avg=463.00, stdev=173.66 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 241], | 30.00th=[ 313], 40.00th=[ 368], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 542], 80.00th=[ 550], 90.00th=[ 625], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1939, max= 2048, per=42.09%, avg=2015.75, stdev=35.84, samples=8 iops : min= 1, max= 2, avg= 1.12, stdev= 0.35, samples=8 lat (msec) : 250=25.00%, 500=33.33%, 750=33.33%, 1000=8.33% cpu : usr=0.02%, sys=4.85%, ctx=152, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179390: Thu Sep 10 16:50:08 2026 read: IOPS=1, BW=1176KiB/s (1204kB/s)(6144KiB/5226msec) clat (msec): min=109, max=404, avg=248.73, stdev=123.34 lat (msec): min=109, max=404, avg=248.74, stdev=123.34 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 259], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1822, max= 2048, per=58.15%, avg=1989.40, stdev=94.52, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1176KiB/s (1204kB/s)(6144KiB/5226msec); 0 zone resets clat (msec): min=247, max=906, avg=587.70, stdev=264.07 lat (msec): min=247, max=906, avg=587.85, stdev=264.07 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 625], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1822, max= 2043, per=41.50%, avg=1987.67, stdev=83.06, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=6.55%, ctx=182, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179391: Thu Sep 10 16:50:08 2026 read: IOPS=0, BW=855KiB/s (876kB/s)(5120KiB/5986msec) clat (msec): min=87, max=395, avg=207.01, stdev=129.66 lat (msec): min=87, max=395, avg=207.01, stdev=129.66 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2035, max= 6035, per=100.00%, avg=4035.00, stdev=2828.43, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1197KiB/s (1226kB/s)(7168KiB/5986msec); 0 zone resets clat (msec): min=219, max=1323, avg=668.26, stdev=347.26 lat (msec): min=219, max=1323, avg=668.58, stdev=347.18 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 481], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 558], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 793], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1939, max= 2035, per=41.71%, avg=1997.50, stdev=40.46, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=4.66%, ctx=149, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3421KiB/s (3503kB/s), 360KiB/s-1788KiB/s (368kB/s-1831kB/s), io=20.0MiB (20.0MB), run=4008-5986msec WRITE: bw=4790KiB/s (4905kB/s), 1176KiB/s-1799KiB/s (1204kB/s-1842kB/s), io=28.0MiB (29.4MB), run=4008-5986msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179404: Thu Sep 10 16:50:26 2026 read: IOPS=0, BW=3994KiB/s (4089kB/s)(12.0MiB/3077msec) clat (msec): min=777, max=1124, avg=1004.73, stdev=197.30 lat (msec): min=777, max=1124, avg=1004.73, stdev=197.30 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7772, max= 8143, per=100.00%, avg=7957.50, stdev=262.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.78%, ctx=440, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179405: Thu Sep 10 16:50:26 2026 read: IOPS=0, BW=980KiB/s (1004kB/s)(4096KiB/4178msec) clat (nsec): min=781749k, max=781749k, avg=781749405.00, stdev= 0.00 lat (nsec): min=781752k, max=781752k, avg=781752120.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1961KiB/s (2008kB/s)(8192KiB/4178msec); 0 zone resets clat (msec): min=831, max=2501, avg=1666.42, stdev=1180.62 lat (msec): min=831, max=2502, avg=1667.31, stdev=1181.46 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 2500], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.81%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179406: Thu Sep 10 16:50:26 2026 write: IOPS=0, BW=2995KiB/s (3067kB/s)(12.0MiB/4103msec); 0 zone resets clat (msec): min=335, max=2474, avg=1330.10, stdev=1077.16 lat (msec): min=336, max=2474, avg=1330.60, stdev=1077.10 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.19%, ctx=167, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179407: Thu Sep 10 16:50:26 2026 write: IOPS=0, BW=3925KiB/s (4019kB/s)(12.0MiB/3131msec); 0 zone resets clat (msec): min=522, max=1701, avg=968.92, stdev=639.06 lat (msec): min=523, max=1701, avg=969.69, stdev=638.86 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7772, max= 8143, per=100.00%, avg=7957.50, stdev=262.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.70%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3921KiB/s (4016kB/s), 980KiB/s-3994KiB/s (1004kB/s-4089kB/s), io=16.0MiB (16.8MB), run=3077-4178msec WRITE: bw=7843KiB/s (8031kB/s), 1961KiB/s-3925KiB/s (2008kB/s-4019kB/s), io=32.0MiB (33.6MB), run=3131-4178msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179408: Thu Sep 10 16:50:26 2026 read: IOPS=0, BW=3749KiB/s (3839kB/s)(12.0MiB/3278msec) clat (msec): min=937, max=1181, avg=1045.74, stdev=124.36 lat (msec): min=937, max=1181, avg=1045.74, stdev=124.36 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7984, max= 8031, per=100.00%, avg=8007.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.75%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179409: Thu Sep 10 16:50:26 2026 read: IOPS=0, BW=902KiB/s (923kB/s)(4096KiB/4542msec) clat (nsec): min=1642.0M, max=1642.0M, avg=1642972326.00, stdev= 0.00 lat (nsec): min=1642.0M, max=1642.0M, avg=1642975287.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1636], 5.00th=[ 1636], 10.00th=[ 1636], 20.00th=[ 1636], | 30.00th=[ 1636], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1804KiB/s (1847kB/s)(8192KiB/4542msec); 0 zone resets clat (msec): min=1181, max=1575, avg=1378.16, stdev=278.68 lat (msec): min=1182, max=1578, avg=1380.52, stdev=280.27 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.06%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179410: Thu Sep 10 16:50:26 2026 write: IOPS=0, BW=2668KiB/s (2732kB/s)(12.0MiB/4606msec); 0 zone resets clat (msec): min=340, max=2734, avg=1512.85, stdev=1197.89 lat (msec): min=345, max=2734, avg=1514.70, stdev=1195.68 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 7684, max= 7684, per=100.00%, avg=7684.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.52%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179411: Thu Sep 10 16:50:26 2026 write: IOPS=0, BW=3289KiB/s (3368kB/s)(12.0MiB/3736msec); 0 zone resets clat (msec): min=540, max=2048, avg=1215.63, stdev=766.43 lat (msec): min=540, max=2049, avg=1216.51, stdev=766.84 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 7684, max= 8062, per=100.00%, avg=7873.00, stdev=267.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.19%, sys=3.86%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3607KiB/s (3694kB/s), 902KiB/s-3749KiB/s (923kB/s-3839kB/s), io=16.0MiB (16.8MB), run=3278-4542msec WRITE: bw=7114KiB/s (7285kB/s), 1804KiB/s-3289KiB/s (1847kB/s-3368kB/s), io=32.0MiB (33.6MB), run=3736-4606msec