== sanity test 398b: DIO and buffer IO race ============== 23:39:10 (1761104350) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.39055 s, 21.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=195182: Tue Oct 21 23:40:18 2025 read: IOPS=24, BW=99.8KiB/s (102kB/s)(5992KiB/60033msec) clat (usec): min=89, max=710732, avg=21837.45, stdev=21326.90 lat (usec): min=90, max=710733, avg=21838.01, stdev=21326.92 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 7111], 10.00th=[ 8848], 20.00th=[ 11731], | 30.00th=[ 14353], 40.00th=[ 16909], 50.00th=[ 19530], 60.00th=[ 22414], | 70.00th=[ 25822], 80.00th=[ 30016], 90.00th=[ 35914], 95.00th=[ 42730], | 99.00th=[ 56886], 99.50th=[ 67634], 99.90th=[109577], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 39, max= 200, per=25.12%, avg=100.25, stdev=29.59, samples=118 iops : min= 9, max= 50, avg=24.65, stdev= 7.49, samples=118 write: IOPS=26, BW=105KiB/s (107kB/s)(6296KiB/60033msec); 0 zone resets clat (usec): min=643, max=116917, avg=17283.60, stdev=12896.06 lat (usec): min=644, max=116918, avg=17284.29, stdev=12896.11 clat percentiles (usec): | 1.00th=[ 717], 5.00th=[ 2442], 10.00th=[ 3130], 20.00th=[ 5211], | 30.00th=[ 8586], 40.00th=[ 11863], 50.00th=[ 15008], 60.00th=[ 18482], | 70.00th=[ 21890], 80.00th=[ 27395], 90.00th=[ 35390], 95.00th=[ 41157], | 99.00th=[ 53216], 99.50th=[ 63701], 99.90th=[ 84411], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 23, max= 224, per=25.20%, avg=105.32, stdev=36.99, samples=118 iops : min= 5, max= 56, avg=25.92, stdev= 9.38, samples=118 lat (usec) : 100=0.03%, 250=0.07%, 500=0.42%, 750=1.14%, 1000=0.52% lat (msec) : 2=0.81%, 4=5.79%, 10=15.69%, 20=33.89%, 50=39.71% lat (msec) : 100=1.82%, 250=0.07%, 750=0.03% cpu : usr=0.05%, sys=26.76%, ctx=10041, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195183: Tue Oct 21 23:40:18 2025 read: IOPS=25, BW=100KiB/s (102kB/s)(5940KiB/59397msec) clat (usec): min=80, max=96415, avg=20417.59, stdev=10781.98 lat (usec): min=81, max=96416, avg=20418.15, stdev=10782.01 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 7111], 10.00th=[ 9110], 20.00th=[11600], | 30.00th=[13960], 40.00th=[16581], 50.00th=[18744], 60.00th=[21103], | 70.00th=[24511], 80.00th=[28181], 90.00th=[34341], 95.00th=[39584], | 99.00th=[54789], 99.50th=[57934], 99.90th=[78119], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 6, max= 184, per=25.02%, avg=99.83, stdev=31.08, samples=118 iops : min= 1, max= 46, avg=24.54, stdev= 7.92, samples=118 write: IOPS=26, BW=107KiB/s (109kB/s)(6348KiB/59397msec); 0 zone resets clat (usec): min=597, max=695570, avg=18253.12, stdev=21684.66 lat (usec): min=597, max=695570, avg=18253.75, stdev=21684.66 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 2507], 10.00th=[ 3261], 20.00th=[ 5473], | 30.00th=[ 9110], 40.00th=[ 12518], 50.00th=[ 15795], 60.00th=[ 18744], | 70.00th=[ 22676], 80.00th=[ 27657], 90.00th=[ 34341], 95.00th=[ 41681], | 99.00th=[ 63177], 99.50th=[ 73925], 99.90th=[113771], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 39, max= 224, per=25.67%, avg=107.30, stdev=35.00, samples=117 iops : min= 9, max= 56, avg=26.42, stdev= 8.85, samples=117 lat (usec) : 100=0.10%, 250=0.07%, 500=0.52%, 750=1.17%, 1000=0.52% lat (msec) : 2=0.85%, 4=5.11%, 10=15.04%, 20=36.49%, 50=38.22% lat (msec) : 100=1.82%, 250=0.07%, 750=0.03% cpu : usr=0.06%, sys=26.82%, ctx=9966, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195184: Tue Oct 21 23:40:18 2025 read: IOPS=25, BW=102KiB/s (105kB/s)(6028KiB/58899msec) clat (usec): min=96, max=104731, avg=20586.39, stdev=11584.86 lat (usec): min=96, max=104731, avg=20587.06, stdev=11584.85 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 7046], 10.00th=[ 8979], 20.00th=[ 11207], | 30.00th=[ 13829], 40.00th=[ 16319], 50.00th=[ 18482], 60.00th=[ 21103], | 70.00th=[ 24511], 80.00th=[ 28443], 90.00th=[ 35390], 95.00th=[ 41681], | 99.00th=[ 60556], 99.50th=[ 66323], 99.90th=[ 85459], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 47, max= 192, per=25.85%, avg=103.15, stdev=33.94, samples=116 iops : min= 11, max= 48, avg=25.37, stdev= 8.59, samples=116 write: IOPS=26, BW=106KiB/s (109kB/s)(6260KiB/58899msec); 0 zone resets clat (usec): min=655, max=658471, avg=17742.58, stdev=20955.69 lat (usec): min=655, max=658472, avg=17743.56, stdev=20955.61 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 2024], 10.00th=[ 2933], 20.00th=[ 4948], | 30.00th=[ 7963], 40.00th=[ 11863], 50.00th=[ 14746], 60.00th=[ 18220], | 70.00th=[ 22676], 80.00th=[ 28181], 90.00th=[ 35914], 95.00th=[ 42206], | 99.00th=[ 60556], 99.50th=[ 67634], 99.90th=[102237], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 47, max= 200, per=25.60%, avg=107.00, stdev=32.68, samples=116 iops : min= 11, max= 50, avg=26.34, stdev= 8.31, samples=116 lat (usec) : 100=0.03%, 250=0.16%, 500=0.62%, 750=1.20%, 1000=0.85% lat (msec) : 2=1.20%, 4=5.76%, 10=14.75%, 20=35.81%, 50=37.53% lat (msec) : 100=1.99%, 250=0.07%, 750=0.03% cpu : usr=0.05%, sys=26.38%, ctx=9899, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195185: Tue Oct 21 23:40:18 2025 read: IOPS=25, BW=101KiB/s (103kB/s)(6052KiB/60119msec) clat (usec): min=79, max=79713, avg=20754.74, stdev=11478.88 lat (usec): min=80, max=79713, avg=20756.50, stdev=11479.06 clat percentiles (usec): | 1.00th=[ 326], 5.00th=[ 6587], 10.00th=[ 8717], 20.00th=[11338], | 30.00th=[13829], 40.00th=[16188], 50.00th=[19006], 60.00th=[21890], | 70.00th=[25297], 80.00th=[28967], 90.00th=[35914], 95.00th=[41157], | 99.00th=[56886], 99.50th=[65799], 99.90th=[79168], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 47, max= 168, per=25.24%, avg=100.72, stdev=31.15, samples=118 iops : min= 11, max= 42, avg=24.77, stdev= 7.91, samples=118 write: IOPS=25, BW=104KiB/s (106kB/s)(6236KiB/60119msec); 0 zone resets clat (usec): min=632, max=653682, avg=18340.46, stdev=21215.57 lat (usec): min=633, max=653683, avg=18341.22, stdev=21215.60 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 2245], 10.00th=[ 3032], 20.00th=[ 5211], | 30.00th=[ 9241], 40.00th=[ 12518], 50.00th=[ 15139], 60.00th=[ 18482], | 70.00th=[ 22676], 80.00th=[ 28443], 90.00th=[ 36963], 95.00th=[ 42206], | 99.00th=[ 59507], 99.50th=[ 72877], 99.90th=[120062], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 40, max= 240, per=24.89%, avg=104.05, stdev=38.36, samples=118 iops : min= 10, max= 60, avg=25.60, stdev= 9.68, samples=118 lat (usec) : 100=0.07%, 250=0.16%, 500=0.68%, 750=1.14%, 1000=0.88% lat (msec) : 2=0.94%, 4=5.96%, 10=13.64%, 20=35.35%, 50=39.19% lat (msec) : 100=1.92%, 250=0.03%, 750=0.03% cpu : usr=0.04%, sys=26.14%, ctx=10065, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=399KiB/s (409kB/s), 99.8KiB/s-102KiB/s (102kB/s-105kB/s), io=23.4MiB (24.6MB), run=58899-60119msec WRITE: bw=418KiB/s (428kB/s), 104KiB/s-107KiB/s (106kB/s-109kB/s), io=24.6MiB (25.7MB), run=58899-60119msec rand-rw: (groupid=0, jobs=1): err= 0: pid=195177: Tue Oct 21 23:40:25 2025 read: IOPS=22, BW=89.2KiB/s (91.3kB/s)(5992KiB/67183msec) clat (msec): min=3, max=711, avg=20.20, stdev=23.69 lat (msec): min=3, max=711, avg=20.20, stdev=23.69 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 78], 99.50th=[ 96], 99.90th=[ 116], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 16, max= 312, per=25.05%, avg=89.18, stdev=56.70, samples=132 iops : min= 4, max= 78, avg=21.92, stdev=14.29, samples=132 write: IOPS=23, BW=93.7KiB/s (95.0kB/s)(6296KiB/67183msec); 0 zone resets clat (msec): min=4, max=140, avg=23.35, stdev=15.65 lat (msec): min=4, max=140, avg=23.35, stdev=15.65 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 44], 95.00th=[ 51], | 99.00th=[ 73], 99.50th=[ 88], 99.90th=[ 138], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 32, max= 352, per=25.02%, avg=93.32, stdev=56.73, samples=132 iops : min= 8, max= 88, avg=22.95, stdev=14.27, samples=132 lat (msec) : 4=0.33%, 10=24.97%, 20=33.33%, 50=35.94%, 100=5.05% lat (msec) : 250=0.36%, 750=0.03% cpu : usr=0.06%, sys=13.09%, ctx=6338, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195178: Tue Oct 21 23:40:25 2025 read: IOPS=22, BW=88.9KiB/s (90.0kB/s)(5940KiB/66849msec) clat (msec): min=3, max=638, avg=19.80, stdev=21.92 lat (msec): min=3, max=638, avg=19.80, stdev=21.92 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 78], 99.50th=[ 91], 99.90th=[ 123], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 23, max= 312, per=25.09%, avg=89.32, stdev=56.11, samples=132 iops : min= 5, max= 78, avg=21.95, stdev=14.13, samples=132 write: IOPS=23, BW=94.0KiB/s (97.2kB/s)(6348KiB/66849msec); 0 zone resets clat (msec): min=4, max=138, avg=23.48, stdev=15.92 lat (msec): min=4, max=138, avg=23.48, stdev=15.92 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 81], 99.50th=[ 104], 99.90th=[ 130], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 304, per=25.62%, avg=95.55, stdev=56.35, samples=132 iops : min= 7, max= 76, avg=23.52, stdev=14.19, samples=132 lat (msec) : 4=0.26%, 10=23.99%, 20=34.70%, 50=35.71%, 100=4.88% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.06%, sys=13.30%, ctx=6434, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195179: Tue Oct 21 23:40:25 2025 read: IOPS=22, BW=89.6KiB/s (91.7kB/s)(6028KiB/67282msec) clat (msec): min=3, max=125, avg=19.20, stdev=15.30 lat (msec): min=3, max=125, avg=19.20, stdev=15.30 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 41], 95.00th=[ 50], | 99.00th=[ 74], 99.50th=[ 91], 99.90th=[ 124], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 23, max= 352, per=25.02%, avg=89.08, stdev=60.33, samples=132 iops : min= 5, max= 88, avg=21.89, stdev=15.17, samples=132 write: IOPS=23, BW=93.0KiB/s (95.3kB/s)(6260KiB/67282msec); 0 zone resets clat (msec): min=4, max=649, avg=24.39, stdev=22.79 lat (msec): min=4, max=649, avg=24.39, stdev=22.79 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 54], | 99.00th=[ 88], 99.50th=[ 104], 99.90th=[ 118], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 31, max= 296, per=24.77%, avg=92.39, stdev=53.49, samples=132 iops : min= 7, max= 74, avg=22.73, stdev=13.48, samples=132 lat (msec) : 4=0.42%, 10=25.65%, 20=32.52%, 50=35.71%, 100=5.31% lat (msec) : 250=0.36%, 750=0.03% cpu : usr=0.05%, sys=12.97%, ctx=6277, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195180: Tue Oct 21 23:40:25 2025 read: IOPS=22, BW=90.3KiB/s (92.5kB/s)(6052KiB/67020msec) clat (msec): min=3, max=118, avg=19.48, stdev=14.88 lat (msec): min=3, max=118, avg=19.48, stdev=14.88 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 75], 99.50th=[ 90], 99.90th=[ 117], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 16, max= 296, per=25.39%, avg=90.40, stdev=55.60, samples=132 iops : min= 4, max= 74, avg=22.23, stdev=14.01, samples=132 write: IOPS=23, BW=93.0KiB/s (95.3kB/s)(6236KiB/67020msec); 0 zone resets clat (msec): min=4, max=645, avg=23.97, stdev=22.06 lat (msec): min=4, max=645, avg=23.97, stdev=22.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 73], 99.50th=[ 82], 99.90th=[ 130], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 31, max= 336, per=25.00%, avg=93.24, stdev=56.98, samples=132 iops : min= 7, max= 84, avg=22.94, stdev=14.32, samples=132 lat (msec) : 4=0.42%, 10=24.02%, 20=33.98%, 50=35.84%, 100=5.50% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.05%, sys=13.31%, ctx=6391, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=357KiB/s (365kB/s), 88.9KiB/s-90.3KiB/s (90.0kB/s-92.5kB/s), io=23.4MiB (24.6MB), run=66849-67282msec WRITE: bw=374KiB/s (383kB/s), 93.0KiB/s-94.0KiB/s (95.3kB/s-97.2kB/s), io=24.6MiB (25.7MB), run=66849-67282msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=195211: Tue Oct 21 23:40:44 2025 read: IOPS=28, BW=456KiB/s (467kB/s)(5920KiB/12969msec) clat (usec): min=86, max=66900, avg=17299.19, stdev=9702.66 lat (usec): min=86, max=66900, avg=17299.66, stdev=9702.65 clat percentiles (usec): | 1.00th=[ 269], 5.00th=[ 437], 10.00th=[ 8160], 20.00th=[10814], | 30.00th=[12649], 40.00th=[14091], 50.00th=[15533], 60.00th=[17957], | 70.00th=[20579], 80.00th=[23462], 90.00th=[28967], 95.00th=[34866], | 99.00th=[49021], 99.50th=[62653], 99.90th=[66847], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 287, max= 640, per=24.68%, avg=449.44, stdev=94.23, samples=25 iops : min= 17, max= 40, avg=27.60, stdev= 6.02, samples=25 write: IOPS=30, BW=491KiB/s (503kB/s)(6368KiB/12969msec); 0 zone resets clat (usec): min=1020, max=75788, avg=16460.53, stdev=11852.81 lat (usec): min=1020, max=75789, avg=16461.33, stdev=11852.85 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 3064], 10.00th=[ 4490], 20.00th=[ 5473], | 30.00th=[ 8029], 40.00th=[11207], 50.00th=[13829], 60.00th=[17171], | 70.00th=[20841], 80.00th=[25822], 90.00th=[33162], 95.00th=[38536], | 99.00th=[53740], 99.50th=[58983], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 224, max= 638, per=25.49%, avg=488.44, stdev=87.50, samples=25 iops : min= 14, max= 39, avg=30.04, stdev= 5.37, samples=25 lat (usec) : 100=0.26%, 250=0.13%, 500=2.21%, 750=0.26%, 1000=0.39% lat (msec) : 2=2.08%, 4=1.95%, 10=19.79%, 20=39.97%, 50=31.64% lat (msec) : 100=1.30% cpu : usr=0.05%, sys=27.41%, ctx=2665, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195212: Tue Oct 21 23:40:44 2025 read: IOPS=27, BW=437KiB/s (447kB/s)(5744KiB/13148msec) clat (usec): min=85, max=92313, avg=18795.27, stdev=10422.40 lat (usec): min=85, max=92313, avg=18795.76, stdev=10422.43 clat percentiles (usec): | 1.00th=[ 396], 5.00th=[ 6783], 10.00th=[ 9634], 20.00th=[11338], | 30.00th=[12780], 40.00th=[15401], 50.00th=[17433], 60.00th=[19530], | 70.00th=[21890], 80.00th=[24249], 90.00th=[29230], 95.00th=[36439], | 99.00th=[60031], 99.50th=[64750], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 191, max= 670, per=23.82%, avg=433.76, stdev=104.72, samples=25 iops : min= 11, max= 41, avg=26.64, stdev= 6.68, samples=25 write: IOPS=31, BW=498KiB/s (510kB/s)(6544KiB/13148msec); 0 zone resets clat (usec): min=1024, max=59783, avg=15555.25, stdev=11446.22 lat (usec): min=1025, max=59784, avg=15555.95, stdev=11446.22 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 2900], 10.00th=[ 4555], 20.00th=[ 5211], | 30.00th=[ 6980], 40.00th=[10552], 50.00th=[12649], 60.00th=[15139], | 70.00th=[19792], 80.00th=[24511], 90.00th=[33424], 95.00th=[39584], | 99.00th=[48497], 99.50th=[49021], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 352, max= 638, per=25.27%, avg=484.12, stdev=91.47, samples=25 iops : min= 22, max= 39, avg=29.80, stdev= 5.48, samples=25 lat (usec) : 100=0.13%, 500=1.43%, 750=0.26% lat (msec) : 2=1.95%, 4=1.82%, 10=20.96%, 20=40.23%, 50=32.16% lat (msec) : 100=1.04% cpu : usr=0.05%, sys=27.41%, ctx=2649, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195213: Tue Oct 21 23:40:44 2025 read: IOPS=30, BW=488KiB/s (500kB/s)(6256KiB/12814msec) clat (usec): min=82, max=71301, avg=17607.17, stdev=9334.59 lat (usec): min=82, max=71302, avg=17607.72, stdev=9334.61 clat percentiles (usec): | 1.00th=[ 262], 5.00th=[ 433], 10.00th=[ 8586], 20.00th=[11076], | 30.00th=[13042], 40.00th=[15139], 50.00th=[16909], 60.00th=[19006], | 70.00th=[20841], 80.00th=[23725], 90.00th=[28181], 95.00th=[31589], | 99.00th=[54264], 99.50th=[56886], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 255, max= 766, per=26.87%, avg=489.28, stdev=109.50, samples=25 iops : min= 15, max= 47, avg=30.12, stdev= 6.73, samples=25 write: IOPS=29, BW=471KiB/s (482kB/s)(6032KiB/12814msec); 0 zone resets clat (usec): min=1020, max=75700, avg=15611.62, stdev=11755.26 lat (usec): min=1021, max=75701, avg=15612.40, stdev=11755.25 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 3458], 10.00th=[ 4359], 20.00th=[ 5538], | 30.00th=[ 7898], 40.00th=[10552], 50.00th=[13173], 60.00th=[15664], | 70.00th=[18220], 80.00th=[23462], 90.00th=[31851], 95.00th=[39060], | 99.00th=[58459], 99.50th=[70779], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 254, max= 672, per=24.22%, avg=464.08, stdev=102.21, samples=25 iops : min= 15, max= 42, avg=28.52, stdev= 6.59, samples=25 lat (usec) : 100=0.13%, 250=0.13%, 500=2.73%, 750=0.13% lat (msec) : 2=1.43%, 4=2.47%, 10=19.27%, 20=44.14%, 50=28.13% lat (msec) : 100=1.43% cpu : usr=0.05%, sys=27.99%, ctx=2710, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195214: Tue Oct 21 23:40:44 2025 read: IOPS=29, BW=480KiB/s (491kB/s)(6032KiB/12568msec) clat (usec): min=91, max=59458, avg=17274.37, stdev=10264.04 lat (usec): min=92, max=59459, avg=17274.82, stdev=10264.04 clat percentiles (usec): | 1.00th=[ 269], 5.00th=[ 412], 10.00th=[ 1029], 20.00th=[10683], | 30.00th=[12256], 40.00th=[14091], 50.00th=[15926], 60.00th=[18220], | 70.00th=[20579], 80.00th=[23725], 90.00th=[30278], 95.00th=[33817], | 99.00th=[54264], 99.50th=[55837], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 256, max= 576, per=25.89%, avg=471.50, stdev=75.80, samples=24 iops : min= 16, max= 36, avg=29.00, stdev= 4.61, samples=24 write: IOPS=31, BW=498KiB/s (510kB/s)(6256KiB/12568msec); 0 zone resets clat (usec): min=929, max=98634, avg=15398.56, stdev=11234.01 lat (usec): min=930, max=98634, avg=15399.32, stdev=11234.03 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 3490], 10.00th=[ 4621], 20.00th=[ 5276], | 30.00th=[ 7504], 40.00th=[10814], 50.00th=[12911], 60.00th=[15533], | 70.00th=[19006], 80.00th=[23725], 90.00th=[30802], 95.00th=[36439], | 99.00th=[46400], 99.50th=[55313], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 286, max= 736, per=25.73%, avg=493.04, stdev=118.26, samples=24 iops : min= 17, max= 46, avg=30.38, stdev= 7.51, samples=24 lat (usec) : 100=0.13%, 250=0.26%, 500=3.65%, 750=0.26%, 1000=0.65% lat (msec) : 2=1.56%, 4=1.82%, 10=18.62%, 20=41.93%, 50=29.95% lat (msec) : 100=1.17% cpu : usr=0.04%, sys=27.92%, ctx=2671, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1822KiB/s (1865kB/s), 437KiB/s-488KiB/s (447kB/s-500kB/s), io=23.4MiB (24.5MB), run=12568-13148msec WRITE: bw=1917KiB/s (1963kB/s), 471KiB/s-498KiB/s (482kB/s-510kB/s), io=24.6MiB (25.8MB), run=12568-13148msec rand-rw: (groupid=0, jobs=1): err= 0: pid=195216: Tue Oct 21 23:40:47 2025 read: IOPS=23, BW=380KiB/s (389kB/s)(5920KiB/15593msec) clat (usec): min=3327, max=66524, avg=17181.22, stdev=11580.53 lat (usec): min=3327, max=66524, avg=17181.73, stdev=11580.50 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 6063], 10.00th=[ 6783], 20.00th=[ 8586], | 30.00th=[ 9896], 40.00th=[11338], 50.00th=[13304], 60.00th=[15139], | 70.00th=[17957], 80.00th=[23987], 90.00th=[36439], 95.00th=[43254], | 99.00th=[51643], 99.50th=[61080], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 128, max= 1024, per=24.53%, avg=370.90, stdev=201.37, samples=30 iops : min= 8, max= 64, avg=22.80, stdev=12.76, samples=30 write: IOPS=25, BW=408KiB/s (418kB/s)(6368KiB/15593msec); 0 zone resets clat (msec): min=5, max=100, avg=23.04, stdev=15.34 lat (msec): min=5, max=100, avg=23.05, stdev=15.34 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 66], 99.50th=[ 94], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 128, max= 1152, per=25.53%, avg=406.23, stdev=200.12, samples=30 iops : min= 8, max= 72, avg=25.00, stdev=12.63, samples=30 lat (msec) : 4=0.26%, 10=24.35%, 20=39.45%, 50=31.51%, 100=4.30% lat (msec) : 250=0.13% cpu : usr=0.05%, sys=11.90%, ctx=1481, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195217: Tue Oct 21 23:40:47 2025 read: IOPS=22, BW=366KiB/s (375kB/s)(5744KiB/15698msec) clat (usec): min=3832, max=64502, avg=17465.92, stdev=12713.83 lat (usec): min=3833, max=64502, avg=17466.40, stdev=12713.82 clat percentiles (usec): | 1.00th=[ 4883], 5.00th=[ 5800], 10.00th=[ 6652], 20.00th=[ 8455], | 30.00th=[ 9765], 40.00th=[11076], 50.00th=[12518], 60.00th=[14615], | 70.00th=[18482], 80.00th=[25822], 90.00th=[36963], 95.00th=[47449], | 99.00th=[59507], 99.50th=[63701], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 127, max= 832, per=24.22%, avg=366.19, stdev=178.71, samples=31 iops : min= 7, max= 52, avg=22.52, stdev=11.32, samples=31 write: IOPS=26, BW=417KiB/s (427kB/s)(6544KiB/15698msec); 0 zone resets clat (msec): min=5, max=102, avg=22.87, stdev=14.66 lat (msec): min=5, max=102, avg=22.87, stdev=14.66 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 42], 95.00th=[ 48], | 99.00th=[ 65], 99.50th=[ 78], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 223, max= 1152, per=26.15%, avg=416.10, stdev=211.52, samples=31 iops : min= 13, max= 72, avg=25.65, stdev=13.34, samples=31 lat (msec) : 4=0.26%, 10=25.13%, 20=37.50%, 50=33.07%, 100=3.91% lat (msec) : 250=0.13% cpu : usr=0.06%, sys=11.87%, ctx=1495, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195218: Tue Oct 21 23:40:47 2025 read: IOPS=24, BW=396KiB/s (406kB/s)(6256KiB/15791msec) clat (usec): min=3343, max=73304, avg=18236.61, stdev=13342.72 lat (usec): min=3343, max=73305, avg=18237.13, stdev=13342.71 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5407], 10.00th=[ 6587], 20.00th=[ 8094], | 30.00th=[ 9765], 40.00th=[11338], 50.00th=[13435], 60.00th=[15401], | 70.00th=[20841], 80.00th=[26870], 90.00th=[39060], 95.00th=[46924], | 99.00th=[63177], 99.50th=[64750], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 159, max= 992, per=26.28%, avg=397.29, stdev=218.64, samples=31 iops : min= 9, max= 62, avg=24.45, stdev=13.83, samples=31 write: IOPS=23, BW=382KiB/s (391kB/s)(6032KiB/15791msec); 0 zone resets clat (usec): min=5024, max=93180, avg=22811.70, stdev=14609.68 lat (usec): min=5025, max=93181, avg=22812.60, stdev=14609.68 clat percentiles (usec): | 1.00th=[ 5669], 5.00th=[ 7177], 10.00th=[ 8160], 20.00th=[ 9896], | 30.00th=[12518], 40.00th=[15533], 50.00th=[18744], 60.00th=[23462], | 70.00th=[27919], 80.00th=[33424], 90.00th=[43254], 95.00th=[50070], | 99.00th=[70779], 99.50th=[87557], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 192, max= 1120, per=23.66%, avg=376.45, stdev=202.35, samples=31 iops : min= 12, max= 70, avg=23.16, stdev=12.77, samples=31 lat (msec) : 4=0.26%, 10=25.39%, 20=35.03%, 50=34.90%, 100=4.43% cpu : usr=0.04%, sys=11.90%, ctx=1508, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195219: Tue Oct 21 23:40:47 2025 read: IOPS=23, BW=381KiB/s (390kB/s)(6032KiB/15835msec) clat (usec): min=3602, max=73950, avg=17745.23, stdev=13046.30 lat (usec): min=3602, max=73950, avg=17745.78, stdev=13046.23 clat percentiles (usec): | 1.00th=[ 4015], 5.00th=[ 5342], 10.00th=[ 5997], 20.00th=[ 7701], | 30.00th=[ 9503], 40.00th=[11469], 50.00th=[13698], 60.00th=[16057], | 70.00th=[19268], 80.00th=[24773], 90.00th=[38536], 95.00th=[47449], | 99.00th=[63701], 99.50th=[69731], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 222, max= 960, per=24.68%, avg=373.19, stdev=191.04, samples=31 iops : min= 13, max= 60, avg=22.97, stdev=12.11, samples=31 write: IOPS=24, BW=395KiB/s (405kB/s)(6256KiB/15835msec); 0 zone resets clat (msec): min=4, max=103, avg=23.17, stdev=15.32 lat (msec): min=4, max=103, avg=23.17, stdev=15.32 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 54], | 99.00th=[ 70], 99.50th=[ 93], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 191, max= 1088, per=24.54%, avg=390.45, stdev=206.63, samples=31 iops : min= 11, max= 68, avg=24.03, stdev=13.05, samples=31 lat (msec) : 4=0.39%, 10=24.87%, 20=37.50%, 50=32.55%, 100=4.56% lat (msec) : 250=0.13% cpu : usr=0.09%, sys=11.60%, ctx=1491, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1513KiB/s (1549kB/s), 366KiB/s-396KiB/s (375kB/s-406kB/s), io=23.4MiB (24.5MB), run=15593-15835msec WRITE: bw=1591KiB/s (1630kB/s), 382KiB/s-417KiB/s (391kB/s-427kB/s), io=24.6MiB (25.8MB), run=15593-15835msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=195226: Tue Oct 21 23:40:55 2025 read: IOPS=4, BW=4182KiB/s (4282kB/s)(7168KiB/1714msec) clat (usec): min=679, max=150179, avg=106122.53, stdev=50815.08 lat (usec): min=679, max=150180, avg=106123.50, stdev=50815.26 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 86508], | 30.00th=[110625], 40.00th=[110625], 50.00th=[125305], 60.00th=[130548], | 70.00th=[130548], 80.00th=[139461], 90.00th=[149947], 95.00th=[149947], | 99.00th=[149947], 99.50th=[149947], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 2035, max= 5163, per=53.57%, avg=3719.67, stdev=1577.90, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2987KiB/s (3059kB/s)(5120KiB/1714msec); 0 zone resets clat (msec): min=96, max=334, avg=191.86, stdev=100.00 lat (msec): min=96, max=334, avg=191.90, stdev=99.99 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1980, max= 6107, per=41.59%, avg=4043.50, stdev=2918.23, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=66.67%, 500=8.33% cpu : usr=0.00%, sys=62.87%, ctx=653, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195227: Tue Oct 21 23:40:55 2025 read: IOPS=0, BW=694KiB/s (711kB/s)(2048KiB/2949msec) clat (usec): min=94704, max=98227, avg=96465.96, stdev=2491.34 lat (usec): min=94704, max=98228, avg=96466.73, stdev=2491.51 clat percentiles (usec): | 1.00th=[94897], 5.00th=[94897], 10.00th=[94897], 20.00th=[94897], | 30.00th=[94897], 40.00th=[94897], 50.00th=[94897], 60.00th=[98042], | 70.00th=[98042], 80.00th=[98042], 90.00th=[98042], 95.00th=[98042], | 99.00th=[98042], 99.50th=[98042], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 1718, max= 2000, per=26.77%, avg=1859.00, stdev=199.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3472KiB/s (3556kB/s)(10.0MiB/2949msec); 0 zone resets clat (msec): min=131, max=605, avg=272.89, stdev=139.92 lat (msec): min=131, max=605, avg=272.96, stdev=139.92 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 169], | 30.00th=[ 182], 40.00th=[ 190], 50.00th=[ 226], 60.00th=[ 239], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 397], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2000, max= 5941, per=41.42%, avg=4027.00, stdev=1610.26, samples=4 iops : min= 1, max= 5, avg= 3.25, stdev= 1.71, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=48.44%, ctx=455, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195228: Tue Oct 21 23:40:55 2025 read: IOPS=2, BW=2180KiB/s (2233kB/s)(6144KiB/2818msec) clat (usec): min=818, max=198481, avg=120354.01, stdev=65000.94 lat (usec): min=819, max=198482, avg=120354.74, stdev=65000.76 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 816], 10.00th=[ 816], 20.00th=[115868], | 30.00th=[115868], 40.00th=[135267], 50.00th=[135267], 60.00th=[135267], | 70.00th=[137364], 80.00th=[137364], 90.00th=[198181], 95.00th=[198181], | 99.00th=[198181], 99.50th=[198181], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 2048, max= 4000, per=48.05%, avg=3336.33, stdev=1115.90, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=2, BW=2180KiB/s (2233kB/s)(6144KiB/2818msec); 0 zone resets clat (msec): min=119, max=773, avg=343.91, stdev=236.85 lat (msec): min=119, max=773, avg=343.95, stdev=236.86 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 321], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1980, max= 3436, per=24.34%, avg=2366.00, stdev=713.90, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=41.04%, ctx=452, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195229: Tue Oct 21 23:40:55 2025 read: IOPS=1, BW=1998KiB/s (2046kB/s)(5120KiB/2562msec) clat (usec): min=645, max=240889, avg=118446.08, stdev=87478.70 lat (usec): min=646, max=240890, avg=118446.64, stdev=87478.84 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 644], | 30.00th=[ 83362], 40.00th=[ 83362], 50.00th=[133694], 60.00th=[133694], | 70.00th=[135267], 80.00th=[135267], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2798KiB/s (2865kB/s)(7168KiB/2562msec); 0 zone resets clat (msec): min=147, max=408, avg=275.99, stdev=106.05 lat (msec): min=147, max=409, avg=276.05, stdev=106.05 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 296], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 376], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1721, max= 3961, per=26.46%, avg=2572.33, stdev=1212.83, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=48.18%, ctx=442, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6945KiB/s (7111kB/s), 694KiB/s-4182KiB/s (711kB/s-4282kB/s), io=20.0MiB (20.0MB), run=1714-2949msec WRITE: bw=9723KiB/s (9956kB/s), 2180KiB/s-3472KiB/s (2233kB/s-3556kB/s), io=28.0MiB (29.4MB), run=1714-2949msec rand-rw: (groupid=0, jobs=1): err= 0: pid=195231: Tue Oct 21 23:40:55 2025 read: IOPS=3, BW=3229KiB/s (3306kB/s)(7168KiB/2220msec) clat (msec): min=57, max=475, avg=160.16, stdev=147.54 lat (msec): min=57, max=475, avg=160.17, stdev=147.54 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 105], 60.00th=[ 125], | 70.00th=[ 125], 80.00th=[ 205], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2007, max= 5052, per=55.51%, avg=3696.67, stdev=1549.79, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2306KiB/s (2362kB/s)(5120KiB/2220msec); 0 zone resets clat (msec): min=100, max=426, avg=205.47, stdev=129.90 lat (msec): min=100, max=426, avg=205.50, stdev=129.88 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2048, max= 6023, per=43.28%, avg=4035.50, stdev=2810.75, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 100=25.00%, 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=24.55%, ctx=242, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195232: Tue Oct 21 23:40:55 2025 read: IOPS=0, BW=666KiB/s (682kB/s)(2048KiB/3075msec) clat (msec): min=86, max=360, avg=223.18, stdev=193.60 lat (msec): min=86, max=360, avg=223.18, stdev=193.60 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1651, max= 2031, per=27.64%, avg=1841.00, stdev=268.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3330KiB/s (3410kB/s)(10.0MiB/3075msec); 0 zone resets clat (msec): min=43, max=797, avg=254.45, stdev=245.20 lat (msec): min=43, max=797, avg=254.48, stdev=245.21 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 58], | 30.00th=[ 64], 40.00th=[ 80], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 355], 80.00th=[ 384], 90.00th=[ 468], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2031, max= 4031, per=36.03%, avg=3359.00, stdev=1150.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=33.33%, 1000=8.33% cpu : usr=0.03%, sys=21.18%, ctx=351, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195233: Tue Oct 21 23:40:55 2025 read: IOPS=2, BW=2101KiB/s (2151kB/s)(6144KiB/2925msec) clat (msec): min=49, max=331, avg=108.66, stdev=110.83 lat (msec): min=49, max=331, avg=108.66, stdev=110.83 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 57], 50.00th=[ 57], 60.00th=[ 58], | 70.00th=[ 101], 80.00th=[ 101], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 4015, max= 4063, per=60.65%, avg=4039.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2101KiB/s (2151kB/s)(6144KiB/2925msec); 0 zone resets clat (msec): min=87, max=645, avg=365.24, stdev=203.18 lat (msec): min=87, max=645, avg=365.28, stdev=203.19 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 409], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1662, max= 2048, per=20.80%, avg=1939.00, stdev=185.16, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=15.53%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195234: Tue Oct 21 23:40:55 2025 read: IOPS=1, BW=1669KiB/s (1709kB/s)(5120KiB/3068msec) clat (msec): min=30, max=410, avg=248.50, stdev=149.45 lat (msec): min=30, max=410, avg=248.50, stdev=149.45 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2007, max= 4063, per=45.57%, avg=3035.00, stdev=1453.81, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2336KiB/s (2392kB/s)(7168KiB/3068msec); 0 zone resets clat (msec): min=16, max=633, avg=251.19, stdev=262.97 lat (msec): min=16, max=633, avg=251.23, stdev=262.98 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 17], 10.00th=[ 17], 20.00th=[ 29], | 30.00th=[ 38], 40.00th=[ 38], 50.00th=[ 114], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 531], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1700, max= 4015, per=27.63%, avg=2576.67, stdev=1255.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 20=8.33%, 50=25.00%, 250=16.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=15.45%, ctx=109, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6660KiB/s (6820kB/s), 666KiB/s-3229KiB/s (682kB/s-3306kB/s), io=20.0MiB (20.0MB), run=2220-3075msec WRITE: bw=9324KiB/s (9548kB/s), 2101KiB/s-3330KiB/s (2151kB/s-3410kB/s), io=28.0MiB (29.4MB), run=2220-3075msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=195239: Tue Oct 21 23:41:03 2025 read: IOPS=2, BW=9548KiB/s (9777kB/s)(12.0MiB/1287msec) clat (msec): min=294, max=524, avg=426.09, stdev=118.83 lat (msec): min=294, max=524, avg=426.09, stdev=118.83 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7420, max= 8110, per=82.66%, avg=7765.00, stdev=487.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=56.92%, ctx=2582, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195240: Tue Oct 21 23:41:03 2025 read: IOPS=0, BW=2349KiB/s (2405kB/s)(4096KiB/1744msec) clat (nsec): min=295971k, max=295971k, avg=295970991.00, stdev= 0.00 lat (nsec): min=295972k, max=295972k, avg=295971933.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7288, max= 7288, per=77.58%, avg=7288.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4697KiB/s (4810kB/s)(8192KiB/1744msec); 0 zone resets clat (msec): min=537, max=892, avg=714.96, stdev=250.85 lat (msec): min=537, max=892, avg=715.21, stdev=250.86 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8110, max= 8110, per=43.17%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=17.21%, ctx=813, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195241: Tue Oct 21 23:41:03 2025 write: IOPS=1, BW=8063KiB/s (8257kB/s)(12.0MiB/1524msec); 0 zone resets clat (msec): min=185, max=765, avg=503.33, stdev=294.26 lat (msec): min=185, max=766, avg=503.64, stdev=294.26 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8110, max= 8110, per=43.17%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.07%, sys=20.75%, ctx=88, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195242: Tue Oct 21 23:41:03 2025 write: IOPS=2, BW=9184KiB/s (9404kB/s)(12.0MiB/1338msec); 0 zone resets clat (msec): min=361, max=571, avg=445.17, stdev=111.56 lat (msec): min=362, max=572, avg=445.39, stdev=111.64 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7515, max= 8110, per=41.58%, avg=7812.50, stdev=420.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=26.10%, ctx=95, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9394KiB/s (9620kB/s), 2349KiB/s-9548KiB/s (2405kB/s-9777kB/s), io=16.0MiB (16.8MB), run=1287-1744msec WRITE: bw=18.3MiB/s (19.2MB/s), 4697KiB/s-9184KiB/s (4810kB/s-9404kB/s), io=32.0MiB (33.6MB), run=1338-1744msec rand-rw: (groupid=0, jobs=1): err= 0: pid=195245: Tue Oct 21 23:41:03 2025 read: IOPS=1, BW=7310KiB/s (7485kB/s)(12.0MiB/1681msec) clat (msec): min=130, max=884, avg=557.27, stdev=387.13 lat (msec): min=130, max=884, avg=557.27, stdev=387.13 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8192, max= 8192, per=85.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.04%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195246: Tue Oct 21 23:41:03 2025 read: IOPS=0, BW=2407KiB/s (2464kB/s)(4096KiB/1702msec) clat (nsec): min=640774k, max=640774k, avg=640774305.00, stdev= 0.00 lat (nsec): min=640775k, max=640775k, avg=640775105.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 5354, max= 5354, per=55.62%, avg=5354.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4813KiB/s (4929kB/s)(8192KiB/1702msec); 0 zone resets clat (msec): min=483, max=555, avg=519.53, stdev=50.56 lat (msec): min=483, max=555, avg=519.69, stdev=50.50 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 8192, max= 8192, per=42.55%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=20.87%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195247: Tue Oct 21 23:41:03 2025 write: IOPS=2, BW=8291KiB/s (8490kB/s)(12.0MiB/1482msec); 0 zone resets clat (msec): min=132, max=873, avg=489.87, stdev=370.94 lat (msec): min=132, max=873, avg=490.03, stdev=371.00 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 5403, max= 5403, per=28.06%, avg=5403.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=18.23%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=195248: Tue Oct 21 23:41:03 2025 write: IOPS=2, BW=8898KiB/s (9111kB/s)(12.0MiB/1381msec); 0 zone resets clat (msec): min=149, max=847, avg=444.28, stdev=361.70 lat (msec): min=149, max=848, avg=444.54, stdev=361.70 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7787, max= 7787, per=40.45%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=21.09%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9626KiB/s (9857kB/s), 2407KiB/s-7310KiB/s (2464kB/s-7485kB/s), io=16.0MiB (16.8MB), run=1681-1702msec WRITE: bw=18.8MiB/s (19.7MB/s), 4813KiB/s-8898KiB/s (4929kB/s-9111kB/s), io=32.0MiB (33.6MB), run=1381-1702msec