== sanity test 398b: DIO and buffer IO race ============== 22:58:30 (1789354710) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.66232 s, 18.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181398: Sun Sep 13 22:59:27 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(5992KiB/48573msec) clat (usec): min=43, max=76227, avg=17003.32, stdev=9242.05 lat (usec): min=44, max=76228, avg=17003.86, stdev=9242.21 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 6915], 10.00th=[ 8291], 20.00th=[ 9896], | 30.00th=[11469], 40.00th=[13042], 50.00th=[15008], 60.00th=[17171], | 70.00th=[19792], 80.00th=[22414], 90.00th=[28967], 95.00th=[35390], | 99.00th=[49021], 99.50th=[53216], 99.90th=[68682], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 20, max= 199, per=25.02%, avg=122.85, stdev=38.63, samples=96 iops : min= 5, max= 49, avg=30.38, stdev= 9.66, samples=96 write: IOPS=32, BW=130KiB/s (133kB/s)(6296KiB/48573msec); 0 zone resets clat (usec): min=691, max=702231, avg=14536.60, stdev=20418.76 lat (usec): min=692, max=702232, avg=14537.18, stdev=20418.79 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 2606], 10.00th=[ 3097], 20.00th=[ 4178], | 30.00th=[ 6915], 40.00th=[ 9372], 50.00th=[ 11338], 60.00th=[ 14353], | 70.00th=[ 17957], 80.00th=[ 22414], 90.00th=[ 28181], 95.00th=[ 33817], | 99.00th=[ 49021], 99.50th=[ 61080], 99.90th=[ 87557], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 40, max= 216, per=25.29%, avg=130.01, stdev=40.68, samples=95 iops : min= 10, max= 54, avg=32.16, stdev=10.25, samples=95 lat (usec) : 50=0.03%, 100=0.46%, 250=0.65%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.46% lat (msec) : 2=0.91%, 4=8.30%, 10=21.39%, 20=40.98%, 50=25.88% lat (msec) : 100=0.81%, 750=0.03% cpu : usr=0.09%, sys=25.73%, ctx=9846, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181399: Sun Sep 13 22:59:27 2026 read: IOPS=30, BW=122KiB/s (125kB/s)(5940KiB/48676msec) clat (usec): min=30, max=110712, avg=16972.13, stdev=9174.29 lat (usec): min=30, max=110713, avg=16973.62, stdev=9174.24 clat percentiles (usec): | 1.00th=[ 103], 5.00th=[ 7046], 10.00th=[ 8225], 20.00th=[ 9896], | 30.00th=[ 11600], 40.00th=[ 13566], 50.00th=[ 15401], 60.00th=[ 17433], | 70.00th=[ 19530], 80.00th=[ 22152], 90.00th=[ 27657], 95.00th=[ 32900], | 99.00th=[ 49546], 99.50th=[ 56886], 99.90th=[ 70779], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 6, max= 200, per=24.74%, avg=121.47, stdev=39.80, samples=96 iops : min= 1, max= 50, avg=30.02, stdev= 9.99, samples=96 write: IOPS=32, BW=130KiB/s (134kB/s)(6348KiB/48676msec); 0 zone resets clat (usec): min=569, max=707955, avg=14651.23, stdev=20433.23 lat (usec): min=570, max=707956, avg=14652.15, stdev=20433.10 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2573], 10.00th=[ 3032], 20.00th=[ 4080], | 30.00th=[ 6980], 40.00th=[ 9765], 50.00th=[ 11731], 60.00th=[ 14353], | 70.00th=[ 17957], 80.00th=[ 22152], 90.00th=[ 28967], 95.00th=[ 35390], | 99.00th=[ 47449], 99.50th=[ 51119], 99.90th=[ 69731], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 6, max= 224, per=25.09%, avg=128.96, stdev=40.29, samples=96 iops : min= 1, max= 56, avg=31.90, stdev=10.13, samples=96 lat (usec) : 50=0.03%, 100=0.42%, 250=0.46%, 750=0.13%, 1000=0.52% lat (msec) : 2=0.88%, 4=8.53%, 10=20.31%, 20=42.42%, 50=25.49% lat (msec) : 100=0.75%, 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=25.87%, ctx=9589, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181400: Sun Sep 13 22:59:27 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(6028KiB/48385msec) clat (usec): min=28, max=73629, avg=17152.40, stdev=9180.16 lat (usec): min=28, max=73629, avg=17152.96, stdev=9180.23 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 7046], 10.00th=[ 8094], 20.00th=[ 9765], | 30.00th=[11469], 40.00th=[13304], 50.00th=[15401], 60.00th=[17695], | 70.00th=[20055], 80.00th=[23462], 90.00th=[28967], 95.00th=[35390], | 99.00th=[45351], 99.50th=[49546], 99.90th=[72877], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 16, max= 223, per=25.60%, avg=125.72, stdev=32.92, samples=95 iops : min= 4, max= 55, avg=31.08, stdev= 8.25, samples=95 write: IOPS=32, BW=129KiB/s (132kB/s)(6260KiB/48385msec); 0 zone resets clat (usec): min=667, max=720396, avg=14254.02, stdev=20698.75 lat (usec): min=667, max=720397, avg=14254.69, stdev=20698.77 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2606], 10.00th=[ 3097], 20.00th=[ 4490], | 30.00th=[ 7177], 40.00th=[ 9634], 50.00th=[ 11338], 60.00th=[ 13829], | 70.00th=[ 17171], 80.00th=[ 21103], 90.00th=[ 27919], 95.00th=[ 33162], | 99.00th=[ 46400], 99.50th=[ 52691], 99.90th=[116917], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 32, max= 208, per=25.37%, avg=130.42, stdev=40.62, samples=95 iops : min= 8, max= 52, avg=32.26, stdev=10.23, samples=95 lat (usec) : 50=0.03%, 100=0.59%, 250=0.59%, 500=0.07%, 750=0.29% lat (usec) : 1000=0.10% lat (msec) : 2=1.07%, 4=7.88%, 10=21.16%, 20=41.47%, 50=26.20% lat (msec) : 100=0.49%, 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=25.78%, ctx=9679, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181401: Sun Sep 13 22:59:27 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(6052KiB/48892msec) clat (usec): min=31, max=99018, avg=16846.27, stdev=8873.62 lat (usec): min=31, max=99019, avg=16846.76, stdev=8873.67 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 6980], 10.00th=[ 8455], 20.00th=[ 9896], | 30.00th=[11338], 40.00th=[13304], 50.00th=[15270], 60.00th=[17433], | 70.00th=[19792], 80.00th=[22414], 90.00th=[27395], 95.00th=[32637], | 99.00th=[47449], 99.50th=[51119], 99.90th=[61604], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 55, max= 208, per=25.34%, avg=124.42, stdev=35.46, samples=96 iops : min= 13, max= 52, avg=30.76, stdev= 8.91, samples=96 write: IOPS=31, BW=128KiB/s (131kB/s)(6236KiB/48892msec); 0 zone resets clat (usec): min=687, max=719162, avg=14876.31, stdev=20841.79 lat (usec): min=687, max=719162, avg=14876.93, stdev=20841.81 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2704], 10.00th=[ 3064], 20.00th=[ 4359], | 30.00th=[ 7373], 40.00th=[ 9765], 50.00th=[ 11863], 60.00th=[ 14615], | 70.00th=[ 18220], 80.00th=[ 22676], 90.00th=[ 28967], 95.00th=[ 35390], | 99.00th=[ 49021], 99.50th=[ 54264], 99.90th=[ 77071], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 13, max= 232, per=24.72%, avg=127.04, stdev=39.84, samples=97 iops : min= 3, max= 58, avg=31.42, stdev=10.03, samples=97 lat (usec) : 50=0.07%, 100=0.46%, 250=0.52%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.29% lat (msec) : 2=0.68%, 4=8.17%, 10=20.41%, 20=42.15%, 50=26.30% lat (msec) : 100=0.75%, 750=0.03% cpu : usr=0.09%, sys=25.64%, ctx=9878, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=491KiB/s (503kB/s), 122KiB/s-125KiB/s (125kB/s-128kB/s), io=23.4MiB (24.6MB), run=48385-48892msec WRITE: bw=514KiB/s (527kB/s), 128KiB/s-130KiB/s (131kB/s-134kB/s), io=24.6MiB (25.7MB), run=48385-48892msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181402: Sun Sep 13 22:59:34 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(5992KiB/55569msec) clat (msec): min=2, max=758, avg=16.51, stdev=22.85 lat (msec): min=2, max=758, avg=16.51, stdev=22.85 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 34], 95.00th=[ 41], | 99.00th=[ 61], 99.50th=[ 73], 99.90th=[ 100], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 24, max= 368, per=25.14%, avg=108.35, stdev=70.51, samples=109 iops : min= 6, max= 92, avg=26.77, stdev=17.77, samples=109 write: IOPS=28, BW=113KiB/s (116kB/s)(6296KiB/55569msec); 0 zone resets clat (msec): min=4, max=116, avg=19.47, stdev=13.35 lat (msec): min=4, max=116, avg=19.47, stdev=13.35 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 36], 95.00th=[ 46], | 99.00th=[ 65], 99.50th=[ 71], 99.90th=[ 108], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 7, max= 376, per=25.21%, avg=113.70, stdev=70.93, samples=109 iops : min= 1, max= 94, avg=28.11, stdev=17.85, samples=109 lat (msec) : 4=1.17%, 10=33.92%, 20=32.52%, 50=29.56%, 100=2.70% lat (msec) : 250=0.10%, 1000=0.03% cpu : usr=0.08%, sys=14.37%, ctx=6628, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181403: Sun Sep 13 22:59:34 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(5940KiB/55461msec) clat (msec): min=2, max=732, avg=16.27, stdev=22.08 lat (msec): min=2, max=732, avg=16.27, stdev=22.08 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 33], 95.00th=[ 40], | 99.00th=[ 58], 99.50th=[ 71], 99.90th=[ 93], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 344, per=25.04%, avg=107.91, stdev=69.41, samples=109 iops : min= 1, max= 86, avg=26.66, stdev=17.45, samples=109 write: IOPS=28, BW=114KiB/s (117kB/s)(6348KiB/55461msec); 0 zone resets clat (msec): min=4, max=103, avg=19.61, stdev=13.05 lat (msec): min=4, max=103, avg=19.61, stdev=13.05 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 38], 95.00th=[ 44], | 99.00th=[ 63], 99.50th=[ 69], 99.90th=[ 100], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 39, max= 336, per=25.52%, avg=115.08, stdev=68.45, samples=109 iops : min= 9, max= 84, avg=28.46, stdev=17.26, samples=109 lat (msec) : 4=0.85%, 10=33.85%, 20=32.06%, 50=30.92%, 100=2.25% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=14.40%, ctx=6403, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181404: Sun Sep 13 22:59:34 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(6028KiB/55547msec) clat (msec): min=2, max=109, avg=15.87, stdev=12.03 lat (msec): min=2, max=109, avg=15.87, stdev=12.03 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 33], 95.00th=[ 39], | 99.00th=[ 56], 99.50th=[ 66], 99.90th=[ 85], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 23, max= 400, per=25.34%, avg=109.22, stdev=71.66, samples=109 iops : min= 5, max= 100, avg=26.99, stdev=18.03, samples=109 write: IOPS=28, BW=113KiB/s (115kB/s)(6260KiB/55547msec); 0 zone resets clat (msec): min=3, max=725, avg=20.08, stdev=21.98 lat (msec): min=3, max=725, avg=20.08, stdev=21.98 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 38], 95.00th=[ 43], | 99.00th=[ 59], 99.50th=[ 66], 99.90th=[ 115], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 31, max= 344, per=25.07%, avg=113.05, stdev=67.53, samples=109 iops : min= 7, max= 86, avg=27.94, stdev=16.99, samples=109 lat (msec) : 4=0.78%, 10=33.85%, 20=32.19%, 50=30.86%, 100=2.21% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.08%, sys=14.50%, ctx=6374, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181405: Sun Sep 13 22:59:34 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(6052KiB/55637msec) clat (msec): min=2, max=105, avg=15.97, stdev=12.51 lat (msec): min=2, max=105, avg=15.98, stdev=12.51 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 34], 95.00th=[ 42], | 99.00th=[ 57], 99.50th=[ 66], 99.90th=[ 84], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 39, max= 416, per=25.43%, avg=109.58, stdev=68.94, samples=108 iops : min= 9, max= 104, avg=27.08, stdev=17.36, samples=108 write: IOPS=28, BW=112KiB/s (115kB/s)(6236KiB/55637msec); 0 zone resets clat (msec): min=4, max=720, avg=20.05, stdev=22.00 lat (msec): min=4, max=720, avg=20.05, stdev=22.00 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 63], 99.50th=[ 68], 99.90th=[ 107], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 31, max= 352, per=24.89%, avg=112.24, stdev=70.00, samples=109 iops : min= 7, max= 88, avg=27.74, stdev=17.62, samples=109 lat (msec) : 4=1.50%, 10=33.82%, 20=31.51%, 50=30.44%, 100=2.60% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.04%, sys=14.44%, ctx=6404, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=432KiB/s (442kB/s), 107KiB/s-109KiB/s (110kB/s-111kB/s), io=23.4MiB (24.6MB), run=55461-55637msec WRITE: bw=452KiB/s (463kB/s), 112KiB/s-114KiB/s (115kB/s-117kB/s), io=24.6MiB (25.7MB), run=55461-55637msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181427: Sun Sep 13 22:59:54 2026 read: IOPS=24, BW=400KiB/s (410kB/s)(5920KiB/14803msec) clat (usec): min=92, max=62692, avg=19825.28, stdev=10540.69 lat (usec): min=92, max=62692, avg=19825.92, stdev=10540.82 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 137], 10.00th=[ 9241], 20.00th=[12125], | 30.00th=[14353], 40.00th=[16188], 50.00th=[18482], 60.00th=[20841], | 70.00th=[24249], 80.00th=[28443], 90.00th=[31851], 95.00th=[36963], | 99.00th=[49546], 99.50th=[60556], 99.90th=[62653], 99.95th=[62653], | 99.99th=[62653] bw ( KiB/s): min= 159, max= 574, per=24.43%, avg=393.59, stdev=103.16, samples=29 iops : min= 9, max= 35, avg=24.00, stdev= 6.55, samples=29 write: IOPS=26, BW=430KiB/s (441kB/s)(6368KiB/14803msec); 0 zone resets clat (usec): min=1136, max=78544, avg=18624.95, stdev=12495.03 lat (usec): min=1137, max=78545, avg=18629.10, stdev=12498.74 clat percentiles (usec): | 1.00th=[ 2245], 5.00th=[ 4752], 10.00th=[ 5276], 20.00th=[ 6980], | 30.00th=[10683], 40.00th=[13042], 50.00th=[15795], 60.00th=[19006], | 70.00th=[22938], 80.00th=[28443], 90.00th=[34341], 95.00th=[41157], | 99.00th=[62653], 99.50th=[65274], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 159, max= 640, per=25.22%, avg=427.48, stdev=111.23, samples=29 iops : min= 9, max= 40, avg=26.10, stdev= 7.07, samples=29 lat (usec) : 100=0.52%, 250=2.99% lat (msec) : 2=0.52%, 4=1.30%, 10=14.71%, 20=38.80%, 50=39.45% lat (msec) : 100=1.69% cpu : usr=0.05%, sys=27.83%, ctx=3047, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181428: Sun Sep 13 22:59:54 2026 read: IOPS=24, BW=398KiB/s (407kB/s)(5744KiB/14443msec) clat (usec): min=39, max=63369, avg=20286.54, stdev=9706.21 lat (usec): min=40, max=63370, avg=20287.10, stdev=9706.21 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 153], 10.00th=[10290], 20.00th=[13042], | 30.00th=[15401], 40.00th=[17695], 50.00th=[19530], 60.00th=[22152], | 70.00th=[24249], 80.00th=[27395], 90.00th=[32375], 95.00th=[35390], | 99.00th=[48497], 99.50th=[62129], 99.90th=[63177], 99.95th=[63177], | 99.99th=[63177] bw ( KiB/s): min= 191, max= 480, per=24.65%, avg=397.14, stdev=71.54, samples=28 iops : min= 11, max= 30, avg=24.18, stdev= 4.61, samples=28 write: IOPS=28, BW=453KiB/s (464kB/s)(6544KiB/14443msec); 0 zone resets clat (usec): min=1923, max=61869, avg=17224.26, stdev=11049.50 lat (usec): min=1923, max=61870, avg=17226.57, stdev=11049.11 clat percentiles (usec): | 1.00th=[ 3097], 5.00th=[ 4621], 10.00th=[ 5538], 20.00th=[ 7111], | 30.00th=[ 9241], 40.00th=[11994], 50.00th=[14484], 60.00th=[17695], | 70.00th=[21627], 80.00th=[27132], 90.00th=[32637], 95.00th=[39060], | 99.00th=[47449], 99.50th=[49546], 99.90th=[62129], 99.95th=[62129], | 99.99th=[62129] bw ( KiB/s): min= 223, max= 638, per=26.43%, avg=448.04, stdev=111.24, samples=28 iops : min= 13, max= 39, avg=27.39, stdev= 6.97, samples=28 lat (usec) : 50=0.13%, 100=0.65%, 250=1.82%, 500=0.13% lat (msec) : 2=0.13%, 4=1.56%, 10=17.06%, 20=38.93%, 50=38.93% lat (msec) : 100=0.65% cpu : usr=0.06%, sys=28.45%, ctx=3147, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181429: Sun Sep 13 22:59:54 2026 read: IOPS=26, BW=421KiB/s (431kB/s)(6256KiB/14859msec) clat (usec): min=51, max=72983, avg=20197.69, stdev=10230.82 lat (usec): min=52, max=72984, avg=20198.30, stdev=10230.84 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 172], 10.00th=[10028], 20.00th=[12911], | 30.00th=[15270], 40.00th=[16909], 50.00th=[18482], 60.00th=[21103], | 70.00th=[24511], 80.00th=[28443], 90.00th=[32900], 95.00th=[38011], | 99.00th=[48497], 99.50th=[59507], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 192, max= 670, per=26.15%, avg=421.31, stdev=103.44, samples=29 iops : min= 12, max= 41, avg=25.72, stdev= 6.51, samples=29 write: IOPS=25, BW=406KiB/s (416kB/s)(6032KiB/14859msec); 0 zone resets clat (usec): min=1278, max=75802, avg=18416.53, stdev=11575.50 lat (usec): min=1279, max=75804, avg=18417.68, stdev=11575.50 clat percentiles (usec): | 1.00th=[ 3818], 5.00th=[ 5145], 10.00th=[ 5735], 20.00th=[ 7701], | 30.00th=[10814], 40.00th=[13698], 50.00th=[15926], 60.00th=[19268], | 70.00th=[22152], 80.00th=[27395], 90.00th=[34341], 95.00th=[40109], | 99.00th=[53740], 99.50th=[57934], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 191, max= 576, per=23.51%, avg=398.41, stdev=111.54, samples=29 iops : min= 11, max= 36, avg=24.28, stdev= 7.06, samples=29 lat (usec) : 100=0.13%, 250=2.73%, 500=0.13% lat (msec) : 2=0.39%, 4=0.52%, 10=14.84%, 20=39.97%, 50=39.97% lat (msec) : 100=1.30% cpu : usr=0.07%, sys=27.84%, ctx=3088, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181430: Sun Sep 13 22:59:54 2026 read: IOPS=25, BW=411KiB/s (421kB/s)(6032KiB/14660msec) clat (usec): min=64, max=65095, avg=20290.87, stdev=10472.32 lat (usec): min=65, max=65095, avg=20291.44, stdev=10472.33 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 141], 10.00th=[10552], 20.00th=[12911], | 30.00th=[15139], 40.00th=[16909], 50.00th=[19006], 60.00th=[21365], | 70.00th=[23987], 80.00th=[27657], 90.00th=[33817], 95.00th=[39584], | 99.00th=[51643], 99.50th=[58459], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 255, max= 574, per=25.35%, avg=408.45, stdev=83.68, samples=29 iops : min= 15, max= 35, avg=24.93, stdev= 5.19, samples=29 write: IOPS=26, BW=427KiB/s (437kB/s)(6256KiB/14660msec); 0 zone resets clat (usec): min=1691, max=59065, avg=17728.96, stdev=11052.56 lat (usec): min=1693, max=59066, avg=17747.74, stdev=11062.80 clat percentiles (usec): | 1.00th=[ 2343], 5.00th=[ 4686], 10.00th=[ 5604], 20.00th=[ 7504], | 30.00th=[10159], 40.00th=[13566], 50.00th=[15664], 60.00th=[18482], | 70.00th=[21890], 80.00th=[25560], 90.00th=[32637], 95.00th=[39584], | 99.00th=[52691], 99.50th=[53740], 99.90th=[58983], 99.95th=[58983], | 99.99th=[58983] bw ( KiB/s): min= 223, max= 608, per=25.12%, avg=425.79, stdev=101.90, samples=29 iops : min= 13, max= 38, avg=26.00, stdev= 6.47, samples=29 lat (usec) : 100=0.26%, 250=2.86%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.39%, 4=1.43%, 10=13.80%, 20=40.36%, 50=39.45% lat (msec) : 100=1.17% cpu : usr=0.06%, sys=27.91%, ctx=3098, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1612KiB/s (1651kB/s), 398KiB/s-421KiB/s (407kB/s-431kB/s), io=23.4MiB (24.5MB), run=14443-14859msec WRITE: bw=1696KiB/s (1737kB/s), 406KiB/s-453KiB/s (416kB/s-464kB/s), io=24.6MiB (25.8MB), run=14443-14859msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181431: Sun Sep 13 22:59:56 2026 read: IOPS=22, BW=360KiB/s (369kB/s)(5920KiB/16430msec) clat (usec): min=4099, max=66730, avg=18474.85, stdev=11981.45 lat (usec): min=4099, max=66731, avg=18475.39, stdev=11981.49 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 5473], 10.00th=[ 6259], 20.00th=[ 8291], | 30.00th=[11207], 40.00th=[13042], 50.00th=[14877], 60.00th=[17433], | 70.00th=[21365], 80.00th=[26870], 90.00th=[36439], 95.00th=[43779], | 99.00th=[55313], 99.50th=[58459], 99.90th=[66847], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 158, max= 1056, per=23.84%, avg=346.22, stdev=183.69, samples=32 iops : min= 9, max= 66, avg=21.12, stdev=11.62, samples=32 write: IOPS=24, BW=388KiB/s (397kB/s)(6368KiB/16430msec); 0 zone resets clat (usec): min=4594, max=95691, avg=24035.67, stdev=15602.55 lat (usec): min=4595, max=95692, avg=24036.94, stdev=15602.56 clat percentiles (usec): | 1.00th=[ 6063], 5.00th=[ 7177], 10.00th=[ 7963], 20.00th=[10159], | 30.00th=[13435], 40.00th=[16188], 50.00th=[19530], 60.00th=[23462], | 70.00th=[29492], 80.00th=[36963], 90.00th=[45876], 95.00th=[56361], | 99.00th=[72877], 99.50th=[82314], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 160, max= 1088, per=24.59%, avg=375.56, stdev=196.49, samples=32 iops : min= 10, max= 68, avg=22.97, stdev=12.43, samples=32 lat (msec) : 10=22.40%, 20=36.20%, 50=36.72%, 100=4.69% cpu : usr=0.05%, sys=14.41%, ctx=1759, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181432: Sun Sep 13 22:59:56 2026 read: IOPS=21, BW=350KiB/s (359kB/s)(5744KiB/16403msec) clat (usec): min=3789, max=71956, avg=19048.55, stdev=12817.42 lat (usec): min=3789, max=71956, avg=19049.07, stdev=12817.44 clat percentiles (usec): | 1.00th=[ 4359], 5.00th=[ 5538], 10.00th=[ 6587], 20.00th=[ 8225], | 30.00th=[11076], 40.00th=[12911], 50.00th=[14615], 60.00th=[17433], | 70.00th=[23462], 80.00th=[28705], 90.00th=[38011], 95.00th=[45876], | 99.00th=[59507], 99.50th=[64750], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 107, max= 1088, per=23.65%, avg=343.34, stdev=180.42, samples=32 iops : min= 6, max= 68, avg=20.94, stdev=11.46, samples=32 write: IOPS=24, BW=399KiB/s (409kB/s)(6544KiB/16403msec); 0 zone resets clat (usec): min=4323, max=81602, avg=23231.06, stdev=14607.36 lat (usec): min=4323, max=81603, avg=23232.42, stdev=14607.49 clat percentiles (usec): | 1.00th=[ 6194], 5.00th=[ 7177], 10.00th=[ 8094], 20.00th=[ 9765], | 30.00th=[12911], 40.00th=[16319], 50.00th=[19268], 60.00th=[22676], | 70.00th=[28443], 80.00th=[34341], 90.00th=[46400], 95.00th=[51119], | 99.00th=[65799], 99.50th=[67634], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 159, max= 1120, per=25.15%, avg=384.09, stdev=210.55, samples=32 iops : min= 9, max= 70, avg=23.50, stdev=13.28, samples=32 lat (msec) : 4=0.26%, 10=23.70%, 20=32.94%, 50=38.67%, 100=4.43% cpu : usr=0.07%, sys=14.49%, ctx=1834, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181433: Sun Sep 13 22:59:56 2026 read: IOPS=23, BW=379KiB/s (388kB/s)(6256KiB/16494msec) clat (usec): min=3083, max=73488, avg=18622.06, stdev=13735.60 lat (usec): min=3083, max=73488, avg=18622.74, stdev=13735.58 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 5145], 10.00th=[ 5604], 20.00th=[ 6915], | 30.00th=[ 9896], 40.00th=[11994], 50.00th=[14484], 60.00th=[16909], | 70.00th=[21365], 80.00th=[28967], 90.00th=[40633], 95.00th=[47973], | 99.00th=[65274], 99.50th=[71828], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 159, max= 1440, per=24.98%, avg=362.69, stdev=232.14, samples=32 iops : min= 9, max= 90, avg=22.16, stdev=14.66, samples=32 write: IOPS=22, BW=366KiB/s (374kB/s)(6032KiB/16494msec); 0 zone resets clat (usec): min=4388, max=96725, avg=24021.62, stdev=16332.67 lat (usec): min=4389, max=96726, avg=24023.34, stdev=16332.93 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 6456], 10.00th=[ 7832], 20.00th=[ 9634], | 30.00th=[12780], 40.00th=[15926], 50.00th=[19530], 60.00th=[23987], | 70.00th=[28967], 80.00th=[36439], 90.00th=[47449], 95.00th=[57410], | 99.00th=[74974], 99.50th=[78119], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 159, max= 864, per=22.42%, avg=342.38, stdev=177.73, samples=32 iops : min= 9, max= 54, avg=20.88, stdev=11.25, samples=32 lat (msec) : 4=0.65%, 10=25.13%, 20=34.11%, 50=34.90%, 100=5.21% cpu : usr=0.07%, sys=13.99%, ctx=1820, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181434: Sun Sep 13 22:59:56 2026 read: IOPS=22, BW=366KiB/s (375kB/s)(6032KiB/16472msec) clat (usec): min=3210, max=64270, avg=17944.84, stdev=12871.20 lat (usec): min=3210, max=64271, avg=17945.40, stdev=12871.25 clat percentiles (usec): | 1.00th=[ 3621], 5.00th=[ 4883], 10.00th=[ 5473], 20.00th=[ 7439], | 30.00th=[ 9896], 40.00th=[11863], 50.00th=[13829], 60.00th=[16450], | 70.00th=[20055], 80.00th=[26870], 90.00th=[38011], 95.00th=[45876], | 99.00th=[60556], 99.50th=[63177], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 31, max= 1120, per=23.75%, avg=344.81, stdev=214.68, samples=32 iops : min= 1, max= 70, avg=21.03, stdev=13.59, samples=32 write: IOPS=23, BW=380KiB/s (389kB/s)(6256KiB/16472msec); 0 zone resets clat (msec): min=4, max=110, avg=24.47, stdev=16.09 lat (msec): min=4, max=110, avg=24.47, stdev=16.09 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 74], 99.50th=[ 85], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 191, max= 1152, per=23.87%, avg=364.50, stdev=191.53, samples=32 iops : min= 11, max= 72, avg=22.28, stdev=12.12, samples=32 lat (msec) : 4=0.65%, 10=24.74%, 20=32.29%, 50=37.11%, 100=5.08% lat (msec) : 250=0.13% cpu : usr=0.07%, sys=14.24%, ctx=1759, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1452KiB/s (1487kB/s), 350KiB/s-379KiB/s (359kB/s-388kB/s), io=23.4MiB (24.5MB), run=16403-16494msec WRITE: bw=1528KiB/s (1564kB/s), 366KiB/s-399KiB/s (374kB/s-409kB/s), io=24.6MiB (25.8MB), run=16403-16494msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181441: Sun Sep 13 23:00:04 2026 read: IOPS=3, BW=3451KiB/s (3534kB/s)(7168KiB/2077msec) clat (msec): min=84, max=143, avg=120.25, stdev=18.72 lat (msec): min=84, max=143, avg=120.25, stdev=18.72 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 112], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 125], 60.00th=[ 126], | 70.00th=[ 126], 80.00th=[ 136], 90.00th=[ 144], 95.00th=[ 144], | 99.00th=[ 144], 99.50th=[ 144], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 2048, max= 6884, per=58.77%, avg=4466.00, stdev=3419.57, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2465KiB/s (2524kB/s)(5120KiB/2077msec); 0 zone resets clat (msec): min=112, max=439, avg=239.34, stdev=123.74 lat (msec): min=112, max=439, avg=239.40, stdev=123.74 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1721, max= 2048, per=18.23%, avg=1939.00, stdev=188.79, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.10%, sys=47.98%, ctx=778, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181442: Sun Sep 13 23:00:04 2026 read: IOPS=0, BW=760KiB/s (778kB/s)(2048KiB/2695msec) clat (usec): min=414, max=893568, avg=446991.60, stdev=631555.79 lat (usec): min=414, max=893570, avg=446992.70, stdev=631556.49 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], 20.00th=[ 416], | 30.00th=[ 416], 40.00th=[ 416], 50.00th=[ 416], 60.00th=[893387], | 70.00th=[893387], 80.00th=[893387], 90.00th=[893387], 95.00th=[893387], | 99.00th=[893387], 99.50th=[893387], 99.90th=[893387], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 2035, max= 2048, per=26.87%, avg=2041.50, stdev= 9.19, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3800KiB/s (3891kB/s)(10.0MiB/2695msec); 0 zone resets clat (msec): min=81, max=583, avg=177.12, stdev=146.24 lat (msec): min=81, max=584, avg=177.18, stdev=146.25 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 84], | 30.00th=[ 122], 40.00th=[ 136], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 146], 80.00th=[ 148], 90.00th=[ 186], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2048, max= 8192, per=57.60%, avg=6127.67, stdev=3533.18, samples=3 iops : min= 2, max= 8, avg= 5.67, stdev= 3.21, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=16.67%, 250=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=46.10%, ctx=495, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181443: Sun Sep 13 23:00:04 2026 read: IOPS=4, BW=4606KiB/s (4716kB/s)(6144KiB/1334msec) clat (usec): min=344, max=104681, avg=41857.37, stdev=49243.22 lat (usec): min=344, max=104682, avg=41858.12, stdev=49243.49 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 371], | 30.00th=[ 371], 40.00th=[ 453], 50.00th=[ 453], 60.00th=[ 49021], | 70.00th=[ 95945], 80.00th=[ 95945], 90.00th=[104334], 95.00th=[104334], | 99.00th=[104334], 99.50th=[104334], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=4, BW=4606KiB/s (4716kB/s)(6144KiB/1334msec); 0 zone resets clat (msec): min=129, max=266, avg=178.85, stdev=54.13 lat (msec): min=129, max=266, avg=178.90, stdev=54.14 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 201], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 3459, max= 4096, per=35.51%, avg=3777.50, stdev=450.43, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 lat (usec) : 500=25.00% lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=8.33% cpu : usr=0.00%, sys=49.96%, ctx=454, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181444: Sun Sep 13 23:00:04 2026 read: IOPS=2, BW=2944KiB/s (3015kB/s)(5120KiB/1739msec) clat (usec): min=453, max=148056, avg=59207.90, stdev=68258.49 lat (usec): min=454, max=148057, avg=59208.60, stdev=68258.21 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 461], 40.00th=[ 461], 50.00th=[ 32113], 60.00th=[ 32113], | 70.00th=[114820], 80.00th=[114820], 90.00th=[147850], 95.00th=[147850], | 99.00th=[147850], 99.50th=[147850], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=4, BW=4122KiB/s (4221kB/s)(7168KiB/1739msec); 0 zone resets clat (msec): min=107, max=274, avg=202.80, stdev=65.21 lat (msec): min=107, max=275, avg=202.86, stdev=65.22 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 130], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 209], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 271], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 3459, max= 6144, per=42.92%, avg=4566.33, stdev=1402.93, samples=3 iops : min= 3, max= 6, avg= 4.33, stdev= 1.53, samples=3 lat (usec) : 500=16.67% lat (msec) : 50=8.33%, 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=57.16%, ctx=441, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7599KiB/s (7782kB/s), 760KiB/s-4606KiB/s (778kB/s-4716kB/s), io=20.0MiB (20.0MB), run=1334-2695msec WRITE: bw=10.4MiB/s (10.9MB/s), 2465KiB/s-4606KiB/s (2524kB/s-4716kB/s), io=28.0MiB (29.4MB), run=1334-2695msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181446: Sun Sep 13 23:00:04 2026 read: IOPS=3, BW=3279KiB/s (3358kB/s)(7168KiB/2186msec) clat (msec): min=50, max=358, avg=148.03, stdev=126.12 lat (msec): min=50, max=358, avg=148.03, stdev=126.12 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 60], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 83], 60.00th=[ 109], | 70.00th=[ 109], 80.00th=[ 300], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1848, max= 4096, per=40.93%, avg=3014.75, stdev=1250.47, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=2, BW=2342KiB/s (2398kB/s)(5120KiB/2186msec); 0 zone resets clat (msec): min=54, max=386, avg=199.72, stdev=136.48 lat (msec): min=54, max=386, avg=199.79, stdev=136.48 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 55], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2048, max= 6059, per=39.30%, avg=4053.50, stdev=2836.21, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 100=41.67%, 250=25.00%, 500=33.33% cpu : usr=0.00%, sys=22.15%, ctx=116, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181447: Sun Sep 13 23:00:04 2026 read: IOPS=0, BW=737KiB/s (754kB/s)(2048KiB/2780msec) clat (msec): min=66, max=917, avg=491.98, stdev=601.88 lat (msec): min=66, max=917, avg=491.98, stdev=601.88 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 67], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 2048, max= 2048, per=27.80%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3683KiB/s (3772kB/s)(10.0MiB/2780msec); 0 zone resets clat (msec): min=32, max=376, avg=160.65, stdev=114.37 lat (msec): min=32, max=376, avg=160.71, stdev=114.37 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 50], | 30.00th=[ 77], 40.00th=[ 80], 50.00th=[ 106], 60.00th=[ 155], | 70.00th=[ 197], 80.00th=[ 245], 90.00th=[ 292], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2048, max= 6059, per=39.44%, avg=4067.67, stdev=2005.65, samples=3 iops : min= 2, max= 5, avg= 3.67, stdev= 1.53, samples=3 lat (msec) : 50=16.67%, 100=25.00%, 250=33.33%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=16.34%, ctx=346, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181448: Sun Sep 13 23:00:04 2026 read: IOPS=2, BW=2350KiB/s (2406kB/s)(6144KiB/2615msec) clat (msec): min=78, max=249, avg=131.83, stdev=66.31 lat (msec): min=78, max=249, avg=131.83, stdev=66.31 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 94], 50.00th=[ 94], 60.00th=[ 108], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 4096, max= 6059, per=68.93%, avg=5077.50, stdev=1388.05, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2350KiB/s (2406kB/s)(6144KiB/2615msec); 0 zone resets clat (msec): min=55, max=956, avg=288.08, stdev=338.08 lat (msec): min=55, max=956, avg=288.14, stdev=338.08 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 155], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2019, max= 4096, per=29.72%, avg=3064.75, stdev=1190.84, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.50, samples=4 lat (msec) : 100=33.33%, 250=50.00%, 500=8.33%, 1000=8.33% cpu : usr=0.04%, sys=13.47%, ctx=101, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181449: Sun Sep 13 23:00:04 2026 read: IOPS=1, BW=1878KiB/s (1923kB/s)(5120KiB/2727msec) clat (msec): min=28, max=327, avg=139.92, stdev=140.60 lat (msec): min=28, max=327, avg=139.93, stdev=140.60 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 29], 10.00th=[ 29], 20.00th=[ 29], | 30.00th=[ 42], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 48], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 4039, max= 4096, per=55.22%, avg=4067.50, stdev=40.31, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2629KiB/s (2692kB/s)(7168KiB/2727msec); 0 zone resets clat (msec): min=34, max=950, avg=273.18, stdev=341.35 lat (msec): min=34, max=951, avg=273.24, stdev=341.36 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 59], | 30.00th=[ 70], 40.00th=[ 70], 50.00th=[ 120], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 518], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2048, max= 4039, per=24.68%, avg=2545.75, stdev=995.50, samples=4 iops : min= 2, max= 3, avg= 2.25, stdev= 0.50, samples=4 lat (msec) : 50=33.33%, 100=16.67%, 250=16.67%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=19.48%, ctx=135, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7367KiB/s (7544kB/s), 737KiB/s-3279KiB/s (754kB/s-3358kB/s), io=20.0MiB (20.0MB), run=2186-2780msec WRITE: bw=10.1MiB/s (10.6MB/s), 2342KiB/s-3683KiB/s (2398kB/s-3772kB/s), io=28.0MiB (29.4MB), run=2186-2780msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181454: Sun Sep 13 23:00:13 2026 read: IOPS=1, BW=6113KiB/s (6260kB/s)(12.0MiB/2010msec) clat (msec): min=453, max=896, avg=662.20, stdev=222.32 lat (msec): min=453, max=896, avg=662.20, stdev=222.32 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=43.95%, ctx=2632, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181455: Sun Sep 13 23:00:13 2026 read: IOPS=0, BW=1371KiB/s (1404kB/s)(4096KiB/2987msec) clat (nsec): min=910696k, max=910696k, avg=910696225.00, stdev= 0.00 lat (nsec): min=910698k, max=910698k, avg=910697579.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2743KiB/s (2808kB/s)(8192KiB/2987msec); 0 zone resets clat (msec): min=462, max=1602, avg=1032.51, stdev=806.33 lat (msec): min=462, max=1602, avg=1032.90, stdev=806.24 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8192, max= 8192, per=74.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=20.49%, ctx=1172, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181456: Sun Sep 13 23:00:13 2026 write: IOPS=1, BW=4411KiB/s (4516kB/s)(12.0MiB/2786msec); 0 zone resets clat (msec): min=443, max=1515, avg=925.55, stdev=543.97 lat (msec): min=443, max=1515, avg=925.82, stdev=543.99 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8159, max= 8192, per=74.53%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.32%, ctx=126, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181457: Sun Sep 13 23:00:13 2026 write: IOPS=1, BW=4656KiB/s (4768kB/s)(12.0MiB/2639msec); 0 zone resets clat (msec): min=773, max=1033, avg=870.96, stdev=141.35 lat (msec): min=773, max=1033, avg=871.25, stdev=141.24 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8094, max= 8192, per=74.23%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.04%, sys=14.37%, ctx=95, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5485KiB/s (5617kB/s), 1371KiB/s-6113KiB/s (1404kB/s-6260kB/s), io=16.0MiB (16.8MB), run=2010-2987msec WRITE: bw=10.7MiB/s (11.2MB/s), 2743KiB/s-4656KiB/s (2808kB/s-4768kB/s), io=32.0MiB (33.6MB), run=2639-2987msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181459: Sun Sep 13 23:00:13 2026 read: IOPS=1, BW=4451KiB/s (4557kB/s)(12.0MiB/2761msec) clat (msec): min=296, max=1663, avg=912.59, stdev=693.74 lat (msec): min=296, max=1663, avg=912.59, stdev=693.74 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.57%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181460: Sun Sep 13 23:00:13 2026 read: IOPS=0, BW=1373KiB/s (1406kB/s)(4096KiB/2983msec) clat (nsec): min=1091.5M, max=1091.5M, avg=1091505276.00, stdev= 0.00 lat (nsec): min=1091.5M, max=1091.5M, avg=1091507559.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2746KiB/s (2812kB/s)(8192KiB/2983msec); 0 zone resets clat (msec): min=364, max=1508, avg=936.50, stdev=809.22 lat (msec): min=364, max=1508, avg=936.66, stdev=809.20 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.04%, ctx=134, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181461: Sun Sep 13 23:00:13 2026 write: IOPS=1, BW=4261KiB/s (4363kB/s)(12.0MiB/2884msec); 0 zone resets clat (msec): min=212, max=2201, avg=956.37, stdev=1085.01 lat (msec): min=212, max=2201, avg=956.65, stdev=1085.06 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8047, max= 8047, per=73.26%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=13.08%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181462: Sun Sep 13 23:00:13 2026 write: IOPS=1, BW=4674KiB/s (4786kB/s)(12.0MiB/2629msec); 0 zone resets clat (msec): min=533, max=1396, avg=871.56, stdev=460.65 lat (msec): min=533, max=1396, avg=871.82, stdev=460.65 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8047, max= 8110, per=73.55%, avg=8078.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.08%, sys=13.32%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5492KiB/s (5624kB/s), 1373KiB/s-4451KiB/s (1406kB/s-4557kB/s), io=16.0MiB (16.8MB), run=2761-2983msec WRITE: bw=10.7MiB/s (11.2MB/s), 2746KiB/s-4674KiB/s (2812kB/s-4786kB/s), io=32.0MiB (33.6MB), run=2629-2983msec