== sanity test 398b: DIO and buffer IO race ============== 02:04:31 (1790661871) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.45657 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146306: Tue Sep 29 02:06:59 2026 read: IOPS=12, BW=48.4KiB/s (49.6kB/s)(5992KiB/123712msec) clat (usec): min=32, max=991731, avg=41269.11, stdev=39558.76 lat (usec): min=32, max=991733, avg=41277.11, stdev=39556.12 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 7242], 20.00th=[ 20055], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 89654], | 99.00th=[143655], 99.50th=[212861], 99.90th=[337642], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 6, max= 103, per=25.86%, avg=48.36, stdev=19.91, samples=242 iops : min= 1, max= 25, avg=11.44, stdev= 5.03, samples=242 write: IOPS=12, BW=50.9KiB/s (52.1kB/s)(6296KiB/123712msec); 0 zone resets clat (usec): min=687, max=509045, avg=38955.50, stdev=41578.19 lat (usec): min=688, max=509046, avg=38962.75, stdev=41580.96 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1696], 20.00th=[ 4293], | 30.00th=[ 8717], 40.00th=[ 18482], 50.00th=[ 29754], 60.00th=[ 38536], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[112722], | 99.00th=[164627], 99.50th=[208667], 99.90th=[429917], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 128, per=26.15%, avg=51.26, stdev=21.21, samples=240 iops : min= 1, max= 32, avg=12.17, stdev= 5.34, samples=240 lat (usec) : 50=0.29%, 100=3.58%, 250=0.72%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.86%, 4=3.78%, 10=7.10%, 20=9.15%, 50=38.93% lat (msec) : 100=24.93%, 250=5.08%, 500=0.23%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.10%, ctx=6606, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146307: Tue Sep 29 02:06:59 2026 read: IOPS=11, BW=46.4KiB/s (47.5kB/s)(5940KiB/128009msec) clat (usec): min=32, max=369233, avg=42393.90, stdev=31692.05 lat (usec): min=32, max=369234, avg=42397.20, stdev=31691.45 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 75], 10.00th=[ 13566], 20.00th=[ 20579], | 30.00th=[ 25297], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[139461], 99.50th=[196084], 99.90th=[316670], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 6, max= 103, per=24.52%, avg=45.85, stdev=19.22, samples=250 iops : min= 1, max= 25, avg=10.80, stdev= 4.82, samples=250 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6348KiB/128009msec); 0 zone resets clat (usec): min=731, max=978583, avg=40634.36, stdev=47681.54 lat (usec): min=731, max=978585, avg=40636.52, stdev=47681.51 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1352], 10.00th=[ 1680], 20.00th=[ 4293], | 30.00th=[ 8848], 40.00th=[ 18220], 50.00th=[ 28705], 60.00th=[ 40109], | 70.00th=[ 53216], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[168821], 99.50th=[214959], 99.90th=[400557], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 166, per=25.03%, avg=49.07, stdev=21.57, samples=249 iops : min= 1, max= 41, avg=11.61, stdev= 5.41, samples=249 lat (usec) : 50=0.29%, 100=2.67%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=6.15%, 4=3.71%, 10=6.80%, 20=10.58%, 50=37.76% lat (msec) : 100=24.84%, 250=6.45%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=5.08%, ctx=6701, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146310: Tue Sep 29 02:06:59 2026 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6028KiB/127091msec) clat (usec): min=33, max=291396, avg=41235.56, stdev=28701.08 lat (usec): min=33, max=291398, avg=41239.15, stdev=28703.57 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 74], 10.00th=[ 12649], 20.00th=[ 21103], | 30.00th=[ 26084], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 90702], | 99.00th=[137364], 99.50th=[158335], 99.90th=[238027], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 111, per=25.52%, avg=47.72, stdev=19.93, samples=247 iops : min= 1, max= 27, avg=11.27, stdev= 5.02, samples=247 write: IOPS=12, BW=49.3KiB/s (50.4kB/s)(6260KiB/127091msec); 0 zone resets clat (usec): min=794, max=1230.1k, avg=41122.99, stdev=53135.05 lat (usec): min=794, max=1230.1k, avg=41127.48, stdev=53134.80 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1336], 10.00th=[ 1582], | 20.00th=[ 4178], 30.00th=[ 8979], 40.00th=[ 17433], | 50.00th=[ 29230], 60.00th=[ 39060], 70.00th=[ 52691], | 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[ 122160], | 99.00th=[ 189793], 99.50th=[ 242222], 99.90th=[ 387974], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 127, per=25.04%, avg=49.07, stdev=21.25, samples=249 iops : min= 1, max= 31, avg=11.61, stdev= 5.34, samples=249 lat (usec) : 50=0.29%, 100=3.32%, 250=0.29%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=6.09%, 4=3.68%, 10=6.45%, 20=9.83%, 50=38.77% lat (msec) : 100=24.61%, 250=5.99%, 500=0.23%, 2000=0.03% cpu : usr=0.09%, sys=5.11%, ctx=6695, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146312: Tue Sep 29 02:06:59 2026 read: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6052KiB/126024msec) clat (usec): min=35, max=1063.7k, avg=41095.33, stdev=39851.80 lat (usec): min=35, max=1063.7k, avg=41100.75, stdev=39849.35 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 1958], | 20.00th=[ 19268], 30.00th=[ 24511], 40.00th=[ 29492], | 50.00th=[ 35390], 60.00th=[ 41157], 70.00th=[ 49546], | 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[ 145753], 99.50th=[ 164627], 99.90th=[ 333448], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 7, max= 103, per=25.84%, avg=48.31, stdev=20.86, samples=245 iops : min= 1, max= 25, avg=11.42, stdev= 5.25, samples=245 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6236KiB/126024msec); 0 zone resets clat (usec): min=818, max=377103, avg=40656.99, stdev=41711.31 lat (usec): min=819, max=377105, avg=40661.45, stdev=41711.10 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1369], 10.00th=[ 1942], 20.00th=[ 4752], | 30.00th=[ 8848], 40.00th=[ 20055], 50.00th=[ 30540], 60.00th=[ 41681], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[183501], 99.50th=[204473], 99.90th=[337642], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 15, max= 118, per=25.18%, avg=49.36, stdev=20.34, samples=247 iops : min= 3, max= 29, avg=11.69, stdev= 5.10, samples=247 lat (usec) : 50=0.23%, 100=4.13%, 250=0.33%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.14%, 4=3.68%, 10=7.39%, 20=9.60%, 50=37.63% lat (msec) : 100=25.85%, 250=5.44%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=5.17%, ctx=6677, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (192kB/s), 46.4KiB/s-48.4KiB/s (47.5kB/s-49.6kB/s), io=23.4MiB (24.6MB), run=123712-128009msec WRITE: bw=196KiB/s (201kB/s), 49.3KiB/s-50.9KiB/s (50.4kB/s-52.1kB/s), io=24.6MiB (25.7MB), run=123712-128009msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146305: Tue Sep 29 02:09:03 2026 read: IOPS=5, BW=23.8KiB/s (24.4kB/s)(5992KiB/251966msec) clat (msec): min=5, max=1036, avg=33.52, stdev=44.05 lat (msec): min=5, max=1036, avg=33.52, stdev=44.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 72], 95.00th=[ 101], | 99.00th=[ 171], 99.50th=[ 236], 99.90th=[ 447], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 95, per=27.87%, avg=26.47, stdev=17.59, samples=438 iops : min= 1, max= 23, avg= 5.97, stdev= 4.41, samples=438 write: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6296KiB/251966msec); 0 zone resets clat (msec): min=31, max=664, avg=127.90, stdev=65.14 lat (msec): min=31, max=664, avg=127.91, stdev=65.14 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 112], 60.00th=[ 130], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 211], 95.00th=[ 253], | 99.00th=[ 363], 99.50th=[ 414], 99.90th=[ 485], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 56, per=25.01%, avg=24.76, stdev=11.94, samples=490 iops : min= 1, max= 14, avg= 5.53, stdev= 3.03, samples=490 lat (msec) : 10=4.49%, 20=18.62%, 50=18.55%, 100=25.98%, 250=29.52% lat (msec) : 500=2.77%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.26%, ctx=5133, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146308: Tue Sep 29 02:09:03 2026 read: IOPS=5, BW=23.6KiB/s (24.1kB/s)(5940KiB/251862msec) clat (msec): min=5, max=1085, avg=32.65, stdev=41.68 lat (msec): min=5, max=1085, avg=32.66, stdev=41.68 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 73], 95.00th=[ 97], | 99.00th=[ 165], 99.50th=[ 194], 99.90th=[ 251], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 104, per=28.04%, avg=26.64, stdev=17.66, samples=431 iops : min= 1, max= 26, avg= 6.00, stdev= 4.46, samples=431 write: IOPS=6, BW=25.2KiB/s (25.8kB/s)(6348KiB/251862msec); 0 zone resets clat (msec): min=33, max=695, avg=127.83, stdev=67.42 lat (msec): min=33, max=695, avg=127.84, stdev=67.42 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 63], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 253], | 99.00th=[ 363], 99.50th=[ 414], 99.90th=[ 531], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 56, per=25.00%, avg=24.75, stdev=12.10, samples=495 iops : min= 1, max= 14, avg= 5.53, stdev= 3.07, samples=495 lat (msec) : 10=4.49%, 20=18.39%, 50=19.14%, 100=25.59%, 250=29.62% lat (msec) : 500=2.67%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5094, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146309: Tue Sep 29 02:09:03 2026 read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(6028KiB/252120msec) clat (msec): min=4, max=376, avg=33.88, stdev=34.94 lat (msec): min=4, max=376, avg=33.88, stdev=34.94 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 79], 95.00th=[ 104], | 99.00th=[ 161], 99.50th=[ 203], 99.90th=[ 355], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 103, per=26.84%, avg=25.50, stdev=18.20, samples=455 iops : min= 1, max= 25, avg= 5.72, stdev= 4.60, samples=455 write: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6260KiB/252120msec); 0 zone resets clat (msec): min=28, max=1203, avg=128.16, stdev=68.35 lat (msec): min=28, max=1203, avg=128.16, stdev=68.35 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 77], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 113], 60.00th=[ 125], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 213], 95.00th=[ 251], | 99.00th=[ 338], 99.50th=[ 376], 99.90th=[ 558], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 64, per=24.70%, avg=24.45, stdev=11.91, samples=492 iops : min= 1, max= 16, avg= 5.45, stdev= 3.02, samples=492 lat (msec) : 10=4.20%, 20=19.01%, 50=18.13%, 100=25.65%, 250=30.27% lat (msec) : 500=2.67%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.26%, ctx=5035, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146311: Tue Sep 29 02:09:03 2026 read: IOPS=6, BW=24.2KiB/s (24.8kB/s)(6052KiB/249590msec) clat (msec): min=5, max=459, avg=32.21, stdev=33.78 lat (msec): min=5, max=459, avg=32.21, stdev=33.78 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 69], 95.00th=[ 94], | 99.00th=[ 161], 99.50th=[ 236], 99.90th=[ 313], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 103, per=28.21%, avg=26.80, stdev=18.76, samples=436 iops : min= 1, max= 25, avg= 6.06, stdev= 4.70, samples=436 write: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6236KiB/249590msec); 0 zone resets clat (msec): min=32, max=1165, avg=128.54, stdev=69.46 lat (msec): min=32, max=1165, avg=128.55, stdev=69.47 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 77], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 176], 90.00th=[ 213], 95.00th=[ 247], | 99.00th=[ 334], 99.50th=[ 426], 99.90th=[ 659], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 64, per=24.97%, avg=24.72, stdev=11.83, samples=485 iops : min= 1, max= 16, avg= 5.52, stdev= 3.02, samples=485 lat (msec) : 10=4.88%, 20=18.52%, 50=19.01%, 100=25.39%, 250=29.65% lat (msec) : 500=2.41%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5067, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=95.2KiB/s (97.5kB/s), 23.6KiB/s-24.2KiB/s (24.1kB/s-24.8kB/s), io=23.4MiB (24.6MB), run=249590-252120msec WRITE: bw=99.7KiB/s (102kB/s), 24.8KiB/s-25.2KiB/s (25.4kB/s-25.8kB/s), io=24.6MiB (25.7MB), run=249590-252120msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146368: Tue Sep 29 02:09:40 2026 read: IOPS=14, BW=226KiB/s (231kB/s)(5920KiB/26236msec) clat (usec): min=36, max=316323, avg=39379.76, stdev=38519.90 lat (usec): min=36, max=316325, avg=39381.28, stdev=38519.77 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 1303], | 30.00th=[ 20841], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 86508], | 99.00th=[212861], 99.50th=[291505], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 95, max= 478, per=24.88%, avg=225.39, stdev=84.84, samples=51 iops : min= 5, max= 29, avg=13.37, stdev= 5.37, samples=51 write: IOPS=15, BW=243KiB/s (249kB/s)(6368KiB/26236msec); 0 zone resets clat (usec): min=1262, max=168742, avg=28893.18, stdev=30353.95 lat (usec): min=1264, max=168744, avg=28895.40, stdev=30353.93 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1860], 10.00th=[ 2114], 20.00th=[ 4621], | 30.00th=[ 6783], 40.00th=[ 10814], 50.00th=[ 18482], 60.00th=[ 26084], | 70.00th=[ 35390], 80.00th=[ 50594], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[135267], 99.50th=[154141], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 63, max= 478, per=25.57%, avg=243.71, stdev=94.80, samples=51 iops : min= 3, max= 29, avg=14.53, stdev= 5.98, samples=51 lat (usec) : 50=1.43%, 100=6.51%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=4.82%, 4=4.69%, 10=11.20%, 20=10.55%, 50=36.07% lat (msec) : 100=20.18%, 250=2.99%, 500=0.39% cpu : usr=0.11%, sys=5.98%, ctx=1465, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146369: Tue Sep 29 02:09:40 2026 read: IOPS=13, BW=217KiB/s (223kB/s)(5744KiB/26423msec) clat (usec): min=25, max=178429, avg=38443.42, stdev=29151.19 lat (usec): min=25, max=178431, avg=38444.77, stdev=29150.92 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 66], 10.00th=[ 76], 20.00th=[ 13960], | 30.00th=[ 24249], 40.00th=[ 30016], 50.00th=[ 34341], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[137364], 99.50th=[173016], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 412, per=24.00%, avg=217.46, stdev=87.19, samples=52 iops : min= 1, max= 25, avg=12.87, stdev= 5.50, samples=52 write: IOPS=15, BW=248KiB/s (254kB/s)(6544KiB/26423msec); 0 zone resets clat (usec): min=957, max=249744, avg=30308.92, stdev=33192.92 lat (usec): min=958, max=249746, avg=30312.22, stdev=33193.62 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1893], 10.00th=[ 2671], 20.00th=[ 4883], | 30.00th=[ 6915], 40.00th=[ 10421], 50.00th=[ 17695], 60.00th=[ 29492], | 70.00th=[ 41157], 80.00th=[ 51119], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[135267], 99.50th=[175113], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 94, max= 436, per=25.92%, avg=247.02, stdev=82.46, samples=52 iops : min= 5, max= 27, avg=14.75, stdev= 5.24, samples=52 lat (usec) : 50=0.78%, 100=6.77%, 250=0.91%, 1000=0.26% lat (msec) : 2=3.78%, 4=4.43%, 10=13.41%, 20=8.59%, 50=35.68% lat (msec) : 100=22.40%, 250=2.99% cpu : usr=0.12%, sys=6.23%, ctx=1529, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146370: Tue Sep 29 02:09:40 2026 read: IOPS=15, BW=244KiB/s (250kB/s)(6256KiB/25642msec) clat (usec): min=33, max=269583, avg=36750.86, stdev=29753.11 lat (usec): min=34, max=269585, avg=36752.23, stdev=29753.13 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 10683], | 30.00th=[ 21890], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[123208], 99.50th=[158335], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 504, per=27.16%, avg=246.08, stdev=96.47, samples=50 iops : min= 3, max= 31, avg=14.70, stdev= 6.18, samples=50 write: IOPS=14, BW=235KiB/s (241kB/s)(6032KiB/25642msec); 0 zone resets clat (usec): min=1322, max=282602, avg=29667.58, stdev=32066.68 lat (usec): min=1323, max=282606, avg=29682.19, stdev=32065.26 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1893], 10.00th=[ 2737], 20.00th=[ 5407], | 30.00th=[ 8225], 40.00th=[ 12387], 50.00th=[ 19268], 60.00th=[ 26608], | 70.00th=[ 38011], 80.00th=[ 50070], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[127402], 99.50th=[193987], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 62, max= 442, per=24.52%, avg=233.64, stdev=88.89, samples=50 iops : min= 3, max= 27, avg=13.90, stdev= 5.61, samples=50 lat (usec) : 50=0.65%, 100=7.68%, 250=1.04%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.12%, 4=4.69%, 10=9.51%, 20=11.72%, 50=36.46% lat (msec) : 100=21.35%, 250=3.12%, 500=0.26% cpu : usr=0.08%, sys=6.28%, ctx=1521, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146371: Tue Sep 29 02:09:40 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(6032KiB/25770msec) clat (usec): min=26, max=344083, avg=38153.50, stdev=34780.22 lat (usec): min=26, max=344084, avg=38154.71, stdev=34780.34 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 74], 20.00th=[ 182], | 30.00th=[ 22938], 40.00th=[ 28967], 50.00th=[ 33162], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 57410], 90.00th=[ 70779], 95.00th=[ 90702], | 99.00th=[156238], 99.50th=[185598], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 63, max= 473, per=25.49%, avg=230.98, stdev=89.28, samples=50 iops : min= 3, max= 29, avg=13.76, stdev= 5.66, samples=50 write: IOPS=15, BW=243KiB/s (249kB/s)(6256KiB/25770msec); 0 zone resets clat (usec): min=1276, max=234826, avg=28625.71, stdev=32253.63 lat (usec): min=1278, max=234829, avg=28638.81, stdev=32251.13 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1778], 10.00th=[ 2540], 20.00th=[ 4490], | 30.00th=[ 6915], 40.00th=[ 10552], 50.00th=[ 17171], 60.00th=[ 25297], | 70.00th=[ 36439], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 86508], | 99.00th=[168821], 99.50th=[225444], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 63, max= 443, per=25.32%, avg=241.28, stdev=88.98, samples=50 iops : min= 3, max= 27, avg=14.40, stdev= 5.64, samples=50 lat (usec) : 50=0.78%, 100=8.33%, 250=0.78%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.91%, 4=5.47%, 10=10.42%, 20=10.03%, 50=36.33% lat (msec) : 100=20.44%, 250=3.12%, 500=0.13% cpu : usr=0.07%, sys=5.84%, ctx=1464, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=906KiB/s (928kB/s), 217KiB/s-244KiB/s (223kB/s-250kB/s), io=23.4MiB (24.5MB), run=25642-26423msec WRITE: bw=954KiB/s (977kB/s), 235KiB/s-248KiB/s (241kB/s-254kB/s), io=24.6MiB (25.8MB), run=25642-26423msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146373: Tue Sep 29 02:10:17 2026 read: IOPS=5, BW=95.5KiB/s (97.8kB/s)(5920KiB/61958msec) clat (msec): min=7, max=182, avg=34.97, stdev=30.05 lat (msec): min=7, max=182, avg=34.98, stdev=30.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 75], 95.00th=[ 101], | 99.00th=[ 146], 99.50th=[ 169], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 30, max= 288, per=28.19%, avg=107.96, stdev=59.96, samples=107 iops : min= 1, max= 18, avg= 5.99, stdev= 3.83, samples=107 write: IOPS=6, BW=103KiB/s (105kB/s)(6368KiB/61958msec); 0 zone resets clat (msec): min=28, max=376, avg=122.74, stdev=55.68 lat (msec): min=28, max=376, avg=122.78, stdev=55.77 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 99], 50.00th=[ 108], 60.00th=[ 122], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 201], 95.00th=[ 230], | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 26, max= 192, per=25.61%, avg=103.19, stdev=42.80, samples=121 iops : min= 1, max= 12, avg= 5.69, stdev= 2.73, samples=121 lat (msec) : 10=2.34%, 20=14.58%, 50=22.92%, 100=27.47%, 250=31.38% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.31%, ctx=1264, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146374: Tue Sep 29 02:10:17 2026 read: IOPS=5, BW=92.0KiB/s (94.2kB/s)(5744KiB/62419msec) clat (msec): min=7, max=239, avg=36.99, stdev=35.76 lat (msec): min=7, max=239, avg=37.00, stdev=35.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 122], | 99.00th=[ 180], 99.50th=[ 190], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 27, max= 416, per=27.39%, avg=104.91, stdev=71.39, samples=107 iops : min= 1, max= 26, avg= 5.79, stdev= 4.54, samples=107 write: IOPS=6, BW=105KiB/s (107kB/s)(6544KiB/62419msec); 0 zone resets clat (msec): min=44, max=337, avg=119.91, stdev=48.63 lat (msec): min=44, max=337, avg=119.91, stdev=48.63 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 122], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 182], 95.00th=[ 213], | 99.00th=[ 305], 99.50th=[ 313], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 27, max= 192, per=25.89%, avg=104.33, stdev=41.39, samples=123 iops : min= 1, max= 12, avg= 5.76, stdev= 2.62, samples=123 lat (msec) : 10=2.86%, 20=14.71%, 50=21.61%, 100=25.39%, 250=34.38% lat (msec) : 500=1.04% cpu : usr=0.06%, sys=1.45%, ctx=1326, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146375: Tue Sep 29 02:10:17 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(6256KiB/61426msec) clat (msec): min=6, max=298, avg=34.14, stdev=32.15 lat (msec): min=6, max=298, avg=34.14, stdev=32.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 67], 95.00th=[ 101], | 99.00th=[ 150], 99.50th=[ 232], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 374, per=28.30%, avg=108.39, stdev=74.77, samples=114 iops : min= 1, max= 23, avg= 6.02, stdev= 4.72, samples=114 write: IOPS=6, BW=98.2KiB/s (101kB/s)(6032KiB/61426msec); 0 zone resets clat (msec): min=44, max=404, avg=127.36, stdev=56.98 lat (msec): min=44, max=404, avg=127.36, stdev=56.98 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 111], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 209], 95.00th=[ 234], | 99.00th=[ 321], 99.50th=[ 351], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 27, max= 191, per=24.24%, avg=97.70, stdev=40.69, samples=121 iops : min= 1, max= 11, avg= 5.34, stdev= 2.63, samples=121 lat (msec) : 10=2.73%, 20=15.76%, 50=24.35%, 100=24.48%, 250=30.86% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.53%, ctx=1332, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146376: Tue Sep 29 02:10:17 2026 read: IOPS=6, BW=98.2KiB/s (101kB/s)(6032KiB/61407msec) clat (msec): min=6, max=208, avg=34.39, stdev=29.22 lat (msec): min=6, max=208, avg=34.39, stdev=29.22 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 72], 95.00th=[ 102], | 99.00th=[ 146], 99.50th=[ 176], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 287, per=28.38%, avg=108.69, stdev=62.42, samples=108 iops : min= 1, max= 17, avg= 6.05, stdev= 3.90, samples=108 write: IOPS=6, BW=102KiB/s (104kB/s)(6256KiB/61407msec); 0 zone resets clat (msec): min=38, max=392, avg=123.69, stdev=55.11 lat (msec): min=38, max=392, avg=123.69, stdev=55.11 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 100], 50.00th=[ 109], 60.00th=[ 125], | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 228], | 99.00th=[ 326], 99.50th=[ 388], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 192, per=25.19%, avg=101.53, stdev=42.47, samples=121 iops : min= 1, max= 12, avg= 5.59, stdev= 2.73, samples=121 lat (msec) : 10=2.21%, 20=16.28%, 50=22.66%, 100=26.43%, 250=31.25% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.43%, ctx=1304, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=384KiB/s (393kB/s), 92.0KiB/s-102KiB/s (94.2kB/s-104kB/s), io=23.4MiB (24.5MB), run=61407-62419msec WRITE: bw=404KiB/s (413kB/s), 98.2KiB/s-105KiB/s (101kB/s-107kB/s), io=24.6MiB (25.8MB), run=61407-62419msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146395: Tue Sep 29 02:10:34 2026 read: IOPS=1, BW=1526KiB/s (1563kB/s)(7168KiB/4697msec) clat (msec): min=114, max=484, avg=256.09, stdev=147.24 lat (msec): min=114, max=484, avg=256.09, stdev=147.24 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 128], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 220], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 439], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1793, max= 2027, per=61.32%, avg=1967.17, stdev=88.94, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=1, BW=1090KiB/s (1116kB/s)(5120KiB/4697msec); 0 zone resets clat (msec): min=324, max=660, avg=530.62, stdev=132.74 lat (msec): min=325, max=660, avg=531.04, stdev=132.81 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1793, max= 3820, per=53.54%, avg=2404.50, stdev=949.55, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=33.33% cpu : usr=0.06%, sys=3.68%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146396: Tue Sep 29 02:10:34 2026 read: IOPS=0, BW=321KiB/s (329kB/s)(2048KiB/6384msec) clat (msec): min=163, max=197, avg=180.56, stdev=24.34 lat (msec): min=163, max=197, avg=180.57, stdev=24.34 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1957, max= 1988, per=61.49%, avg=1972.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1604KiB/s (1643kB/s)(10.0MiB/6384msec); 0 zone resets clat (msec): min=347, max=1015, avg=584.62, stdev=293.82 lat (msec): min=348, max=1016, avg=584.74, stdev=293.82 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 359], | 30.00th=[ 376], 40.00th=[ 388], 50.00th=[ 422], 60.00th=[ 430], | 70.00th=[ 510], 80.00th=[ 986], 90.00th=[ 1011], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1793, max= 4023, per=48.96%, avg=2198.88, stdev=743.07, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.87%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146397: Tue Sep 29 02:10:34 2026 read: IOPS=0, BW=1001KiB/s (1025kB/s)(6144KiB/6136msec) clat (msec): min=156, max=512, avg=297.95, stdev=145.69 lat (msec): min=156, max=512, avg=297.95, stdev=145.69 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 300], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1910, max= 2048, per=61.86%, avg=1984.40, stdev=52.85, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=1001KiB/s (1025kB/s)(6144KiB/6136msec); 0 zone resets clat (msec): min=374, max=1036, avg=685.34, stdev=277.73 lat (msec): min=374, max=1036, avg=685.45, stdev=277.73 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 584], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1793, max= 2027, per=43.30%, avg=1944.60, stdev=90.27, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=25.00%, 750=33.33%, 2000=16.67% cpu : usr=0.00%, sys=2.31%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146398: Tue Sep 29 02:10:34 2026 read: IOPS=0, BW=994KiB/s (1018kB/s)(5120KiB/5152msec) clat (msec): min=140, max=542, avg=281.17, stdev=162.30 lat (msec): min=140, max=542, avg=281.17, stdev=162.30 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1910, max= 3992, per=82.55%, avg=2648.33, stdev=1165.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1391KiB/s (1425kB/s)(7168KiB/5152msec); 0 zone resets clat (msec): min=289, max=958, avg=528.31, stdev=260.71 lat (msec): min=289, max=958, avg=528.43, stdev=260.73 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 334], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 372], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 760], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1793, max= 2048, per=43.61%, avg=1958.50, stdev=97.30, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=2.74%, ctx=55, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3208KiB/s (3285kB/s), 321KiB/s-1526KiB/s (329kB/s-1563kB/s), io=20.0MiB (20.0MB), run=4697-6384msec WRITE: bw=4491KiB/s (4599kB/s), 1001KiB/s-1604KiB/s (1025kB/s-1643kB/s), io=28.0MiB (29.4MB), run=4697-6384msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146400: Tue Sep 29 02:10:34 2026 read: IOPS=1, BW=1417KiB/s (1451kB/s)(7168KiB/5057msec) clat (usec): min=700, max=466299, avg=270428.16, stdev=190472.85 lat (usec): min=701, max=466301, avg=270430.09, stdev=190472.99 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 1696], | 30.00th=[316670], 40.00th=[316670], 50.00th=[333448], 60.00th=[367002], | 70.00th=[367002], 80.00th=[408945], 90.00th=[467665], 95.00th=[467665], | 99.00th=[467665], 99.50th=[467665], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 1532, max= 3908, per=71.64%, avg=2301.80, stdev=922.81, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=1012KiB/s (1037kB/s)(5120KiB/5057msec); 0 zone resets clat (msec): min=230, max=956, avg=586.47, stdev=334.03 lat (msec): min=230, max=957, avg=586.56, stdev=334.04 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1954, max= 2048, per=44.66%, avg=2009.00, stdev=39.51, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=58.33%, 1000=16.67% cpu : usr=0.00%, sys=7.63%, ctx=242, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146401: Tue Sep 29 02:10:34 2026 read: IOPS=0, BW=321KiB/s (329kB/s)(2048KiB/6374msec) clat (usec): min=1942, max=397322, avg=199632.84, stdev=279576.01 lat (usec): min=1943, max=397325, avg=199634.66, stdev=279577.41 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 1942], 10.00th=[ 1942], 20.00th=[ 1942], | 30.00th=[ 1942], 40.00th=[ 1942], 50.00th=[ 1942], 60.00th=[396362], | 70.00th=[396362], 80.00th=[396362], 90.00th=[396362], 95.00th=[396362], | 99.00th=[396362], 99.50th=[396362], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 1395, max= 2015, per=53.07%, avg=1705.00, stdev=438.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1607KiB/s (1645kB/s)(10.0MiB/6374msec); 0 zone resets clat (msec): min=226, max=1200, avg=588.28, stdev=350.92 lat (msec): min=226, max=1200, avg=588.39, stdev=350.91 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 271], | 30.00th=[ 347], 40.00th=[ 393], 50.00th=[ 397], 60.00th=[ 514], | 70.00th=[ 523], 80.00th=[ 936], 90.00th=[ 1083], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1954, max= 4031, per=57.12%, avg=2569.43, stdev=972.30, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 2=8.33%, 250=8.33%, 500=41.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.03%, sys=7.53%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146402: Tue Sep 29 02:10:34 2026 read: IOPS=0, BW=981KiB/s (1005kB/s)(6144KiB/6260msec) clat (usec): min=769, max=396131, avg=210416.99, stdev=129495.35 lat (usec): min=770, max=396133, avg=210418.53, stdev=129495.85 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[179307], | 30.00th=[179307], 40.00th=[183501], 50.00th=[183501], 60.00th=[242222], | 70.00th=[263193], 80.00th=[263193], 90.00th=[396362], 95.00th=[396362], | 99.00th=[396362], 99.50th=[396362], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 2011, max= 4096, per=100.00%, avg=3340.67, stdev=1155.08, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=981KiB/s (1005kB/s)(6144KiB/6260msec); 0 zone resets clat (msec): min=373, max=1440, avg=788.94, stdev=400.68 lat (msec): min=373, max=1440, avg=789.07, stdev=400.72 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 919], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 2007, max= 2043, per=44.89%, avg=2019.00, stdev=14.14, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=6.44%, ctx=214, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146403: Tue Sep 29 02:10:34 2026 read: IOPS=0, BW=997KiB/s (1021kB/s)(5120KiB/5137msec) clat (usec): min=726, max=335643, avg=174811.54, stdev=162921.56 lat (usec): min=728, max=335645, avg=174813.24, stdev=162921.57 clat percentiles (usec): | 1.00th=[ 725], 5.00th=[ 725], 10.00th=[ 725], 20.00th=[ 725], | 30.00th=[ 1696], 40.00th=[ 1696], 50.00th=[231736], 60.00th=[231736], | 70.00th=[304088], 80.00th=[304088], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 1954, max= 6047, per=100.00%, avg=4000.50, stdev=2894.19, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1395KiB/s (1429kB/s)(7168KiB/5137msec); 0 zone resets clat (msec): min=258, max=806, avg=554.46, stdev=193.63 lat (msec): min=258, max=806, avg=554.60, stdev=193.61 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 388], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 592], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 726], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1954, max= 2043, per=44.45%, avg=1999.17, stdev=35.90, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=7.26%, ctx=150, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3213KiB/s (3290kB/s), 321KiB/s-1417KiB/s (329kB/s-1451kB/s), io=20.0MiB (20.0MB), run=5057-6374msec WRITE: bw=4498KiB/s (4606kB/s), 981KiB/s-1607KiB/s (1005kB/s-1645kB/s), io=28.0MiB (29.4MB), run=5057-6374msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146410: Tue Sep 29 02:10:52 2026 read: IOPS=0, BW=2808KiB/s (2875kB/s)(12.0MiB/4376msec) clat (msec): min=759, max=1986, avg=1412.50, stdev=617.46 lat (msec): min=759, max=1986, avg=1412.50, stdev=617.47 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 7892, max= 8175, per=100.00%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.05%, sys=6.68%, ctx=128, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146411: Tue Sep 29 02:10:52 2026 read: IOPS=0, BW=936KiB/s (959kB/s)(4096KiB/4375msec) clat (nsec): min=2003.9M, max=2003.9M, avg=2003938197.00, stdev= 0.00 lat (nsec): min=2003.9M, max=2003.9M, avg=2003940308.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2005], 5.00th=[ 2005], 10.00th=[ 2005], 20.00th=[ 2005], | 30.00th=[ 2005], 40.00th=[ 2005], 50.00th=[ 2005], 60.00th=[ 2005], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1872KiB/s (1917kB/s)(8192KiB/4375msec); 0 zone resets clat (msec): min=588, max=1586, avg=1087.87, stdev=705.60 lat (msec): min=589, max=1587, avg=1088.27, stdev=705.65 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7641, max= 7641, per=100.00%, avg=7641.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.65%, ctx=264, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146412: Tue Sep 29 02:10:52 2026 write: IOPS=0, BW=3095KiB/s (3169kB/s)(12.0MiB/3970msec); 0 zone resets clat (msec): min=872, max=1557, avg=1247.33, stdev=346.85 lat (msec): min=874, max=1557, avg=1248.97, stdev=346.56 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7953, max= 8175, per=100.00%, avg=8064.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.05%, sys=4.56%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146413: Tue Sep 29 02:10:52 2026 write: IOPS=0, BW=3168KiB/s (3244kB/s)(12.0MiB/3879msec); 0 zone resets clat (msec): min=463, max=1826, avg=1247.89, stdev=704.75 lat (msec): min=463, max=1826, avg=1248.45, stdev=704.80 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min=15906, max=15906, per=100.00%, avg=15906.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.05%, sys=3.84%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3744KiB/s (3834kB/s), 936KiB/s-2808KiB/s (959kB/s-2875kB/s), io=16.0MiB (16.8MB), run=4375-4376msec WRITE: bw=7490KiB/s (7670kB/s), 1872KiB/s-3168KiB/s (1917kB/s-3244kB/s), io=32.0MiB (33.6MB), run=3879-4375msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146415: Tue Sep 29 02:10:52 2026 read: IOPS=0, BW=2773KiB/s (2840kB/s)(12.0MiB/4431msec) clat (msec): min=300, max=2642, avg=1476.51, stdev=1171.32 lat (msec): min=300, max=2642, avg=1476.51, stdev=1171.32 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 7861, max= 8110, per=100.00%, avg=7985.50, stdev=176.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=1.87%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146416: Tue Sep 29 02:10:52 2026 read: IOPS=0, BW=876KiB/s (897kB/s)(4096KiB/4674msec) clat (nsec): min=1870.9M, max=1870.9M, avg=1870932436.00, stdev= 0.00 lat (nsec): min=1870.9M, max=1870.9M, avg=1870933833.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1871], 5.00th=[ 1871], 10.00th=[ 1871], 20.00th=[ 1871], | 30.00th=[ 1871], 40.00th=[ 1871], 50.00th=[ 1871], 60.00th=[ 1871], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1753KiB/s (1795kB/s)(8192KiB/4674msec); 0 zone resets clat (msec): min=1082, max=1718, avg=1400.54, stdev=449.15 lat (msec): min=1083, max=1718, avg=1400.98, stdev=449.19 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.09%, sys=1.80%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146417: Tue Sep 29 02:10:52 2026 write: IOPS=0, BW=2598KiB/s (2661kB/s)(12.0MiB/4729msec); 0 zone resets clat (msec): min=740, max=2368, avg=1574.14, stdev=814.46 lat (msec): min=741, max=2368, avg=1574.82, stdev=814.21 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 7627, max= 7968, per=100.00%, avg=7797.50, stdev=241.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.52%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146418: Tue Sep 29 02:10:52 2026 write: IOPS=0, BW=3217KiB/s (3294kB/s)(12.0MiB/3820msec); 0 zone resets clat (msec): min=400, max=1708, avg=1271.33, stdev=754.07 lat (msec): min=401, max=1709, avg=1271.87, stdev=753.93 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7876, max= 8094, per=100.00%, avg=7985.00, stdev=154.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.53%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3505KiB/s (3589kB/s), 876KiB/s-2773KiB/s (897kB/s-2840kB/s), io=16.0MiB (16.8MB), run=4431-4674msec WRITE: bw=6929KiB/s (7095kB/s), 1753KiB/s-3217KiB/s (1795kB/s-3294kB/s), io=32.0MiB (33.6MB), run=3820-4729msec