== sanity test 398b: DIO and buffer IO race ============== 18:44:13 (1787870653) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.11764 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179965: Thu Aug 27 18:46:24 2026 read: IOPS=13, BW=53.6KiB/s (54.9kB/s)(5992KiB/111742msec) clat (usec): min=39, max=362556, avg=40073.90, stdev=26327.09 lat (usec): min=39, max=362557, avg=40076.02, stdev=26328.72 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11338], 10.00th=[ 15795], 20.00th=[ 20579], | 30.00th=[ 25297], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 70779], 95.00th=[ 88605], | 99.00th=[126354], 99.50th=[147850], 99.90th=[206570], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 116, per=25.06%, avg=53.38, stdev=20.11, samples=220 iops : min= 1, max= 29, avg=12.71, stdev= 5.07, samples=220 write: IOPS=14, BW=56.3KiB/s (57.7kB/s)(6296KiB/111742msec); 0 zone resets clat (usec): min=1017, max=669723, avg=32585.05, stdev=37842.94 lat (usec): min=1018, max=669725, avg=32589.23, stdev=37844.32 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1221], 10.00th=[ 1483], 20.00th=[ 3392], | 30.00th=[ 6325], 40.00th=[ 14091], 50.00th=[ 22938], 60.00th=[ 31065], | 70.00th=[ 41681], 80.00th=[ 55837], 90.00th=[ 77071], 95.00th=[100140], | 99.00th=[149947], 99.50th=[173016], 99.90th=[258999], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 120, per=25.01%, avg=56.02, stdev=22.36, samples=220 iops : min= 1, max= 30, avg=13.37, stdev= 5.62, samples=220 lat (usec) : 50=0.33%, 100=1.17%, 250=0.07%, 750=0.07% lat (msec) : 2=6.90%, 4=4.79%, 10=6.90%, 20=12.60%, 50=41.89% lat (msec) : 100=21.13%, 250=4.07%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=5.63%, ctx=6509, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179966: Thu Aug 27 18:46:24 2026 read: IOPS=13, BW=53.1KiB/s (54.4kB/s)(5940KiB/111903msec) clat (usec): min=46, max=194878, avg=40795.68, stdev=25335.45 lat (usec): min=46, max=194879, avg=40799.95, stdev=25334.74 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11731], 10.00th=[ 15270], 20.00th=[ 21365], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[126354], 99.50th=[141558], 99.90th=[173016], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 7, max= 96, per=24.75%, avg=52.72, stdev=18.08, samples=220 iops : min= 1, max= 24, avg=12.55, stdev= 4.57, samples=220 write: IOPS=14, BW=56.7KiB/s (58.1kB/s)(6348KiB/111903msec); 0 zone resets clat (usec): min=896, max=697462, avg=32076.08, stdev=36589.54 lat (usec): min=898, max=697463, avg=32080.49, stdev=36591.12 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1647], 20.00th=[ 3228], | 30.00th=[ 7242], 40.00th=[ 14877], 50.00th=[ 23200], 60.00th=[ 31327], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[135267], 99.50th=[160433], 99.90th=[341836], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 141, per=25.00%, avg=56.01, stdev=24.56, samples=221 iops : min= 1, max= 35, avg=13.36, stdev= 6.18, samples=221 lat (usec) : 50=0.10%, 100=1.27%, 250=0.03%, 500=0.13%, 1000=0.03% lat (msec) : 2=6.38%, 4=5.21%, 10=6.61%, 20=12.17%, 50=42.74% lat (msec) : 100=21.74%, 250=3.52%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=5.51%, ctx=6573, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179967: Thu Aug 27 18:46:24 2026 read: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6028KiB/110808msec) clat (usec): min=44, max=271682, avg=40204.51, stdev=27741.63 lat (usec): min=46, max=271682, avg=40212.52, stdev=27747.03 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 172], 10.00th=[ 14484], 20.00th=[ 20579], | 30.00th=[ 24511], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[133694], 99.50th=[164627], 99.90th=[265290], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 15, max= 119, per=25.53%, avg=54.39, stdev=19.45, samples=217 iops : min= 3, max= 29, avg=12.96, stdev= 4.88, samples=217 write: IOPS=14, BW=56.5KiB/s (57.8kB/s)(6260KiB/110808msec); 0 zone resets clat (usec): min=934, max=786187, avg=31791.15, stdev=37344.86 lat (usec): min=936, max=786191, avg=31795.29, stdev=37347.62 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1254], 10.00th=[ 1778], 20.00th=[ 3916], | 30.00th=[ 7242], 40.00th=[ 14615], 50.00th=[ 22938], 60.00th=[ 30016], | 70.00th=[ 40633], 80.00th=[ 52167], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[162530], 99.90th=[240124], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 120, per=25.32%, avg=56.73, stdev=22.89, samples=216 iops : min= 1, max= 30, avg=13.55, stdev= 5.77, samples=216 lat (usec) : 50=0.39%, 100=1.99%, 250=0.16%, 1000=0.10% lat (msec) : 2=5.63%, 4=4.65%, 10=7.71%, 20=12.63%, 50=41.89% lat (msec) : 100=20.90%, 250=3.81%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.55%, ctx=6465, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179968: Thu Aug 27 18:46:24 2026 read: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6052KiB/112217msec) clat (usec): min=33, max=300795, avg=40026.48, stdev=26327.79 lat (usec): min=33, max=300796, avg=40028.87, stdev=26327.21 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8717], 10.00th=[ 15270], 20.00th=[ 20055], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[123208], 99.50th=[141558], 99.90th=[240124], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 111, per=25.29%, avg=53.86, stdev=18.32, samples=220 iops : min= 1, max= 27, avg=12.84, stdev= 4.63, samples=220 write: IOPS=13, BW=55.6KiB/s (56.9kB/s)(6236KiB/112217msec); 0 zone resets clat (usec): min=1028, max=732561, avg=32849.57, stdev=36795.60 lat (usec): min=1029, max=732563, avg=32851.41, stdev=36795.62 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 1909], 20.00th=[ 4113], | 30.00th=[ 8029], 40.00th=[ 15795], 50.00th=[ 23987], 60.00th=[ 31589], | 70.00th=[ 43254], 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[147850], 99.50th=[160433], 99.90th=[248513], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 149, per=24.79%, avg=55.52, stdev=22.95, samples=220 iops : min= 1, max= 37, avg=13.25, stdev= 5.77, samples=220 lat (usec) : 50=0.26%, 100=1.79%, 250=0.16% lat (msec) : 2=5.44%, 4=4.62%, 10=7.00%, 20=13.05%, 50=42.74% lat (msec) : 100=21.39%, 250=3.48%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.71%, ctx=6593, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=214KiB/s (219kB/s), 53.1KiB/s-54.4KiB/s (54.4kB/s-55.7kB/s), io=23.4MiB (24.6MB), run=110808-112217msec WRITE: bw=224KiB/s (229kB/s), 55.6KiB/s-56.7KiB/s (56.9kB/s-58.1kB/s), io=24.6MiB (25.7MB), run=110808-112217msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179970: Thu Aug 27 18:47:05 2026 read: IOPS=9, BW=39.1KiB/s (39.0kB/s)(5992KiB/153432msec) clat (msec): min=5, max=630, avg=41.13, stdev=39.61 lat (msec): min=5, max=630, avg=41.13, stdev=39.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 91], 95.00th=[ 117], | 99.00th=[ 180], 99.50th=[ 203], 99.90th=[ 309], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 142, per=24.90%, avg=38.84, stdev=25.28, samples=299 iops : min= 1, max= 35, avg= 9.05, stdev= 6.36, samples=299 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6296KiB/153432msec); 0 zone resets clat (msec): min=11, max=354, avg=58.11, stdev=39.75 lat (msec): min=11, max=354, avg=58.11, stdev=39.75 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 108], 95.00th=[ 136], | 99.00th=[ 207], 99.50th=[ 222], 99.90th=[ 347], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 127, per=25.01%, avg=40.77, stdev=23.68, samples=300 iops : min= 1, max= 31, avg= 9.54, stdev= 5.95, samples=300 lat (msec) : 10=1.99%, 20=17.12%, 50=45.48%, 100=24.90%, 250=10.29% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=1.86%, ctx=4761, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179971: Thu Aug 27 18:47:05 2026 read: IOPS=9, BW=38.9KiB/s (39.8kB/s)(5940KiB/152727msec) clat (msec): min=5, max=737, avg=40.04, stdev=38.72 lat (msec): min=5, max=737, avg=40.04, stdev=38.72 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 85], 95.00th=[ 112], | 99.00th=[ 174], 99.50th=[ 190], 99.90th=[ 288], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 135, per=25.22%, avg=39.35, stdev=24.21, samples=294 iops : min= 1, max= 33, avg= 9.18, stdev= 6.09, samples=294 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6348KiB/152727msec); 0 zone resets clat (msec): min=9, max=346, avg=58.58, stdev=40.29 lat (msec): min=9, max=346, avg=58.59, stdev=40.29 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 112], 95.00th=[ 138], | 99.00th=[ 199], 99.50th=[ 264], 99.90th=[ 313], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 126, per=25.21%, avg=41.10, stdev=23.66, samples=301 iops : min= 1, max= 31, avg= 9.61, stdev= 5.94, samples=301 lat (msec) : 10=2.51%, 20=15.59%, 50=47.01%, 100=24.74%, 250=9.83% lat (msec) : 500=0.29%, 750=0.03% cpu : usr=0.06%, sys=1.95%, ctx=4987, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179972: Thu Aug 27 18:47:05 2026 read: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6028KiB/152036msec) clat (msec): min=6, max=292, avg=40.85, stdev=36.32 lat (msec): min=6, max=292, avg=40.85, stdev=36.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 90], 95.00th=[ 116], | 99.00th=[ 178], 99.50th=[ 209], 99.90th=[ 284], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 151, per=25.49%, avg=39.76, stdev=24.31, samples=296 iops : min= 1, max= 37, avg= 9.29, stdev= 6.12, samples=296 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6260KiB/152036msec); 0 zone resets clat (msec): min=11, max=751, avg=57.61, stdev=42.31 lat (msec): min=11, max=751, avg=57.62, stdev=42.31 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 110], 95.00th=[ 131], | 99.00th=[ 194], 99.50th=[ 228], 99.90th=[ 321], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 142, per=25.08%, avg=40.89, stdev=24.37, samples=299 iops : min= 1, max= 35, avg= 9.57, stdev= 6.13, samples=299 lat (msec) : 10=2.47%, 20=16.44%, 50=46.19%, 100=25.13%, 250=9.41% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.90%, ctx=4700, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179973: Thu Aug 27 18:47:05 2026 read: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6052KiB/152736msec) clat (msec): min=6, max=386, avg=40.07, stdev=35.33 lat (msec): min=6, max=386, avg=40.07, stdev=35.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 83], 95.00th=[ 111], | 99.00th=[ 178], 99.50th=[ 209], 99.90th=[ 262], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 126, per=25.72%, avg=40.12, stdev=25.17, samples=294 iops : min= 1, max= 31, avg= 9.38, stdev= 6.32, samples=294 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6236KiB/152736msec); 0 zone resets clat (msec): min=10, max=747, avg=58.86, stdev=44.50 lat (msec): min=10, max=747, avg=58.86, stdev=44.50 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 205], 99.50th=[ 284], 99.90th=[ 359], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 149, per=25.01%, avg=40.76, stdev=23.58, samples=298 iops : min= 1, max= 37, avg= 9.53, stdev= 5.93, samples=298 lat (msec) : 10=2.38%, 20=15.95%, 50=46.61%, 100=24.93%, 250=9.70% lat (msec) : 500=0.39%, 750=0.03% cpu : usr=0.07%, sys=1.88%, ctx=4822, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (160kB/s), 38.9KiB/s-39.6KiB/s (39.8kB/s-40.6kB/s), io=23.4MiB (24.6MB), run=152036-153432msec WRITE: bw=164KiB/s (168kB/s), 40.8KiB/s-41.6KiB/s (41.8kB/s-42.6kB/s), io=24.6MiB (25.7MB), run=152036-153432msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180011: Thu Aug 27 18:47:50 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5920KiB/33452msec) clat (usec): min=40, max=206300, avg=48441.76, stdev=31967.02 lat (usec): min=40, max=206302, avg=48443.82, stdev=31968.31 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 14746], 20.00th=[ 23462], | 30.00th=[ 28443], 40.00th=[ 35914], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 61604], 80.00th=[ 72877], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[154141], 99.50th=[183501], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 32, max= 352, per=25.04%, avg=176.28, stdev=68.15, samples=65 iops : min= 2, max= 22, avg=10.23, stdev= 4.30, samples=65 write: IOPS=11, BW=190KiB/s (195kB/s)(6368KiB/33452msec); 0 zone resets clat (usec): min=1524, max=228386, avg=38812.87, stdev=36684.01 lat (usec): min=1526, max=228389, avg=38815.09, stdev=36683.97 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2147], 10.00th=[ 3523], 20.00th=[ 6849], | 30.00th=[ 11863], 40.00th=[ 19792], 50.00th=[ 28443], 60.00th=[ 39584], | 70.00th=[ 49546], 80.00th=[ 66323], 90.00th=[ 93848], 95.00th=[111674], | 99.00th=[154141], 99.50th=[166724], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 446, per=25.75%, avg=190.52, stdev=89.22, samples=65 iops : min= 1, max= 27, avg=11.12, stdev= 5.68, samples=65 lat (usec) : 50=0.39%, 100=3.39%, 250=0.26%, 1000=0.13% lat (msec) : 2=2.21%, 4=4.43%, 10=8.07%, 20=9.11%, 50=36.07% lat (msec) : 100=29.04%, 250=6.90% cpu : usr=0.08%, sys=5.35%, ctx=1652, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180012: Thu Aug 27 18:47:50 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/34020msec) clat (usec): min=37, max=193029, avg=49725.20, stdev=32296.19 lat (usec): min=38, max=193031, avg=49726.32, stdev=32296.20 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 83], 10.00th=[ 16712], 20.00th=[ 23462], | 30.00th=[ 30278], 40.00th=[ 38011], 50.00th=[ 45351], 60.00th=[ 52167], | 70.00th=[ 60556], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[113771], | 99.00th=[145753], 99.50th=[185598], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 379, per=23.86%, avg=167.94, stdev=74.04, samples=66 iops : min= 1, max= 23, avg= 9.70, stdev= 4.69, samples=66 write: IOPS=12, BW=192KiB/s (197kB/s)(6544KiB/34020msec); 0 zone resets clat (usec): min=1491, max=209966, avg=38886.75, stdev=39202.04 lat (usec): min=1492, max=209967, avg=38888.65, stdev=39202.07 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2040], 10.00th=[ 3097], 20.00th=[ 6390], | 30.00th=[ 9765], 40.00th=[ 19530], 50.00th=[ 25035], 60.00th=[ 36439], | 70.00th=[ 50594], 80.00th=[ 66847], 90.00th=[ 91751], 95.00th=[124257], | 99.00th=[162530], 99.50th=[170918], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 30, max= 352, per=25.67%, avg=189.94, stdev=78.85, samples=66 iops : min= 1, max= 22, avg=11.09, stdev= 5.01, samples=66 lat (usec) : 50=0.26%, 100=2.47%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=2.34%, 4=4.17%, 10=10.03%, 20=8.33%, 50=35.29% lat (msec) : 100=28.65%, 250=8.07% cpu : usr=0.08%, sys=5.16%, ctx=1657, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180013: Thu Aug 27 18:47:50 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(6256KiB/33046msec) clat (usec): min=42, max=195965, avg=48790.42, stdev=31315.96 lat (usec): min=43, max=195967, avg=48791.89, stdev=31316.01 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 14091], 20.00th=[ 25297], | 30.00th=[ 31065], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[154141], 99.50th=[168821], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 63, max= 350, per=27.06%, avg=190.53, stdev=67.30, samples=64 iops : min= 3, max= 21, avg=11.14, stdev= 4.23, samples=64 write: IOPS=11, BW=183KiB/s (187kB/s)(6032KiB/33046msec); 0 zone resets clat (usec): min=1475, max=220072, avg=36350.13, stdev=34631.35 lat (usec): min=1476, max=220075, avg=36352.31, stdev=34631.33 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2343], 10.00th=[ 3621], 20.00th=[ 7177], | 30.00th=[ 10814], 40.00th=[ 18744], 50.00th=[ 26870], 60.00th=[ 35390], | 70.00th=[ 44303], 80.00th=[ 62129], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[166724], 99.50th=[185598], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 442, per=24.36%, avg=180.23, stdev=84.62, samples=64 iops : min= 1, max= 27, avg=10.48, stdev= 5.33, samples=64 lat (usec) : 50=0.13%, 100=4.30%, 250=0.26%, 1000=0.13% lat (msec) : 2=1.82%, 4=3.52%, 10=8.46%, 20=8.85%, 50=38.41% lat (msec) : 100=27.86%, 250=6.25% cpu : usr=0.10%, sys=5.60%, ctx=1683, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180014: Thu Aug 27 18:47:50 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(6032KiB/32559msec) clat (usec): min=43, max=171386, avg=45993.97, stdev=31895.64 lat (usec): min=43, max=171387, avg=46003.56, stdev=31897.57 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 94], 20.00th=[ 23725], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[162530], 99.50th=[170918], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 380, per=26.19%, avg=184.38, stdev=73.79, samples=63 iops : min= 1, max= 23, avg=10.75, stdev= 4.68, samples=63 write: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32559msec); 0 zone resets clat (usec): min=1316, max=247724, avg=38043.36, stdev=38063.90 lat (usec): min=1317, max=247726, avg=38052.71, stdev=38067.06 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2008], 10.00th=[ 3326], 20.00th=[ 6849], | 30.00th=[ 9896], 40.00th=[ 16712], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 51119], 80.00th=[ 65799], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[149947], 99.50th=[214959], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 63, max= 383, per=25.84%, avg=191.24, stdev=77.55, samples=63 iops : min= 3, max= 23, avg=11.17, stdev= 4.91, samples=63 lat (usec) : 50=0.39%, 100=4.56%, 250=0.65%, 1000=0.13% lat (msec) : 2=2.47%, 4=4.04%, 10=9.24%, 20=8.98%, 50=35.29% lat (msec) : 100=27.34%, 250=6.90% cpu : usr=0.06%, sys=5.47%, ctx=1654, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=704KiB/s (721kB/s), 169KiB/s-189KiB/s (173kB/s-194kB/s), io=23.4MiB (24.5MB), run=32559-34020msec WRITE: bw=741KiB/s (759kB/s), 183KiB/s-192KiB/s (187kB/s-197kB/s), io=24.6MiB (25.8MB), run=32559-34020msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180015: Thu Aug 27 18:48:06 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(5920KiB/49417msec) clat (msec): min=8, max=268, avg=51.23, stdev=39.55 lat (msec): min=8, max=268, avg=51.23, stdev=39.55 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 70], 90.00th=[ 97], 95.00th=[ 131], | 99.00th=[ 234], 99.50th=[ 241], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 29, max= 345, per=25.16%, avg=121.00, stdev=61.30, samples=95 iops : min= 1, max= 21, avg= 6.76, stdev= 3.87, samples=95 write: IOPS=8, BW=129KiB/s (132kB/s)(6368KiB/49417msec); 0 zone resets clat (msec): min=24, max=236, avg=75.39, stdev=39.94 lat (msec): min=24, max=236, avg=75.39, stdev=39.94 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 45], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 64], 60.00th=[ 73], | 70.00th=[ 84], 80.00th=[ 102], 90.00th=[ 131], 95.00th=[ 165], | 99.00th=[ 199], 99.50th=[ 226], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 282, per=25.62%, avg=129.66, stdev=57.67, samples=96 iops : min= 1, max= 17, avg= 7.30, stdev= 3.65, samples=96 lat (msec) : 10=0.26%, 20=6.12%, 50=38.80%, 100=39.58%, 250=15.10% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.61%, ctx=1151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180016: Thu Aug 27 18:48:06 2026 read: IOPS=7, BW=116KiB/s (118kB/s)(5744KiB/49700msec) clat (msec): min=7, max=262, avg=50.45, stdev=38.76 lat (msec): min=7, max=262, avg=50.45, stdev=38.76 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 107], 95.00th=[ 138], | 99.00th=[ 186], 99.50th=[ 203], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 29, max= 285, per=24.75%, avg=119.05, stdev=67.98, samples=95 iops : min= 1, max= 17, avg= 6.63, stdev= 4.31, samples=95 write: IOPS=8, BW=132KiB/s (135kB/s)(6544KiB/49700msec); 0 zone resets clat (msec): min=16, max=259, avg=76.91, stdev=44.59 lat (msec): min=16, max=259, avg=76.92, stdev=44.58 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 34], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 74], | 70.00th=[ 87], 80.00th=[ 103], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 234], 99.50th=[ 255], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 407, per=26.10%, avg=132.07, stdev=61.87, samples=97 iops : min= 1, max= 25, avg= 7.45, stdev= 3.93, samples=97 lat (msec) : 10=0.78%, 20=6.77%, 50=39.32%, 100=36.33%, 250=16.28% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.65%, ctx=1174, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180017: Thu Aug 27 18:48:06 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49737msec) clat (msec): min=7, max=257, avg=52.92, stdev=40.23 lat (msec): min=7, max=257, avg=52.92, stdev=40.23 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 63], 80.00th=[ 77], 90.00th=[ 99], 95.00th=[ 140], | 99.00th=[ 199], 99.50th=[ 245], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 313, per=26.39%, avg=126.94, stdev=73.39, samples=97 iops : min= 1, max= 19, avg= 7.13, stdev= 4.64, samples=97 write: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49737msec); 0 zone resets clat (msec): min=19, max=281, avg=76.16, stdev=42.26 lat (msec): min=19, max=281, avg=76.16, stdev=42.26 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 33], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 90], 80.00th=[ 108], 90.00th=[ 132], 95.00th=[ 163], | 99.00th=[ 224], 99.50th=[ 232], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 375, per=23.75%, avg=120.18, stdev=63.15, samples=98 iops : min= 1, max= 23, avg= 6.70, stdev= 3.99, samples=98 lat (msec) : 10=0.26%, 20=6.64%, 50=39.19%, 100=37.89%, 250=15.76% lat (msec) : 500=0.26% cpu : usr=0.03%, sys=1.48%, ctx=1068, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180018: Thu Aug 27 18:48:06 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(6032KiB/49216msec) clat (msec): min=8, max=295, avg=54.33, stdev=44.54 lat (msec): min=8, max=295, avg=54.33, stdev=44.54 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 49], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 111], 95.00th=[ 144], | 99.00th=[ 247], 99.50th=[ 271], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 407, per=26.14%, avg=125.71, stdev=66.69, samples=94 iops : min= 1, max= 25, avg= 7.05, stdev= 4.22, samples=94 write: IOPS=7, BW=127KiB/s (130kB/s)(6256KiB/49216msec); 0 zone resets clat (msec): min=14, max=270, avg=72.82, stdev=42.75 lat (msec): min=14, max=270, avg=72.82, stdev=42.75 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 35], 20.00th=[ 41], | 30.00th=[ 47], 40.00th=[ 53], 50.00th=[ 60], 60.00th=[ 69], | 70.00th=[ 83], 80.00th=[ 100], 90.00th=[ 126], 95.00th=[ 163], | 99.00th=[ 243], 99.50th=[ 259], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 375, per=25.34%, avg=128.23, stdev=62.51, samples=96 iops : min= 1, max= 23, avg= 7.22, stdev= 3.96, samples=96 lat (msec) : 10=0.26%, 20=5.34%, 50=43.23%, 100=34.90%, 250=15.49% lat (msec) : 500=0.78% cpu : usr=0.07%, sys=1.64%, ctx=1083, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=482KiB/s (493kB/s), 116KiB/s-126KiB/s (118kB/s-129kB/s), io=23.4MiB (24.5MB), run=49216-49737msec WRITE: bw=507KiB/s (519kB/s), 121KiB/s-132KiB/s (124kB/s-135kB/s), io=24.6MiB (25.8MB), run=49216-49737msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180036: Thu Aug 27 18:48:29 2026 read: IOPS=1, BW=1141KiB/s (1169kB/s)(7168KiB/6281msec) clat (msec): min=154, max=242, avg=201.04, stdev=30.94 lat (msec): min=154, max=242, avg=201.04, stdev=30.94 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 184], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 190], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 226], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1992, max= 4101, per=100.00%, avg=2535.75, stdev=1043.72, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=815KiB/s (835kB/s)(5120KiB/6281msec); 0 zone resets clat (msec): min=205, max=2772, avg=942.79, stdev=1036.17 lat (msec): min=205, max=2772, avg=942.88, stdev=1036.21 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 2031, max= 3842, per=81.54%, avg=2638.67, stdev=1042.13, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=8.33%, ctx=225, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180038: Thu Aug 27 18:48:29 2026 read: IOPS=0, BW=231KiB/s (237kB/s)(2048KiB/8859msec) clat (usec): min=985, max=2931.7k, avg=1466358.70, stdev=2072350.74 lat (usec): min=987, max=2931.7k, avg=1466360.70, stdev=2072351.13 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], | 20.00th=[ 988], 30.00th=[ 988], 40.00th=[ 988], | 50.00th=[ 988], 60.00th=[2936013], 70.00th=[2936013], | 80.00th=[2936013], 90.00th=[2936013], 95.00th=[2936013], | 99.00th=[2936013], 99.50th=[2936013], 99.90th=[2936013], | 99.95th=[2936013], 99.99th=[2936013] bw ( KiB/s): min= 1924, max= 2043, per=85.83%, avg=1983.50, stdev=84.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1156KiB/s (1184kB/s)(10.0MiB/8859msec); 0 zone resets clat (msec): min=114, max=2394, avg=589.26, stdev=672.97 lat (msec): min=114, max=2394, avg=589.42, stdev=672.97 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 131], | 30.00th=[ 209], 40.00th=[ 243], 50.00th=[ 309], 60.00th=[ 542], | 70.00th=[ 584], 80.00th=[ 592], 90.00th=[ 776], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1729, max= 4087, per=78.78%, avg=2549.29, stdev=1047.25, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=8.33%, 750=25.00%, 1000=8.33%, >=2000=16.67% cpu : usr=0.05%, sys=7.39%, ctx=674, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180040: Thu Aug 27 18:48:29 2026 read: IOPS=0, BW=695KiB/s (711kB/s)(6144KiB/8846msec) clat (usec): min=552, max=2949.9k, avg=552461.64, stdev=1183158.02 lat (usec): min=559, max=2949.9k, avg=552463.98, stdev=1183157.51 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 644], 30.00th=[ 644], 40.00th=[ 1696], | 50.00th=[ 1696], 60.00th=[ 3294], 70.00th=[ 358613], | 80.00th=[ 358613], 90.00th=[2936013], 95.00th=[2936013], | 99.00th=[2936013], 99.50th=[2936013], 99.90th=[2936013], | 99.95th=[2936013], 99.99th=[2936013] bw ( KiB/s): min= 1921, max= 2031, per=85.50%, avg=1976.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=695KiB/s (711kB/s)(6144KiB/8846msec); 0 zone resets clat (msec): min=165, max=3182, avg=904.35, stdev=1139.54 lat (msec): min=165, max=3184, avg=904.68, stdev=1140.14 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 667], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1992, max= 2043, per=62.37%, avg=2018.25, stdev=23.03, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 4=8.33%, 250=16.67%, 500=8.33%, 750=25.00% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=5.43%, ctx=545, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180043: Thu Aug 27 18:48:29 2026 read: IOPS=0, BW=825KiB/s (845kB/s)(5120KiB/6208msec) clat (usec): min=754, max=423444, avg=144208.81, stdev=200503.57 lat (usec): min=756, max=423445, avg=144210.13, stdev=200503.58 clat percentiles (usec): | 1.00th=[ 758], 5.00th=[ 758], 10.00th=[ 758], 20.00th=[ 758], | 30.00th=[ 2114], 40.00th=[ 2114], 50.00th=[ 2376], 60.00th=[ 2376], | 70.00th=[291505], 80.00th=[291505], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 2007, max= 3849, per=100.00%, avg=2631.67, stdev=1054.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1155KiB/s (1182kB/s)(7168KiB/6208msec); 0 zone resets clat (msec): min=210, max=3268, avg=769.35, stdev=1115.46 lat (msec): min=210, max=3268, avg=769.44, stdev=1115.46 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 222], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 342], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 709], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1924, max= 4063, per=83.32%, avg=2696.20, stdev=996.05, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 1000=8.33% lat (msec) : 4=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.94%, ctx=110, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2312KiB/s (2367kB/s), 231KiB/s-1141KiB/s (237kB/s-1169kB/s), io=20.0MiB (20.0MB), run=6208-8859msec WRITE: bw=3236KiB/s (3314kB/s), 695KiB/s-1156KiB/s (711kB/s-1184kB/s), io=28.0MiB (29.4MB), run=6208-8859msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180037: Thu Aug 27 18:48:30 2026 read: IOPS=1, BW=1216KiB/s (1246kB/s)(7168KiB/5893msec) clat (msec): min=107, max=261, avg=173.35, stdev=55.59 lat (msec): min=107, max=261, avg=173.35, stdev=55.59 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 122], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 188], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 211], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 2035, max= 4243, per=100.00%, avg=3441.67, stdev=1222.14, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=869KiB/s (890kB/s)(5120KiB/5893msec); 0 zone resets clat (msec): min=445, max=2475, avg=921.86, stdev=875.20 lat (msec): min=445, max=2475, avg=921.95, stdev=875.20 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1943, max= 2048, per=69.98%, avg=2016.00, stdev=43.21, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.66%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180039: Thu Aug 27 18:48:30 2026 read: IOPS=0, BW=206KiB/s (211kB/s)(2048KiB/9952msec) clat (msec): min=112, max=2958, avg=1535.40, stdev=2012.35 lat (msec): min=112, max=2958, avg=1535.41, stdev=2012.35 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 113], 60.00th=[ 2970], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 2011, max= 2019, per=97.96%, avg=2015.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1029KiB/s (1054kB/s)(10.0MiB/9952msec); 0 zone resets clat (msec): min=80, max=3375, avg=672.10, stdev=1016.40 lat (msec): min=80, max=3375, avg=672.20, stdev=1016.39 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 114], 50.00th=[ 205], 60.00th=[ 443], | 70.00th=[ 468], 80.00th=[ 609], 90.00th=[ 1250], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1957, max= 6059, per=98.00%, avg=2823.40, stdev=1809.10, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=16.67%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.02%, sys=2.21%, ctx=92, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180041: Thu Aug 27 18:48:30 2026 read: IOPS=0, BW=618KiB/s (633kB/s)(6144KiB/9940msec) clat (msec): min=111, max=3407, avg=787.46, stdev=1295.75 lat (msec): min=111, max=3407, avg=787.46, stdev=1295.75 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 334], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1957, max= 4087, per=100.00%, avg=2526.50, stdev=1040.96, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=618KiB/s (633kB/s)(6144KiB/9940msec); 0 zone resets clat (msec): min=167, max=3173, avg=864.16, stdev=1143.20 lat (msec): min=167, max=3174, avg=864.25, stdev=1143.20 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 567], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 2000, max= 2043, per=70.23%, avg=2023.20, stdev=17.78, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, >=2000=16.67% cpu : usr=0.00%, sys=1.25%, ctx=61, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180042: Thu Aug 27 18:48:30 2026 read: IOPS=0, BW=540KiB/s (553kB/s)(5120KiB/9485msec) clat (msec): min=73, max=2593, avg=773.00, stdev=1036.84 lat (msec): min=73, max=2593, avg=773.00, stdev=1036.84 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1790, max= 2043, per=95.81%, avg=1970.75, stdev=121.07, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=756KiB/s (774kB/s)(7168KiB/9485msec); 0 zone resets clat (msec): min=68, max=3563, avg=788.01, stdev=1240.10 lat (msec): min=68, max=3563, avg=788.15, stdev=1240.05 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 148], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 518], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 535], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 2011, max= 4031, per=84.30%, avg=2428.60, stdev=895.85, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=8.33%, 750=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=2.44%, ctx=120, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2058KiB/s (2107kB/s), 206KiB/s-1216KiB/s (211kB/s-1246kB/s), io=20.0MiB (20.0MB), run=5893-9952msec WRITE: bw=2881KiB/s (2950kB/s), 618KiB/s-1029KiB/s (633kB/s-1054kB/s), io=28.0MiB (29.4MB), run=5893-9952msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180055: Thu Aug 27 18:48:46 2026 read: IOPS=0, BW=3960KiB/s (4055kB/s)(12.0MiB/3103msec) clat (msec): min=782, max=1297, avg=1033.94, stdev=257.31 lat (msec): min=782, max=1297, avg=1033.94, stdev=257.31 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7641, max= 8192, per=100.00%, avg=7916.50, stdev=389.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.12%, ctx=319, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180056: Thu Aug 27 18:48:46 2026 read: IOPS=0, BW=1305KiB/s (1337kB/s)(4096KiB/3138msec) clat (nsec): min=1090.6M, max=1090.6M, avg=1090616323.00, stdev= 0.00 lat (nsec): min=1090.6M, max=1090.6M, avg=1090617729.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7641, max= 7641, per=100.00%, avg=7641.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2611KiB/s (2673kB/s)(8192KiB/3138msec); 0 zone resets clat (msec): min=857, max=1186, avg=1022.25, stdev=232.75 lat (msec): min=857, max=1188, avg=1023.05, stdev=233.49 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8110, max= 8110, per=86.51%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.53%, ctx=155, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180057: Thu Aug 27 18:48:46 2026 write: IOPS=0, BW=3516KiB/s (3600kB/s)(12.0MiB/3495msec); 0 zone resets clat (msec): min=799, max=1648, avg=1163.97, stdev=436.86 lat (msec): min=799, max=1648, avg=1164.37, stdev=436.94 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7907, max= 8192, per=85.86%, avg=8049.50, stdev=201.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.11%, sys=6.98%, ctx=88, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180058: Thu Aug 27 18:48:46 2026 write: IOPS=1, BW=6175KiB/s (6323kB/s)(12.0MiB/1990msec); 0 zone resets clat (msec): min=407, max=955, avg=659.79, stdev=276.92 lat (msec): min=413, max=956, avg=662.03, stdev=274.48 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7641, max= 7968, per=83.25%, avg=7804.50, stdev=231.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.33%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5221KiB/s (5346kB/s), 1305KiB/s-3960KiB/s (1337kB/s-4055kB/s), io=16.0MiB (16.8MB), run=3103-3138msec WRITE: bw=9376KiB/s (9601kB/s), 2611KiB/s-6175KiB/s (2673kB/s-6323kB/s), io=32.0MiB (33.6MB), run=1990-3495msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180050: Thu Aug 27 18:48:46 2026 read: IOPS=1, BW=5498KiB/s (5630kB/s)(12.0MiB/2235msec) clat (msec): min=668, max=834, avg=724.44, stdev=94.92 lat (msec): min=668, max=834, avg=724.44, stdev=94.92 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=3.72%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180051: Thu Aug 27 18:48:46 2026 read: IOPS=0, BW=1025KiB/s (1050kB/s)(4096KiB/3996msec) clat (nsec): min=1725.2M, max=1725.2M, avg=1725195898.00, stdev= 0.00 lat (nsec): min=1725.2M, max=1725.2M, avg=1725196781.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2050KiB/s (2099kB/s)(8192KiB/3996msec); 0 zone resets clat (msec): min=905, max=1254, avg=1080.16, stdev=246.63 lat (msec): min=906, max=1255, avg=1080.79, stdev=246.71 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8031, max= 8031, per=97.94%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=2.88%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180052: Thu Aug 27 18:48:46 2026 write: IOPS=1, BW=5851KiB/s (5992kB/s)(12.0MiB/2100msec); 0 zone resets clat (msec): min=272, max=1297, avg=655.45, stdev=559.45 lat (msec): min=274, max=1298, avg=656.76, stdev=558.74 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 5868, max= 8192, per=85.73%, avg=7030.00, stdev=1643.32, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=5.81%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180053: Thu Aug 27 18:48:46 2026 write: IOPS=1, BW=5430KiB/s (5560kB/s)(12.0MiB/2263msec); 0 zone resets clat (msec): min=390, max=1280, avg=750.91, stdev=468.19 lat (msec): min=395, max=1280, avg=752.83, stdev=466.45 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7670, max= 8192, per=96.72%, avg=7931.00, stdev=369.11, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.17%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4100KiB/s (4199kB/s), 1025KiB/s-5498KiB/s (1050kB/s-5630kB/s), io=16.0MiB (16.8MB), run=2235-3996msec WRITE: bw=8200KiB/s (8397kB/s), 2050KiB/s-5851KiB/s (2099kB/s-5992kB/s), io=32.0MiB (33.6MB), run=2100-3996msec