== sanity test 398b: DIO and buffer IO race ============== 04:02:23 (1787472143) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.55297 s, 11.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179268: Sun Aug 23 04:04:32 2026 read: IOPS=13, BW=52.3KiB/s (53.6kB/s)(5992KiB/114473msec) clat (usec): min=31, max=311200, avg=41480.72, stdev=27657.96 lat (usec): min=31, max=311202, avg=41484.22, stdev=27657.56 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9372], 10.00th=[ 14877], 20.00th=[ 20579], | 30.00th=[ 25822], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 58983], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[145753], 99.50th=[160433], 99.90th=[210764], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 103, per=24.88%, avg=52.00, stdev=19.07, samples=225 iops : min= 1, max= 25, avg=12.35, stdev= 4.80, samples=225 write: IOPS=13, BW=54.0KiB/s (56.3kB/s)(6296KiB/114473msec); 0 zone resets clat (usec): min=1096, max=737061, avg=33011.98, stdev=36907.19 lat (usec): min=1097, max=737062, avg=33017.38, stdev=36904.18 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1401], 10.00th=[ 1926], 20.00th=[ 3949], | 30.00th=[ 7504], 40.00th=[ 14877], 50.00th=[ 24249], 60.00th=[ 31851], | 70.00th=[ 42730], 80.00th=[ 56361], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[131597], 99.50th=[156238], 99.90th=[208667], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 150, per=24.79%, avg=54.28, stdev=22.36, samples=226 iops : min= 1, max= 37, avg=12.95, stdev= 5.65, samples=226 lat (usec) : 50=0.39%, 100=1.40%, 250=0.20%, 500=0.13% lat (msec) : 2=5.40%, 4=4.98%, 10=7.68%, 20=11.98%, 50=41.11% lat (msec) : 100=22.88%, 250=3.78%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=6.08%, ctx=6901, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179269: Sun Aug 23 04:04:32 2026 read: IOPS=13, BW=52.8KiB/s (54.1kB/s)(5940KiB/112452msec) clat (usec): min=37, max=341664, avg=41471.85, stdev=27278.57 lat (usec): min=37, max=341665, avg=41474.90, stdev=27279.41 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9503], 10.00th=[ 15926], 20.00th=[ 21103], | 30.00th=[ 26346], 40.00th=[ 31065], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 58983], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[123208], 99.50th=[147850], 99.90th=[333448], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 103, per=24.96%, avg=52.18, stdev=18.36, samples=222 iops : min= 1, max= 25, avg=12.41, stdev= 4.62, samples=222 write: IOPS=14, BW=56.5KiB/s (57.8kB/s)(6348KiB/112452msec); 0 zone resets clat (usec): min=1102, max=415647, avg=31834.10, stdev=33308.27 lat (usec): min=1104, max=415648, avg=31836.98, stdev=33307.33 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1450], 10.00th=[ 2212], 20.00th=[ 4080], | 30.00th=[ 7177], 40.00th=[ 14746], 50.00th=[ 23725], 60.00th=[ 31851], | 70.00th=[ 41157], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[156238], 99.90th=[208667], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 150, per=25.44%, avg=55.71, stdev=23.96, samples=222 iops : min= 1, max= 37, avg=13.29, stdev= 6.02, samples=222 lat (usec) : 50=0.33%, 100=1.43%, 250=0.26%, 500=0.07%, 750=0.07% lat (msec) : 2=4.52%, 4=5.60%, 10=8.20%, 20=11.78%, 50=41.63% lat (msec) : 100=22.36%, 250=3.65%, 500=0.10% cpu : usr=0.08%, sys=6.24%, ctx=6623, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179270: Sun Aug 23 04:04:32 2026 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6028KiB/112118msec) clat (usec): min=31, max=223374, avg=40347.88, stdev=25100.56 lat (usec): min=31, max=223376, avg=40349.61, stdev=25100.36 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 7373], 10.00th=[ 15270], 20.00th=[ 21103], | 30.00th=[ 26084], 40.00th=[ 30540], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 58459], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[113771], 99.50th=[139461], 99.90th=[183501], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 126, per=25.48%, avg=53.24, stdev=19.17, samples=221 iops : min= 1, max= 31, avg=12.68, stdev= 4.81, samples=221 write: IOPS=13, BW=55.8KiB/s (57.2kB/s)(6260KiB/112118msec); 0 zone resets clat (usec): min=1135, max=458794, avg=32574.57, stdev=35367.39 lat (usec): min=1136, max=458795, avg=32577.79, stdev=35366.14 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1401], 10.00th=[ 2040], 20.00th=[ 4228], | 30.00th=[ 7635], 40.00th=[ 15139], 50.00th=[ 23200], 60.00th=[ 30802], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[149947], 99.50th=[179307], 99.90th=[274727], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 15, max= 126, per=25.39%, avg=55.61, stdev=21.75, samples=220 iops : min= 3, max= 31, avg=13.27, stdev= 5.49, samples=220 lat (usec) : 50=0.39%, 100=1.60%, 250=0.26%, 750=0.07% lat (msec) : 2=4.92%, 4=4.98%, 10=8.01%, 20=11.98%, 50=41.57% lat (msec) : 100=22.85%, 250=3.29%, 500=0.10% cpu : usr=0.06%, sys=6.27%, ctx=6819, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179271: Sun Aug 23 04:04:32 2026 read: IOPS=13, BW=52.8KiB/s (54.0kB/s)(6052KiB/114677msec) clat (usec): min=42, max=472483, avg=41781.37, stdev=29195.09 lat (usec): min=43, max=472485, avg=41785.01, stdev=29194.60 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 1090], 10.00th=[ 15139], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[133694], 99.50th=[158335], 99.90th=[274727], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 102, per=24.96%, avg=52.16, stdev=19.39, samples=226 iops : min= 1, max= 25, avg=12.40, stdev= 4.87, samples=226 write: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6236KiB/114677msec); 0 zone resets clat (usec): min=1142, max=294219, avg=32756.23, stdev=33575.01 lat (usec): min=1143, max=294220, avg=32760.33, stdev=33575.85 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1401], 10.00th=[ 1958], 20.00th=[ 3785], | 30.00th=[ 7242], 40.00th=[ 15270], 50.00th=[ 23987], 60.00th=[ 31851], | 70.00th=[ 41681], 80.00th=[ 55837], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[145753], 99.50th=[158335], 99.90th=[187696], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 119, per=24.52%, avg=53.69, stdev=21.32, samples=226 iops : min= 1, max= 29, avg=12.79, stdev= 5.39, samples=226 lat (usec) : 50=0.49%, 100=1.66%, 250=0.26% lat (msec) : 2=5.31%, 4=5.40%, 10=6.80%, 20=12.01%, 50=41.73% lat (msec) : 100=22.14%, 250=4.10%, 500=0.10% cpu : usr=0.08%, sys=6.01%, ctx=6705, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=209KiB/s (214kB/s), 52.3KiB/s-53.8KiB/s (53.6kB/s-55.1kB/s), io=23.4MiB (24.6MB), run=112118-114677msec WRITE: bw=219KiB/s (224kB/s), 54.4KiB/s-56.5KiB/s (55.7kB/s-57.8kB/s), io=24.6MiB (25.7MB), run=112118-114677msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179273: Sun Aug 23 04:05:10 2026 read: IOPS=9, BW=39.5KiB/s (40.5kB/s)(5992KiB/151533msec) clat (msec): min=4, max=485, avg=39.62, stdev=37.84 lat (msec): min=4, max=485, avg=39.63, stdev=37.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 86], 95.00th=[ 117], | 99.00th=[ 184], 99.50th=[ 207], 99.90th=[ 288], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 149, per=25.39%, avg=40.12, stdev=26.65, samples=292 iops : min= 1, max= 37, avg= 9.41, stdev= 6.67, samples=292 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6296KiB/151533msec); 0 zone resets clat (msec): min=9, max=352, avg=58.48, stdev=40.41 lat (msec): min=9, max=352, avg=58.48, stdev=40.40 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 113], 95.00th=[ 136], | 99.00th=[ 201], 99.50th=[ 230], 99.90th=[ 317], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 112, per=25.10%, avg=41.41, stdev=24.82, samples=297 iops : min= 1, max= 28, avg= 9.73, stdev= 6.22, samples=297 lat (msec) : 10=2.60%, 20=17.68%, 50=45.70%, 100=23.18%, 250=10.61% lat (msec) : 500=0.23% cpu : usr=0.06%, sys=2.34%, ctx=4903, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179274: Sun Aug 23 04:05:10 2026 read: IOPS=9, BW=39.6KiB/s (40.6kB/s)(5940KiB/149818msec) clat (msec): min=5, max=770, avg=39.51, stdev=40.91 lat (msec): min=5, max=770, avg=39.51, stdev=40.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 86], 95.00th=[ 121], | 99.00th=[ 174], 99.50th=[ 207], 99.90th=[ 305], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 127, per=25.58%, avg=40.42, stdev=26.31, samples=287 iops : min= 1, max= 31, avg= 9.49, stdev= 6.60, samples=287 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6348KiB/149818msec); 0 zone resets clat (msec): min=10, max=337, avg=57.36, stdev=38.03 lat (msec): min=10, max=337, avg=57.36, stdev=38.03 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 111], 95.00th=[ 134], | 99.00th=[ 174], 99.50th=[ 211], 99.90th=[ 275], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 120, per=25.40%, avg=41.91, stdev=24.55, samples=295 iops : min= 1, max= 30, avg= 9.85, stdev= 6.15, samples=295 lat (msec) : 10=2.34%, 20=16.96%, 50=46.71%, 100=23.80%, 250=9.96% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=2.35%, ctx=4964, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179275: Sun Aug 23 04:05:10 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6028KiB/151075msec) clat (msec): min=5, max=280, avg=39.53, stdev=35.36 lat (msec): min=5, max=280, avg=39.54, stdev=35.36 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 89], 95.00th=[ 115], | 99.00th=[ 174], 99.50th=[ 201], 99.90th=[ 241], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 135, per=25.36%, avg=40.06, stdev=25.86, samples=294 iops : min= 1, max= 33, avg= 9.39, stdev= 6.49, samples=294 write: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6260KiB/151075msec); 0 zone resets clat (msec): min=10, max=781, avg=58.36, stdev=44.99 lat (msec): min=10, max=781, avg=58.37, stdev=44.99 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 85], 90.00th=[ 113], 95.00th=[ 146], | 99.00th=[ 207], 99.50th=[ 234], 99.90th=[ 359], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 127, per=24.95%, avg=41.17, stdev=26.39, samples=297 iops : min= 1, max= 31, avg= 9.67, stdev= 6.62, samples=297 lat (msec) : 10=2.86%, 20=16.37%, 50=47.49%, 100=22.40%, 250=10.64% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=2.44%, ctx=4978, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179276: Sun Aug 23 04:05:10 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6052KiB/151672msec) clat (msec): min=6, max=293, avg=38.92, stdev=34.97 lat (msec): min=6, max=293, avg=38.92, stdev=34.97 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 114], | 99.00th=[ 159], 99.50th=[ 194], 99.90th=[ 236], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 141, per=25.64%, avg=40.52, stdev=27.35, samples=291 iops : min= 1, max= 35, avg= 9.51, stdev= 6.85, samples=291 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6236KiB/151672msec); 0 zone resets clat (msec): min=11, max=798, avg=59.46, stdev=46.62 lat (msec): min=11, max=798, avg=59.46, stdev=46.62 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 89], 90.00th=[ 116], 95.00th=[ 144], | 99.00th=[ 220], 99.50th=[ 243], 99.90th=[ 355], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 119, per=24.67%, avg=40.70, stdev=25.16, samples=298 iops : min= 1, max= 29, avg= 9.55, stdev= 6.32, samples=298 lat (msec) : 10=2.70%, 20=18.72%, 50=44.86%, 100=22.01%, 250=11.52% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.05%, sys=2.39%, ctx=5144, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (162kB/s), 39.5KiB/s-39.9KiB/s (40.5kB/s-40.9kB/s), io=23.4MiB (24.6MB), run=149818-151672msec WRITE: bw=166KiB/s (170kB/s), 41.1KiB/s-42.4KiB/s (42.1kB/s-43.4kB/s), io=24.6MiB (25.7MB), run=149818-151672msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179324: Sun Aug 23 04:05:51 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5920KiB/30345msec) clat (usec): min=42, max=238023, avg=42578.10, stdev=28968.20 lat (usec): min=43, max=238024, avg=42585.76, stdev=28965.01 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 90], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[141558], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 63, max= 380, per=25.26%, avg=193.73, stdev=68.76, samples=59 iops : min= 3, max= 23, avg=11.31, stdev= 4.31, samples=59 write: IOPS=13, BW=210KiB/s (215kB/s)(6368KiB/30345msec); 0 zone resets clat (usec): min=1643, max=186767, avg=36598.43, stdev=34332.74 lat (usec): min=1644, max=186769, avg=36601.46, stdev=34331.91 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2704], 10.00th=[ 4047], 20.00th=[ 6325], | 30.00th=[ 10552], 40.00th=[ 19006], 50.00th=[ 28705], 60.00th=[ 36963], | 70.00th=[ 47449], 80.00th=[ 60031], 90.00th=[ 82314], 95.00th=[107480], | 99.00th=[158335], 99.50th=[168821], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 446, per=26.00%, avg=209.78, stdev=76.20, samples=59 iops : min= 3, max= 27, avg=12.34, stdev= 4.79, samples=59 lat (usec) : 50=0.13%, 100=4.95%, 250=0.52%, 500=0.13%, 750=0.26% lat (msec) : 2=0.78%, 4=4.17%, 10=10.29%, 20=8.72%, 50=39.84% lat (msec) : 100=25.39%, 250=4.82% cpu : usr=0.06%, sys=6.39%, ctx=1720, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179325: Sun Aug 23 04:05:51 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(5744KiB/31220msec) clat (usec): min=47, max=262669, avg=46411.08, stdev=31410.41 lat (usec): min=48, max=262669, avg=46413.98, stdev=31409.12 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 12649], 20.00th=[ 23462], | 30.00th=[ 31589], 40.00th=[ 35914], 50.00th=[ 42730], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 66323], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[154141], 99.50th=[175113], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 50, max= 351, per=23.82%, avg=182.70, stdev=61.95, samples=61 iops : min= 3, max= 21, avg=10.64, stdev= 3.87, samples=61 write: IOPS=13, BW=210KiB/s (215kB/s)(6544KiB/31220msec); 0 zone resets clat (usec): min=1663, max=188913, avg=35487.09, stdev=34341.26 lat (usec): min=1664, max=188915, avg=35489.16, stdev=34341.07 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2376], 10.00th=[ 3425], 20.00th=[ 6194], | 30.00th=[ 12125], 40.00th=[ 18744], 50.00th=[ 25560], 60.00th=[ 33162], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 86508], 95.00th=[101188], | 99.00th=[160433], 99.50th=[177210], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 61, max= 446, per=25.74%, avg=207.72, stdev=88.08, samples=61 iops : min= 3, max= 27, avg=12.21, stdev= 5.57, samples=61 lat (usec) : 50=0.13%, 100=2.99%, 250=0.39%, 500=0.39% lat (msec) : 2=1.56%, 4=5.47%, 10=7.68%, 20=11.07%, 50=39.84% lat (msec) : 100=25.26%, 250=5.08%, 500=0.13% cpu : usr=0.04%, sys=6.48%, ctx=1840, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179326: Sun Aug 23 04:05:51 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30464msec) clat (usec): min=40, max=190668, avg=41955.11, stdev=28436.27 lat (usec): min=40, max=190863, avg=41956.72, stdev=28438.87 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 126], 20.00th=[ 20055], | 30.00th=[ 26608], 40.00th=[ 32900], 50.00th=[ 38536], 60.00th=[ 46924], | 70.00th=[ 52691], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 86508], | 99.00th=[152044], 99.50th=[183501], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 62, max= 414, per=26.78%, avg=205.41, stdev=72.25, samples=59 iops : min= 3, max= 25, avg=12.05, stdev= 4.54, samples=59 write: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30464msec); 0 zone resets clat (usec): min=1761, max=214403, avg=37215.07, stdev=32864.95 lat (usec): min=1763, max=214405, avg=37217.87, stdev=32864.46 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 3818], 10.00th=[ 5342], 20.00th=[ 8848], | 30.00th=[ 15008], 40.00th=[ 22676], 50.00th=[ 28705], 60.00th=[ 35914], | 70.00th=[ 46400], 80.00th=[ 57934], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[131597], 99.50th=[162530], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 414, per=24.50%, avg=197.74, stdev=75.66, samples=58 iops : min= 1, max= 25, avg=11.57, stdev= 4.78, samples=58 lat (usec) : 50=0.13%, 100=4.82%, 250=0.26%, 500=0.13% lat (msec) : 2=0.78%, 4=2.21%, 10=8.59%, 20=10.81%, 50=41.54% lat (msec) : 100=26.04%, 250=4.69% cpu : usr=0.07%, sys=6.53%, ctx=1849, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179327: Sun Aug 23 04:05:51 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(6032KiB/31084msec) clat (usec): min=43, max=178449, avg=43608.88, stdev=30995.44 lat (usec): min=44, max=178450, avg=43610.13, stdev=30995.19 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 114], 20.00th=[ 20579], | 30.00th=[ 26870], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 66847], 90.00th=[ 79168], 95.00th=[102237], | 99.00th=[147850], 99.50th=[164627], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 63, max= 384, per=25.00%, avg=191.79, stdev=81.57, samples=61 iops : min= 3, max= 24, avg=11.20, stdev= 5.18, samples=61 write: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31084msec); 0 zone resets clat (usec): min=1692, max=189601, avg=37360.13, stdev=36432.99 lat (usec): min=1695, max=189603, avg=37364.80, stdev=36430.59 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2573], 10.00th=[ 3556], 20.00th=[ 5735], | 30.00th=[ 9110], 40.00th=[ 18220], 50.00th=[ 27132], 60.00th=[ 36963], | 70.00th=[ 45351], 80.00th=[ 63177], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[158335], 99.50th=[175113], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 93, max= 444, per=24.88%, avg=200.82, stdev=88.48, samples=61 iops : min= 5, max= 27, avg=11.77, stdev= 5.55, samples=61 lat (usec) : 50=0.39%, 100=4.30%, 250=0.91%, 500=0.39%, 1000=0.26% lat (msec) : 2=1.43%, 4=5.08%, 10=10.03%, 20=8.46%, 50=36.72% lat (msec) : 100=25.52%, 250=6.51% cpu : usr=0.04%, sys=6.09%, ctx=1805, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=767KiB/s (786kB/s), 184KiB/s-205KiB/s (188kB/s-210kB/s), io=23.4MiB (24.5MB), run=30345-31220msec WRITE: bw=807KiB/s (827kB/s), 198KiB/s-210KiB/s (203kB/s-215kB/s), io=24.6MiB (25.8MB), run=30345-31220msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179319: Sun Aug 23 04:06:00 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(5920KiB/40123msec) clat (msec): min=7, max=278, avg=42.08, stdev=37.48 lat (msec): min=7, max=278, avg=42.08, stdev=37.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 118], | 99.00th=[ 165], 99.50th=[ 257], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 509, per=25.37%, avg=148.65, stdev=100.81, samples=78 iops : min= 1, max= 31, avg= 8.53, stdev= 6.36, samples=78 write: IOPS=9, BW=159KiB/s (163kB/s)(6368KiB/40123msec); 0 zone resets clat (msec): min=13, max=280, avg=61.46, stdev=43.21 lat (msec): min=13, max=280, avg=61.46, stdev=43.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 90], 90.00th=[ 122], 95.00th=[ 142], | 99.00th=[ 228], 99.50th=[ 255], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 414, per=25.94%, avg=160.06, stdev=96.16, samples=78 iops : min= 1, max= 25, avg= 9.24, stdev= 6.05, samples=78 lat (msec) : 10=2.34%, 20=16.02%, 50=44.40%, 100=25.13%, 250=11.46% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=2.34%, ctx=1259, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179320: Sun Aug 23 04:06:00 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(5744KiB/40825msec) clat (msec): min=6, max=254, avg=41.91, stdev=39.56 lat (msec): min=6, max=254, avg=41.91, stdev=39.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 97], 95.00th=[ 130], | 99.00th=[ 222], 99.50th=[ 236], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 30, max= 446, per=24.33%, avg=142.59, stdev=99.89, samples=78 iops : min= 1, max= 27, avg= 8.15, stdev= 6.29, samples=78 write: IOPS=10, BW=160KiB/s (164kB/s)(6544KiB/40825msec); 0 zone resets clat (msec): min=11, max=280, avg=62.66, stdev=43.38 lat (msec): min=11, max=280, avg=62.67, stdev=43.38 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 61], | 70.00th=[ 75], 80.00th=[ 96], 90.00th=[ 128], 95.00th=[ 150], | 99.00th=[ 203], 99.50th=[ 245], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 414, per=25.74%, avg=158.84, stdev=95.00, samples=79 iops : min= 1, max= 25, avg= 9.16, stdev= 5.99, samples=79 lat (msec) : 10=2.47%, 20=15.76%, 50=44.27%, 100=24.09%, 250=13.15% lat (msec) : 500=0.26% cpu : usr=0.03%, sys=2.37%, ctx=1236, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179321: Sun Aug 23 04:06:00 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(6256KiB/40575msec) clat (msec): min=8, max=277, avg=44.03, stdev=41.28 lat (msec): min=8, max=277, avg=44.03, stdev=41.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 106], 95.00th=[ 136], | 99.00th=[ 207], 99.50th=[ 228], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 478, per=26.63%, avg=156.03, stdev=110.54, samples=79 iops : min= 1, max= 29, avg= 9.00, stdev= 6.97, samples=79 write: IOPS=9, BW=149KiB/s (152kB/s)(6032KiB/40575msec); 0 zone resets clat (msec): min=10, max=245, avg=61.58, stdev=41.49 lat (msec): min=10, max=245, avg=61.59, stdev=41.49 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 59], | 70.00th=[ 81], 80.00th=[ 95], 90.00th=[ 125], 95.00th=[ 146], | 99.00th=[ 180], 99.50th=[ 232], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 446, per=24.12%, avg=148.82, stdev=94.60, samples=79 iops : min= 1, max= 27, avg= 8.54, stdev= 5.94, samples=79 lat (msec) : 10=2.21%, 20=17.45%, 50=43.75%, 100=22.01%, 250=14.45% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.32%, ctx=1286, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179322: Sun Aug 23 04:06:00 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(6032KiB/39678msec) clat (msec): min=6, max=258, avg=41.15, stdev=36.85 lat (msec): min=6, max=258, avg=41.16, stdev=36.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 93], 95.00th=[ 120], | 99.00th=[ 174], 99.50th=[ 213], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 443, per=25.97%, avg=152.21, stdev=97.49, samples=77 iops : min= 1, max= 27, avg= 8.74, stdev= 6.12, samples=77 write: IOPS=9, BW=158KiB/s (161kB/s)(6256KiB/39678msec); 0 zone resets clat (msec): min=14, max=255, avg=61.41, stdev=40.33 lat (msec): min=14, max=255, avg=61.41, stdev=40.33 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 75], 80.00th=[ 91], 90.00th=[ 118], 95.00th=[ 138], | 99.00th=[ 201], 99.50th=[ 226], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 480, per=25.50%, avg=157.31, stdev=96.17, samples=78 iops : min= 1, max= 30, avg= 9.06, stdev= 6.05, samples=78 lat (msec) : 10=1.82%, 20=17.06%, 50=44.01%, 100=25.91%, 250=10.94% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=2.38%, ctx=1223, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=587KiB/s (601kB/s), 141KiB/s-154KiB/s (144kB/s-158kB/s), io=23.4MiB (24.5MB), run=39678-40825msec WRITE: bw=617KiB/s (632kB/s), 149KiB/s-160KiB/s (152kB/s-164kB/s), io=24.6MiB (25.8MB), run=39678-40825msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179341: Sun Aug 23 04:06:16 2026 read: IOPS=1, BW=1329KiB/s (1361kB/s)(7168KiB/5394msec) clat (msec): min=3, max=3234, avg=595.21, stdev=1166.70 lat (msec): min=3, max=3234, avg=595.21, stdev=1166.70 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 146], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 161], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 284], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 2031, max= 4096, per=100.00%, avg=3308.67, stdev=1116.41, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=949KiB/s (972kB/s)(5120KiB/5394msec); 0 zone resets clat (msec): min=137, max=374, avg=227.17, stdev=108.18 lat (msec): min=137, max=381, avg=228.65, stdev=110.14 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2031, max= 4071, per=65.72%, avg=2716.67, stdev=1172.92, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 4=8.33%, 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=11.22%, ctx=683, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179342: Sun Aug 23 04:06:16 2026 read: IOPS=0, BW=295KiB/s (302kB/s)(2048KiB/6935msec) clat (msec): min=168, max=293, avg=230.97, stdev=87.94 lat (msec): min=168, max=293, avg=230.97, stdev=87.94 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1903, max= 1954, per=65.31%, avg=1928.50, stdev=36.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1477KiB/s (1512kB/s)(10.0MiB/6935msec); 0 zone resets clat (msec): min=102, max=4080, avg=643.38, stdev=1220.08 lat (msec): min=102, max=4080, avg=643.47, stdev=1220.08 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 125], | 30.00th=[ 130], 40.00th=[ 138], 50.00th=[ 199], 60.00th=[ 226], | 70.00th=[ 363], 80.00th=[ 418], 90.00th=[ 659], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 1954, max= 8192, per=88.51%, avg=3659.20, stdev=2691.34, samples=5 iops : min= 1, max= 8, avg= 3.00, stdev= 3.08, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=9.33%, ctx=166, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179343: Sun Aug 23 04:06:16 2026 read: IOPS=1, BW=1121KiB/s (1147kB/s)(6144KiB/5483msec) clat (usec): min=528, max=236449, avg=66459.50, stdev=97693.49 lat (usec): min=529, max=236450, avg=66460.51, stdev=97693.13 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 799], | 30.00th=[ 799], 40.00th=[ 4047], 50.00th=[ 4047], 60.00th=[ 23725], | 70.00th=[132645], 80.00th=[132645], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 2035, max= 6095, per=100.00%, avg=4065.00, stdev=2870.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1121KiB/s (1147kB/s)(6144KiB/5483msec); 0 zone resets clat (msec): min=119, max=3443, avg=835.41, stdev=1287.18 lat (msec): min=120, max=3443, avg=835.51, stdev=1287.21 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 422], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 2035, max= 4079, per=82.06%, avg=3392.33, stdev=1175.51, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 10=8.33%, 50=8.33%, 250=33.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=8.19%, ctx=157, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179344: Sun Aug 23 04:06:16 2026 read: IOPS=0, BW=859KiB/s (880kB/s)(5120KiB/5960msec) clat (usec): min=483, max=222101, avg=112031.97, stdev=104180.82 lat (usec): min=486, max=222102, avg=112033.38, stdev=104180.60 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 766], 40.00th=[ 766], 50.00th=[160433], 60.00th=[160433], | 70.00th=[177210], 80.00th=[177210], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1203KiB/s (1232kB/s)(7168KiB/5960msec); 0 zone resets clat (msec): min=130, max=3413, avg=764.77, stdev=1179.20 lat (msec): min=130, max=3413, avg=764.83, stdev=1179.21 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 150], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 405], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 567], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1374, max= 6131, per=69.74%, avg=2883.00, stdev=2186.29, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.37%, ctx=119, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2953KiB/s (3024kB/s), 295KiB/s-1329KiB/s (302kB/s-1361kB/s), io=20.0MiB (20.0MB), run=5394-6935msec WRITE: bw=4134KiB/s (4234kB/s), 949KiB/s-1477KiB/s (972kB/s-1512kB/s), io=28.0MiB (29.4MB), run=5394-6935msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179346: Sun Aug 23 04:06:17 2026 read: IOPS=0, BW=1020KiB/s (1044kB/s)(7168KiB/7028msec) clat (msec): min=103, max=3859, avg=775.47, stdev=1373.59 lat (msec): min=103, max=3859, avg=775.47, stdev=1373.59 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 126], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 165], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 617], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 1692, max= 4087, per=83.86%, avg=2443.75, stdev=1105.46, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=729KiB/s (746kB/s)(5120KiB/7028msec); 0 zone resets clat (msec): min=106, max=606, avg=310.39, stdev=209.32 lat (msec): min=107, max=606, avg=310.75, stdev=208.99 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1943, max= 6107, per=98.68%, avg=4025.00, stdev=2944.39, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.86%, ctx=99, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179347: Sun Aug 23 04:06:17 2026 read: IOPS=0, BW=302KiB/s (310kB/s)(2048KiB/6771msec) clat (msec): min=84, max=352, avg=218.64, stdev=189.70 lat (msec): min=84, max=352, avg=218.64, stdev=189.70 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 85], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1799, max= 2043, per=65.92%, avg=1921.00, stdev=172.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1512KiB/s (1549kB/s)(10.0MiB/6771msec); 0 zone resets clat (msec): min=84, max=3992, avg=630.70, stdev=1195.83 lat (msec): min=84, max=3992, avg=630.78, stdev=1195.84 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 126], | 30.00th=[ 142], 40.00th=[ 163], 50.00th=[ 169], 60.00th=[ 176], | 70.00th=[ 342], 80.00th=[ 418], 90.00th=[ 701], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 1799, max= 6107, per=73.64%, avg=3003.67, stdev=1745.07, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.01%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179348: Sun Aug 23 04:06:17 2026 read: IOPS=0, BW=922KiB/s (944kB/s)(6144KiB/6664msec) clat (msec): min=60, max=758, avg=246.26, stdev=258.41 lat (msec): min=60, max=758, avg=246.26, stdev=258.41 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 201], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1943, max= 4071, per=92.16%, avg=2685.67, stdev=1200.78, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=922KiB/s (944kB/s)(6144KiB/6664msec); 0 zone resets clat (msec): min=96, max=3936, avg=836.95, stdev=1524.70 lat (msec): min=96, max=3936, avg=837.25, stdev=1524.58 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 264], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 1957, max= 3447, per=60.79%, avg=2479.67, stdev=838.64, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.87%, ctx=122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179349: Sun Aug 23 04:06:17 2026 read: IOPS=0, BW=742KiB/s (760kB/s)(5120KiB/6897msec) clat (msec): min=47, max=598, avg=264.31, stdev=222.61 lat (msec): min=47, max=598, avg=264.31, stdev=222.61 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1943, max= 2043, per=69.11%, avg=2014.00, stdev=47.48, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1039KiB/s (1064kB/s)(7168KiB/6897msec); 0 zone resets clat (msec): min=107, max=3791, avg=794.04, stdev=1332.50 lat (msec): min=107, max=3791, avg=794.17, stdev=1332.47 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 109], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 300], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 531], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1872, max= 3886, per=59.76%, avg=2437.50, stdev=967.96, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.26%, ctx=97, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2914KiB/s (2984kB/s), 302KiB/s-1020KiB/s (310kB/s-1044kB/s), io=20.0MiB (20.0MB), run=6664-7028msec WRITE: bw=4080KiB/s (4178kB/s), 729KiB/s-1512KiB/s (746kB/s-1549kB/s), io=28.0MiB (29.4MB), run=6664-7028msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179361: Sun Aug 23 04:06:31 2026 read: IOPS=1, BW=5205KiB/s (5329kB/s)(12.0MiB/2361msec) clat (msec): min=555, max=1143, avg=786.65, stdev=313.69 lat (msec): min=555, max=1143, avg=786.65, stdev=313.69 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.85%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179362: Sun Aug 23 04:06:31 2026 read: IOPS=0, BW=1330KiB/s (1362kB/s)(4096KiB/3080msec) clat (nsec): min=1270.3M, max=1270.3M, avg=1270303547.00, stdev= 0.00 lat (nsec): min=1270.3M, max=1270.3M, avg=1270305801.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2660KiB/s (2724kB/s)(8192KiB/3080msec); 0 zone resets clat (msec): min=633, max=1169, avg=901.35, stdev=378.57 lat (msec): min=634, max=1170, avg=902.72, stdev=379.11 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8062, max= 8062, per=75.78%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.35%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179363: Sun Aug 23 04:06:31 2026 write: IOPS=1, BW=4373KiB/s (4478kB/s)(12.0MiB/2810msec); 0 zone resets clat (msec): min=200, max=1840, avg=936.06, stdev=833.26 lat (msec): min=200, max=1841, avg=936.42, stdev=833.48 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8062, max= 8159, per=76.24%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.49%, ctx=26, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179364: Sun Aug 23 04:06:31 2026 write: IOPS=1, BW=4939KiB/s (5057kB/s)(12.0MiB/2488msec); 0 zone resets clat (msec): min=341, max=1305, avg=827.67, stdev=482.22 lat (msec): min=343, max=1306, avg=828.73, stdev=481.70 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8159, max= 8192, per=76.85%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.26%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5319KiB/s (5447kB/s), 1330KiB/s-5205KiB/s (1362kB/s-5329kB/s), io=16.0MiB (16.8MB), run=2361-3080msec WRITE: bw=10.4MiB/s (10.9MB/s), 2660KiB/s-4939KiB/s (2724kB/s-5057kB/s), io=32.0MiB (33.6MB), run=2488-3080msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179356: Sun Aug 23 04:06:31 2026 read: IOPS=1, BW=5350KiB/s (5478kB/s)(12.0MiB/2297msec) clat (msec): min=686, max=793, avg=755.06, stdev=59.62 lat (msec): min=686, max=793, avg=755.06, stdev=59.62 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.21%, ctx=400, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179357: Sun Aug 23 04:06:31 2026 read: IOPS=0, BW=1347KiB/s (1380kB/s)(4096KiB/3040msec) clat (nsec): min=747368k, max=747368k, avg=747367769.00, stdev= 0.00 lat (nsec): min=747370k, max=747370k, avg=747369914.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2695KiB/s (2759kB/s)(8192KiB/3040msec); 0 zone resets clat (msec): min=970, max=1233, avg=1102.20, stdev=185.56 lat (msec): min=971, max=1233, avg=1102.68, stdev=185.62 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8031, max= 8031, per=90.91%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.67%, ctx=170, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179358: Sun Aug 23 04:06:31 2026 write: IOPS=0, BW=3313KiB/s (3393kB/s)(12.0MiB/3709msec); 0 zone resets clat (msec): min=253, max=2655, avg=1222.00, stdev=1266.53 lat (msec): min=254, max=2655, avg=1222.59, stdev=1266.38 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 7968, max= 8175, per=91.37%, avg=8071.50, stdev=146.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.29%, ctx=78, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179359: Sun Aug 23 04:06:31 2026 write: IOPS=0, BW=3882KiB/s (3976kB/s)(12.0MiB/3165msec); 0 zone resets clat (msec): min=488, max=1954, avg=1054.12, stdev=788.09 lat (msec): min=488, max=1955, avg=1054.63, stdev=788.46 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8175, max= 8175, per=92.54%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.53%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5389KiB/s (5519kB/s), 1347KiB/s-5350KiB/s (1380kB/s-5478kB/s), io=16.0MiB (16.8MB), run=2297-3040msec WRITE: bw=8835KiB/s (9047kB/s), 2695KiB/s-3882KiB/s (2759kB/s-3976kB/s), io=32.0MiB (33.6MB), run=3040-3709msec