== sanity test 398b: DIO and buffer IO race ============== 03:22:38 (1788765758) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.13471 s, 16.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188243: Mon Sep 7 03:23:47 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(5992KiB/58835msec) clat (usec): min=30, max=760247, avg=21158.34, stdev=22343.92 lat (usec): min=30, max=760248, avg=21159.42, stdev=22343.92 clat percentiles (usec): | 1.00th=[ 116], 5.00th=[ 7373], 10.00th=[ 9241], 20.00th=[ 11994], | 30.00th=[ 14222], 40.00th=[ 16450], 50.00th=[ 18744], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 27919], 90.00th=[ 34341], 95.00th=[ 39584], | 99.00th=[ 58983], 99.50th=[ 72877], 99.90th=[143655], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 14, max= 176, per=24.91%, avg=101.64, stdev=26.74, samples=117 iops : min= 3, max= 44, avg=24.97, stdev= 6.71, samples=117 write: IOPS=26, BW=107KiB/s (110kB/s)(6296KiB/58835msec); 0 zone resets clat (usec): min=734, max=101134, avg=17107.13, stdev=13111.95 lat (usec): min=735, max=101135, avg=17108.67, stdev=13111.86 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2442], 10.00th=[ 3261], 20.00th=[ 4752], | 30.00th=[ 7570], 40.00th=[ 11469], 50.00th=[ 14615], 60.00th=[ 18220], | 70.00th=[ 21627], 80.00th=[ 26870], 90.00th=[ 35390], 95.00th=[ 41681], | 99.00th=[ 58983], 99.50th=[ 61604], 99.90th=[ 84411], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 39, max= 224, per=25.21%, avg=107.66, stdev=31.30, samples=116 iops : min= 9, max= 56, avg=26.47, stdev= 7.88, samples=116 lat (usec) : 50=0.03%, 100=0.26%, 250=1.14%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=1.33%, 4=6.12%, 10=15.10%, 20=35.74%, 50=37.83% lat (msec) : 100=2.08%, 250=0.07%, 1000=0.03% cpu : usr=0.11%, sys=24.00%, ctx=9455, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188246: Mon Sep 7 03:23:47 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(5940KiB/58305msec) clat (usec): min=45, max=121861, avg=21003.72, stdev=11380.16 lat (usec): min=47, max=121862, avg=21005.41, stdev=11380.93 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 8029], 10.00th=[ 9896], 20.00th=[ 12256], | 30.00th=[ 14615], 40.00th=[ 16450], 50.00th=[ 19006], 60.00th=[ 21627], | 70.00th=[ 24773], 80.00th=[ 28443], 90.00th=[ 34341], 95.00th=[ 40633], | 99.00th=[ 62129], 99.50th=[ 67634], 99.90th=[120062], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 7, max= 168, per=24.89%, avg=101.57, stdev=26.58, samples=116 iops : min= 1, max= 42, avg=24.95, stdev= 6.68, samples=116 write: IOPS=27, BW=109KiB/s (111kB/s)(6348KiB/58305msec); 0 zone resets clat (usec): min=719, max=725295, avg=16940.41, stdev=22107.20 lat (usec): min=720, max=725297, avg=16942.37, stdev=22107.33 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2343], 10.00th=[ 2999], 20.00th=[ 4490], | 30.00th=[ 6849], 40.00th=[ 10421], 50.00th=[ 13435], 60.00th=[ 16909], | 70.00th=[ 21365], 80.00th=[ 27395], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 56886], 99.50th=[ 61080], 99.90th=[107480], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 199, per=25.45%, avg=108.68, stdev=32.53, samples=116 iops : min= 1, max= 49, avg=26.72, stdev= 8.17, samples=116 lat (usec) : 50=0.03%, 100=0.39%, 250=0.62%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=1.53%, 4=6.80%, 10=15.33%, 20=35.87%, 50=37.08% lat (msec) : 100=1.89%, 250=0.10%, 750=0.03% cpu : usr=0.13%, sys=24.14%, ctx=9507, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188247: Mon Sep 7 03:23:47 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(6028KiB/58303msec) clat (usec): min=48, max=746655, avg=21127.38, stdev=21761.10 lat (usec): min=49, max=746655, avg=21128.56, stdev=21761.13 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 8029], 10.00th=[ 9503], 20.00th=[ 11863], | 30.00th=[ 14222], 40.00th=[ 16057], 50.00th=[ 18482], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 28705], 90.00th=[ 34341], 95.00th=[ 39584], | 99.00th=[ 53740], 99.50th=[ 64750], 99.90th=[152044], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 31, max= 168, per=25.51%, avg=104.07, stdev=27.39, samples=115 iops : min= 7, max= 42, avg=25.57, stdev= 6.91, samples=115 write: IOPS=26, BW=107KiB/s (110kB/s)(6260KiB/58303msec); 0 zone resets clat (usec): min=869, max=119610, avg=16771.98, stdev=13661.19 lat (usec): min=870, max=119612, avg=16773.37, stdev=13661.17 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 2343], 10.00th=[ 2933], 20.00th=[ 4293], | 30.00th=[ 6456], 40.00th=[ 10814], 50.00th=[ 13829], 60.00th=[ 16909], | 70.00th=[ 21365], 80.00th=[ 27919], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 60031], 99.50th=[ 64750], 99.90th=[100140], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 21, max= 183, per=25.06%, avg=107.00, stdev=30.65, samples=116 iops : min= 5, max= 45, avg=26.31, stdev= 7.68, samples=116 lat (usec) : 50=0.03%, 100=0.33%, 250=0.75%, 500=0.10%, 1000=0.13% lat (msec) : 2=1.66%, 4=7.45%, 10=14.62%, 20=36.04%, 50=36.95% lat (msec) : 100=1.82%, 250=0.10%, 750=0.03% cpu : usr=0.14%, sys=24.07%, ctx=9334, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188248: Mon Sep 7 03:23:47 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(6052KiB/58634msec) clat (usec): min=35, max=115464, avg=20478.99, stdev=11594.14 lat (usec): min=35, max=115465, avg=20480.12, stdev=11594.20 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 7504], 10.00th=[ 9110], 20.00th=[ 11469], | 30.00th=[ 13698], 40.00th=[ 16057], 50.00th=[ 18482], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 27919], 90.00th=[ 34341], 95.00th=[ 39584], | 99.00th=[ 60556], 99.50th=[ 72877], 99.90th=[ 93848], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 55, max= 184, per=25.35%, avg=103.44, stdev=27.17, samples=115 iops : min= 13, max= 46, avg=25.42, stdev= 6.88, samples=115 write: IOPS=26, BW=106KiB/s (109kB/s)(6236KiB/58634msec); 0 zone resets clat (usec): min=839, max=740007, avg=17600.97, stdev=22578.51 lat (usec): min=840, max=740007, avg=17602.29, stdev=22578.54 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 2343], 10.00th=[ 2966], 20.00th=[ 4621], | 30.00th=[ 7373], 40.00th=[ 11469], 50.00th=[ 14615], 60.00th=[ 17695], | 70.00th=[ 22152], 80.00th=[ 27919], 90.00th=[ 35914], 95.00th=[ 42206], | 99.00th=[ 57410], 99.50th=[ 67634], 99.90th=[ 77071], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 21, max= 223, per=24.80%, avg=105.88, stdev=31.17, samples=116 iops : min= 5, max= 55, avg=26.03, stdev= 7.80, samples=116 lat (usec) : 50=0.10%, 100=0.39%, 250=0.68%, 500=0.16%, 1000=0.23% lat (msec) : 2=1.40%, 4=6.61%, 10=15.66%, 20=35.48%, 50=37.14% lat (msec) : 100=2.08%, 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=24.11%, ctx=9410, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=408KiB/s (418kB/s), 102KiB/s-103KiB/s (104kB/s-106kB/s), io=23.4MiB (24.6MB), run=58303-58835msec WRITE: bw=427KiB/s (438kB/s), 106KiB/s-109KiB/s (109kB/s-111kB/s), io=24.6MiB (25.7MB), run=58303-58835msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188241: Mon Sep 7 03:23:58 2026 read: IOPS=21, BW=86.4KiB/s (88.5kB/s)(5992KiB/69321msec) clat (msec): min=3, max=768, avg=18.80, stdev=24.25 lat (msec): min=3, max=768, avg=18.80, stdev=24.25 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 73], 99.50th=[ 78], 99.90th=[ 113], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 16, max= 272, per=25.40%, avg=86.88, stdev=52.48, samples=137 iops : min= 4, max= 68, avg=21.31, stdev=13.18, samples=137 write: IOPS=22, BW=90.8KiB/s (93.0kB/s)(6296KiB/69321msec); 0 zone resets clat (msec): min=5, max=140, avg=26.01, stdev=16.77 lat (msec): min=5, max=140, avg=26.02, stdev=16.77 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 48], 95.00th=[ 59], | 99.00th=[ 81], 99.50th=[ 100], 99.90th=[ 128], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 16, max= 240, per=25.46%, avg=91.14, stdev=51.82, samples=137 iops : min= 4, max= 60, avg=22.38, stdev=13.00, samples=137 lat (msec) : 4=0.03%, 10=20.57%, 20=38.44%, 50=33.89%, 100=6.77% lat (msec) : 250=0.26%, 1000=0.03% cpu : usr=0.14%, sys=10.36%, ctx=5716, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188242: Mon Sep 7 03:23:58 2026 read: IOPS=21, BW=84.8KiB/s (86.8kB/s)(5940KiB/70058msec) clat (msec): min=3, max=751, avg=19.68, stdev=24.73 lat (msec): min=3, max=751, avg=19.68, stdev=24.73 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 44], 95.00th=[ 54], | 99.00th=[ 77], 99.50th=[ 84], 99.90th=[ 112], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8, max= 272, per=24.85%, avg=84.97, stdev=54.79, samples=138 iops : min= 2, max= 68, avg=20.84, stdev=13.75, samples=138 write: IOPS=22, BW=90.6KiB/s (92.8kB/s)(6348KiB/70058msec); 0 zone resets clat (msec): min=5, max=154, avg=25.59, stdev=16.92 lat (msec): min=5, max=154, avg=25.60, stdev=16.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 49], 95.00th=[ 58], | 99.00th=[ 79], 99.50th=[ 90], 99.90th=[ 142], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 23, max= 256, per=25.31%, avg=90.59, stdev=51.68, samples=138 iops : min= 5, max= 64, avg=22.25, stdev=12.99, samples=138 lat (msec) : 4=0.10%, 10=21.45%, 20=37.99%, 50=32.91%, 100=7.29% lat (msec) : 250=0.23%, 1000=0.03% cpu : usr=0.12%, sys=10.17%, ctx=5656, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188244: Mon Sep 7 03:23:58 2026 read: IOPS=21, BW=85.9KiB/s (87.9kB/s)(6028KiB/70186msec) clat (msec): min=3, max=137, avg=19.61, stdev=16.40 lat (msec): min=3, max=137, avg=19.61, stdev=16.40 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 55], | 99.00th=[ 78], 99.50th=[ 81], 99.90th=[ 125], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 15, max= 280, per=25.10%, avg=85.84, stdev=52.73, samples=138 iops : min= 3, max= 70, avg=21.06, stdev=13.27, samples=138 write: IOPS=22, BW=89.2KiB/s (91.3kB/s)(6260KiB/70186msec); 0 zone resets clat (msec): min=6, max=755, avg=25.83, stdev=24.69 lat (msec): min=6, max=755, avg=25.83, stdev=24.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 48], 95.00th=[ 57], | 99.00th=[ 81], 99.50th=[ 88], 99.90th=[ 140], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 31, max= 248, per=24.87%, avg=89.03, stdev=51.84, samples=138 iops : min= 7, max= 62, avg=21.86, stdev=13.01, samples=138 lat (msec) : 4=0.20%, 10=20.83%, 20=38.25%, 50=33.46%, 100=7.00% lat (msec) : 250=0.23%, 1000=0.03% cpu : usr=0.12%, sys=10.29%, ctx=5703, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188245: Mon Sep 7 03:23:58 2026 read: IOPS=21, BW=86.6KiB/s (88.7kB/s)(6052KiB/69893msec) clat (msec): min=3, max=105, avg=18.99, stdev=15.10 lat (msec): min=3, max=105, avg=19.00, stdev=15.10 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 51], | 99.00th=[ 73], 99.50th=[ 79], 99.90th=[ 102], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 31, max= 280, per=25.42%, avg=86.94, stdev=53.26, samples=138 iops : min= 7, max= 70, avg=21.33, stdev=13.38, samples=138 write: IOPS=22, BW=89.2KiB/s (91.4kB/s)(6236KiB/69893msec); 0 zone resets clat (msec): min=6, max=740, avg=26.25, stdev=24.94 lat (msec): min=6, max=740, avg=26.26, stdev=24.94 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 49], 95.00th=[ 59], | 99.00th=[ 81], 99.50th=[ 104], 99.90th=[ 153], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 31, max= 264, per=25.01%, avg=89.55, stdev=52.45, samples=138 iops : min= 7, max= 66, avg=21.99, stdev=13.16, samples=138 lat (msec) : 4=0.10%, 10=21.45%, 20=37.63%, 50=33.79%, 100=6.71% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.13%, sys=10.20%, ctx=5702, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=342KiB/s (350kB/s), 84.8KiB/s-86.6KiB/s (86.8kB/s-88.7kB/s), io=23.4MiB (24.6MB), run=69321-70186msec WRITE: bw=358KiB/s (367kB/s), 89.2KiB/s-90.8KiB/s (91.3kB/s-93.0kB/s), io=24.6MiB (25.7MB), run=69321-70186msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188275: Mon Sep 7 03:24:20 2026 read: IOPS=23, BW=373KiB/s (382kB/s)(5920KiB/15882msec) clat (usec): min=85, max=94063, avg=21245.60, stdev=13207.16 lat (usec): min=85, max=94063, avg=21246.59, stdev=13207.20 clat percentiles (usec): | 1.00th=[ 91], 5.00th=[ 137], 10.00th=[ 7898], 20.00th=[11731], | 30.00th=[14353], 40.00th=[16909], 50.00th=[19530], 60.00th=[22152], | 70.00th=[25822], 80.00th=[30016], 90.00th=[35914], 95.00th=[46924], | 99.00th=[65799], 99.50th=[71828], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 190, max= 601, per=24.44%, avg=368.48, stdev=98.15, samples=31 iops : min= 11, max= 37, avg=22.48, stdev= 6.19, samples=31 write: IOPS=25, BW=401KiB/s (411kB/s)(6368KiB/15882msec); 0 zone resets clat (usec): min=1649, max=115716, avg=20081.32, stdev=14754.68 lat (usec): min=1650, max=115718, avg=20083.60, stdev=14754.75 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 41], 95.00th=[ 48], | 99.00th=[ 65], 99.50th=[ 73], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 221, max= 640, per=25.23%, avg=400.10, stdev=97.61, samples=31 iops : min= 13, max= 40, avg=24.48, stdev= 6.14, samples=31 lat (usec) : 100=0.65%, 250=2.99%, 500=0.39%, 750=0.13% lat (msec) : 2=0.65%, 4=3.26%, 10=12.76%, 20=35.16%, 50=40.23% lat (msec) : 100=3.65%, 250=0.13% cpu : usr=0.12%, sys=22.15%, ctx=2596, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188276: Mon Sep 7 03:24:20 2026 read: IOPS=23, BW=368KiB/s (377kB/s)(5744KiB/15591msec) clat (usec): min=38, max=95569, avg=21986.55, stdev=12803.75 lat (usec): min=39, max=95570, avg=21987.59, stdev=12803.79 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 133], 10.00th=[ 9241], 20.00th=[13042], | 30.00th=[15533], 40.00th=[18220], 50.00th=[20579], 60.00th=[23200], | 70.00th=[26346], 80.00th=[30016], 90.00th=[37487], 95.00th=[43779], | 99.00th=[71828], 99.50th=[81265], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 160, max= 573, per=24.54%, avg=370.03, stdev=96.85, samples=30 iops : min= 10, max= 35, avg=22.57, stdev= 5.89, samples=30 write: IOPS=26, BW=420KiB/s (430kB/s)(6544KiB/15591msec); 0 zone resets clat (usec): min=1271, max=80142, avg=18617.43, stdev=13787.49 lat (usec): min=1273, max=80146, avg=18619.20, stdev=13787.53 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3851], 10.00th=[ 4424], 20.00th=[ 5800], | 30.00th=[ 8979], 40.00th=[12780], 50.00th=[15926], 60.00th=[19006], | 70.00th=[23200], 80.00th=[28967], 90.00th=[37487], 95.00th=[44303], | 99.00th=[61080], 99.50th=[61604], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 254, max= 606, per=26.01%, avg=412.50, stdev=94.08, samples=30 iops : min= 15, max= 37, avg=25.23, stdev= 5.93, samples=30 lat (usec) : 50=0.26%, 100=0.78%, 250=1.82%, 500=0.26%, 750=0.13% lat (msec) : 2=0.65%, 4=2.47%, 10=15.63%, 20=34.11%, 50=40.62% lat (msec) : 100=3.26% cpu : usr=0.12%, sys=22.66%, ctx=2593, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188277: Mon Sep 7 03:24:20 2026 read: IOPS=25, BW=404KiB/s (414kB/s)(6256KiB/15471msec) clat (usec): min=56, max=121018, avg=21754.26, stdev=12526.46 lat (usec): min=58, max=121019, avg=21755.31, stdev=12526.50 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 178], 10.00th=[ 10421], 20.00th=[ 13304], | 30.00th=[ 15401], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 22938], | 70.00th=[ 25822], 80.00th=[ 29230], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 59507], 99.50th=[ 94897], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 254, max= 537, per=26.95%, avg=406.43, stdev=77.70, samples=30 iops : min= 15, max= 33, avg=24.87, stdev= 4.75, samples=30 write: IOPS=24, BW=390KiB/s (399kB/s)(6032KiB/15471msec); 0 zone resets clat (usec): min=1606, max=87412, avg=18315.01, stdev=13568.29 lat (usec): min=1608, max=87415, avg=18317.07, stdev=13568.25 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 3458], 10.00th=[ 4752], 20.00th=[ 6783], | 30.00th=[ 9765], 40.00th=[12387], 50.00th=[14615], 60.00th=[18220], | 70.00th=[22152], 80.00th=[27657], 90.00th=[36439], 95.00th=[44303], | 99.00th=[71828], 99.50th=[72877], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 158, max= 512, per=24.26%, avg=384.73, stdev=109.11, samples=30 iops : min= 9, max= 32, avg=23.50, stdev= 6.93, samples=30 lat (usec) : 100=0.78%, 250=1.95%, 500=0.13% lat (msec) : 2=0.39%, 4=3.12%, 10=13.54%, 20=37.50%, 50=39.71% lat (msec) : 100=2.73%, 250=0.13% cpu : usr=0.11%, sys=22.82%, ctx=2648, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188278: Mon Sep 7 03:24:20 2026 read: IOPS=24, BW=387KiB/s (396kB/s)(6032KiB/15580msec) clat (usec): min=52, max=132312, avg=20756.39, stdev=13202.42 lat (usec): min=52, max=132313, avg=20757.39, stdev=13202.45 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 130], 10.00th=[ 8291], 20.00th=[ 11994], | 30.00th=[ 14615], 40.00th=[ 16712], 50.00th=[ 19006], 60.00th=[ 21890], | 70.00th=[ 24773], 80.00th=[ 28181], 90.00th=[ 36439], 95.00th=[ 42206], | 99.00th=[ 64226], 99.50th=[ 71828], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 191, max= 544, per=25.28%, avg=381.27, stdev=84.92, samples=30 iops : min= 11, max= 34, avg=23.27, stdev= 5.29, samples=30 write: IOPS=25, BW=402KiB/s (411kB/s)(6256KiB/15580msec); 0 zone resets clat (usec): min=1131, max=88951, avg=19580.76, stdev=14605.97 lat (usec): min=1132, max=88952, avg=19582.79, stdev=14606.07 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 3523], 10.00th=[ 4228], 20.00th=[ 6456], | 30.00th=[10290], 40.00th=[13173], 50.00th=[16188], 60.00th=[20317], | 70.00th=[24249], 80.00th=[30016], 90.00th=[38536], 95.00th=[46924], | 99.00th=[67634], 99.50th=[83362], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 223, max= 576, per=25.11%, avg=398.17, stdev=99.55, samples=30 iops : min= 13, max= 36, avg=24.33, stdev= 6.34, samples=30 lat (usec) : 100=1.17%, 250=2.99%, 500=0.13% lat (msec) : 2=0.91%, 4=2.86%, 10=12.50%, 20=35.42%, 50=40.89% lat (msec) : 100=2.99%, 250=0.13% cpu : usr=0.09%, sys=22.72%, ctx=2569, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1508KiB/s (1544kB/s), 368KiB/s-404KiB/s (377kB/s-414kB/s), io=23.4MiB (24.5MB), run=15471-15882msec WRITE: bw=1587KiB/s (1625kB/s), 390KiB/s-420KiB/s (399kB/s-430kB/s), io=24.6MiB (25.8MB), run=15471-15882msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188270: Mon Sep 7 03:24:23 2026 read: IOPS=19, BW=314KiB/s (322kB/s)(5920KiB/18846msec) clat (usec): min=4871, max=91528, avg=20695.50, stdev=15890.68 lat (usec): min=4873, max=91529, avg=20696.66, stdev=15890.56 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 6980], 10.00th=[ 7570], 20.00th=[ 8979], | 30.00th=[11076], 40.00th=[12911], 50.00th=[14746], 60.00th=[17171], | 70.00th=[20579], 80.00th=[28443], 90.00th=[45876], 95.00th=[55837], | 99.00th=[72877], 99.50th=[84411], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 96, max= 768, per=24.67%, avg=310.65, stdev=170.10, samples=37 iops : min= 6, max= 48, avg=18.86, stdev=10.79, samples=37 write: IOPS=21, BW=338KiB/s (346kB/s)(6368KiB/18846msec); 0 zone resets clat (msec): min=9, max=178, avg=27.98, stdev=18.06 lat (msec): min=9, max=179, avg=27.98, stdev=18.06 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 51], 95.00th=[ 63], | 99.00th=[ 82], 99.50th=[ 118], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 94, max= 736, per=25.41%, avg=336.65, stdev=150.39, samples=37 iops : min= 5, max= 46, avg=20.49, stdev= 9.54, samples=37 lat (msec) : 10=12.37%, 20=43.49%, 50=35.16%, 100=8.72%, 250=0.26% cpu : usr=0.11%, sys=9.28%, ctx=1416, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188271: Mon Sep 7 03:24:23 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(5744KiB/19017msec) clat (msec): min=5, max=115, avg=20.77, stdev=16.01 lat (msec): min=5, max=115, avg=20.77, stdev=16.01 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 46], 95.00th=[ 54], | 99.00th=[ 77], 99.50th=[ 85], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 63, max= 736, per=23.85%, avg=300.30, stdev=155.92, samples=37 iops : min= 3, max= 46, avg=18.22, stdev= 9.90, samples=37 write: IOPS=21, BW=344KiB/s (352kB/s)(6544KiB/19017msec); 0 zone resets clat (msec): min=6, max=184, avg=28.18, stdev=19.36 lat (msec): min=6, max=184, avg=28.18, stdev=19.36 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 54], 95.00th=[ 65], | 99.00th=[ 86], 99.50th=[ 123], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 96, max= 830, per=25.60%, avg=339.22, stdev=169.38, samples=37 iops : min= 6, max= 51, avg=20.65, stdev=10.65, samples=37 lat (msec) : 10=12.76%, 20=42.58%, 50=35.16%, 100=8.98%, 250=0.52% cpu : usr=0.08%, sys=8.83%, ctx=1370, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188272: Mon Sep 7 03:24:23 2026 read: IOPS=20, BW=330KiB/s (338kB/s)(6256KiB/18969msec) clat (msec): min=3, max=112, avg=21.15, stdev=17.09 lat (msec): min=3, max=112, avg=21.15, stdev=17.09 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 46], 95.00th=[ 59], | 99.00th=[ 81], 99.50th=[ 86], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 159, max= 1056, per=26.11%, avg=328.68, stdev=186.47, samples=37 iops : min= 9, max= 66, avg=20.00, stdev=11.75, samples=37 write: IOPS=19, BW=318KiB/s (326kB/s)(6032KiB/18969msec); 0 zone resets clat (msec): min=8, max=156, avg=28.20, stdev=17.24 lat (msec): min=8, max=156, avg=28.20, stdev=17.24 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 48], 95.00th=[ 57], | 99.00th=[ 87], 99.50th=[ 123], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 127, max= 768, per=23.61%, avg=312.89, stdev=158.63, samples=37 iops : min= 7, max= 48, avg=19.03, stdev=10.09, samples=37 lat (msec) : 4=0.13%, 10=15.23%, 20=38.28%, 50=38.02%, 100=7.94% lat (msec) : 250=0.39% cpu : usr=0.12%, sys=9.05%, ctx=1448, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188273: Mon Sep 7 03:24:23 2026 read: IOPS=19, BW=318KiB/s (325kB/s)(6032KiB/18997msec) clat (msec): min=4, max=129, avg=20.85, stdev=16.92 lat (msec): min=4, max=129, avg=20.85, stdev=16.92 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 47], 95.00th=[ 57], | 99.00th=[ 78], 99.50th=[ 106], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 95, max= 768, per=24.85%, avg=312.89, stdev=156.04, samples=37 iops : min= 5, max= 48, avg=19.03, stdev= 9.88, samples=37 write: IOPS=20, BW=329KiB/s (337kB/s)(6256KiB/18997msec); 0 zone resets clat (msec): min=8, max=136, avg=28.29, stdev=17.33 lat (msec): min=8, max=136, avg=28.30, stdev=17.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 52], 95.00th=[ 62], | 99.00th=[ 79], 99.50th=[ 124], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 127, max= 736, per=24.63%, avg=326.41, stdev=149.63, samples=37 iops : min= 7, max= 46, avg=19.86, stdev= 9.49, samples=37 lat (msec) : 10=12.63%, 20=42.06%, 50=35.55%, 100=9.24%, 250=0.52% cpu : usr=0.18%, sys=9.01%, ctx=1404, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1260KiB/s (1290kB/s), 302KiB/s-330KiB/s (309kB/s-338kB/s), io=23.4MiB (24.5MB), run=18846-19017msec WRITE: bw=1325KiB/s (1357kB/s), 318KiB/s-344KiB/s (326kB/s-352kB/s), io=24.6MiB (25.8MB), run=18846-19017msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188291: Mon Sep 7 03:24:35 2026 read: IOPS=1, BW=1830KiB/s (1873kB/s)(7168KiB/3918msec) clat (usec): min=707, max=1529.4k, avg=352014.39, stdev=530406.26 lat (usec): min=708, max=1529.4k, avg=352015.79, stdev=530406.76 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], | 20.00th=[ 93848], 30.00th=[ 99091], 40.00th=[ 99091], | 50.00th=[ 183501], 60.00th=[ 214959], 70.00th=[ 214959], | 80.00th=[ 341836], 90.00th=[1535116], 95.00th=[1535116], | 99.00th=[1535116], 99.50th=[1535116], 99.90th=[1535116], | 99.95th=[1535116], 99.99th=[1535116] bw ( KiB/s): min= 2048, max= 4096, per=75.75%, avg=3034.50, stdev=1140.76, samples=4 iops : min= 2, max= 4, avg= 2.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1307KiB/s (1338kB/s)(5120KiB/3918msec); 0 zone resets clat (msec): min=197, max=456, avg=285.75, stdev=102.64 lat (msec): min=197, max=456, avg=285.82, stdev=102.62 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1973, max= 4096, per=60.42%, avg=3388.33, stdev=1225.71, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=37.66%, ctx=1020, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188292: Mon Sep 7 03:24:35 2026 read: IOPS=0, BW=401KiB/s (410kB/s)(2048KiB/5112msec) clat (usec): min=657, max=267941, avg=134299.42, stdev=188998.09 lat (usec): min=658, max=267943, avg=134300.92, stdev=188998.94 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[ 660], 40.00th=[ 660], 50.00th=[ 660], 60.00th=[267387], | 70.00th=[267387], 80.00th=[267387], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 1809, max= 2048, per=48.14%, avg=1928.50, stdev=169.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2003KiB/s (2051kB/s)(10.0MiB/5112msec); 0 zone resets clat (msec): min=148, max=1558, avg=467.88, stdev=444.97 lat (msec): min=148, max=1558, avg=467.95, stdev=444.97 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 169], | 30.00th=[ 201], 40.00th=[ 230], 50.00th=[ 255], 60.00th=[ 292], | 70.00th=[ 313], 80.00th=[ 709], 90.00th=[ 810], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 1973, max= 4096, per=54.39%, avg=3050.00, stdev=1125.55, samples=6 iops : min= 1, max= 4, avg= 2.67, stdev= 1.21, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=34.87%, ctx=282, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188293: Mon Sep 7 03:24:35 2026 read: IOPS=1, BW=1425KiB/s (1459kB/s)(6144KiB/4313msec) clat (usec): min=596, max=535901, avg=131919.56, stdev=211617.96 lat (usec): min=597, max=535902, avg=131920.75, stdev=211617.86 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 644], | 30.00th=[ 644], 40.00th=[ 2999], 50.00th=[ 2999], 60.00th=[ 56886], | 70.00th=[193987], 80.00th=[193987], 90.00th=[534774], 95.00th=[534774], | 99.00th=[534774], 99.50th=[534774], 99.90th=[534774], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 2048, max= 4096, per=85.21%, avg=3413.33, stdev=1182.41, samples=3 iops : min= 2, max= 4, avg= 3.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1425KiB/s (1459kB/s)(6144KiB/4313msec); 0 zone resets clat (msec): min=85, max=2158, avg=551.20, stdev=793.32 lat (msec): min=85, max=2158, avg=551.28, stdev=793.31 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 271], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 2048, max= 4096, per=58.18%, avg=3262.67, stdev=1075.94, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 100=16.67%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=27.23%, ctx=471, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188294: Mon Sep 7 03:24:35 2026 read: IOPS=1, BW=1262KiB/s (1292kB/s)(5120KiB/4058msec) clat (usec): min=552, max=266710, avg=138850.15, stdev=130246.27 lat (usec): min=553, max=266710, avg=138850.98, stdev=130246.05 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[179307], 60.00th=[179307], | 70.00th=[246416], 80.00th=[246416], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 2048, max= 6144, per=100.00%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1766KiB/s (1809kB/s)(7168KiB/4058msec); 0 zone resets clat (msec): min=119, max=1757, avg=470.55, stdev=578.96 lat (msec): min=119, max=1757, avg=470.64, stdev=578.96 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 188], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 234], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 472], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1899, max= 4096, per=53.78%, avg=3016.00, stdev=1247.44, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=32.14%, ctx=447, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4006KiB/s (4102kB/s), 401KiB/s-1830KiB/s (410kB/s-1873kB/s), io=20.0MiB (20.0MB), run=3918-5112msec WRITE: bw=5609KiB/s (5743kB/s), 1307KiB/s-2003KiB/s (1338kB/s-2051kB/s), io=28.0MiB (29.4MB), run=3918-5112msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188287: Mon Sep 7 03:24:35 2026 read: IOPS=1, BW=1357KiB/s (1389kB/s)(7168KiB/5283msec) clat (msec): min=35, max=1787, avg=659.72, stdev=724.99 lat (msec): min=35, max=1787, avg=659.72, stdev=724.99 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 40], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 531], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 1536], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1924, max= 4096, per=65.67%, avg=2526.50, stdev=1047.84, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=969KiB/s (992kB/s)(5120KiB/5283msec); 0 zone resets clat (msec): min=48, max=231, avg=117.41, stdev=75.66 lat (msec): min=48, max=231, avg=117.50, stdev=75.65 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 91], 60.00th=[ 91], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 2039, max= 4096, per=56.95%, avg=3067.50, stdev=1454.52, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (msec) : 50=25.00%, 100=25.00%, 250=16.67%, 750=16.67%, 2000=16.67% cpu : usr=0.02%, sys=12.85%, ctx=157, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188288: Mon Sep 7 03:24:35 2026 read: IOPS=0, BW=448KiB/s (459kB/s)(2048KiB/4567msec) clat (msec): min=75, max=198, avg=136.83, stdev=86.53 lat (msec): min=75, max=198, avg=136.83, stdev=86.53 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 77], 50.00th=[ 77], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1828, max= 1924, per=48.77%, avg=1876.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2242KiB/s (2296kB/s)(10.0MiB/4567msec); 0 zone resets clat (msec): min=86, max=1715, avg=423.53, stdev=518.49 lat (msec): min=86, max=1715, avg=423.63, stdev=518.48 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 95], | 30.00th=[ 113], 40.00th=[ 140], 50.00th=[ 167], 60.00th=[ 184], | 70.00th=[ 284], 80.00th=[ 617], 90.00th=[ 844], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1980, max= 4087, per=52.01%, avg=2801.40, stdev=1068.61, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=13.75%, ctx=351, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188289: Mon Sep 7 03:24:35 2026 read: IOPS=1, BW=1238KiB/s (1268kB/s)(6144KiB/4961msec) clat (msec): min=68, max=716, avg=338.83, stdev=241.71 lat (msec): min=68, max=716, avg=338.83, stdev=241.71 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 388], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2043, max= 6119, per=88.47%, avg=3403.33, stdev=2351.84, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1238KiB/s (1268kB/s)(6144KiB/4961msec); 0 zone resets clat (msec): min=69, max=1995, avg=483.57, stdev=744.39 lat (msec): min=69, max=1995, avg=483.67, stdev=744.39 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 251], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1924, max= 3592, per=44.26%, avg=2383.75, stdev=806.87, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=14.33%, ctx=129, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188290: Mon Sep 7 03:24:35 2026 read: IOPS=0, BW=962KiB/s (985kB/s)(5120KiB/5323msec) clat (msec): min=35, max=570, avg=262.13, stdev=228.04 lat (msec): min=35, max=570, avg=262.13, stdev=228.04 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 36], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1924, max= 4096, per=69.83%, avg=2686.33, stdev=1222.16, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1347KiB/s (1379kB/s)(7168KiB/5323msec); 0 zone resets clat (msec): min=53, max=2063, avg=545.69, stdev=720.48 lat (msec): min=53, max=2063, avg=545.76, stdev=720.49 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 86], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 203], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 844], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 1793, max= 2048, per=35.95%, avg=1936.25, stdev=108.12, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.79%, ctx=125, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3847KiB/s (3940kB/s), 448KiB/s-1357KiB/s (459kB/s-1389kB/s), io=20.0MiB (20.0MB), run=4567-5323msec WRITE: bw=5386KiB/s (5516kB/s), 969KiB/s-2242KiB/s (992kB/s-2296kB/s), io=28.0MiB (29.4MB), run=4567-5323msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188301: Mon Sep 7 03:24:44 2026 read: IOPS=1, BW=6819KiB/s (6983kB/s)(12.0MiB/1802msec) clat (msec): min=409, max=727, avg=574.89, stdev=159.29 lat (msec): min=409, max=727, avg=574.89, stdev=159.29 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=16.16%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188302: Mon Sep 7 03:24:44 2026 read: IOPS=0, BW=1849KiB/s (1894kB/s)(4096KiB/2215msec) clat (nsec): min=1169.0M, max=1169.0M, avg=1169027588.00, stdev= 0.00 lat (nsec): min=1169.0M, max=1169.0M, avg=1169029644.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3698KiB/s (3787kB/s)(8192KiB/2215msec); 0 zone resets clat (msec): min=140, max=851, avg=496.35, stdev=502.66 lat (msec): min=141, max=851, avg=496.61, stdev=502.49 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8110, max= 8110, per=54.82%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.05%, sys=12.29%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188303: Mon Sep 7 03:24:44 2026 write: IOPS=3, BW=15.5MiB/s (16.2MB/s)(12.0MiB/775msec); 0 zone resets clat (msec): min=147, max=365, avg=239.20, stdev=113.35 lat (msec): min=147, max=366, avg=239.54, stdev=113.44 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min=12172, max=12172, per=82.28%, avg=12172.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=32.82%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188305: Mon Sep 7 03:24:44 2026 write: IOPS=1, BW=6614KiB/s (6772kB/s)(12.0MiB/1858msec); 0 zone resets clat (msec): min=141, max=1362, avg=607.08, stdev=659.86 lat (msec): min=141, max=1362, avg=607.39, stdev=660.04 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min=13429, max=13429, per=90.78%, avg=13429.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.63%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7397KiB/s (7574kB/s), 1849KiB/s-6819KiB/s (1894kB/s-6983kB/s), io=16.0MiB (16.8MB), run=1802-2215msec WRITE: bw=14.4MiB/s (15.1MB/s), 3698KiB/s-15.5MiB/s (3787kB/s-16.2MB/s), io=32.0MiB (33.6MB), run=775-2215msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188304: Mon Sep 7 03:24:44 2026 read: IOPS=1, BW=7520KiB/s (7701kB/s)(12.0MiB/1634msec) clat (msec): min=419, max=582, avg=524.19, stdev=91.05 lat (msec): min=419, max=582, avg=524.19, stdev=91.05 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min=15906, max=15906, per=100.00%, avg=15906.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=47.70%, ctx=1141, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188306: Mon Sep 7 03:24:44 2026 read: IOPS=0, BW=2260KiB/s (2315kB/s)(4096KiB/1812msec) clat (nsec): min=561970k, max=561970k, avg=561969576.00, stdev= 0.00 lat (nsec): min=561972k, max=561972k, avg=561971774.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7953, max= 7953, per=87.97%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4521KiB/s (4629kB/s)(8192KiB/1812msec); 0 zone resets clat (msec): min=579, max=584, avg=581.87, stdev= 3.87 lat (msec): min=579, max=585, avg=582.27, stdev= 3.99 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8175, max= 8175, per=59.30%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=14.63%, ctx=203, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188307: Mon Sep 7 03:24:44 2026 write: IOPS=1, BW=5170KiB/s (5294kB/s)(12.0MiB/2377msec); 0 zone resets clat (msec): min=100, max=2076, avg=784.51, stdev=1119.81 lat (msec): min=100, max=2077, avg=784.84, stdev=1119.78 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 8175, max= 8175, per=59.30%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.04%, sys=9.89%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188308: Mon Sep 7 03:24:44 2026 write: IOPS=1, BW=6092KiB/s (6238kB/s)(12.0MiB/2017msec); 0 zone resets clat (msec): min=259, max=1324, avg=655.76, stdev=582.80 lat (msec): min=259, max=1325, avg=656.29, stdev=583.21 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 6660, max= 7953, per=53.00%, avg=7306.50, stdev=914.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.90%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9042KiB/s (9259kB/s), 2260KiB/s-7520KiB/s (2315kB/s-7701kB/s), io=16.0MiB (16.8MB), run=1634-1812msec WRITE: bw=13.5MiB/s (14.1MB/s), 4521KiB/s-6092KiB/s (4629kB/s-6238kB/s), io=32.0MiB (33.6MB), run=1812-2377msec