== sanity test 398b: DIO and buffer IO race ============== 17:32:04 (1788816724) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.20623 s, 9.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144344: Mon Sep 7 17:33:59 2026 read: IOPS=15, BW=60.5KiB/s (61.0kB/s)(5992KiB/98972msec) clat (usec): min=27, max=364369, avg=32438.91, stdev=26456.40 lat (usec): min=27, max=364370, avg=32440.47, stdev=26456.39 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 61], 10.00th=[ 94], 20.00th=[ 14484], | 30.00th=[ 19006], 40.00th=[ 23200], 50.00th=[ 27657], 60.00th=[ 32375], | 70.00th=[ 39584], 80.00th=[ 49021], 90.00th=[ 62653], 95.00th=[ 73925], | 99.00th=[123208], 99.50th=[135267], 99.90th=[254804], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 119, per=25.09%, avg=59.97, stdev=22.12, samples=195 iops : min= 1, max= 29, avg=14.38, stdev= 5.55, samples=195 write: IOPS=15, BW=63.6KiB/s (65.1kB/s)(6296KiB/98972msec); 0 zone resets clat (usec): min=677, max=325470, avg=31917.40, stdev=33875.25 lat (usec): min=677, max=325471, avg=31919.47, stdev=33875.19 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1254], 10.00th=[ 1565], 20.00th=[ 3523], | 30.00th=[ 6456], 40.00th=[ 14877], 50.00th=[ 23200], 60.00th=[ 31851], | 70.00th=[ 42730], 80.00th=[ 52691], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[170918], 99.90th=[278922], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 126, per=25.17%, avg=63.17, stdev=24.09, samples=195 iops : min= 1, max= 31, avg=15.19, stdev= 6.08, samples=195 lat (usec) : 50=1.01%, 100=3.94%, 250=0.68%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.36% lat (msec) : 2=6.71%, 4=4.46%, 10=7.81%, 20=14.23%, 50=40.14% lat (msec) : 100=17.38%, 250=2.96%, 500=0.16% cpu : usr=0.10%, sys=6.98%, ctx=6416, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144345: Mon Sep 7 17:33:59 2026 read: IOPS=14, BW=59.3KiB/s (60.8kB/s)(5940KiB/100112msec) clat (usec): min=32, max=347854, avg=31722.98, stdev=25581.68 lat (usec): min=32, max=347856, avg=31724.23, stdev=25581.70 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 111], 20.00th=[ 14746], | 30.00th=[ 19006], 40.00th=[ 22414], 50.00th=[ 26608], 60.00th=[ 31851], | 70.00th=[ 38536], 80.00th=[ 47449], 90.00th=[ 60556], 95.00th=[ 74974], | 99.00th=[116917], 99.50th=[135267], 99.90th=[278922], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 5, max= 127, per=24.89%, avg=59.48, stdev=23.03, samples=196 iops : min= 1, max= 31, avg=14.26, stdev= 5.81, samples=196 write: IOPS=15, BW=63.4KiB/s (64.9kB/s)(6348KiB/100112msec); 0 zone resets clat (usec): min=826, max=254874, avg=33322.83, stdev=33334.16 lat (usec): min=827, max=254877, avg=33325.00, stdev=33333.83 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1270], 10.00th=[ 1663], 20.00th=[ 3523], | 30.00th=[ 7439], 40.00th=[ 16188], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[160433], 99.90th=[231736], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 15, max= 151, per=25.08%, avg=62.94, stdev=24.50, samples=198 iops : min= 3, max= 37, avg=15.13, stdev= 6.17, samples=198 lat (usec) : 50=0.68%, 100=4.04%, 250=0.59%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=6.48%, 4=5.14%, 10=6.84%, 20=14.62%, 50=39.84% lat (msec) : 100=18.59%, 250=2.77%, 500=0.10% cpu : usr=0.10%, sys=6.85%, ctx=6460, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144346: Mon Sep 7 17:33:59 2026 read: IOPS=15, BW=60.3KiB/s (61.8kB/s)(6028KiB/99909msec) clat (usec): min=29, max=315688, avg=31307.68, stdev=25906.99 lat (usec): min=29, max=315690, avg=31312.15, stdev=25911.73 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 81], 20.00th=[ 13829], | 30.00th=[ 18482], 40.00th=[ 22414], 50.00th=[ 26084], 60.00th=[ 30278], | 70.00th=[ 38011], 80.00th=[ 47973], 90.00th=[ 61604], 95.00th=[ 74974], | 99.00th=[111674], 99.50th=[141558], 99.90th=[287310], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 135, per=25.01%, avg=59.78, stdev=24.55, samples=197 iops : min= 1, max= 33, avg=14.33, stdev= 6.16, samples=197 write: IOPS=15, BW=62.7KiB/s (64.2kB/s)(6260KiB/99909msec); 0 zone resets clat (usec): min=710, max=429469, avg=33602.07, stdev=34360.64 lat (usec): min=711, max=429472, avg=33603.85, stdev=34360.49 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1221], 10.00th=[ 1418], 20.00th=[ 3195], | 30.00th=[ 7242], 40.00th=[ 16581], 50.00th=[ 26084], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[135267], 99.50th=[168821], 99.90th=[214959], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 15, max= 135, per=24.69%, avg=61.96, stdev=21.73, samples=197 iops : min= 3, max= 33, avg=14.88, stdev= 5.45, samples=197 lat (usec) : 50=0.85%, 100=4.52%, 250=0.68%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.33% lat (msec) : 2=7.23%, 4=4.30%, 10=6.15%, 20=14.19%, 50=39.49% lat (msec) : 100=18.91%, 250=3.03%, 500=0.10% cpu : usr=0.09%, sys=6.77%, ctx=6526, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144347: Mon Sep 7 17:33:59 2026 read: IOPS=15, BW=60.5KiB/s (62.0kB/s)(6052KiB/99950msec) clat (usec): min=35, max=337251, avg=31962.88, stdev=26339.40 lat (usec): min=35, max=337252, avg=31967.87, stdev=26340.83 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 104], 20.00th=[ 14746], | 30.00th=[ 18744], 40.00th=[ 22414], 50.00th=[ 26608], 60.00th=[ 31065], | 70.00th=[ 38011], 80.00th=[ 47449], 90.00th=[ 63177], 95.00th=[ 79168], | 99.00th=[121111], 99.50th=[152044], 99.90th=[225444], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 11, max= 128, per=25.05%, avg=59.87, stdev=23.47, samples=197 iops : min= 2, max= 32, avg=14.35, stdev= 5.91, samples=197 write: IOPS=15, BW=62.4KiB/s (63.9kB/s)(6236KiB/99950msec); 0 zone resets clat (usec): min=823, max=426971, avg=32939.48, stdev=35289.24 lat (usec): min=824, max=426974, avg=32942.59, stdev=35288.02 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1254], 10.00th=[ 1663], 20.00th=[ 3556], | 30.00th=[ 7308], 40.00th=[ 14877], 50.00th=[ 23462], 60.00th=[ 32637], | 70.00th=[ 41681], 80.00th=[ 54789], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[149947], 99.50th=[173016], 99.90th=[244319], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 119, per=24.73%, avg=62.08, stdev=22.18, samples=196 iops : min= 1, max= 29, avg=14.91, stdev= 5.60, samples=196 lat (usec) : 50=0.62%, 100=4.26%, 250=0.62%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.33% lat (msec) : 2=6.09%, 4=4.52%, 10=7.16%, 20=15.76%, 50=39.68% lat (msec) : 100=17.15%, 250=3.45%, 500=0.07% cpu : usr=0.09%, sys=6.90%, ctx=6567, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=240KiB/s (246kB/s), 59.3KiB/s-60.5KiB/s (60.8kB/s-62.0kB/s), io=23.4MiB (24.6MB), run=98972-100112msec WRITE: bw=251KiB/s (257kB/s), 62.4KiB/s-63.6KiB/s (63.9kB/s-65.1kB/s), io=24.6MiB (25.7MB), run=98972-100112msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144339: Mon Sep 7 17:35:42 2026 read: IOPS=7, BW=29.6KiB/s (30.3kB/s)(5992KiB/202296msec) clat (msec): min=4, max=518, avg=29.68, stdev=27.97 lat (msec): min=4, max=518, avg=29.68, stdev=27.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 61], 95.00th=[ 84], | 99.00th=[ 129], 99.50th=[ 144], 99.90th=[ 245], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 96, per=26.54%, avg=31.05, stdev=19.62, samples=376 iops : min= 1, max= 24, avg= 7.19, stdev= 4.97, samples=376 write: IOPS=7, BW=31.1KiB/s (31.9kB/s)(6296KiB/202296msec); 0 zone resets clat (msec): min=31, max=393, avg=100.05, stdev=50.56 lat (msec): min=31, max=393, avg=100.05, stdev=50.56 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 61], | 30.00th=[ 69], 40.00th=[ 77], 50.00th=[ 85], 60.00th=[ 96], | 70.00th=[ 112], 80.00th=[ 136], 90.00th=[ 171], 95.00th=[ 207], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 330], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 64, per=24.95%, avg=30.69, stdev=13.65, samples=399 iops : min= 1, max= 16, avg= 7.10, stdev= 3.47, samples=399 lat (msec) : 10=6.09%, 20=15.66%, 50=24.45%, 100=33.98%, 250=18.95% lat (msec) : 500=0.85%, 750=0.03% cpu : usr=0.05%, sys=1.63%, ctx=5483, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144340: Mon Sep 7 17:35:42 2026 read: IOPS=7, BW=29.2KiB/s (29.9kB/s)(5940KiB/203630msec) clat (msec): min=4, max=489, avg=30.37, stdev=30.18 lat (msec): min=4, max=489, avg=30.37, stdev=30.18 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 64], 95.00th=[ 88], | 99.00th=[ 144], 99.50th=[ 174], 99.90th=[ 296], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 112, per=26.50%, avg=31.00, stdev=19.70, samples=373 iops : min= 1, max= 28, avg= 7.18, stdev= 4.98, samples=373 write: IOPS=7, BW=31.2KiB/s (31.9kB/s)(6348KiB/203630msec); 0 zone resets clat (msec): min=27, max=327, avg=99.68, stdev=47.47 lat (msec): min=27, max=327, avg=99.69, stdev=47.47 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 47], 10.00th=[ 53], 20.00th=[ 62], | 30.00th=[ 70], 40.00th=[ 78], 50.00th=[ 86], 60.00th=[ 96], | 70.00th=[ 112], 80.00th=[ 136], 90.00th=[ 169], 95.00th=[ 197], | 99.00th=[ 253], 99.50th=[ 279], 99.90th=[ 321], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 80, per=25.05%, avg=30.81, stdev=13.93, samples=401 iops : min= 1, max= 20, avg= 7.13, stdev= 3.55, samples=401 lat (msec) : 10=5.70%, 20=16.31%, 50=23.47%, 100=33.53%, 250=20.38% lat (msec) : 500=0.62% cpu : usr=0.06%, sys=1.65%, ctx=5528, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144341: Mon Sep 7 17:35:42 2026 read: IOPS=7, BW=29.7KiB/s (30.4kB/s)(6028KiB/202717msec) clat (msec): min=4, max=296, avg=30.43, stdev=27.63 lat (msec): min=4, max=296, avg=30.43, stdev=27.63 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 63], 95.00th=[ 84], | 99.00th=[ 140], 99.50th=[ 161], 99.90th=[ 241], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 103, per=25.98%, avg=30.40, stdev=19.43, samples=386 iops : min= 1, max= 25, avg= 7.02, stdev= 4.89, samples=386 write: IOPS=7, BW=30.9KiB/s (31.6kB/s)(6260KiB/202717msec); 0 zone resets clat (msec): min=32, max=562, avg=100.01, stdev=49.51 lat (msec): min=32, max=562, avg=100.01, stdev=49.51 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 48], 10.00th=[ 54], 20.00th=[ 63], | 30.00th=[ 69], 40.00th=[ 77], 50.00th=[ 86], 60.00th=[ 96], | 70.00th=[ 111], 80.00th=[ 132], 90.00th=[ 171], 95.00th=[ 201], | 99.00th=[ 257], 99.50th=[ 279], 99.90th=[ 330], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 72, per=24.81%, avg=30.52, stdev=14.07, samples=399 iops : min= 1, max= 18, avg= 7.06, stdev= 3.60, samples=399 lat (msec) : 10=5.63%, 20=16.47%, 50=22.88%, 100=34.80%, 250=19.53% lat (msec) : 500=0.65%, 750=0.03% cpu : usr=0.06%, sys=1.64%, ctx=5411, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144342: Mon Sep 7 17:35:42 2026 read: IOPS=7, BW=29.9KiB/s (30.6kB/s)(6052KiB/202256msec) clat (msec): min=4, max=298, avg=29.40, stdev=26.46 lat (msec): min=4, max=298, avg=29.40, stdev=26.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 63], 95.00th=[ 84], | 99.00th=[ 132], 99.50th=[ 146], 99.90th=[ 211], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 120, per=26.89%, avg=31.46, stdev=21.44, samples=375 iops : min= 1, max= 30, avg= 7.30, stdev= 5.40, samples=375 write: IOPS=7, BW=30.8KiB/s (31.6kB/s)(6236KiB/202256msec); 0 zone resets clat (msec): min=24, max=566, avg=100.98, stdev=51.49 lat (msec): min=24, max=566, avg=100.98, stdev=51.48 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 61], | 30.00th=[ 70], 40.00th=[ 78], 50.00th=[ 86], 60.00th=[ 97], | 70.00th=[ 113], 80.00th=[ 138], 90.00th=[ 174], 95.00th=[ 199], | 99.00th=[ 275], 99.50th=[ 305], 99.90th=[ 393], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 70, per=24.83%, avg=30.55, stdev=13.85, samples=397 iops : min= 1, max= 17, avg= 7.07, stdev= 3.52, samples=397 lat (msec) : 10=6.05%, 20=17.09%, 50=23.40%, 100=32.65%, 250=20.02% lat (msec) : 500=0.75%, 750=0.03% cpu : usr=0.06%, sys=1.67%, ctx=5524, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=118KiB/s (121kB/s), 29.2KiB/s-29.9KiB/s (29.9kB/s-30.6kB/s), io=23.4MiB (24.6MB), run=202256-203630msec WRITE: bw=123KiB/s (126kB/s), 30.8KiB/s-31.2KiB/s (31.6kB/s-31.9kB/s), io=24.6MiB (25.7MB), run=202256-203630msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144401: Mon Sep 7 17:36:10 2026 read: IOPS=19, BW=318KiB/s (325kB/s)(5920KiB/18634msec) clat (usec): min=36, max=126774, avg=26415.44, stdev=21065.14 lat (usec): min=36, max=126776, avg=26417.21, stdev=21065.20 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 338], | 30.00th=[ 14615], 40.00th=[ 19792], 50.00th=[ 23462], 60.00th=[ 28705], | 70.00th=[ 33817], 80.00th=[ 42730], 90.00th=[ 51643], 95.00th=[ 65799], | 99.00th=[ 91751], 99.50th=[ 98042], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 125, max= 571, per=25.05%, avg=311.89, stdev=91.86, samples=36 iops : min= 7, max= 35, avg=18.78, stdev= 5.79, samples=36 write: IOPS=21, BW=342KiB/s (350kB/s)(6368KiB/18634msec); 0 zone resets clat (usec): min=1164, max=179765, avg=21881.60, stdev=22730.14 lat (usec): min=1165, max=179770, avg=21884.88, stdev=22730.24 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1991], 10.00th=[ 2573], 20.00th=[ 3982], | 30.00th=[ 5997], 40.00th=[ 9110], 50.00th=[ 13829], 60.00th=[ 19792], | 70.00th=[ 27657], 80.00th=[ 36963], 90.00th=[ 53216], 95.00th=[ 66323], | 99.00th=[101188], 99.50th=[115868], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 189, max= 573, per=25.85%, avg=338.69, stdev=111.34, samples=36 iops : min= 11, max= 35, avg=20.47, stdev= 7.00, samples=36 lat (usec) : 50=1.69%, 100=6.12%, 250=1.69%, 500=0.13%, 750=0.13% lat (msec) : 2=2.73%, 4=7.94%, 10=11.85%, 20=18.23%, 50=37.89% lat (msec) : 100=10.81%, 250=0.78% cpu : usr=0.12%, sys=10.52%, ctx=1636, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144402: Mon Sep 7 17:36:10 2026 read: IOPS=18, BW=299KiB/s (306kB/s)(5744KiB/19234msec) clat (usec): min=40, max=153594, avg=28892.10, stdev=22905.61 lat (usec): min=41, max=153596, avg=28894.39, stdev=22905.16 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 89], 20.00th=[ 11994], | 30.00th=[ 17957], 40.00th=[ 22152], 50.00th=[ 24773], 60.00th=[ 29492], | 70.00th=[ 35914], 80.00th=[ 42730], 90.00th=[ 57410], 95.00th=[ 72877], | 99.00th=[105382], 99.50th=[135267], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 189, max= 415, per=23.65%, avg=294.46, stdev=58.44, samples=37 iops : min= 11, max= 25, avg=17.70, stdev= 3.67, samples=37 write: IOPS=21, BW=340KiB/s (348kB/s)(6544KiB/19234msec); 0 zone resets clat (usec): min=1330, max=119993, avg=21284.26, stdev=20921.29 lat (usec): min=1331, max=119995, avg=21288.23, stdev=20921.64 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2311], 10.00th=[ 2704], 20.00th=[ 3818], | 30.00th=[ 5604], 40.00th=[ 7701], 50.00th=[ 13173], 60.00th=[ 20579], | 70.00th=[ 29230], 80.00th=[ 38536], 90.00th=[ 50594], 95.00th=[ 61080], | 99.00th=[ 85459], 99.50th=[108528], 99.90th=[120062], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 95, max= 638, per=25.44%, avg=333.30, stdev=128.15, samples=37 iops : min= 5, max= 39, avg=20.14, stdev= 8.09, samples=37 lat (usec) : 50=0.65%, 100=4.43%, 250=2.34%, 500=0.13% lat (msec) : 2=2.08%, 4=9.24%, 10=14.06%, 20=14.84%, 50=39.84% lat (msec) : 100=11.46%, 250=0.91% cpu : usr=0.16%, sys=10.30%, ctx=1605, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144403: Mon Sep 7 17:36:10 2026 read: IOPS=21, BW=340KiB/s (348kB/s)(6256KiB/18405msec) clat (usec): min=41, max=160097, avg=25565.01, stdev=20530.51 lat (usec): min=41, max=160098, avg=25572.15, stdev=20524.24 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 198], | 30.00th=[ 16188], 40.00th=[ 20317], 50.00th=[ 24773], 60.00th=[ 27919], | 70.00th=[ 33817], 80.00th=[ 40109], 90.00th=[ 49021], 95.00th=[ 62653], | 99.00th=[ 86508], 99.50th=[108528], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 159, max= 637, per=27.48%, avg=342.08, stdev=113.31, samples=36 iops : min= 9, max= 39, avg=20.67, stdev= 7.13, samples=36 write: IOPS=20, BW=328KiB/s (336kB/s)(6032KiB/18405msec); 0 zone resets clat (usec): min=1194, max=111304, avg=22119.63, stdev=22592.49 lat (usec): min=1196, max=111307, avg=22121.99, stdev=22592.53 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1909], 10.00th=[ 2376], 20.00th=[ 4490], | 30.00th=[ 6194], 40.00th=[ 9110], 50.00th=[ 14353], 60.00th=[ 20055], | 70.00th=[ 28443], 80.00th=[ 37487], 90.00th=[ 51119], 95.00th=[ 69731], | 99.00th=[103285], 99.50th=[109577], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 127, max= 513, per=24.73%, avg=324.00, stdev=115.43, samples=36 iops : min= 7, max= 32, avg=19.56, stdev= 7.31, samples=36 lat (usec) : 50=0.78%, 100=7.16%, 250=2.47%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=3.12%, 4=6.12%, 10=12.11%, 20=16.93%, 50=40.36% lat (msec) : 100=9.38%, 250=0.91% cpu : usr=0.08%, sys=10.58%, ctx=1599, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144404: Mon Sep 7 17:36:10 2026 read: IOPS=20, BW=323KiB/s (331kB/s)(6032KiB/18651msec) clat (usec): min=29, max=193707, avg=27004.99, stdev=22913.11 lat (usec): min=29, max=193708, avg=27006.44, stdev=22913.16 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 63], 10.00th=[ 75], 20.00th=[ 791], | 30.00th=[ 17171], 40.00th=[ 20579], 50.00th=[ 23725], 60.00th=[ 29230], | 70.00th=[ 35914], 80.00th=[ 41157], 90.00th=[ 51119], 95.00th=[ 64226], | 99.00th=[130548], 99.50th=[141558], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 94, max= 571, per=25.57%, avg=318.39, stdev=96.81, samples=36 iops : min= 5, max= 35, avg=19.17, stdev= 6.00, samples=36 write: IOPS=20, BW=335KiB/s (343kB/s)(6256KiB/18651msec); 0 zone resets clat (usec): min=1518, max=122239, avg=21354.47, stdev=21099.51 lat (usec): min=1519, max=122241, avg=21357.81, stdev=21099.26 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1975], 10.00th=[ 2999], 20.00th=[ 4752], | 30.00th=[ 6259], 40.00th=[ 8848], 50.00th=[ 13435], 60.00th=[ 19530], | 70.00th=[ 25822], 80.00th=[ 37487], 90.00th=[ 50070], 95.00th=[ 64750], | 99.00th=[ 91751], 99.50th=[ 94897], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 159, max= 575, per=25.46%, avg=333.47, stdev=113.24, samples=36 iops : min= 9, max= 35, avg=20.14, stdev= 7.14, samples=36 lat (usec) : 50=1.04%, 100=6.25%, 250=2.21%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.86%, 4=5.34%, 10=14.32%, 20=17.84%, 50=39.45% lat (msec) : 100=9.64%, 250=0.65% cpu : usr=0.14%, sys=10.33%, ctx=1606, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1245KiB/s (1275kB/s), 299KiB/s-340KiB/s (306kB/s-348kB/s), io=23.4MiB (24.5MB), run=18405-19234msec WRITE: bw=1310KiB/s (1342kB/s), 328KiB/s-342KiB/s (336kB/s-350kB/s), io=24.6MiB (25.8MB), run=18405-19234msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144406: Mon Sep 7 17:36:34 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5920KiB/42876msec) clat (msec): min=4, max=183, avg=27.37, stdev=25.46 lat (msec): min=4, max=183, avg=27.37, stdev=25.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 51], 95.00th=[ 82], | 99.00th=[ 132], 99.50th=[ 153], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 384, per=25.20%, avg=140.34, stdev=84.57, samples=82 iops : min= 1, max= 24, avg= 8.05, stdev= 5.37, samples=82 write: IOPS=9, BW=149KiB/s (152kB/s)(6368KiB/42876msec); 0 zone resets clat (msec): min=33, max=268, avg=82.12, stdev=35.77 lat (msec): min=33, max=268, avg=82.12, stdev=35.77 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 43], 10.00th=[ 46], 20.00th=[ 54], | 30.00th=[ 62], 40.00th=[ 67], 50.00th=[ 74], 60.00th=[ 81], | 70.00th=[ 90], 80.00th=[ 106], 90.00th=[ 133], 95.00th=[ 150], | 99.00th=[ 199], 99.50th=[ 222], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 255, per=25.28%, avg=148.14, stdev=58.68, samples=84 iops : min= 1, max= 15, avg= 8.55, stdev= 3.72, samples=84 lat (msec) : 10=4.95%, 20=20.05%, 50=26.17%, 100=34.77%, 250=13.93% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.17%, ctx=1421, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144407: Mon Sep 7 17:36:34 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(5744KiB/42989msec) clat (msec): min=6, max=195, avg=26.42, stdev=24.25 lat (msec): min=6, max=195, avg=26.43, stdev=24.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 57], 95.00th=[ 84], | 99.00th=[ 128], 99.50th=[ 155], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 22, max= 415, per=24.44%, avg=136.15, stdev=80.77, samples=82 iops : min= 1, max= 25, avg= 7.78, stdev= 5.04, samples=82 write: IOPS=9, BW=152KiB/s (156kB/s)(6544KiB/42989msec); 0 zone resets clat (msec): min=24, max=287, avg=81.77, stdev=38.16 lat (msec): min=24, max=287, avg=81.78, stdev=38.16 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 41], 10.00th=[ 47], 20.00th=[ 54], | 30.00th=[ 59], 40.00th=[ 65], 50.00th=[ 74], 60.00th=[ 82], | 70.00th=[ 90], 80.00th=[ 102], 90.00th=[ 136], 95.00th=[ 157], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 256, per=25.80%, avg=151.20, stdev=60.26, samples=84 iops : min= 1, max= 16, avg= 8.74, stdev= 3.86, samples=84 lat (msec) : 10=5.60%, 20=19.79%, 50=24.09%, 100=38.54%, 250=11.59% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.24%, ctx=1400, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144408: Mon Sep 7 17:36:34 2026 read: IOPS=9, BW=148KiB/s (152kB/s)(6256KiB/42195msec) clat (msec): min=6, max=153, avg=25.74, stdev=21.01 lat (msec): min=6, max=153, avg=25.74, stdev=21.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 51], 95.00th=[ 68], | 99.00th=[ 117], 99.50th=[ 128], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 30, max= 350, per=27.44%, avg=152.85, stdev=92.09, samples=81 iops : min= 1, max= 21, avg= 8.84, stdev= 5.79, samples=81 write: IOPS=8, BW=143KiB/s (146kB/s)(6032KiB/42195msec); 0 zone resets clat (msec): min=27, max=232, avg=85.06, stdev=37.35 lat (msec): min=27, max=232, avg=85.06, stdev=37.35 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 43], 10.00th=[ 49], 20.00th=[ 57], | 30.00th=[ 63], 40.00th=[ 69], 50.00th=[ 77], 60.00th=[ 84], | 70.00th=[ 94], 80.00th=[ 109], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 213], 99.50th=[ 230], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 287, per=24.33%, avg=142.58, stdev=55.33, samples=83 iops : min= 1, max= 17, avg= 8.18, stdev= 3.51, samples=83 lat (msec) : 10=6.12%, 20=20.70%, 50=24.61%, 100=35.94%, 250=12.63% cpu : usr=0.04%, sys=2.37%, ctx=1462, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144409: Mon Sep 7 17:36:34 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(6032KiB/42835msec) clat (msec): min=6, max=188, avg=25.86, stdev=21.96 lat (msec): min=6, max=188, avg=25.86, stdev=21.96 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 48], 95.00th=[ 67], | 99.00th=[ 121], 99.50th=[ 140], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 30, max= 381, per=25.70%, avg=143.16, stdev=78.40, samples=82 iops : min= 1, max= 23, avg= 8.23, stdev= 5.00, samples=82 write: IOPS=9, BW=146KiB/s (150kB/s)(6256KiB/42835msec); 0 zone resets clat (msec): min=31, max=257, avg=84.46, stdev=37.56 lat (msec): min=31, max=257, avg=84.46, stdev=37.56 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 44], 10.00th=[ 49], 20.00th=[ 55], | 30.00th=[ 64], 40.00th=[ 68], 50.00th=[ 77], 60.00th=[ 83], | 70.00th=[ 93], 80.00th=[ 108], 90.00th=[ 129], 95.00th=[ 161], | 99.00th=[ 222], 99.50th=[ 251], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 256, per=24.81%, avg=145.40, stdev=56.51, samples=84 iops : min= 1, max= 16, avg= 8.37, stdev= 3.59, samples=84 lat (msec) : 10=6.38%, 20=19.27%, 50=24.61%, 100=36.33%, 250=13.28% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=2.28%, ctx=1477, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=557KiB/s (571kB/s), 134KiB/s-148KiB/s (137kB/s-152kB/s), io=23.4MiB (24.5MB), run=42195-42989msec WRITE: bw=586KiB/s (600kB/s), 143KiB/s-152KiB/s (146kB/s-156kB/s), io=24.6MiB (25.8MB), run=42195-42989msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144420: Mon Sep 7 17:36:46 2026 read: IOPS=2, BW=2500KiB/s (2560kB/s)(7168KiB/2867msec) clat (msec): min=89, max=400, avg=191.99, stdev=137.89 lat (msec): min=89, max=400, avg=191.99, stdev=137.89 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 125], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 384], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1973, max= 5688, per=61.98%, avg=2936.75, stdev=1834.46, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1786KiB/s (1829kB/s)(5120KiB/2867msec); 0 zone resets clat (msec): min=244, max=332, avg=282.04, stdev=35.08 lat (msec): min=246, max=332, avg=282.49, stdev=34.58 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 2043, max= 4039, per=40.83%, avg=2708.33, stdev=1152.39, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=50.00% cpu : usr=0.00%, sys=6.84%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144421: Mon Sep 7 17:36:46 2026 read: IOPS=0, BW=474KiB/s (486kB/s)(2048KiB/4317msec) clat (msec): min=87, max=336, avg=212.04, stdev=175.64 lat (msec): min=87, max=336, avg=212.04, stdev=175.64 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 88], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1943, max= 1973, per=41.33%, avg=1958.00, stdev=21.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2372KiB/s (2429kB/s)(10.0MiB/4317msec); 0 zone resets clat (msec): min=160, max=891, avg=377.64, stdev=235.01 lat (msec): min=161, max=891, avg=377.82, stdev=234.91 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 215], | 30.00th=[ 220], 40.00th=[ 230], 50.00th=[ 255], 60.00th=[ 330], | 70.00th=[ 355], 80.00th=[ 447], 90.00th=[ 676], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1943, max= 4087, per=40.47%, avg=2684.67, stdev=1068.35, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=6.79%, ctx=149, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144422: Mon Sep 7 17:36:46 2026 read: IOPS=1, BW=1422KiB/s (1456kB/s)(6144KiB/4322msec) clat (msec): min=49, max=568, avg=298.50, stdev=212.33 lat (msec): min=49, max=568, avg=298.50, stdev=212.33 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 338], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2015, max= 2043, per=42.82%, avg=2028.60, stdev=13.45, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1422KiB/s (1456kB/s)(6144KiB/4322msec); 0 zone resets clat (msec): min=127, max=726, avg=414.88, stdev=231.91 lat (msec): min=127, max=726, avg=414.97, stdev=231.90 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 447], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1885, max= 2043, per=30.05%, avg=1993.40, stdev=67.01, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=5.62%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144423: Mon Sep 7 17:36:46 2026 read: IOPS=1, BW=1324KiB/s (1356kB/s)(5120KiB/3866msec) clat (msec): min=59, max=640, avg=239.50, stdev=230.86 lat (msec): min=59, max=640, avg=239.50, stdev=230.86 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 3946, max= 4031, per=84.18%, avg=3988.50, stdev=60.10, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1854KiB/s (1899kB/s)(7168KiB/3866msec); 0 zone resets clat (msec): min=231, max=509, avg=358.65, stdev=114.90 lat (msec): min=231, max=509, avg=358.93, stdev=114.70 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 251], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 355], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 477], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2019, max= 4087, per=46.12%, avg=3059.00, stdev=1187.07, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=6.99%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4739KiB/s (4852kB/s), 474KiB/s-2500KiB/s (486kB/s-2560kB/s), io=20.0MiB (20.0MB), run=2867-4322msec WRITE: bw=6634KiB/s (6793kB/s), 1422KiB/s-2372KiB/s (1456kB/s-2429kB/s), io=28.0MiB (29.4MB), run=2867-4322msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144425: Mon Sep 7 17:36:46 2026 read: IOPS=2, BW=2385KiB/s (2443kB/s)(7168KiB/3005msec) clat (usec): min=599, max=229937, avg=152027.01, stdev=78344.91 lat (usec): min=600, max=229939, avg=152029.12, stdev=78345.04 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[101188], | 30.00th=[156238], 40.00th=[156238], 50.00th=[179307], 60.00th=[193987], | 70.00th=[193987], 80.00th=[204473], 90.00th=[229639], 95.00th=[229639], | 99.00th=[229639], 99.50th=[229639], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 2035, max= 4087, per=69.95%, avg=3311.67, stdev=1114.08, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1704KiB/s (1745kB/s)(5120KiB/3005msec); 0 zone resets clat (msec): min=202, max=652, avg=341.68, stdev=185.21 lat (msec): min=202, max=653, avg=341.75, stdev=185.22 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2035, max= 4023, per=40.71%, avg=2697.67, stdev=1147.77, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=22.34%, ctx=308, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144426: Mon Sep 7 17:36:46 2026 read: IOPS=0, BW=473KiB/s (485kB/s)(2048KiB/4326msec) clat (msec): min=44, max=461, avg=253.13, stdev=295.13 lat (msec): min=44, max=461, avg=253.13, stdev=295.13 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 45], 40.00th=[ 45], 50.00th=[ 45], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2023, max= 2035, per=42.86%, avg=2029.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2367KiB/s (2424kB/s)(10.0MiB/4326msec); 0 zone resets clat (msec): min=199, max=727, avg=365.31, stdev=166.52 lat (msec): min=199, max=727, avg=365.40, stdev=166.50 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 218], | 30.00th=[ 234], 40.00th=[ 239], 50.00th=[ 334], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 422], 90.00th=[ 542], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2035, max= 4087, per=49.06%, avg=3251.20, stdev=1104.55, samples=5 iops : min= 1, max= 3, avg= 2.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=19.05%, ctx=205, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144427: Mon Sep 7 17:36:46 2026 read: IOPS=1, BW=1650KiB/s (1690kB/s)(6144KiB/3723msec) clat (usec): min=424, max=768551, avg=276297.94, stdev=353691.50 lat (usec): min=426, max=768554, avg=276299.60, stdev=353691.67 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 578], 50.00th=[ 578], 60.00th=[221250], | 70.00th=[666895], 80.00th=[666895], 90.00th=[767558], 95.00th=[767558], | 99.00th=[767558], 99.50th=[767558], 99.90th=[767558], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 2023, max= 4063, per=53.68%, avg=2541.00, stdev=1014.70, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1650KiB/s (1690kB/s)(6144KiB/3723msec); 0 zone resets clat (msec): min=124, max=593, avg=338.49, stdev=178.10 lat (msec): min=124, max=593, avg=338.57, stdev=178.09 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 363], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2019, max= 2043, per=30.67%, avg=2032.60, stdev= 8.76, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=14.51%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144428: Mon Sep 7 17:36:46 2026 read: IOPS=1, BW=1601KiB/s (1639kB/s)(5120KiB/3199msec) clat (usec): min=572, max=280637, avg=131943.77, stdev=134039.92 lat (usec): min=574, max=280639, avg=131945.76, stdev=134040.17 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 2343], 40.00th=[ 2343], 50.00th=[119014], 60.00th=[119014], | 70.00th=[256902], 80.00th=[256902], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 4023, max= 4047, per=85.23%, avg=4035.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2241KiB/s (2294kB/s)(7168KiB/3199msec); 0 zone resets clat (msec): min=145, max=581, avg=330.21, stdev=198.29 lat (msec): min=145, max=581, avg=330.37, stdev=198.37 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 180], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 567], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2035, max= 4087, per=46.04%, avg=3051.00, stdev=1173.29, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=20.39%, ctx=191, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4734KiB/s (4848kB/s), 473KiB/s-2385KiB/s (485kB/s-2443kB/s), io=20.0MiB (20.0MB), run=3005-4326msec WRITE: bw=6628KiB/s (6787kB/s), 1650KiB/s-2367KiB/s (1690kB/s-2424kB/s), io=28.0MiB (29.4MB), run=3005-4326msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144436: Mon Sep 7 17:36:57 2026 read: IOPS=1, BW=4983KiB/s (5103kB/s)(12.0MiB/2466msec) clat (msec): min=607, max=825, avg=742.53, stdev=118.03 lat (msec): min=607, max=825, avg=742.53, stdev=118.03 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7613, max= 8192, per=100.00%, avg=7902.50, stdev=409.41, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=16.31%, ctx=514, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144438: Mon Sep 7 17:36:57 2026 read: IOPS=0, BW=1608KiB/s (1647kB/s)(4096KiB/2547msec) clat (nsec): min=618258k, max=618258k, avg=618258391.00, stdev= 0.00 lat (nsec): min=618260k, max=618260k, avg=618259994.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7613, max= 7613, per=100.00%, avg=7613.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3216KiB/s (3294kB/s)(8192KiB/2547msec); 0 zone resets clat (msec): min=722, max=1082, avg=902.34, stdev=254.67 lat (msec): min=722, max=1082, avg=902.68, stdev=254.61 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=74.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.70%, ctx=180, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144440: Mon Sep 7 17:36:57 2026 write: IOPS=1, BW=4101KiB/s (4200kB/s)(12.0MiB/2996msec); 0 zone resets clat (msec): min=236, max=1538, avg=937.38, stdev=657.00 lat (msec): min=236, max=1538, avg=937.68, stdev=656.94 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8031, max= 8031, per=73.43%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.03%, sys=7.05%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144441: Mon Sep 7 17:36:57 2026 write: IOPS=1, BW=5707KiB/s (5844kB/s)(12.0MiB/2153msec); 0 zone resets clat (msec): min=349, max=999, avg=651.33, stdev=327.59 lat (msec): min=350, max=1000, avg=652.14, stdev=327.53 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 6606, max= 7613, per=65.00%, avg=7109.50, stdev=712.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.09%, sys=6.13%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6433KiB/s (6587kB/s), 1608KiB/s-4983KiB/s (1647kB/s-5103kB/s), io=16.0MiB (16.8MB), run=2466-2547msec WRITE: bw=10.7MiB/s (11.2MB/s), 3216KiB/s-5707KiB/s (3294kB/s-5844kB/s), io=32.0MiB (33.6MB), run=2153-2996msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144435: Mon Sep 7 17:36:57 2026 read: IOPS=1, BW=4971KiB/s (5090kB/s)(12.0MiB/2472msec) clat (msec): min=385, max=1222, avg=768.23, stdev=423.43 lat (msec): min=385, max=1222, avg=768.23, stdev=423.43 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.61%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144437: Mon Sep 7 17:36:57 2026 read: IOPS=0, BW=1354KiB/s (1386kB/s)(4096KiB/3026msec) clat (nsec): min=937748k, max=937748k, avg=937747602.00, stdev= 0.00 lat (nsec): min=937750k, max=937750k, avg=937750338.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2707KiB/s (2772kB/s)(8192KiB/3026msec); 0 zone resets clat (msec): min=774, max=1232, avg=1003.58, stdev=323.29 lat (msec): min=775, max=1232, avg=1003.94, stdev=323.27 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7922, max= 7922, per=73.89%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.80%, ctx=41, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144439: Mon Sep 7 17:36:57 2026 write: IOPS=0, BW=4021KiB/s (4117kB/s)(12.0MiB/3056msec); 0 zone resets clat (msec): min=190, max=1682, avg=996.40, stdev=753.54 lat (msec): min=190, max=1683, avg=996.81, stdev=753.59 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 7922, max= 7922, per=73.89%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.14%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144442: Mon Sep 7 17:36:57 2026 write: IOPS=1, BW=5361KiB/s (5490kB/s)(12.0MiB/2292msec); 0 zone resets clat (msec): min=648, max=929, avg=754.52, stdev=152.89 lat (msec): min=648, max=930, avg=754.98, stdev=152.91 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7968, max= 8159, per=75.21%, avg=8063.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=8.03%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5414KiB/s (5544kB/s), 1354KiB/s-4971KiB/s (1386kB/s-5090kB/s), io=16.0MiB (16.8MB), run=2472-3026msec WRITE: bw=10.5MiB/s (10.0MB/s), 2707KiB/s-5361KiB/s (2772kB/s-5490kB/s), io=32.0MiB (33.6MB), run=2292-3056msec