== sanity test 398b: DIO and buffer IO race ============== 15:38:42 (1779997122) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.8757 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179715: Thu May 28 15:40:53 2026 read: IOPS=13, BW=54.2KiB/s (55.6kB/s)(5992KiB/110453msec) clat (usec): min=37, max=1147.4k, avg=40939.62, stdev=38724.49 lat (usec): min=38, max=1147.4k, avg=40942.33, stdev=38724.58 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11600], 10.00th=[ 15664], | 20.00th=[ 21103], 30.00th=[ 25297], 40.00th=[ 30016], | 50.00th=[ 34866], 60.00th=[ 40109], 70.00th=[ 46924], | 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[ 139461], 99.50th=[ 166724], 99.90th=[ 242222], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 111, per=24.89%, avg=54.00, stdev=20.94, samples=217 iops : min= 1, max= 27, avg=12.83, stdev= 5.27, samples=217 write: IOPS=14, BW=57.0KiB/s (58.4kB/s)(6296KiB/110453msec); 0 zone resets clat (usec): min=755, max=242643, avg=30972.31, stdev=31042.24 lat (usec): min=755, max=242645, avg=30973.84, stdev=31042.25 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1319], 10.00th=[ 1450], 20.00th=[ 3621], | 30.00th=[ 7701], 40.00th=[ 15008], 50.00th=[ 22414], 60.00th=[ 30278], | 70.00th=[ 41157], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[160433], 99.90th=[193987], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 118, per=24.99%, avg=56.74, stdev=21.99, samples=217 iops : min= 1, max= 29, avg=13.52, stdev= 5.54, samples=217 lat (usec) : 50=0.26%, 100=1.37%, 750=0.03%, 1000=0.46% lat (msec) : 2=6.71%, 4=3.58%, 10=7.23%, 20=12.57%, 50=42.97% lat (msec) : 100=21.71%, 250=3.09%, 2000=0.03% cpu : usr=0.07%, sys=5.81%, ctx=6306, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179716: Thu May 28 15:40:53 2026 read: IOPS=13, BW=54.5KiB/s (55.9kB/s)(5940KiB/108900msec) clat (usec): min=40, max=1157.3k, avg=41559.68, stdev=38538.17 lat (usec): min=40, max=1157.3k, avg=41565.10, stdev=38541.81 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11600], 10.00th=[ 15795], | 20.00th=[ 20579], 30.00th=[ 25560], 40.00th=[ 30540], | 50.00th=[ 35914], 60.00th=[ 41681], 70.00th=[ 49021], | 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[ 129500], 99.50th=[ 152044], 99.90th=[ 229639], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 104, per=25.03%, avg=54.31, stdev=19.93, samples=214 iops : min= 1, max= 26, avg=12.90, stdev= 5.02, samples=214 write: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6348KiB/108900msec); 0 zone resets clat (usec): min=824, max=231587, avg=29464.20, stdev=29721.02 lat (usec): min=825, max=231589, avg=29466.47, stdev=29721.59 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 1434], 20.00th=[ 3064], | 30.00th=[ 6259], 40.00th=[ 14353], 50.00th=[ 21890], 60.00th=[ 29230], | 70.00th=[ 38536], 80.00th=[ 51119], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[126354], 99.50th=[135267], 99.90th=[175113], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 151, per=25.57%, avg=58.04, stdev=25.20, samples=214 iops : min= 1, max= 37, avg=13.85, stdev= 6.33, samples=214 lat (usec) : 50=0.29%, 100=1.01%, 250=0.07%, 750=0.03%, 1000=0.29% lat (msec) : 2=7.42%, 4=4.17%, 10=7.13%, 20=12.79%, 50=42.42% lat (msec) : 100=21.39%, 250=2.96%, 2000=0.03% cpu : usr=0.09%, sys=5.79%, ctx=6329, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179717: Thu May 28 15:40:53 2026 read: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6028KiB/108801msec) clat (usec): min=35, max=306902, avg=39846.69, stdev=25962.90 lat (usec): min=36, max=306904, avg=39847.99, stdev=25962.93 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10421], 10.00th=[ 15270], 20.00th=[ 20579], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[126354], 99.50th=[147850], 99.90th=[202376], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 15, max= 119, per=25.63%, avg=55.61, stdev=21.69, samples=212 iops : min= 3, max= 29, avg=13.23, stdev= 5.44, samples=212 write: IOPS=14, BW=57.5KiB/s (58.9kB/s)(6260KiB/108801msec); 0 zone resets clat (usec): min=770, max=1068.6k, avg=30811.49, stdev=40180.34 lat (usec): min=771, max=1068.6k, avg=30819.32, stdev=40183.52 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1319], 10.00th=[ 1418], | 20.00th=[ 3130], 30.00th=[ 6587], 40.00th=[ 14091], | 50.00th=[ 22676], 60.00th=[ 30278], 70.00th=[ 40633], | 80.00th=[ 53216], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[ 129500], 99.50th=[ 166724], 99.90th=[ 208667], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 8, max= 158, per=25.31%, avg=57.45, stdev=23.66, samples=213 iops : min= 2, max= 39, avg=13.70, stdev= 5.94, samples=213 lat (usec) : 50=0.29%, 100=1.30%, 250=0.07%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.55% lat (msec) : 2=7.26%, 4=3.65%, 10=7.36%, 20=12.34%, 50=43.00% lat (msec) : 100=21.16%, 250=2.86%, 500=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.88%, ctx=6436, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179718: Thu May 28 15:40:53 2026 read: IOPS=14, BW=56.5KiB/s (57.9kB/s)(6052KiB/107073msec) clat (usec): min=42, max=206213, avg=40285.04, stdev=26412.43 lat (usec): min=42, max=206214, avg=40287.90, stdev=26414.63 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 9372], 10.00th=[ 15533], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[129500], 99.50th=[168821], 99.90th=[193987], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 15, max= 111, per=26.05%, avg=56.54, stdev=19.34, samples=209 iops : min= 3, max= 27, avg=13.47, stdev= 4.84, samples=209 write: IOPS=14, BW=58.2KiB/s (59.6kB/s)(6236KiB/107073msec); 0 zone resets clat (usec): min=752, max=1036.4k, avg=29354.00, stdev=38813.43 lat (usec): min=753, max=1036.4k, avg=29355.63, stdev=38813.43 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1336], 10.00th=[ 1467], | 20.00th=[ 3228], 30.00th=[ 6521], 40.00th=[ 13435], | 50.00th=[ 20841], 60.00th=[ 27657], 70.00th=[ 38011], | 80.00th=[ 50594], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[ 122160], 99.50th=[ 141558], 99.90th=[ 223347], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 157, per=25.49%, avg=57.86, stdev=24.48, samples=210 iops : min= 1, max= 39, avg=13.80, stdev= 6.18, samples=210 lat (usec) : 50=0.52%, 100=1.56%, 500=0.03%, 750=0.03%, 1000=0.29% lat (msec) : 2=6.74%, 4=4.59%, 10=6.87%, 20=13.12%, 50=42.81% lat (msec) : 100=20.38%, 250=3.03%, 2000=0.03% cpu : usr=0.08%, sys=5.61%, ctx=6246, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=217KiB/s (223kB/s), 54.2KiB/s-56.5KiB/s (55.6kB/s-57.9kB/s), io=23.4MiB (24.6MB), run=107073-110453msec WRITE: bw=228KiB/s (233kB/s), 57.0KiB/s-58.3KiB/s (58.4kB/s-59.7kB/s), io=24.6MiB (25.7MB), run=107073-110453msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179719: Thu May 28 15:41:29 2026 read: IOPS=10, BW=41.0KiB/s (42.0kB/s)(5992KiB/146007msec) clat (msec): min=4, max=1199, avg=37.70, stdev=44.71 lat (msec): min=4, max=1199, avg=37.70, stdev=44.71 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 107], | 99.00th=[ 163], 99.50th=[ 192], 99.90th=[ 226], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 190, per=25.12%, avg=41.20, stdev=28.79, samples=282 iops : min= 1, max= 47, avg= 9.62, stdev= 7.22, samples=282 write: IOPS=10, BW=43.1KiB/s (44.2kB/s)(6296KiB/146007msec); 0 zone resets clat (msec): min=7, max=294, avg=56.66, stdev=39.25 lat (msec): min=7, max=294, avg=56.66, stdev=39.25 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 110], 95.00th=[ 133], | 99.00th=[ 194], 99.50th=[ 230], 99.90th=[ 279], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 143, per=24.92%, avg=42.87, stdev=26.24, samples=285 iops : min= 1, max= 35, avg=10.04, stdev= 6.59, samples=285 lat (msec) : 10=4.17%, 20=18.26%, 50=44.73%, 100=23.24%, 250=9.44% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.07%, sys=2.25%, ctx=4832, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179720: Thu May 28 15:41:29 2026 read: IOPS=10, BW=40.8KiB/s (41.7kB/s)(5940KiB/145694msec) clat (msec): min=5, max=979, avg=36.18, stdev=39.33 lat (msec): min=5, max=979, avg=36.18, stdev=39.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 78], 95.00th=[ 103], | 99.00th=[ 159], 99.50th=[ 176], 99.90th=[ 236], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 167, per=25.32%, avg=41.52, stdev=29.97, samples=279 iops : min= 1, max= 41, avg= 9.71, stdev= 7.52, samples=279 write: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6348KiB/145694msec); 0 zone resets clat (msec): min=10, max=295, avg=57.64, stdev=41.94 lat (msec): min=10, max=295, avg=57.64, stdev=41.94 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 69], 80.00th=[ 87], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 234], 99.90th=[ 284], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 127, per=25.19%, avg=43.33, stdev=26.69, samples=286 iops : min= 1, max= 31, avg=10.16, stdev= 6.70, samples=286 lat (msec) : 10=3.22%, 20=20.25%, 50=44.82%, 100=21.94%, 250=9.57% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=2.19%, ctx=4957, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179721: Thu May 28 15:41:29 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6028KiB/145622msec) clat (msec): min=3, max=212, avg=37.34, stdev=32.60 lat (msec): min=3, max=212, avg=37.34, stdev=32.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 83], 95.00th=[ 111], | 99.00th=[ 163], 99.50th=[ 186], 99.90th=[ 207], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 7, max= 175, per=25.45%, avg=41.73, stdev=27.10, samples=282 iops : min= 1, max= 43, avg= 9.76, stdev= 6.79, samples=282 write: IOPS=10, BW=42.0KiB/s (44.0kB/s)(6260KiB/145622msec); 0 zone resets clat (msec): min=10, max=1100, avg=56.83, stdev=46.52 lat (msec): min=10, max=1100, avg=56.84, stdev=46.52 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 107], 95.00th=[ 131], | 99.00th=[ 184], 99.50th=[ 209], 99.90th=[ 326], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 167, per=25.02%, avg=43.04, stdev=26.46, samples=284 iops : min= 1, max= 41, avg=10.08, stdev= 6.64, samples=284 lat (msec) : 4=0.03%, 10=2.54%, 20=18.42%, 50=46.68%, 100=22.69% lat (msec) : 250=9.47%, 500=0.13%, 2000=0.03% cpu : usr=0.06%, sys=2.27%, ctx=4935, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179722: Thu May 28 15:41:29 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6052KiB/146102msec) clat (msec): min=5, max=200, avg=37.22, stdev=31.95 lat (msec): min=5, max=200, avg=37.22, stdev=31.95 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 153], 99.50th=[ 174], 99.90th=[ 192], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 7, max= 167, per=26.12%, avg=42.84, stdev=28.78, samples=276 iops : min= 1, max= 41, avg=10.03, stdev= 7.20, samples=276 write: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6236KiB/146102msec); 0 zone resets clat (msec): min=9, max=979, avg=57.27, stdev=46.54 lat (msec): min=9, max=979, avg=57.27, stdev=46.54 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 110], 95.00th=[ 140], | 99.00th=[ 205], 99.50th=[ 232], 99.90th=[ 321], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 127, per=24.65%, avg=42.39, stdev=26.73, samples=287 iops : min= 1, max= 31, avg= 9.92, stdev= 6.70, samples=287 lat (msec) : 10=3.61%, 20=19.04%, 50=44.47%, 100=23.05%, 250=9.67% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=2.21%, ctx=4875, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=164KiB/s (168kB/s), 40.8KiB/s-41.4KiB/s (41.7kB/s-42.4kB/s), io=23.4MiB (24.6MB), run=145622-146102msec WRITE: bw=172KiB/s (176kB/s), 42.7KiB/s-43.6KiB/s (43.7kB/s-44.6kB/s), io=24.6MiB (25.7MB), run=145622-146102msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179761: Thu May 28 15:42:18 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(5920KiB/32693msec) clat (usec): min=37, max=223273, avg=46821.66, stdev=31806.32 lat (usec): min=38, max=223274, avg=46823.57, stdev=31806.34 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 12649], 20.00th=[ 24773], | 30.00th=[ 29754], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[106431], | 99.00th=[145753], 99.50th=[179307], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 351, per=27.10%, avg=181.02, stdev=78.37, samples=64 iops : min= 1, max= 21, avg=10.50, stdev= 4.92, samples=64 write: IOPS=12, BW=195KiB/s (199kB/s)(6368KiB/32693msec); 0 zone resets clat (usec): min=1687, max=248370, avg=37835.56, stdev=38225.70 lat (usec): min=1689, max=248373, avg=37837.98, stdev=38225.76 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2089], 10.00th=[ 3458], 20.00th=[ 7046], | 30.00th=[ 11994], 40.00th=[ 17957], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 64226], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[170918], 99.50th=[208667], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 63, max= 351, per=27.74%, avg=194.98, stdev=71.24, samples=64 iops : min= 3, max= 21, avg=11.39, stdev= 4.48, samples=64 lat (usec) : 50=0.13%, 100=3.78%, 250=0.39%, 500=0.26% lat (msec) : 2=2.34%, 4=3.65%, 10=7.94%, 20=10.81%, 50=38.15% lat (msec) : 100=25.65%, 250=6.90% cpu : usr=0.06%, sys=5.62%, ctx=1671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179762: Thu May 28 15:42:18 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5744KiB/33222msec) clat (usec): min=40, max=219735, avg=50396.25, stdev=32894.12 lat (usec): min=40, max=219738, avg=50424.55, stdev=32917.05 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 82], 10.00th=[ 16319], 20.00th=[ 27919], | 30.00th=[ 33817], 40.00th=[ 40633], 50.00th=[ 45351], 60.00th=[ 51119], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[109577], | 99.00th=[166724], 99.50th=[191890], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 61, max= 287, per=25.90%, avg=173.02, stdev=55.88, samples=65 iops : min= 3, max= 17, avg=10.00, stdev= 3.54, samples=65 write: IOPS=12, BW=197KiB/s (202kB/s)(6544KiB/33222msec); 0 zone resets clat (usec): min=1256, max=273340, avg=36741.78, stdev=36980.38 lat (usec): min=1258, max=273340, avg=36765.65, stdev=36986.79 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2073], 10.00th=[ 3359], 20.00th=[ 7242], | 30.00th=[ 11863], 40.00th=[ 18220], 50.00th=[ 26084], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[112722], | 99.00th=[156238], 99.50th=[166724], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 447, per=27.77%, avg=195.22, stdev=81.61, samples=65 iops : min= 1, max= 27, avg=11.40, stdev= 5.16, samples=65 lat (usec) : 50=0.26%, 100=2.60%, 250=0.52%, 500=0.13%, 750=0.26% lat (msec) : 2=2.73%, 4=3.65%, 10=8.33%, 20=9.77%, 50=38.02% lat (msec) : 100=27.34%, 250=6.25%, 500=0.13% cpu : usr=0.08%, sys=5.79%, ctx=1683, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179763: Thu May 28 15:42:18 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35819msec) clat (usec): min=40, max=163887, avg=48861.64, stdev=30605.98 lat (usec): min=40, max=163889, avg=48863.57, stdev=30607.26 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 15139], 20.00th=[ 24773], | 30.00th=[ 31589], 40.00th=[ 38011], 50.00th=[ 45876], 60.00th=[ 52691], | 70.00th=[ 60556], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[132645], 99.50th=[149947], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 22, max= 409, per=26.25%, avg=175.37, stdev=83.98, samples=70 iops : min= 1, max= 25, avg=10.14, stdev= 5.29, samples=70 write: IOPS=10, BW=168KiB/s (172kB/s)(6032KiB/35819msec); 0 zone resets clat (usec): min=1251, max=330115, avg=43267.71, stdev=43143.33 lat (usec): min=1252, max=330117, avg=43271.88, stdev=43141.95 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2040], 10.00th=[ 3425], 20.00th=[ 7308], | 30.00th=[ 13829], 40.00th=[ 24249], 50.00th=[ 32900], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[196084], 99.50th=[291505], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 346, per=23.81%, avg=167.37, stdev=70.03, samples=70 iops : min= 1, max= 21, avg= 9.64, stdev= 4.41, samples=70 lat (usec) : 50=0.39%, 100=3.52%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.34%, 4=4.04%, 10=5.99%, 20=8.59%, 50=35.42% lat (msec) : 100=30.60%, 250=8.20%, 500=0.39% cpu : usr=0.07%, sys=5.37%, ctx=1778, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179764: Thu May 28 15:42:18 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(6032KiB/32810msec) clat (usec): min=41, max=250816, avg=49125.80, stdev=36334.27 lat (usec): min=41, max=250817, avg=49127.02, stdev=36334.29 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 91], 20.00th=[ 22676], | 30.00th=[ 30802], 40.00th=[ 36963], 50.00th=[ 43779], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 70779], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[164627], 99.50th=[229639], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 380, per=27.37%, avg=182.86, stdev=76.32, samples=64 iops : min= 1, max= 23, avg=10.61, stdev= 4.79, samples=64 write: IOPS=11, BW=191KiB/s (195kB/s)(6256KiB/32810msec); 0 zone resets clat (usec): min=1546, max=195298, avg=35663.52, stdev=36539.01 lat (usec): min=1547, max=195301, avg=35666.44, stdev=36538.74 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2147], 10.00th=[ 3392], 20.00th=[ 6915], | 30.00th=[ 10028], 40.00th=[ 14877], 50.00th=[ 21890], 60.00th=[ 31589], | 70.00th=[ 44827], 80.00th=[ 63177], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[179307], 99.50th=[185598], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 404, per=27.17%, avg=190.98, stdev=75.88, samples=64 iops : min= 1, max= 25, avg=11.12, stdev= 4.82, samples=64 lat (usec) : 50=0.65%, 100=4.56%, 250=0.52%, 1000=0.13% lat (msec) : 2=2.47%, 4=3.65%, 10=9.38%, 20=11.33%, 50=32.81% lat (msec) : 100=27.47%, 250=6.90%, 500=0.13% cpu : usr=0.07%, sys=5.64%, ctx=1662, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=669KiB/s (685kB/s), 173KiB/s-184KiB/s (177kB/s-188kB/s), io=23.4MiB (24.5MB), run=32693-35819msec WRITE: bw=704KiB/s (720kB/s), 168KiB/s-197KiB/s (172kB/s-202kB/s), io=24.6MiB (25.8MB), run=32693-35819msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179765: Thu May 28 15:42:30 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5920KiB/47597msec) clat (msec): min=7, max=229, avg=53.07, stdev=39.02 lat (msec): min=7, max=229, avg=53.07, stdev=39.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 58], 80.00th=[ 79], 90.00th=[ 115], 95.00th=[ 136], | 99.00th=[ 199], 99.50th=[ 213], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 448, per=24.95%, avg=124.24, stdev=71.90, samples=92 iops : min= 1, max= 28, avg= 6.95, stdev= 4.53, samples=92 write: IOPS=8, BW=134KiB/s (137kB/s)(6368KiB/47597msec); 0 zone resets clat (msec): min=13, max=304, avg=69.88, stdev=44.67 lat (msec): min=13, max=304, avg=69.89, stdev=44.67 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 83], 80.00th=[ 97], 90.00th=[ 133], 95.00th=[ 167], | 99.00th=[ 211], 99.50th=[ 247], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 23, max= 318, per=25.73%, avg=134.82, stdev=67.80, samples=92 iops : min= 1, max= 19, avg= 7.62, stdev= 4.29, samples=92 lat (msec) : 10=0.52%, 20=7.29%, 50=45.31%, 100=30.47%, 250=16.28% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.98%, ctx=1299, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179766: Thu May 28 15:42:30 2026 read: IOPS=7, BW=120KiB/s (122kB/s)(5744KiB/48028msec) clat (msec): min=7, max=248, avg=51.99, stdev=41.67 lat (msec): min=7, max=248, avg=51.99, stdev=41.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 109], 95.00th=[ 155], | 99.00th=[ 211], 99.50th=[ 228], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 23, max= 412, per=25.12%, avg=125.09, stdev=75.73, samples=89 iops : min= 1, max= 25, avg= 7.01, stdev= 4.79, samples=89 write: IOPS=8, BW=136KiB/s (140kB/s)(6544KiB/48028msec); 0 zone resets clat (msec): min=12, max=349, avg=70.99, stdev=46.14 lat (msec): min=12, max=349, avg=70.99, stdev=46.14 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 71], | 70.00th=[ 83], 80.00th=[ 103], 90.00th=[ 130], 95.00th=[ 153], | 99.00th=[ 259], 99.50th=[ 271], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 351, per=25.97%, avg=136.09, stdev=72.01, samples=93 iops : min= 1, max= 21, avg= 7.70, stdev= 4.56, samples=93 lat (msec) : 10=0.65%, 20=7.29%, 50=45.18%, 100=29.95%, 250=16.28% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=2.04%, ctx=1286, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179767: Thu May 28 15:42:30 2026 read: IOPS=8, BW=131KiB/s (135kB/s)(6256KiB/47621msec) clat (msec): min=6, max=230, avg=51.77, stdev=40.84 lat (msec): min=6, max=230, avg=51.77, stdev=40.84 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 72], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 199], 99.50th=[ 220], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 349, per=26.41%, avg=131.52, stdev=80.43, samples=93 iops : min= 1, max= 21, avg= 7.41, stdev= 5.07, samples=93 write: IOPS=7, BW=127KiB/s (130kB/s)(6032KiB/47621msec); 0 zone resets clat (msec): min=16, max=314, avg=71.91, stdev=47.68 lat (msec): min=16, max=314, avg=71.91, stdev=47.68 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 84], 80.00th=[ 106], 90.00th=[ 132], 95.00th=[ 167], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 29, max= 318, per=23.82%, avg=124.80, stdev=67.36, samples=93 iops : min= 1, max= 19, avg= 6.98, stdev= 4.23, samples=93 lat (msec) : 10=0.52%, 20=8.20%, 50=44.27%, 100=29.17%, 250=17.06% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=2.12%, ctx=1365, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179768: Thu May 28 15:42:30 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(6032KiB/47499msec) clat (msec): min=9, max=259, avg=50.55, stdev=37.49 lat (msec): min=9, max=259, avg=50.55, stdev=37.49 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 107], 95.00th=[ 130], | 99.00th=[ 194], 99.50th=[ 213], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 316, per=26.09%, avg=129.92, stdev=71.93, samples=90 iops : min= 1, max= 19, avg= 7.30, stdev= 4.56, samples=90 write: IOPS=8, BW=132KiB/s (135kB/s)(6256KiB/47499msec); 0 zone resets clat (msec): min=14, max=332, avg=71.83, stdev=46.88 lat (msec): min=14, max=332, avg=71.83, stdev=46.88 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 57], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 105], 90.00th=[ 130], 95.00th=[ 157], | 99.00th=[ 259], 99.50th=[ 300], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 448, per=25.05%, avg=131.26, stdev=69.45, samples=93 iops : min= 1, max= 28, avg= 7.40, stdev= 4.41, samples=93 lat (msec) : 10=0.65%, 20=5.60%, 50=45.31%, 100=31.90%, 250=15.63% lat (msec) : 500=0.91% cpu : usr=0.06%, sys=2.00%, ctx=1280, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=499KiB/s (511kB/s), 120KiB/s-131KiB/s (122kB/s-135kB/s), io=23.4MiB (24.5MB), run=47499-48028msec WRITE: bw=525KiB/s (537kB/s), 127KiB/s-136KiB/s (130kB/s-140kB/s), io=24.6MiB (25.8MB), run=47499-48028msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179782: Thu May 28 15:42:47 2026 read: IOPS=1, BW=1952KiB/s (1999kB/s)(7168KiB/3672msec) clat (usec): min=490, max=202893, avg=141180.30, stdev=81418.89 lat (usec): min=492, max=202896, avg=141181.83, stdev=81419.16 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 49021], | 30.00th=[170918], 40.00th=[170918], 50.00th=[183501], 60.00th=[185598], | 70.00th=[185598], 80.00th=[196084], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 2007, max= 4087, per=77.96%, avg=3038.00, stdev=1040.12, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1394KiB/s (1428kB/s)(5120KiB/3672msec); 0 zone resets clat (msec): min=108, max=1309, avg=462.69, stdev=487.89 lat (msec): min=108, max=1309, avg=462.77, stdev=487.90 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1759, max= 2043, per=35.56%, avg=1940.33, stdev=157.50, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=11.17%, ctx=204, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179783: Thu May 28 15:42:47 2026 read: IOPS=0, BW=390KiB/s (399kB/s)(2048KiB/5255msec) clat (msec): min=3, max=1848, avg=926.26, stdev=1304.35 lat (msec): min=3, max=1848, avg=926.26, stdev=1304.35 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 4], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 2019, max= 2035, per=52.01%, avg=2027.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1949KiB/s (1995kB/s)(10.0MiB/5255msec); 0 zone resets clat (msec): min=148, max=968, avg=322.84, stdev=237.44 lat (msec): min=149, max=969, avg=323.03, stdev=237.60 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 153], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 275], 60.00th=[ 305], | 70.00th=[ 313], 80.00th=[ 321], 90.00th=[ 338], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2039, max= 6119, per=74.73%, avg=4077.00, stdev=1665.66, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=12.50%, ctx=205, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179784: Thu May 28 15:42:47 2026 read: IOPS=2, BW=2190KiB/s (2242kB/s)(6144KiB/2806msec) clat (usec): min=536, max=231364, avg=73833.55, stdev=108771.36 lat (usec): min=537, max=231365, avg=73834.53, stdev=108771.38 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 1012], | 30.00th=[ 1012], 40.00th=[ 5211], 50.00th=[ 5211], 60.00th=[ 9372], | 70.00th=[196084], 80.00th=[196084], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 2039, max= 4039, per=86.33%, avg=3364.33, stdev=1147.84, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2190KiB/s (2242kB/s)(6144KiB/2806msec); 0 zone resets clat (msec): min=189, max=631, avg=337.89, stdev=159.95 lat (msec): min=189, max=631, avg=338.22, stdev=159.99 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 359], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1484, max= 4079, per=42.64%, avg=2326.40, stdev=1007.23, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=16.67%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=12.69%, ctx=110, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179785: Thu May 28 15:42:47 2026 read: IOPS=1, BW=1522KiB/s (1559kB/s)(5120KiB/3364msec) clat (usec): min=587, max=943053, avg=237803.36, stdev=402230.98 lat (usec): min=588, max=943053, avg=237804.43, stdev=402230.59 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 586], | 30.00th=[ 7898], 40.00th=[ 7898], 50.00th=[ 40109], 60.00th=[ 40109], | 70.00th=[198181], 80.00th=[198181], 90.00th=[943719], 95.00th=[943719], | 99.00th=[943719], 99.50th=[943719], 99.90th=[943719], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 2043, max= 6059, per=100.00%, avg=4051.00, stdev=2839.74, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2131KiB/s (2182kB/s)(7168KiB/3364msec); 0 zone resets clat (msec): min=184, max=517, avg=308.11, stdev=110.72 lat (msec): min=185, max=517, avg=308.23, stdev=110.69 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 209], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 284], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 359], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 2039, max= 4087, per=58.13%, avg=3171.75, stdev=867.42, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 50=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=12.34%, ctx=126, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3897KiB/s (3991kB/s), 390KiB/s-2190KiB/s (399kB/s-2242kB/s), io=20.0MiB (20.0MB), run=2806-5255msec WRITE: bw=5456KiB/s (5587kB/s), 1394KiB/s-2190KiB/s (1428kB/s-2242kB/s), io=28.0MiB (29.4MB), run=2806-5255msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179787: Thu May 28 15:42:48 2026 read: IOPS=1, BW=1652KiB/s (1691kB/s)(7168KiB/4340msec) clat (msec): min=78, max=664, avg=303.43, stdev=248.06 lat (msec): min=78, max=664, avg=303.43, stdev=248.06 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 80], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 174], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 575], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1475, max= 4087, per=68.48%, avg=2335.00, stdev=1009.25, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1180KiB/s (1208kB/s)(5120KiB/4340msec); 0 zone resets clat (msec): min=149, max=1025, avg=419.90, stdev=351.25 lat (msec): min=149, max=1026, avg=419.98, stdev=351.27 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1917, max= 4071, per=70.07%, avg=3345.00, stdev=1236.74, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.93%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179788: Thu May 28 15:42:48 2026 read: IOPS=0, BW=341KiB/s (349kB/s)(2048KiB/6005msec) clat (msec): min=163, max=2142, avg=1152.79, stdev=1399.08 lat (msec): min=163, max=2142, avg=1152.79, stdev=1399.08 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 2140], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 1917, max= 2007, per=57.54%, avg=1962.00, stdev=63.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1705KiB/s (1746kB/s)(10.0MiB/6005msec); 0 zone resets clat (msec): min=109, max=637, avg=332.41, stdev=169.87 lat (msec): min=109, max=637, avg=332.50, stdev=169.88 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 161], | 30.00th=[ 167], 40.00th=[ 271], 50.00th=[ 292], 60.00th=[ 338], | 70.00th=[ 372], 80.00th=[ 443], 90.00th=[ 535], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1943, max= 6107, per=76.04%, avg=3630.20, stdev=2228.59, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=4.21%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179789: Thu May 28 15:42:48 2026 read: IOPS=1, BW=1102KiB/s (1128kB/s)(6144KiB/5576msec) clat (msec): min=182, max=437, avg=329.72, stdev=107.58 lat (msec): min=182, max=437, avg=329.72, stdev=107.58 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 384], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1943, max= 2043, per=58.95%, avg=2010.20, stdev=39.94, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1102KiB/s (1128kB/s)(6144KiB/5576msec); 0 zone resets clat (msec): min=177, max=2198, avg=545.40, stdev=810.23 lat (msec): min=177, max=2198, avg=545.65, stdev=810.18 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 236], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1917, max= 4087, per=50.23%, avg=2397.80, stdev=945.48, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.30%, ctx=114, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179790: Thu May 28 15:42:48 2026 read: IOPS=0, BW=878KiB/s (899kB/s)(5120KiB/5832msec) clat (msec): min=72, max=665, avg=280.79, stdev=237.95 lat (msec): min=72, max=665, avg=280.79, stdev=237.95 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2023, max= 4015, per=78.91%, avg=2691.00, stdev=1146.63, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1229KiB/s (1259kB/s)(7168KiB/5832msec); 0 zone resets clat (msec): min=113, max=2531, avg=623.13, stdev=851.86 lat (msec): min=114, max=2531, avg=623.22, stdev=851.86 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 167], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 368], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 477], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1943, max= 3835, per=51.55%, avg=2461.00, stdev=917.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.04%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3410KiB/s (3492kB/s), 341KiB/s-1652KiB/s (349kB/s-1691kB/s), io=20.0MiB (20.0MB), run=4340-6005msec WRITE: bw=4775KiB/s (4889kB/s), 1102KiB/s-1705KiB/s (1128kB/s-1746kB/s), io=28.0MiB (29.4MB), run=4340-6005msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179797: Thu May 28 15:43:04 2026 read: IOPS=1, BW=6554KiB/s (6711kB/s)(12.0MiB/1875msec) clat (msec): min=316, max=794, avg=611.19, stdev=257.44 lat (msec): min=316, max=794, avg=611.19, stdev=257.44 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7846, max= 8159, per=100.00%, avg=8002.50, stdev=221.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.71%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179798: Thu May 28 15:43:04 2026 read: IOPS=0, BW=1123KiB/s (1150kB/s)(4096KiB/3648msec) clat (nsec): min=1661.3M, max=1661.3M, avg=1661339140.00, stdev= 0.00 lat (nsec): min=1661.3M, max=1661.3M, avg=1661342195.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1670], 5.00th=[ 1670], 10.00th=[ 1670], 20.00th=[ 1670], | 30.00th=[ 1670], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2246KiB/s (2300kB/s)(8192KiB/3648msec); 0 zone resets clat (msec): min=875, max=1033, avg=954.47, stdev=111.61 lat (msec): min=877, max=1033, avg=955.49, stdev=110.62 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8126, max= 8126, per=90.47%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.43%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179799: Thu May 28 15:43:04 2026 write: IOPS=0, BW=3908KiB/s (4002kB/s)(12.0MiB/3144msec); 0 zone resets clat (msec): min=356, max=1616, avg=1015.35, stdev=631.62 lat (msec): min=357, max=1616, avg=1015.67, stdev=631.66 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8159, max= 8192, per=91.02%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.71%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179800: Thu May 28 15:43:04 2026 write: IOPS=1, BW=4361KiB/s (4465kB/s)(12.0MiB/2818msec); 0 zone resets clat (msec): min=233, max=1507, avg=914.82, stdev=641.79 lat (msec): min=233, max=1508, avg=915.27, stdev=641.72 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 5859, max= 8192, per=78.22%, avg=7025.50, stdev=1649.68, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.07%, sys=5.18%, ctx=99, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4491KiB/s (4599kB/s), 1123KiB/s-6554KiB/s (1150kB/s-6711kB/s), io=16.0MiB (16.8MB), run=1875-3648msec WRITE: bw=8982KiB/s (9198kB/s), 2246KiB/s-4361KiB/s (2300kB/s-4465kB/s), io=32.0MiB (33.6MB), run=2818-3648msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179801: Thu May 28 15:43:04 2026 read: IOPS=1, BW=4953KiB/s (5072kB/s)(12.0MiB/2481msec) clat (msec): min=632, max=888, avg=762.93, stdev=128.18 lat (msec): min=632, max=888, avg=762.93, stdev=128.18 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=12.74%, ctx=484, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179802: Thu May 28 15:43:04 2026 read: IOPS=0, BW=1288KiB/s (1319kB/s)(4096KiB/3179msec) clat (nsec): min=724333k, max=724333k, avg=724333185.00, stdev= 0.00 lat (nsec): min=724336k, max=724336k, avg=724335538.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2577KiB/s (2639kB/s)(8192KiB/3179msec); 0 zone resets clat (msec): min=581, max=1746, avg=1163.74, stdev=823.52 lat (msec): min=581, max=1746, avg=1164.25, stdev=823.67 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8062, max= 8062, per=88.90%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.64%, ctx=114, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179803: Thu May 28 15:43:04 2026 write: IOPS=0, BW=3401KiB/s (3483kB/s)(12.0MiB/3613msec); 0 zone resets clat (msec): min=181, max=2197, avg=1130.93, stdev=1013.14 lat (msec): min=181, max=2197, avg=1131.21, stdev=1013.10 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8047, max= 8047, per=88.73%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.30%, ctx=46, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179804: Thu May 28 15:43:04 2026 write: IOPS=0, BW=3725KiB/s (3814kB/s)(12.0MiB/3299msec); 0 zone resets clat (msec): min=275, max=1945, avg=1074.26, stdev=837.33 lat (msec): min=275, max=1945, avg=1074.95, stdev=837.31 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 7937, max= 8159, per=88.74%, avg=8048.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.55%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5154KiB/s (5278kB/s), 1288KiB/s-4953KiB/s (1319kB/s-5072kB/s), io=16.0MiB (16.8MB), run=2481-3179msec WRITE: bw=9069KiB/s (9287kB/s), 2577KiB/s-3725KiB/s (2639kB/s-3814kB/s), io=32.0MiB (33.6MB), run=3179-3613msec