== sanity test 398b: DIO and buffer IO race ============== 11:38:51 (1772469531) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.49733 s, 9.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181543: Mon Mar 2 11:41:00 2026 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(5992KiB/111331msec) clat (usec): min=105, max=287210, avg=40490.93, stdev=27330.89 lat (usec): min=106, max=287210, avg=40492.26, stdev=27330.85 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 3949], 10.00th=[ 13698], 20.00th=[ 19792], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 47973], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[130548], 99.50th=[149947], 99.90th=[177210], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 111, per=24.85%, avg=53.43, stdev=19.06, samples=218 iops : min= 1, max= 27, avg=12.72, stdev= 4.78, samples=218 write: IOPS=14, BW=56.6KiB/s (57.9kB/s)(6296KiB/111331msec); 0 zone resets clat (usec): min=726, max=322694, avg=32106.01, stdev=34770.29 lat (usec): min=727, max=322695, avg=32108.11, stdev=34769.74 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1106], 10.00th=[ 1221], 20.00th=[ 2638], | 30.00th=[ 6849], 40.00th=[ 14091], 50.00th=[ 22676], 60.00th=[ 29754], | 70.00th=[ 40633], 80.00th=[ 57410], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[152044], 99.50th=[181404], 99.90th=[316670], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 127, per=24.87%, avg=55.96, stdev=24.69, samples=219 iops : min= 1, max= 31, avg=13.36, stdev= 6.23, samples=219 lat (usec) : 250=1.99%, 500=0.16%, 750=0.07%, 1000=0.55% lat (msec) : 2=7.98%, 4=3.97%, 10=5.83%, 20=13.05%, 50=40.72% lat (msec) : 100=21.71%, 250=3.87%, 500=0.10% cpu : usr=0.08%, sys=5.23%, ctx=6295, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181544: Mon Mar 2 11:41:00 2026 read: IOPS=13, BW=53.7KiB/s (55.0kB/s)(5940KiB/110569msec) clat (usec): min=116, max=395527, avg=42408.66, stdev=31228.31 lat (usec): min=117, max=395528, avg=42410.23, stdev=31228.16 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 9634], 10.00th=[ 15139], 20.00th=[ 20317], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[162530], 99.50th=[181404], 99.90th=[261096], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 5, max= 127, per=24.79%, avg=53.29, stdev=20.58, samples=218 iops : min= 1, max= 31, avg=12.69, stdev= 5.17, samples=218 write: IOPS=14, BW=57.4KiB/s (58.8kB/s)(6348KiB/110569msec); 0 zone resets clat (usec): min=751, max=241741, avg=29884.20, stdev=33082.03 lat (usec): min=753, max=241743, avg=29887.22, stdev=33082.28 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 2442], | 30.00th=[ 5800], 40.00th=[ 12256], 50.00th=[ 20317], 60.00th=[ 28443], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[145753], 99.50th=[193987], 99.90th=[225444], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 135, per=25.32%, avg=56.97, stdev=25.51, samples=218 iops : min= 1, max= 33, avg=13.61, stdev= 6.41, samples=218 lat (usec) : 250=1.56%, 500=0.23%, 1000=0.39% lat (msec) : 2=9.05%, 4=3.78%, 10=6.71%, 20=13.38%, 50=39.88% lat (msec) : 100=20.90%, 250=4.04%, 500=0.10% cpu : usr=0.07%, sys=5.21%, ctx=6193, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181545: Mon Mar 2 11:41:00 2026 read: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6028KiB/110691msec) clat (usec): min=119, max=287213, avg=41004.96, stdev=28994.03 lat (usec): min=120, max=287215, avg=41006.08, stdev=28994.05 clat percentiles (usec): | 1.00th=[ 155], 5.00th=[ 9372], 10.00th=[ 14222], 20.00th=[ 19792], | 30.00th=[ 24511], 40.00th=[ 28967], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[149947], 99.50th=[166724], 99.90th=[231736], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 111, per=25.15%, avg=54.07, stdev=19.91, samples=218 iops : min= 1, max= 27, avg=12.88, stdev= 5.00, samples=218 write: IOPS=14, BW=56.6KiB/s (57.9kB/s)(6260KiB/110691msec); 0 zone resets clat (usec): min=781, max=261731, avg=31157.59, stdev=32816.38 lat (usec): min=782, max=261733, avg=31159.37, stdev=32816.47 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1106], 10.00th=[ 1205], 20.00th=[ 2704], | 30.00th=[ 7046], 40.00th=[ 15139], 50.00th=[ 22414], 60.00th=[ 29754], | 70.00th=[ 39584], 80.00th=[ 53740], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[166724], 99.90th=[256902], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 134, per=24.95%, avg=56.14, stdev=24.38, samples=218 iops : min= 1, max= 33, avg=13.40, stdev= 6.12, samples=218 lat (usec) : 250=1.56%, 500=0.16%, 750=0.07%, 1000=0.42% lat (msec) : 2=8.50%, 4=3.74%, 10=5.73%, 20=13.41%, 50=41.34% lat (msec) : 100=21.42%, 250=3.55%, 500=0.10% cpu : usr=0.08%, sys=5.32%, ctx=6190, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181546: Mon Mar 2 11:41:00 2026 read: IOPS=13, BW=55.0KiB/s (56.3kB/s)(6052KiB/110013msec) clat (usec): min=100, max=196313, avg=40894.77, stdev=26905.49 lat (usec): min=101, max=196314, avg=40896.76, stdev=26906.58 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 10552], 10.00th=[ 14615], 20.00th=[ 19792], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[160433], 99.90th=[193987], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 7, max= 118, per=25.39%, avg=54.59, stdev=21.69, samples=217 iops : min= 1, max= 29, avg=13.01, stdev= 5.45, samples=217 write: IOPS=14, BW=56.7KiB/s (58.0kB/s)(6236KiB/110013msec); 0 zone resets clat (usec): min=700, max=242881, avg=30772.30, stdev=32185.47 lat (usec): min=701, max=242883, avg=30778.38, stdev=32184.97 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1106], 10.00th=[ 1188], 20.00th=[ 2147], | 30.00th=[ 5735], 40.00th=[ 13173], 50.00th=[ 21627], 60.00th=[ 30278], | 70.00th=[ 42206], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[135267], 99.50th=[154141], 99.90th=[179307], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 135, per=24.98%, avg=56.21, stdev=23.72, samples=217 iops : min= 1, max= 33, avg=13.42, stdev= 5.97, samples=217 lat (usec) : 250=1.46%, 500=0.20%, 750=0.13%, 1000=0.68% lat (msec) : 2=9.02%, 4=3.55%, 10=5.66%, 20=13.64%, 50=40.69% lat (msec) : 100=21.29%, 250=3.68% cpu : usr=0.08%, sys=5.09%, ctx=6149, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=216KiB/s (221kB/s), 53.7KiB/s-55.0KiB/s (55.0kB/s-56.3kB/s), io=23.4MiB (24.6MB), run=110013-111331msec WRITE: bw=226KiB/s (231kB/s), 56.6KiB/s-57.4KiB/s (57.9kB/s-58.8kB/s), io=24.6MiB (25.7MB), run=110013-111331msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181538: Mon Mar 2 11:41:41 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(5992KiB/153268msec) clat (msec): min=5, max=677, avg=39.76, stdev=39.14 lat (msec): min=5, max=677, avg=39.76, stdev=39.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 84], 95.00th=[ 110], | 99.00th=[ 186], 99.50th=[ 211], 99.90th=[ 279], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 135, per=25.39%, avg=39.61, stdev=24.89, samples=295 iops : min= 1, max= 33, avg= 9.26, stdev= 6.27, samples=295 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6296KiB/153268msec); 0 zone resets clat (msec): min=8, max=438, avg=59.34, stdev=43.90 lat (msec): min=8, max=438, avg=59.35, stdev=43.90 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 87], 90.00th=[ 115], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 288], 99.90th=[ 397], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 151, per=25.02%, avg=41.04, stdev=24.15, samples=299 iops : min= 1, max= 37, avg= 9.62, stdev= 6.07, samples=299 lat (msec) : 10=2.80%, 20=16.93%, 50=45.48%, 100=24.41%, 250=9.93% lat (msec) : 500=0.42%, 750=0.03% cpu : usr=0.07%, sys=1.84%, ctx=4829, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181539: Mon Mar 2 11:41:41 2026 read: IOPS=9, BW=38.9KiB/s (39.9kB/s)(5940KiB/152509msec) clat (msec): min=5, max=707, avg=40.49, stdev=39.48 lat (msec): min=5, max=707, avg=40.50, stdev=39.48 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 89], 95.00th=[ 116], | 99.00th=[ 174], 99.50th=[ 205], 99.90th=[ 309], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 151, per=25.15%, avg=39.24, stdev=25.75, samples=295 iops : min= 1, max= 37, avg= 9.17, stdev= 6.45, samples=295 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6348KiB/152509msec); 0 zone resets clat (msec): min=8, max=373, avg=58.01, stdev=40.70 lat (msec): min=8, max=373, avg=58.02, stdev=40.70 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 199], 99.50th=[ 268], 99.90th=[ 363], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 151, per=25.07%, avg=41.11, stdev=24.35, samples=300 iops : min= 1, max= 37, avg= 9.64, stdev= 6.14, samples=300 lat (msec) : 10=2.86%, 20=16.89%, 50=44.76%, 100=25.46%, 250=9.67% lat (msec) : 500=0.33%, 750=0.03% cpu : usr=0.06%, sys=1.83%, ctx=4728, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181540: Mon Mar 2 11:41:41 2026 read: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6028KiB/152676msec) clat (msec): min=4, max=254, avg=39.54, stdev=34.49 lat (msec): min=4, max=254, avg=39.54, stdev=34.49 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 176], 99.50th=[ 197], 99.90th=[ 230], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 159, per=25.58%, avg=39.91, stdev=25.02, samples=295 iops : min= 1, max= 39, avg= 9.33, stdev= 6.30, samples=295 write: IOPS=10, BW=41.0KiB/s (41.0kB/s)(6260KiB/152676msec); 0 zone resets clat (msec): min=10, max=737, avg=59.28, stdev=44.61 lat (msec): min=10, max=737, avg=59.29, stdev=44.60 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 109], 95.00th=[ 136], | 99.00th=[ 199], 99.50th=[ 288], 99.90th=[ 451], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 120, per=24.94%, avg=40.90, stdev=22.84, samples=299 iops : min= 1, max= 30, avg= 9.58, stdev= 5.74, samples=299 lat (msec) : 10=2.51%, 20=15.79%, 50=46.45%, 100=25.52%, 250=9.38% lat (msec) : 500=0.33%, 750=0.03% cpu : usr=0.05%, sys=1.85%, ctx=4879, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181541: Mon Mar 2 11:41:41 2026 read: IOPS=9, BW=39.6KiB/s (40.5kB/s)(6052KiB/153009msec) clat (msec): min=4, max=330, avg=38.20, stdev=33.63 lat (msec): min=4, max=330, avg=38.20, stdev=33.63 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 82], 95.00th=[ 106], | 99.00th=[ 161], 99.50th=[ 203], 99.90th=[ 288], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 143, per=25.93%, avg=40.46, stdev=26.45, samples=291 iops : min= 1, max= 35, avg= 9.47, stdev= 6.64, samples=291 write: IOPS=10, BW=40.8KiB/s (41.7kB/s)(6236KiB/153009msec); 0 zone resets clat (msec): min=8, max=729, avg=60.87, stdev=46.53 lat (msec): min=8, max=729, avg=60.87, stdev=46.52 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 87], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 249], 99.50th=[ 288], 99.90th=[ 376], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 120, per=24.61%, avg=40.35, stdev=23.28, samples=300 iops : min= 1, max= 30, avg= 9.44, stdev= 5.86, samples=300 lat (msec) : 10=3.35%, 20=16.44%, 50=44.73%, 100=25.68%, 250=9.24% lat (msec) : 500=0.52%, 750=0.03% cpu : usr=0.05%, sys=1.87%, ctx=4792, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=157KiB/s (160kB/s), 38.9KiB/s-39.6KiB/s (39.9kB/s-40.5kB/s), io=23.4MiB (24.6MB), run=152509-153268msec WRITE: bw=164KiB/s (168kB/s), 40.8KiB/s-41.6KiB/s (41.7kB/s-42.6kB/s), io=24.6MiB (25.7MB), run=152509-153268msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181587: Mon Mar 2 11:42:26 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(5920KiB/32882msec) clat (usec): min=111, max=326382, avg=47410.69, stdev=32733.25 lat (usec): min=111, max=326382, avg=47412.00, stdev=32733.23 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 10814], 10.00th=[ 18220], 20.00th=[ 24511], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 40109], 60.00th=[ 45876], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[156238], 99.50th=[177210], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 319, per=25.62%, avg=177.30, stdev=68.22, samples=64 iops : min= 1, max= 19, avg=10.33, stdev= 4.29, samples=64 write: IOPS=12, BW=194KiB/s (198kB/s)(6368KiB/32882msec); 0 zone resets clat (usec): min=1396, max=272146, avg=38139.11, stdev=41466.25 lat (usec): min=1402, max=272148, avg=38143.74, stdev=41468.97 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1762], 10.00th=[ 2376], 20.00th=[ 5080], | 30.00th=[ 11207], 40.00th=[ 17695], 50.00th=[ 24511], 60.00th=[ 31851], | 70.00th=[ 46400], 80.00th=[ 64226], 90.00th=[ 89654], 95.00th=[117965], | 99.00th=[196084], 99.50th=[246416], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 476, per=26.44%, avg=192.47, stdev=89.06, samples=64 iops : min= 1, max= 29, avg=11.30, stdev= 5.59, samples=64 lat (usec) : 250=1.69%, 500=0.52% lat (msec) : 2=4.43%, 4=3.52%, 10=6.38%, 20=11.59%, 50=40.62% lat (msec) : 100=24.74%, 250=6.25%, 500=0.26% cpu : usr=0.08%, sys=5.54%, ctx=1683, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181588: Mon Mar 2 11:42:26 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5744KiB/33163msec) clat (usec): min=133, max=251930, avg=48794.10, stdev=35692.45 lat (usec): min=135, max=251932, avg=48795.40, stdev=35692.32 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 186], 10.00th=[ 14222], 20.00th=[ 25035], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[123208], | 99.00th=[189793], 99.50th=[219153], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 349, per=24.82%, avg=171.78, stdev=74.75, samples=65 iops : min= 1, max= 21, avg= 9.98, stdev= 4.75, samples=65 write: IOPS=12, BW=197KiB/s (202kB/s)(6544KiB/33163msec); 0 zone resets clat (usec): min=1357, max=201123, avg=37515.41, stdev=36833.91 lat (usec): min=1359, max=201125, avg=37517.44, stdev=36833.93 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1713], 10.00th=[ 2868], 20.00th=[ 6718], | 30.00th=[ 11600], 40.00th=[ 18744], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 63701], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[162530], 99.50th=[179307], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 380, per=26.90%, avg=195.83, stdev=75.68, samples=65 iops : min= 1, max= 23, avg=11.52, stdev= 4.77, samples=65 lat (usec) : 250=2.73%, 500=0.26%, 1000=0.26% lat (msec) : 2=4.17%, 4=2.99%, 10=7.55%, 20=10.94%, 50=38.80% lat (msec) : 100=24.48%, 250=7.68%, 500=0.13% cpu : usr=0.07%, sys=5.50%, ctx=1658, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181589: Mon Mar 2 11:42:26 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34589msec) clat (usec): min=117, max=196104, avg=50492.02, stdev=33627.77 lat (usec): min=118, max=196106, avg=50497.66, stdev=33630.07 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 184], 10.00th=[ 16712], 20.00th=[ 24249], | 30.00th=[ 30278], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 51119], | 70.00th=[ 62653], 80.00th=[ 74974], 90.00th=[ 92799], 95.00th=[108528], | 99.00th=[179307], 99.50th=[183501], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 345, per=26.12%, avg=180.74, stdev=68.08, samples=68 iops : min= 1, max= 21, avg=10.56, stdev= 4.28, samples=68 write: IOPS=10, BW=174KiB/s (179kB/s)(6032KiB/34589msec); 0 zone resets clat (usec): min=1111, max=219294, avg=38776.76, stdev=34943.35 lat (usec): min=1113, max=219296, avg=38779.69, stdev=34942.46 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1729], 10.00th=[ 3097], 20.00th=[ 7111], | 30.00th=[ 15270], 40.00th=[ 21103], 50.00th=[ 29230], 60.00th=[ 38011], | 70.00th=[ 52691], 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[105382], | 99.00th=[145753], 99.50th=[196084], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 377, per=24.08%, avg=175.28, stdev=73.62, samples=67 iops : min= 1, max= 23, avg=10.22, stdev= 4.64, samples=67 lat (usec) : 250=2.86%, 500=0.13%, 750=0.13% lat (msec) : 2=3.78%, 4=2.99%, 10=5.60%, 20=10.81%, 50=36.20% lat (msec) : 100=30.47%, 250=7.03% cpu : usr=0.08%, sys=5.07%, ctx=1784, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181590: Mon Mar 2 11:42:26 2026 read: IOPS=11, BW=190KiB/s (195kB/s)(6032KiB/31723msec) clat (usec): min=113, max=303185, avg=44747.56, stdev=34705.80 lat (usec): min=113, max=303187, avg=44748.82, stdev=34705.82 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 165], 10.00th=[ 758], 20.00th=[ 19268], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 64750], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[156238], 99.50th=[181404], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 57, max= 407, per=27.28%, avg=188.76, stdev=72.67, samples=62 iops : min= 3, max= 25, avg=11.03, stdev= 4.57, samples=62 write: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31723msec); 0 zone resets clat (usec): min=1281, max=211643, avg=37408.21, stdev=37821.30 lat (usec): min=1282, max=211645, avg=37411.06, stdev=37820.68 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1696], 10.00th=[ 2671], 20.00th=[ 6652], | 30.00th=[ 10945], 40.00th=[ 18482], 50.00th=[ 26084], 60.00th=[ 34341], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 95945], 95.00th=[113771], | 99.00th=[173016], 99.50th=[202376], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 62, max= 412, per=27.11%, avg=197.34, stdev=86.80, samples=62 iops : min= 3, max= 25, avg=11.58, stdev= 5.48, samples=62 lat (usec) : 250=4.56%, 500=0.26%, 1000=0.26% lat (msec) : 2=4.04%, 4=4.04%, 10=6.90%, 20=12.24%, 50=36.46% lat (msec) : 100=23.83%, 250=7.29%, 500=0.13% cpu : usr=0.07%, sys=5.42%, ctx=1623, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=692KiB/s (709kB/s), 173KiB/s-190KiB/s (177kB/s-195kB/s), io=23.4MiB (24.5MB), run=31723-34589msec WRITE: bw=729KiB/s (746kB/s), 174KiB/s-197KiB/s (179kB/s-202kB/s), io=24.6MiB (25.8MB), run=31723-34589msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181583: Mon Mar 2 11:42:38 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5920KiB/45442msec) clat (msec): min=7, max=228, avg=46.94, stdev=36.33 lat (msec): min=7, max=228, avg=46.95, stdev=36.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 55], 80.00th=[ 68], 90.00th=[ 94], 95.00th=[ 122], | 99.00th=[ 186], 99.50th=[ 226], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 30, max= 381, per=24.93%, avg=128.90, stdev=79.69, samples=89 iops : min= 1, max= 23, avg= 7.24, stdev= 5.04, samples=89 write: IOPS=8, BW=140KiB/s (143kB/s)(6368KiB/45442msec); 0 zone resets clat (msec): min=11, max=293, avg=70.02, stdev=46.12 lat (msec): min=11, max=293, avg=70.02, stdev=46.12 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 68], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 128], 95.00th=[ 161], | 99.00th=[ 239], 99.50th=[ 279], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 320, per=25.66%, avg=139.57, stdev=68.59, samples=89 iops : min= 1, max= 20, avg= 7.92, stdev= 4.36, samples=89 lat (msec) : 10=1.04%, 20=10.29%, 50=41.93%, 100=33.07%, 250=13.28% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.80%, ctx=1240, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181584: Mon Mar 2 11:42:38 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5744KiB/45231msec) clat (msec): min=5, max=324, avg=48.67, stdev=43.01 lat (msec): min=5, max=324, avg=48.71, stdev=42.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 105], 95.00th=[ 134], | 99.00th=[ 226], 99.50th=[ 271], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 415, per=25.17%, avg=130.12, stdev=82.75, samples=86 iops : min= 1, max= 25, avg= 7.33, stdev= 5.23, samples=86 write: IOPS=9, BW=145KiB/s (148kB/s)(6544KiB/45231msec); 0 zone resets clat (msec): min=12, max=245, avg=67.63, stdev=42.47 lat (msec): min=12, max=245, avg=67.64, stdev=42.47 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 100], 90.00th=[ 130], 95.00th=[ 150], | 99.00th=[ 213], 99.50th=[ 239], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 30, max= 375, per=26.50%, avg=144.13, stdev=81.79, samples=89 iops : min= 1, max= 23, avg= 8.20, stdev= 5.18, samples=89 lat (msec) : 10=1.17%, 20=8.72%, 50=45.57%, 100=29.30%, 250=14.97% lat (msec) : 500=0.26% cpu : usr=0.03%, sys=1.70%, ctx=1137, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181585: Mon Mar 2 11:42:38 2026 read: IOPS=8, BW=135KiB/s (138kB/s)(6256KiB/46266msec) clat (msec): min=6, max=293, avg=49.80, stdev=41.33 lat (msec): min=6, max=293, avg=49.81, stdev=41.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 57], 80.00th=[ 77], 90.00th=[ 107], 95.00th=[ 132], | 99.00th=[ 178], 99.50th=[ 247], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 28, max= 416, per=26.10%, avg=134.93, stdev=85.74, samples=91 iops : min= 1, max= 26, avg= 7.63, stdev= 5.43, samples=91 write: IOPS=8, BW=130KiB/s (134kB/s)(6032KiB/46266msec); 0 zone resets clat (msec): min=10, max=368, avg=70.27, stdev=47.56 lat (msec): min=10, max=368, avg=70.27, stdev=47.56 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 21], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 80], 80.00th=[ 100], 90.00th=[ 136], 95.00th=[ 159], | 99.00th=[ 257], 99.50th=[ 279], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 318, per=23.44%, avg=127.52, stdev=66.33, samples=91 iops : min= 1, max= 19, avg= 7.16, stdev= 4.22, samples=91 lat (msec) : 10=1.17%, 20=9.51%, 50=44.27%, 100=29.17%, 250=15.23% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.76%, ctx=1247, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181586: Mon Mar 2 11:42:38 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45678msec) clat (msec): min=6, max=324, avg=50.29, stdev=40.72 lat (msec): min=6, max=324, avg=50.29, stdev=40.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 46], | 70.00th=[ 54], 80.00th=[ 71], 90.00th=[ 121], 95.00th=[ 140], | 99.00th=[ 171], 99.50th=[ 197], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 320, per=25.57%, avg=132.20, stdev=74.62, samples=89 iops : min= 1, max= 20, avg= 7.45, stdev= 4.77, samples=89 write: IOPS=8, BW=137KiB/s (140kB/s)(6256KiB/45678msec); 0 zone resets clat (msec): min=12, max=370, avg=67.75, stdev=46.48 lat (msec): min=12, max=370, avg=67.77, stdev=46.50 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 26], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 63], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 126], 95.00th=[ 157], | 99.00th=[ 247], 99.50th=[ 268], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 445, per=25.40%, avg=138.17, stdev=72.32, samples=89 iops : min= 1, max= 27, avg= 7.84, stdev= 4.60, samples=89 lat (msec) : 10=0.65%, 20=11.20%, 50=42.71%, 100=30.08%, 250=14.84% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.94%, ctx=1274, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=518KiB/s (530kB/s), 127KiB/s-135KiB/s (130kB/s-138kB/s), io=23.4MiB (24.5MB), run=45231-46266msec WRITE: bw=545KiB/s (558kB/s), 130KiB/s-145KiB/s (134kB/s-148kB/s), io=24.6MiB (25.8MB), run=45231-46266msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181608: Mon Mar 2 11:42:55 2026 read: IOPS=1, BW=1620KiB/s (1659kB/s)(7168KiB/4425msec) clat (usec): min=831, max=1648.4k, avg=366122.95, stdev=573069.99 lat (usec): min=832, max=1648.4k, avg=366124.11, stdev=573069.88 clat percentiles (usec): | 1.00th=[ 832], 5.00th=[ 832], 10.00th=[ 832], | 20.00th=[ 125305], 30.00th=[ 129500], 40.00th=[ 129500], | 50.00th=[ 137364], 60.00th=[ 217056], 70.00th=[ 217056], | 80.00th=[ 304088], 90.00th=[1652556], 95.00th=[1652556], | 99.00th=[1652556], 99.50th=[1652556], 99.90th=[1652556], | 99.95th=[1652556], 99.99th=[1652556] bw ( KiB/s): min= 1597, max= 4096, per=59.39%, avg=2328.80, stdev=1002.81, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=1, BW=1157KiB/s (1185kB/s)(5120KiB/4425msec); 0 zone resets clat (msec): min=212, max=426, avg=337.04, stdev=86.76 lat (msec): min=212, max=426, avg=337.12, stdev=86.75 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1980, max= 4096, per=49.30%, avg=2706.33, stdev=1203.90, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=10.74%, ctx=361, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181609: Mon Mar 2 11:42:55 2026 read: IOPS=0, BW=392KiB/s (402kB/s)(2048KiB/5223msec) clat (msec): min=210, max=317, avg=264.01, stdev=76.23 lat (msec): min=210, max=317, avg=264.02, stdev=76.24 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1643, max= 2048, per=47.07%, avg=1845.50, stdev=286.38, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1961KiB/s (2008kB/s)(10.0MiB/5223msec); 0 zone resets clat (msec): min=111, max=1969, avg=443.59, stdev=555.34 lat (msec): min=112, max=1969, avg=443.66, stdev=555.35 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 150], | 30.00th=[ 171], 40.00th=[ 207], 50.00th=[ 209], 60.00th=[ 264], | 70.00th=[ 376], 80.00th=[ 384], 90.00th=[ 600], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 1980, max= 6071, per=54.78%, avg=3007.00, stdev=1677.87, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=9.77%, ctx=133, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181610: Mon Mar 2 11:42:55 2026 read: IOPS=1, BW=1275KiB/s (1306kB/s)(6144KiB/4818msec) clat (msec): min=3, max=310, avg=132.88, stdev=115.95 lat (msec): min=3, max=310, avg=132.88, stdev=115.95 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1928, max= 4096, per=63.44%, avg=2487.50, stdev=1072.55, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1275KiB/s (1306kB/s)(6144KiB/4818msec); 0 zone resets clat (msec): min=239, max=1704, avg=651.28, stdev=561.29 lat (msec): min=239, max=1704, avg=651.36, stdev=561.28 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 693], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1486, max= 2048, per=34.35%, avg=1885.40, stdev=228.74, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 4=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=7.00%, ctx=132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181611: Mon Mar 2 11:42:55 2026 read: IOPS=1, BW=1060KiB/s (1085kB/s)(5120KiB/4831msec) clat (usec): min=540, max=193997, avg=64013.13, stdev=90280.40 lat (usec): min=542, max=193999, avg=64014.26, stdev=90280.46 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 553], 40.00th=[ 553], 50.00th=[ 660], 60.00th=[ 660], | 70.00th=[124257], 80.00th=[124257], 90.00th=[193987], 95.00th=[193987], | 99.00th=[193987], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 2048, max= 5941, per=100.00%, avg=3994.50, stdev=2752.77, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1484KiB/s (1519kB/s)(7168KiB/4831msec); 0 zone resets clat (msec): min=129, max=1880, avg=617.58, stdev=577.37 lat (msec): min=130, max=1880, avg=617.66, stdev=577.37 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 317], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 435], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 584], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 1928, max= 3893, per=43.47%, avg=2386.20, stdev=843.71, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=25.00% lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=7.39%, ctx=115, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3921KiB/s (4015kB/s), 392KiB/s-1620KiB/s (402kB/s-1659kB/s), io=20.0MiB (20.0MB), run=4425-5223msec WRITE: bw=5490KiB/s (5621kB/s), 1157KiB/s-1961KiB/s (1185kB/s-2008kB/s), io=28.0MiB (29.4MB), run=4425-5223msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181603: Mon Mar 2 11:42:55 2026 read: IOPS=1, BW=1741KiB/s (1782kB/s)(7168KiB/4118msec) clat (msec): min=80, max=1476, avg=386.14, stdev=496.08 lat (msec): min=80, max=1476, avg=386.15, stdev=496.08 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 97], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 243], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 414], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1980, max= 5019, per=100.00%, avg=3653.33, stdev=1542.68, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1243KiB/s (1273kB/s)(5120KiB/4118msec); 0 zone resets clat (msec): min=67, max=427, avg=245.19, stdev=145.71 lat (msec): min=67, max=427, avg=245.30, stdev=145.73 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1980, max= 3900, per=51.57%, avg=2620.00, stdev=1108.51, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, 2000=8.33% cpu : usr=0.07%, sys=3.74%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181604: Mon Mar 2 11:42:55 2026 read: IOPS=0, BW=363KiB/s (372kB/s)(2048KiB/5643msec) clat (msec): min=130, max=647, avg=389.02, stdev=366.20 lat (msec): min=130, max=647, avg=389.02, stdev=366.20 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1638, max= 2019, per=50.39%, avg=1828.50, stdev=269.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1815KiB/s (1858kB/s)(10.0MiB/5643msec); 0 zone resets clat (msec): min=109, max=1908, avg=472.92, stdev=522.63 lat (msec): min=109, max=1908, avg=473.00, stdev=522.63 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 136], | 30.00th=[ 140], 40.00th=[ 347], 50.00th=[ 363], 60.00th=[ 388], | 70.00th=[ 422], 80.00th=[ 439], 90.00th=[ 481], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 1980, max= 6131, per=63.13%, avg=3206.80, stdev=1832.06, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.50%, ctx=149, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181605: Mon Mar 2 11:42:55 2026 read: IOPS=1, BW=1196KiB/s (1224kB/s)(6144KiB/5139msec) clat (msec): min=133, max=408, avg=260.69, stdev=109.60 lat (msec): min=133, max=408, avg=260.70, stdev=109.60 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 284], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1954, max= 3900, per=67.88%, avg=2463.25, stdev=958.21, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1196KiB/s (1224kB/s)(6144KiB/5139msec); 0 zone resets clat (msec): min=222, max=1805, avg=590.05, stdev=604.89 lat (msec): min=223, max=1806, avg=590.14, stdev=604.88 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 439], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1643, max= 1980, per=37.55%, avg=1907.40, stdev=148.23, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=50.00%, 2000=8.33% cpu : usr=0.00%, sys=2.92%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181606: Mon Mar 2 11:42:55 2026 read: IOPS=0, BW=935KiB/s (957kB/s)(5120KiB/5476msec) clat (msec): min=93, max=430, avg=256.66, stdev=161.36 lat (msec): min=93, max=430, avg=256.67, stdev=161.36 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 3908, max= 4039, per=100.00%, avg=3973.50, stdev=92.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1309KiB/s (1340kB/s)(7168KiB/5476msec); 0 zone resets clat (msec): min=90, max=1678, avg=566.84, stdev=523.80 lat (msec): min=90, max=1678, avg=566.94, stdev=523.80 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 266], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 510], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 609], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1950, max= 4071, per=47.09%, avg=2392.20, stdev=938.57, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.04%, sys=4.07%, ctx=114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3629KiB/s (3716kB/s), 363KiB/s-1741KiB/s (372kB/s-1782kB/s), io=20.0MiB (20.0MB), run=4118-5643msec WRITE: bw=5081KiB/s (5203kB/s), 1196KiB/s-1815KiB/s (1224kB/s-1858kB/s), io=28.0MiB (29.4MB), run=4118-5643msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181619: Mon Mar 2 11:43:14 2026 read: IOPS=0, BW=2585KiB/s (2647kB/s)(12.0MiB/4753msec) clat (msec): min=818, max=2901, avg=1534.81, stdev=1183.66 lat (msec): min=818, max=2901, avg=1534.81, stdev=1183.67 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 7892, max= 7953, per=100.00%, avg=7922.50, stdev=43.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.08%, ctx=677, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181621: Mon Mar 2 11:43:14 2026 read: IOPS=0, BW=660KiB/s (676kB/s)(4096KiB/6204msec) clat (nsec): min=521897k, max=521897k, avg=521897121.00, stdev= 0.00 lat (nsec): min=521899k, max=521899k, avg=521899425.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1320KiB/s (1352kB/s)(8192KiB/6204msec); 0 zone resets clat (msec): min=1254, max=4139, avg=2697.15, stdev=2039.72 lat (msec): min=1255, max=4140, avg=2698.07, stdev=2040.56 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 4144], | 70.00th=[ 4144], 80.00th=[ 4144], 90.00th=[ 4144], 95.00th=[ 4144], | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4144], 99.95th=[ 4144], | 99.99th=[ 4144] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.76%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181623: Mon Mar 2 11:43:14 2026 write: IOPS=0, BW=2103KiB/s (2154kB/s)(12.0MiB/5843msec); 0 zone resets clat (msec): min=669, max=3653, avg=1858.80, stdev=1581.73 lat (msec): min=670, max=3654, avg=1859.09, stdev=1581.63 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 3641], 80.00th=[ 3641], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 7861, max= 7953, per=100.00%, avg=7907.00, stdev=65.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.09%, sys=1.76%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181625: Mon Mar 2 11:43:14 2026 write: IOPS=0, BW=2154KiB/s (2205kB/s)(12.0MiB/5706msec); 0 zone resets clat (msec): min=360, max=3796, avg=1864.03, stdev=1757.95 lat (msec): min=360, max=3797, avg=1864.32, stdev=1757.87 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 7861, max= 8110, per=100.00%, avg=7985.50, stdev=176.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.65%, ctx=36, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2641KiB/s (2704kB/s), 660KiB/s-2585KiB/s (676kB/s-2647kB/s), io=16.0MiB (16.8MB), run=4753-6204msec WRITE: bw=5282KiB/s (5409kB/s), 1320KiB/s-2154KiB/s (1352kB/s-2205kB/s), io=32.0MiB (33.6MB), run=5706-6204msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181618: Mon Mar 2 11:43:14 2026 read: IOPS=0, BW=2306KiB/s (2361kB/s)(12.0MiB/5329msec) clat (msec): min=455, max=3338, avg=1741.14, stdev=1466.42 lat (msec): min=455, max=3338, avg=1741.14, stdev=1466.42 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 7728, max= 8159, per=100.00%, avg=7943.50, stdev=304.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.20%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181620: Mon Mar 2 11:43:14 2026 read: IOPS=0, BW=635KiB/s (650kB/s)(4096KiB/6453msec) clat (nsec): min=3109.5M, max=3109.5M, avg=3109451873.00, stdev= 0.00 lat (nsec): min=3109.5M, max=3109.5M, avg=3109455052.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3104], 5.00th=[ 3104], 10.00th=[ 3104], 20.00th=[ 3104], | 30.00th=[ 3104], 40.00th=[ 3104], 50.00th=[ 3104], 60.00th=[ 3104], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1269KiB/s (1300kB/s)(8192KiB/6453msec); 0 zone resets clat (msec): min=1069, max=2005, avg=1537.51, stdev=661.85 lat (msec): min=1070, max=2005, avg=1537.96, stdev=661.75 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 2005], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.89%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181622: Mon Mar 2 11:43:14 2026 write: IOPS=0, BW=2057KiB/s (2107kB/s)(12.0MiB/5973msec); 0 zone resets clat (msec): min=272, max=4181, avg=1924.68, stdev=2023.48 lat (msec): min=272, max=4181, avg=1925.08, stdev=2023.49 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 4178], 80.00th=[ 4178], 90.00th=[ 4178], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.56%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181624: Mon Mar 2 11:43:14 2026 write: IOPS=0, BW=2374KiB/s (2431kB/s)(12.0MiB/5176msec); 0 zone resets clat (msec): min=328, max=3592, avg=1678.20, stdev=1703.35 lat (msec): min=329, max=3597, avg=1680.26, stdev=1706.16 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 7728, max= 7728, per=100.00%, avg=7728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.60%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2539KiB/s (2600kB/s), 635KiB/s-2306KiB/s (650kB/s-2361kB/s), io=16.0MiB (16.8MB), run=5329-6453msec WRITE: bw=5078KiB/s (5200kB/s), 1269KiB/s-2374KiB/s (1300kB/s-2431kB/s), io=32.0MiB (33.6MB), run=5176-6453msec