== sanity test 398b: DIO and buffer IO race ============== 06:20:08 (1773224408) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.95887 s, 12.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146620: Wed Mar 11 06:21:47 2026 read: IOPS=18, BW=72.1KiB/s (73.8kB/s)(5992KiB/83098msec) clat (usec): min=20, max=600175, avg=27998.49, stdev=24637.39 lat (usec): min=20, max=600177, avg=28005.78, stdev=24632.20 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 83], 10.00th=[ 8586], 20.00th=[ 14222], | 30.00th=[ 17433], 40.00th=[ 20841], 50.00th=[ 24249], 60.00th=[ 28443], | 70.00th=[ 33817], 80.00th=[ 39584], 90.00th=[ 50070], 95.00th=[ 60031], | 99.00th=[103285], 99.50th=[121111], 99.90th=[274727], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 6, max= 143, per=25.73%, avg=71.79, stdev=24.79, samples=165 iops : min= 1, max= 35, avg=17.38, stdev= 6.21, samples=165 write: IOPS=18, BW=75.8KiB/s (77.6kB/s)(6296KiB/83098msec); 0 zone resets clat (usec): min=1013, max=175953, avg=26067.96, stdev=24225.57 lat (usec): min=1015, max=175954, avg=26072.32, stdev=24223.91 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1958], 10.00th=[ 2671], 20.00th=[ 4424], | 30.00th=[ 7308], 40.00th=[ 14484], 50.00th=[ 20317], 60.00th=[ 26608], | 70.00th=[ 33817], 80.00th=[ 43779], 90.00th=[ 57934], 95.00th=[ 72877], | 99.00th=[105382], 99.50th=[114820], 99.90th=[156238], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 23, max= 166, per=25.95%, avg=75.79, stdev=25.34, samples=164 iops : min= 5, max= 41, avg=18.38, stdev= 6.35, samples=164 lat (usec) : 50=0.55%, 100=2.54%, 250=0.85%, 500=0.29%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=2.77%, 4=6.58%, 10=9.54%, 20=20.28%, 50=43.95% lat (msec) : 100=11.49%, 250=1.04%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=11.36%, ctx=7646, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146621: Wed Mar 11 06:21:47 2026 read: IOPS=17, BW=70.7KiB/s (72.4kB/s)(5940KiB/84005msec) clat (usec): min=33, max=570963, avg=27617.13, stdev=22625.23 lat (usec): min=34, max=570965, avg=27618.98, stdev=22625.11 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 104], 10.00th=[ 10683], 20.00th=[ 14484], | 30.00th=[ 17433], 40.00th=[ 21103], 50.00th=[ 24511], 60.00th=[ 27919], | 70.00th=[ 32900], 80.00th=[ 40109], 90.00th=[ 48497], 95.00th=[ 56886], | 99.00th=[ 80217], 99.50th=[ 92799], 99.90th=[254804], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 6, max= 151, per=25.20%, avg=70.31, stdev=25.26, samples=166 iops : min= 1, max= 37, avg=17.02, stdev= 6.37, samples=166 write: IOPS=18, BW=75.6KiB/s (77.4kB/s)(6348KiB/84005msec); 0 zone resets clat (usec): min=1029, max=201327, avg=26989.83, stdev=24708.26 lat (usec): min=1031, max=201329, avg=27000.28, stdev=24707.10 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1844], 10.00th=[ 2638], 20.00th=[ 4621], | 30.00th=[ 8029], 40.00th=[ 14877], 50.00th=[ 21890], 60.00th=[ 27919], | 70.00th=[ 35390], 80.00th=[ 44827], 90.00th=[ 60556], 95.00th=[ 74974], | 99.00th=[103285], 99.50th=[124257], 99.90th=[158335], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 183, per=25.88%, avg=75.57, stdev=24.27, samples=165 iops : min= 1, max= 45, avg=18.33, stdev= 6.07, samples=165 lat (usec) : 50=0.39%, 100=2.02%, 250=0.62%, 500=0.29%, 750=0.07% lat (msec) : 2=3.55%, 4=5.57%, 10=9.18%, 20=20.61%, 50=45.44% lat (msec) : 100=11.39%, 250=0.81%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=11.30%, ctx=7709, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146622: Wed Mar 11 06:21:47 2026 read: IOPS=17, BW=71.4KiB/s (73.1kB/s)(6028KiB/84458msec) clat (usec): min=36, max=157849, avg=26893.96, stdev=18785.52 lat (usec): min=37, max=157849, avg=26896.16, stdev=18786.43 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 79], 10.00th=[ 8586], 20.00th=[ 13698], | 30.00th=[ 16712], 40.00th=[ 19792], 50.00th=[ 22938], 60.00th=[ 27395], | 70.00th=[ 32637], 80.00th=[ 39584], 90.00th=[ 49546], 95.00th=[ 60031], | 99.00th=[ 86508], 99.50th=[106431], 99.90th=[152044], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 15, max= 135, per=25.59%, avg=71.40, stdev=23.83, samples=166 iops : min= 3, max= 33, avg=17.29, stdev= 5.99, samples=166 write: IOPS=18, BW=74.1KiB/s (75.9kB/s)(6260KiB/84458msec); 0 zone resets clat (usec): min=1082, max=633577, avg=27990.27, stdev=28671.52 lat (usec): min=1084, max=633579, avg=27996.59, stdev=28669.25 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2024], 10.00th=[ 2933], 20.00th=[ 5145], | 30.00th=[ 8586], 40.00th=[ 15401], 50.00th=[ 22414], 60.00th=[ 29230], | 70.00th=[ 36963], 80.00th=[ 45876], 90.00th=[ 61080], 95.00th=[ 76022], | 99.00th=[103285], 99.50th=[110625], 99.90th=[173016], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 15, max= 136, per=25.33%, avg=73.95, stdev=23.25, samples=166 iops : min= 3, max= 34, avg=17.93, stdev= 5.87, samples=166 lat (usec) : 50=0.59%, 100=2.47%, 250=0.94%, 500=0.42%, 1000=0.07% lat (msec) : 2=2.57%, 4=5.70%, 10=9.44%, 20=21.48%, 50=43.23% lat (msec) : 100=12.21%, 250=0.85%, 750=0.03% cpu : usr=0.11%, sys=11.16%, ctx=7665, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146623: Wed Mar 11 06:21:47 2026 read: IOPS=17, BW=70.5KiB/s (72.2kB/s)(6052KiB/85818msec) clat (usec): min=35, max=150834, avg=27383.44, stdev=18543.61 lat (usec): min=36, max=150835, avg=27385.58, stdev=18543.47 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 87], 10.00th=[ 9241], 20.00th=[ 14484], | 30.00th=[ 17695], 40.00th=[ 20579], 50.00th=[ 23462], 60.00th=[ 27919], | 70.00th=[ 32900], 80.00th=[ 40633], 90.00th=[ 50070], 95.00th=[ 58983], | 99.00th=[ 87557], 99.50th=[113771], 99.90th=[131597], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 16, max= 159, per=25.29%, avg=70.56, stdev=24.44, samples=169 iops : min= 4, max= 39, avg=17.08, stdev= 6.13, samples=169 write: IOPS=18, BW=72.7KiB/s (74.4kB/s)(6236KiB/85818msec); 0 zone resets clat (usec): min=904, max=630427, avg=28382.34, stdev=30578.90 lat (usec): min=905, max=630430, avg=28386.40, stdev=30579.00 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1893], 10.00th=[ 2573], 20.00th=[ 4490], | 30.00th=[ 7570], 40.00th=[ 15533], 50.00th=[ 22938], 60.00th=[ 28705], | 70.00th=[ 35914], 80.00th=[ 46400], 90.00th=[ 61604], 95.00th=[ 77071], | 99.00th=[115868], 99.50th=[139461], 99.90th=[231736], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 152, per=24.85%, avg=72.56, stdev=25.34, samples=169 iops : min= 1, max= 38, avg=17.59, stdev= 6.37, samples=169 lat (usec) : 50=0.39%, 100=2.38%, 250=1.01%, 500=0.42%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=3.06%, 4=5.99%, 10=9.05%, 20=19.82%, 50=43.95% lat (msec) : 100=12.47%, 250=1.27%, 750=0.03% cpu : usr=0.12%, sys=11.02%, ctx=7728, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=280KiB/s (287kB/s), 70.5KiB/s-72.1KiB/s (72.2kB/s-73.8kB/s), io=23.4MiB (24.6MB), run=83098-85818msec WRITE: bw=293KiB/s (300kB/s), 72.7KiB/s-75.8KiB/s (74.4kB/s-77.6kB/s), io=24.6MiB (25.7MB), run=83098-85818msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146615: Wed Mar 11 06:23:18 2026 read: IOPS=8, BW=33.8KiB/s (34.6kB/s)(5992KiB/177481msec) clat (msec): min=5, max=829, avg=25.60, stdev=31.34 lat (msec): min=5, max=829, avg=25.61, stdev=31.34 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 53], 95.00th=[ 67], | 99.00th=[ 136], 99.50th=[ 171], 99.90th=[ 222], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 112, per=25.91%, avg=34.72, stdev=21.06, samples=338 iops : min= 1, max= 28, avg= 8.13, stdev= 5.30, samples=338 write: IOPS=8, BW=35.5KiB/s (36.3kB/s)(6296KiB/177481msec); 0 zone resets clat (msec): min=32, max=286, avg=88.18, stdev=33.12 lat (msec): min=32, max=286, avg=88.18, stdev=33.12 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 62], | 30.00th=[ 68], 40.00th=[ 74], 50.00th=[ 82], 60.00th=[ 91], | 70.00th=[ 101], 80.00th=[ 113], 90.00th=[ 133], 95.00th=[ 148], | 99.00th=[ 199], 99.50th=[ 220], 99.90th=[ 257], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 71, per=24.98%, avg=35.22, stdev=13.01, samples=350 iops : min= 1, max= 17, avg= 8.25, stdev= 3.30, samples=350 lat (msec) : 10=5.83%, 20=23.70%, 50=18.07%, 100=35.97%, 250=16.31% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=2.70%, ctx=5510, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146616: Wed Mar 11 06:23:18 2026 read: IOPS=8, BW=33.4KiB/s (34.2kB/s)(5940KiB/177787msec) clat (msec): min=5, max=788, avg=24.01, stdev=28.38 lat (msec): min=5, max=788, avg=24.01, stdev=28.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 50], 95.00th=[ 65], | 99.00th=[ 103], 99.50th=[ 124], 99.90th=[ 213], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 119, per=25.86%, avg=34.65, stdev=21.81, samples=335 iops : min= 1, max= 29, avg= 8.11, stdev= 5.49, samples=335 write: IOPS=8, BW=35.7KiB/s (36.6kB/s)(6348KiB/177787msec); 0 zone resets clat (msec): min=28, max=334, avg=89.35, stdev=35.83 lat (msec): min=28, max=334, avg=89.35, stdev=35.83 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 62], | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 83], 60.00th=[ 91], | 70.00th=[ 101], 80.00th=[ 113], 90.00th=[ 134], 95.00th=[ 157], | 99.00th=[ 207], 99.50th=[ 249], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 71, per=25.08%, avg=35.36, stdev=12.64, samples=351 iops : min= 1, max= 17, avg= 8.29, stdev= 3.22, samples=351 lat (msec) : 10=5.83%, 20=24.87%, 50=16.83%, 100=36.23%, 250=15.98% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.71%, ctx=5436, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146617: Wed Mar 11 06:23:18 2026 read: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6028KiB/176958msec) clat (msec): min=5, max=273, avg=25.51, stdev=24.99 lat (msec): min=5, max=273, avg=25.51, stdev=24.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 52], 95.00th=[ 73], | 99.00th=[ 140], 99.50th=[ 178], 99.90th=[ 220], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 135, per=25.75%, avg=34.51, stdev=20.99, samples=342 iops : min= 1, max= 33, avg= 8.08, stdev= 5.28, samples=342 write: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6260KiB/176958msec); 0 zone resets clat (msec): min=32, max=853, avg=88.29, stdev=39.41 lat (msec): min=32, max=853, avg=88.30, stdev=39.41 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 60], | 30.00th=[ 67], 40.00th=[ 74], 50.00th=[ 82], 60.00th=[ 90], | 70.00th=[ 100], 80.00th=[ 112], 90.00th=[ 133], 95.00th=[ 150], | 99.00th=[ 201], 99.50th=[ 226], 99.90th=[ 342], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 64, per=24.83%, avg=35.01, stdev=13.66, samples=350 iops : min= 1, max= 16, avg= 8.20, stdev= 3.47, samples=350 lat (msec) : 10=6.93%, 20=22.56%, 50=18.55%, 100=36.00%, 250=15.76% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=2.72%, ctx=5473, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146618: Wed Mar 11 06:23:18 2026 read: IOPS=8, BW=33.0KiB/s (34.8kB/s)(6052KiB/178024msec) clat (msec): min=6, max=281, avg=24.79, stdev=23.97 lat (msec): min=6, max=281, avg=24.79, stdev=23.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 50], 95.00th=[ 70], | 99.00th=[ 128], 99.50th=[ 148], 99.90th=[ 224], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 120, per=26.08%, avg=34.94, stdev=20.66, samples=339 iops : min= 1, max= 30, avg= 8.18, stdev= 5.18, samples=339 write: IOPS=8, BW=35.0KiB/s (35.9kB/s)(6236KiB/178024msec); 0 zone resets clat (msec): min=30, max=847, avg=89.91, stdev=39.48 lat (msec): min=30, max=847, avg=89.92, stdev=39.48 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 48], 10.00th=[ 53], 20.00th=[ 62], | 30.00th=[ 69], 40.00th=[ 77], 50.00th=[ 83], 60.00th=[ 91], | 70.00th=[ 101], 80.00th=[ 112], 90.00th=[ 136], 95.00th=[ 153], | 99.00th=[ 207], 99.50th=[ 232], 99.90th=[ 300], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 64, per=24.56%, avg=34.62, stdev=12.67, samples=352 iops : min= 1, max= 16, avg= 8.10, stdev= 3.22, samples=352 lat (msec) : 10=6.09%, 20=24.32%, 50=17.74%, 100=35.84%, 250=15.85% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=2.72%, ctx=5563, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=135KiB/s (138kB/s), 33.4KiB/s-34.1KiB/s (34.2kB/s-34.9kB/s), io=23.4MiB (24.6MB), run=176958-178024msec WRITE: bw=141KiB/s (145kB/s), 35.0KiB/s-35.7KiB/s (35.9kB/s-36.6kB/s), io=24.6MiB (25.7MB), run=176958-178024msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146662: Wed Mar 11 06:23:47 2026 read: IOPS=18, BW=298KiB/s (305kB/s)(5920KiB/19847msec) clat (usec): min=29, max=123721, avg=26438.21, stdev=22086.92 lat (usec): min=29, max=123721, avg=26439.59, stdev=22086.99 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 111], | 30.00th=[ 15533], 40.00th=[ 20841], 50.00th=[ 24773], 60.00th=[ 28705], | 70.00th=[ 35914], 80.00th=[ 43254], 90.00th=[ 55313], 95.00th=[ 66847], | 99.00th=[ 86508], 99.50th=[ 89654], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 127, max= 539, per=26.00%, avg=299.05, stdev=97.00, samples=39 iops : min= 7, max= 33, avg=18.00, stdev= 6.08, samples=39 write: IOPS=20, BW=321KiB/s (329kB/s)(6368KiB/19847msec); 0 zone resets clat (usec): min=1784, max=144906, avg=24673.15, stdev=24134.10 lat (usec): min=1786, max=144909, avg=24677.76, stdev=24134.79 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2835], 10.00th=[ 3818], 20.00th=[ 5604], | 30.00th=[ 7373], 40.00th=[ 11338], 50.00th=[ 15926], 60.00th=[ 21890], | 70.00th=[ 30802], 80.00th=[ 43254], 90.00th=[ 57934], 95.00th=[ 72877], | 99.00th=[106431], 99.50th=[130548], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 126, max= 509, per=26.66%, avg=322.33, stdev=82.75, samples=39 iops : min= 7, max= 31, avg=19.46, stdev= 5.22, samples=39 lat (usec) : 50=1.43%, 100=7.29%, 250=2.08%, 500=1.30%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=0.78%, 4=5.34%, 10=13.54%, 20=16.15%, 50=37.24% lat (msec) : 100=13.41%, 250=0.91% cpu : usr=0.08%, sys=12.22%, ctx=1657, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146663: Wed Mar 11 06:23:47 2026 read: IOPS=17, BW=276KiB/s (282kB/s)(5744KiB/20827msec) clat (usec): min=27, max=295899, avg=27144.88, stdev=24216.30 lat (usec): min=28, max=295900, avg=27146.26, stdev=24216.32 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 63], 10.00th=[ 69], 20.00th=[ 119], | 30.00th=[ 17433], 40.00th=[ 23462], 50.00th=[ 26346], 60.00th=[ 29754], | 70.00th=[ 37487], 80.00th=[ 43254], 90.00th=[ 53216], 95.00th=[ 60556], | 99.00th=[ 70779], 99.50th=[ 96994], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 27, max= 479, per=23.94%, avg=275.27, stdev=107.16, samples=41 iops : min= 1, max= 29, avg=16.51, stdev= 6.68, samples=41 write: IOPS=19, BW=314KiB/s (322kB/s)(6544KiB/20827msec); 0 zone resets clat (usec): min=1285, max=191217, avg=26648.69, stdev=28573.33 lat (usec): min=1286, max=191220, avg=26655.97, stdev=28583.22 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2474], 10.00th=[ 3359], 20.00th=[ 4817], | 30.00th=[ 7308], 40.00th=[ 10421], 50.00th=[ 14615], 60.00th=[ 24249], | 70.00th=[ 33817], 80.00th=[ 47449], 90.00th=[ 63177], 95.00th=[ 80217], | 99.00th=[137364], 99.50th=[147850], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 63, max= 608, per=25.97%, avg=313.95, stdev=130.39, samples=41 iops : min= 3, max= 38, avg=18.95, stdev= 8.21, samples=41 lat (usec) : 50=0.78%, 100=7.55%, 250=1.56%, 500=0.91%, 750=0.39% lat (msec) : 2=1.30%, 4=5.60%, 10=14.06%, 20=13.93%, 50=38.67% lat (msec) : 100=13.67%, 250=1.43%, 500=0.13% cpu : usr=0.08%, sys=12.08%, ctx=1670, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146664: Wed Mar 11 06:23:47 2026 read: IOPS=19, BW=319KiB/s (326kB/s)(6256KiB/19625msec) clat (usec): min=26, max=157258, avg=26770.61, stdev=22077.18 lat (usec): min=26, max=157259, avg=26772.25, stdev=22077.12 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 74], 20.00th=[ 119], | 30.00th=[ 15664], 40.00th=[ 20841], 50.00th=[ 25297], 60.00th=[ 30540], | 70.00th=[ 37487], 80.00th=[ 44303], 90.00th=[ 55313], 95.00th=[ 65274], | 99.00th=[ 84411], 99.50th=[117965], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 125, max= 667, per=28.63%, avg=329.24, stdev=106.45, samples=37 iops : min= 7, max= 41, avg=19.89, stdev= 6.62, samples=37 write: IOPS=19, BW=307KiB/s (315kB/s)(6032KiB/19625msec); 0 zone resets clat (usec): min=1756, max=156790, avg=23424.82, stdev=23053.41 lat (usec): min=1758, max=156794, avg=23436.48, stdev=23061.30 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2540], 10.00th=[ 3589], 20.00th=[ 4817], | 30.00th=[ 6915], 40.00th=[ 9896], 50.00th=[ 15139], 60.00th=[ 22152], | 70.00th=[ 28181], 80.00th=[ 40633], 90.00th=[ 56361], 95.00th=[ 74974], | 99.00th=[ 89654], 99.50th=[103285], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 55, max= 542, per=25.25%, avg=305.32, stdev=114.30, samples=38 iops : min= 3, max= 33, avg=18.39, stdev= 7.13, samples=38 lat (usec) : 50=1.43%, 100=7.16%, 250=2.86%, 500=1.17% lat (msec) : 2=1.17%, 4=6.64%, 10=12.37%, 20=15.23%, 50=38.67% lat (msec) : 100=12.63%, 250=0.65% cpu : usr=0.14%, sys=12.20%, ctx=1671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146665: Wed Mar 11 06:23:47 2026 read: IOPS=19, BW=311KiB/s (318kB/s)(6032KiB/19411msec) clat (usec): min=39, max=127068, avg=26371.97, stdev=20924.61 lat (usec): min=40, max=127070, avg=26374.43, stdev=20924.53 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 120], | 30.00th=[ 15926], 40.00th=[ 22152], 50.00th=[ 26346], 60.00th=[ 30802], | 70.00th=[ 37487], 80.00th=[ 43254], 90.00th=[ 50594], 95.00th=[ 62129], | 99.00th=[ 79168], 99.50th=[109577], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 158, max= 480, per=26.87%, avg=308.97, stdev=79.21, samples=38 iops : min= 9, max= 30, avg=18.63, stdev= 4.94, samples=38 write: IOPS=20, BW=322KiB/s (330kB/s)(6256KiB/19411msec); 0 zone resets clat (usec): min=1550, max=148771, avg=24067.03, stdev=24118.80 lat (usec): min=1553, max=148774, avg=24070.52, stdev=24118.14 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2311], 10.00th=[ 3195], 20.00th=[ 5145], | 30.00th=[ 7439], 40.00th=[ 10421], 50.00th=[ 15270], 60.00th=[ 22152], | 70.00th=[ 30540], 80.00th=[ 40633], 90.00th=[ 58983], 95.00th=[ 71828], | 99.00th=[106431], 99.50th=[124257], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 160, max= 574, per=26.63%, avg=321.92, stdev=98.46, samples=38 iops : min= 10, max= 35, avg=19.45, stdev= 6.06, samples=38 lat (usec) : 50=1.43%, 100=6.77%, 250=2.86%, 500=1.04%, 750=0.52% lat (msec) : 2=1.43%, 4=5.99%, 10=12.63%, 20=13.67%, 50=41.54% lat (msec) : 100=10.94%, 250=1.17% cpu : usr=0.15%, sys=12.01%, ctx=1658, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1150KiB/s (1178kB/s), 276KiB/s-319KiB/s (282kB/s-326kB/s), io=23.4MiB (24.5MB), run=19411-20827msec WRITE: bw=1210KiB/s (1239kB/s), 307KiB/s-322KiB/s (315kB/s-330kB/s), io=24.6MiB (25.8MB), run=19411-20827msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146666: Wed Mar 11 06:24:14 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5920KiB/47123msec) clat (msec): min=4, max=240, avg=28.14, stdev=28.44 lat (msec): min=4, max=240, avg=28.15, stdev=28.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 38], 90.00th=[ 57], 95.00th=[ 82], | 99.00th=[ 155], 99.50th=[ 180], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 445, per=25.63%, avg=128.66, stdev=88.12, samples=90 iops : min= 1, max= 27, avg= 7.31, stdev= 5.53, samples=90 write: IOPS=8, BW=135KiB/s (138kB/s)(6368KiB/47123msec); 0 zone resets clat (msec): min=38, max=329, avg=91.77, stdev=39.77 lat (msec): min=38, max=329, avg=91.78, stdev=39.77 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 69], 40.00th=[ 75], 50.00th=[ 81], 60.00th=[ 92], | 70.00th=[ 103], 80.00th=[ 116], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 228], 99.50th=[ 249], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 29, max= 256, per=25.46%, avg=134.41, stdev=56.65, samples=93 iops : min= 1, max= 16, avg= 7.67, stdev= 3.58, samples=93 lat (msec) : 10=4.17%, 20=23.83%, 50=17.84%, 100=35.16%, 250=18.88% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=2.84%, ctx=1423, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146667: Wed Mar 11 06:24:14 2026 read: IOPS=7, BW=121KiB/s (123kB/s)(5744KiB/47655msec) clat (msec): min=6, max=191, avg=27.30, stdev=26.83 lat (msec): min=6, max=191, avg=27.30, stdev=26.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 37], 90.00th=[ 62], 95.00th=[ 81], | 99.00th=[ 140], 99.50th=[ 184], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 29, max= 411, per=24.65%, avg=123.73, stdev=79.86, samples=91 iops : min= 1, max= 25, avg= 6.99, stdev= 5.04, samples=91 write: IOPS=8, BW=137KiB/s (141kB/s)(6544KiB/47655msec); 0 zone resets clat (msec): min=32, max=258, avg=92.31, stdev=40.45 lat (msec): min=32, max=258, avg=92.32, stdev=40.45 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 47], 10.00th=[ 54], 20.00th=[ 61], | 30.00th=[ 68], 40.00th=[ 74], 50.00th=[ 82], 60.00th=[ 91], | 70.00th=[ 102], 80.00th=[ 122], 90.00th=[ 148], 95.00th=[ 178], | 99.00th=[ 232], 99.50th=[ 234], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 256, per=25.82%, avg=136.32, stdev=58.02, samples=94 iops : min= 1, max= 16, avg= 7.79, stdev= 3.67, samples=94 lat (msec) : 10=5.08%, 20=22.79%, 50=16.54%, 100=37.50%, 250=17.97% lat (msec) : 500=0.13% cpu : usr=0.09%, sys=2.92%, ctx=1485, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146668: Wed Mar 11 06:24:14 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45477msec) clat (msec): min=6, max=190, avg=25.73, stdev=24.10 lat (msec): min=6, max=190, avg=25.73, stdev=24.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 49], 95.00th=[ 75], | 99.00th=[ 129], 99.50th=[ 182], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 415, per=28.41%, avg=142.63, stdev=94.54, samples=87 iops : min= 1, max= 25, avg= 8.17, stdev= 5.93, samples=87 write: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45477msec); 0 zone resets clat (msec): min=32, max=358, avg=93.33, stdev=40.96 lat (msec): min=32, max=358, avg=93.34, stdev=40.96 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 49], 10.00th=[ 53], 20.00th=[ 61], | 30.00th=[ 68], 40.00th=[ 74], 50.00th=[ 84], 60.00th=[ 94], | 70.00th=[ 107], 80.00th=[ 121], 90.00th=[ 148], 95.00th=[ 165], | 99.00th=[ 234], 99.50th=[ 266], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 256, per=25.03%, avg=132.16, stdev=55.83, samples=90 iops : min= 1, max= 16, avg= 7.51, stdev= 3.50, samples=90 lat (msec) : 10=4.69%, 20=24.74%, 50=19.92%, 100=32.03%, 250=18.36% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.89%, ctx=1451, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146669: Wed Mar 11 06:24:14 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(6032KiB/46804msec) clat (msec): min=7, max=192, avg=27.59, stdev=27.37 lat (msec): min=7, max=192, avg=27.60, stdev=27.37 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 60], 95.00th=[ 84], | 99.00th=[ 176], 99.50th=[ 190], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 31, max= 415, per=26.50%, avg=133.05, stdev=87.92, samples=88 iops : min= 1, max= 25, avg= 7.58, stdev= 5.54, samples=88 write: IOPS=8, BW=134KiB/s (137kB/s)(6256KiB/46804msec); 0 zone resets clat (msec): min=31, max=323, avg=92.47, stdev=42.77 lat (msec): min=31, max=323, avg=92.48, stdev=42.77 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 60], | 30.00th=[ 68], 40.00th=[ 77], 50.00th=[ 84], 60.00th=[ 90], | 70.00th=[ 102], 80.00th=[ 118], 90.00th=[ 146], 95.00th=[ 182], | 99.00th=[ 247], 99.50th=[ 309], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 256, per=25.13%, avg=132.71, stdev=57.57, samples=92 iops : min= 1, max= 16, avg= 7.55, stdev= 3.61, samples=92 lat (msec) : 10=4.30%, 20=24.35%, 50=18.88%, 100=35.29%, 250=16.80% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.71%, ctx=1482, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=503KiB/s (515kB/s), 121KiB/s-138KiB/s (123kB/s-141kB/s), io=23.4MiB (24.5MB), run=45477-47655msec WRITE: bw=529KiB/s (541kB/s), 133KiB/s-137KiB/s (136kB/s-141kB/s), io=24.6MiB (25.8MB), run=45477-47655msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146683: Wed Mar 11 06:24:25 2026 read: IOPS=2, BW=2424KiB/s (2482kB/s)(7168KiB/2957msec) clat (msec): min=83, max=333, avg=166.61, stdev=86.08 lat (msec): min=83, max=333, avg=166.62, stdev=86.08 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 88], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 161], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 205], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1988, max= 5555, per=73.53%, avg=3876.67, stdev=1792.78, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1731KiB/s (1773kB/s)(5120KiB/2957msec); 0 zone resets clat (msec): min=122, max=523, avg=352.20, stdev=166.25 lat (msec): min=122, max=523, avg=352.36, stdev=166.34 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1851, max= 2031, per=26.70%, avg=1971.25, stdev=82.11, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=8.39%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146684: Wed Mar 11 06:24:25 2026 read: IOPS=0, BW=527KiB/s (540kB/s)(2048KiB/3884msec) clat (msec): min=128, max=153, avg=140.95, stdev=17.70 lat (msec): min=128, max=153, avg=140.96, stdev=17.70 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 155], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 155], 95.00th=[ 155], | 99.00th=[ 155], 99.50th=[ 155], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 1939, max= 2031, per=37.65%, avg=1985.00, stdev=65.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2636KiB/s (2700kB/s)(10.0MiB/3884msec); 0 zone resets clat (msec): min=125, max=777, avg=354.06, stdev=205.25 lat (msec): min=125, max=777, avg=354.21, stdev=205.26 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 144], | 30.00th=[ 174], 40.00th=[ 243], 50.00th=[ 330], 60.00th=[ 342], | 70.00th=[ 368], 80.00th=[ 518], 90.00th=[ 527], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1965, max= 4087, per=40.65%, avg=3000.67, stdev=1104.52, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=8.52%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146685: Wed Mar 11 06:24:25 2026 read: IOPS=1, BW=1593KiB/s (1631kB/s)(6144KiB/3858msec) clat (msec): min=133, max=462, avg=275.13, stdev=128.76 lat (msec): min=133, max=462, avg=275.13, stdev=128.76 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 251], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1965, max= 4063, per=47.83%, avg=2521.50, stdev=1028.17, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1593KiB/s (1631kB/s)(6144KiB/3858msec); 0 zone resets clat (msec): min=125, max=910, avg=353.01, stdev=308.07 lat (msec): min=125, max=910, avg=353.13, stdev=308.13 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 266], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1965, max= 3750, per=31.97%, avg=2360.00, stdev=777.58, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.86%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146686: Wed Mar 11 06:24:25 2026 read: IOPS=1, BW=1463KiB/s (1498kB/s)(5120KiB/3500msec) clat (msec): min=92, max=190, avg=148.80, stdev=35.47 lat (msec): min=92, max=190, avg=148.80, stdev=35.47 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 4031, max= 4063, per=76.76%, avg=4047.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2048KiB/s (2097kB/s)(7168KiB/3500msec); 0 zone resets clat (msec): min=96, max=702, avg=379.45, stdev=244.10 lat (msec): min=96, max=703, avg=379.89, stdev=244.46 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 207], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 251], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 667], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1988, max= 3864, per=33.56%, avg=2477.50, stdev=924.61, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 750=25.00% cpu : usr=0.03%, sys=8.23%, ctx=109, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5273KiB/s (5399kB/s), 527KiB/s-2424KiB/s (540kB/s-2482kB/s), io=20.0MiB (20.0MB), run=2957-3884msec WRITE: bw=7382KiB/s (7559kB/s), 1593KiB/s-2636KiB/s (1631kB/s-2700kB/s), io=28.0MiB (29.4MB), run=2957-3884msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146688: Wed Mar 11 06:24:25 2026 read: IOPS=2, BW=2521KiB/s (2582kB/s)(7168KiB/2843msec) clat (usec): min=835, max=440891, avg=158358.51, stdev=169488.12 lat (usec): min=837, max=440893, avg=158359.90, stdev=169488.24 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 840], 10.00th=[ 840], 20.00th=[ 955], | 30.00th=[ 1029], 40.00th=[ 1029], 50.00th=[164627], 60.00th=[223347], | 70.00th=[223347], 80.00th=[274727], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 1921, max= 4096, per=57.88%, avg=3365.33, stdev=1250.86, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1801KiB/s (1844kB/s)(5120KiB/2843msec); 0 zone resets clat (msec): min=120, max=551, avg=346.63, stdev=166.82 lat (msec): min=120, max=551, avg=346.71, stdev=166.83 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2043, max= 4096, per=33.53%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 1000=16.67% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=19.49%, ctx=257, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146689: Wed Mar 11 06:24:25 2026 read: IOPS=0, BW=581KiB/s (595kB/s)(2048KiB/3522msec) clat (usec): min=879, max=303047, avg=151963.92, stdev=213665.12 lat (usec): min=881, max=303050, avg=151965.90, stdev=213665.89 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 881], | 30.00th=[ 881], 40.00th=[ 881], 50.00th=[ 881], 60.00th=[304088], | 70.00th=[304088], 80.00th=[304088], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 1848, max= 2043, per=33.46%, avg=1945.50, stdev=137.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2907KiB/s (2977kB/s)(10.0MiB/3522msec); 0 zone resets clat (msec): min=136, max=576, avg=321.19, stdev=125.06 lat (msec): min=136, max=576, avg=321.28, stdev=125.08 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 232], | 30.00th=[ 255], 40.00th=[ 262], 50.00th=[ 264], 60.00th=[ 284], | 70.00th=[ 388], 80.00th=[ 397], 90.00th=[ 422], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2048, max= 4087, per=40.15%, avg=3268.20, stdev=1113.89, samples=5 iops : min= 2, max= 3, avg= 2.60, stdev= 0.55, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=16.67%, 500=66.67%, 750=8.33% cpu : usr=0.06%, sys=25.02%, ctx=181, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146690: Wed Mar 11 06:24:25 2026 read: IOPS=1, BW=1805KiB/s (1849kB/s)(6144KiB/3403msec) clat (usec): min=740, max=234392, avg=102701.95, stdev=100844.23 lat (usec): min=742, max=234394, avg=102703.47, stdev=100844.06 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 758], | 30.00th=[ 758], 40.00th=[ 73925], 50.00th=[ 73925], 60.00th=[ 94897], | 70.00th=[210764], 80.00th=[210764], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 2039, max= 8192, per=87.99%, avg=5115.50, stdev=4350.83, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 write: IOPS=1, BW=1805KiB/s (1849kB/s)(6144KiB/3403msec); 0 zone resets clat (msec): min=172, max=1145, avg=464.06, stdev=379.21 lat (msec): min=172, max=1145, avg=464.16, stdev=379.19 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 468], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2039, max= 3938, per=30.94%, avg=2518.25, stdev=946.51, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=16.37%, ctx=225, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146691: Wed Mar 11 06:24:25 2026 read: IOPS=1, BW=1964KiB/s (2011kB/s)(5120KiB/2607msec) clat (usec): min=587, max=322426, avg=125312.27, stdev=144227.79 lat (usec): min=588, max=322426, avg=125313.23, stdev=144227.89 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 586], | 30.00th=[ 3490], 40.00th=[ 3490], 50.00th=[ 69731], 60.00th=[ 69731], | 70.00th=[229639], 80.00th=[229639], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2750KiB/s (2816kB/s)(7168KiB/2607msec); 0 zone resets clat (msec): min=129, max=477, avg=282.55, stdev=140.05 lat (msec): min=129, max=477, avg=282.71, stdev=140.18 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 161], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 241], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 468], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1878, max= 6119, per=43.40%, avg=3533.00, stdev=1994.87, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=28.13%, ctx=164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5815KiB/s (5954kB/s), 581KiB/s-2521KiB/s (595kB/s-2582kB/s), io=20.0MiB (20.0MB), run=2607-3522msec WRITE: bw=8141KiB/s (8336kB/s), 1801KiB/s-2907KiB/s (1844kB/s-2977kB/s), io=28.0MiB (29.4MB), run=2607-3522msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146701: Wed Mar 11 06:24:38 2026 read: IOPS=0, BW=3008KiB/s (3080kB/s)(12.0MiB/4085msec) clat (msec): min=564, max=2797, avg=1340.18, stdev=1263.17 lat (msec): min=564, max=2797, avg=1340.18, stdev=1263.17 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.19%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146703: Wed Mar 11 06:24:38 2026 read: IOPS=0, BW=869KiB/s (890kB/s)(4096KiB/4713msec) clat (nsec): min=3050.4M, max=3050.4M, avg=3050437496.00, stdev= 0.00 lat (nsec): min=3050.4M, max=3050.4M, avg=3050439531.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3037], 5.00th=[ 3037], 10.00th=[ 3037], 20.00th=[ 3037], | 30.00th=[ 3037], 40.00th=[ 3037], 50.00th=[ 3037], 60.00th=[ 3037], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1738KiB/s (1780kB/s)(8192KiB/4713msec); 0 zone resets clat (msec): min=474, max=1093, avg=783.83, stdev=437.84 lat (msec): min=474, max=1093, avg=784.32, stdev=437.77 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.54%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146704: Wed Mar 11 06:24:38 2026 write: IOPS=0, BW=2501KiB/s (2561kB/s)(12.0MiB/4914msec); 0 zone resets clat (msec): min=468, max=3500, avg=1588.00, stdev=1664.44 lat (msec): min=469, max=3501, avg=1588.37, stdev=1664.46 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 8031, max= 8126, per=100.00%, avg=8078.50, stdev=67.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.99%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146705: Wed Mar 11 06:24:38 2026 write: IOPS=0, BW=2980KiB/s (3051kB/s)(12.0MiB/4124msec); 0 zone resets clat (msec): min=195, max=3536, avg=1349.65, stdev=1894.84 lat (msec): min=196, max=3536, avg=1350.28, stdev=1894.64 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 3540], 80.00th=[ 3540], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min=11872, max=11872, per=100.00%, avg=11872.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.27%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3476KiB/s (3560kB/s), 869KiB/s-3008KiB/s (890kB/s-3080kB/s), io=16.0MiB (16.8MB), run=4085-4713msec WRITE: bw=6668KiB/s (6828kB/s), 1738KiB/s-2980KiB/s (1780kB/s-3051kB/s), io=32.0MiB (33.6MB), run=4124-4914msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146698: Wed Mar 11 06:24:38 2026 read: IOPS=0, BW=2934KiB/s (3005kB/s)(12.0MiB/4188msec) clat (msec): min=515, max=2812, avg=1321.26, stdev=1292.93 lat (msec): min=515, max=2812, avg=1321.26, stdev=1292.93 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 8000, max= 8192, per=100.00%, avg=8096.00, stdev=135.76, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=15.72%, ctx=1141, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146699: Wed Mar 11 06:24:38 2026 read: IOPS=0, BW=973KiB/s (997kB/s)(4096KiB/4209msec) clat (nsec): min=513283k, max=513283k, avg=513283018.00, stdev= 0.00 lat (nsec): min=513284k, max=513284k, avg=513284223.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 5936, max= 5936, per=100.00%, avg=5936.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1946KiB/s (1993kB/s)(8192KiB/4209msec); 0 zone resets clat (msec): min=983, max=2580, avg=1782.27, stdev=1128.95 lat (msec): min=984, max=2583, avg=1784.19, stdev=1130.75 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 2567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.85%, ctx=169, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146700: Wed Mar 11 06:24:38 2026 write: IOPS=0, BW=2324KiB/s (2380kB/s)(12.0MiB/5287msec); 0 zone resets clat (msec): min=179, max=4478, avg=1688.35, stdev=2418.82 lat (msec): min=179, max=4478, avg=1690.63, stdev=2417.32 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.07%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146702: Wed Mar 11 06:24:38 2026 write: IOPS=0, BW=2433KiB/s (2491kB/s)(12.0MiB/5051msec); 0 zone resets clat (msec): min=493, max=2603, avg=1615.52, stdev=1061.51 lat (msec): min=494, max=2604, avg=1616.12, stdev=1061.42 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 8000, max= 8192, per=100.00%, avg=8096.00, stdev=135.76, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.26%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3893KiB/s (3986kB/s), 973KiB/s-2934KiB/s (997kB/s-3005kB/s), io=16.0MiB (16.8MB), run=4188-4209msec WRITE: bw=6198KiB/s (6347kB/s), 1946KiB/s-2433KiB/s (1993kB/s-2491kB/s), io=32.0MiB (33.6MB), run=4209-5287msec