== sanity test 398b: DIO and buffer IO race ============== 03:51:52 (1780386712) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.52611 s, 14.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179867: Tue Jun 2 03:53:14 2026 read: IOPS=21, BW=86.4KiB/s (88.5kB/s)(5992KiB/69312msec) clat (usec): min=32, max=759277, avg=25846.09, stdev=24285.40 lat (usec): min=33, max=759279, avg=25847.03, stdev=24285.41 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8717], 10.00th=[ 10814], 20.00th=[ 13960], | 30.00th=[ 16581], 40.00th=[ 19268], 50.00th=[ 22414], 60.00th=[ 26084], | 70.00th=[ 30278], 80.00th=[ 34866], 90.00th=[ 42206], 95.00th=[ 51119], | 99.00th=[ 88605], 99.50th=[ 95945], 99.90th=[160433], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 13, max= 168, per=25.48%, avg=85.85, stdev=25.55, samples=137 iops : min= 3, max= 42, avg=20.91, stdev= 6.40, samples=137 write: IOPS=22, BW=90.8KiB/s (93.0kB/s)(6296KiB/69312msec); 0 zone resets clat (usec): min=854, max=130637, avg=19321.32, stdev=18631.45 lat (usec): min=856, max=130637, avg=19323.22, stdev=18631.83 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1352], 10.00th=[ 1745], 20.00th=[ 2933], | 30.00th=[ 4883], 40.00th=[ 10028], 50.00th=[ 14615], 60.00th=[ 19268], | 70.00th=[ 25035], 80.00th=[ 32900], 90.00th=[ 45351], 95.00th=[ 57934], | 99.00th=[ 78119], 99.50th=[ 89654], 99.90th=[109577], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 15, max= 198, per=25.76%, avg=90.95, stdev=30.17, samples=136 iops : min= 3, max= 49, avg=22.19, stdev= 7.55, samples=136 lat (usec) : 50=0.39%, 100=0.65%, 250=0.26%, 1000=0.33% lat (msec) : 2=5.96%, 4=7.39%, 10=9.28%, 20=28.03%, 50=41.47% lat (msec) : 100=5.92%, 250=0.29%, 1000=0.03% cpu : usr=0.11%, sys=10.75%, ctx=7095, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179868: Tue Jun 2 03:53:14 2026 read: IOPS=21, BW=84.9KiB/s (86.9kB/s)(5940KiB/69957msec) clat (usec): min=33, max=153974, avg=25879.78, stdev=16094.93 lat (usec): min=34, max=153975, avg=25881.36, stdev=16094.90 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 8225], 10.00th=[ 11076], 20.00th=[ 14353], | 30.00th=[ 16581], 40.00th=[ 19268], 50.00th=[ 22414], 60.00th=[ 26084], | 70.00th=[ 30278], 80.00th=[ 35390], 90.00th=[ 44827], 95.00th=[ 54264], | 99.00th=[ 87557], 99.50th=[ 95945], 99.90th=[139461], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 6, max= 152, per=25.02%, avg=84.30, stdev=22.35, samples=138 iops : min= 1, max= 38, avg=20.52, stdev= 5.64, samples=138 write: IOPS=22, BW=90.7KiB/s (92.9kB/s)(6348KiB/69957msec); 0 zone resets clat (usec): min=797, max=690863, avg=19743.41, stdev=24846.77 lat (usec): min=797, max=690864, avg=19745.12, stdev=24846.33 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1287], 10.00th=[ 1663], 20.00th=[ 2966], | 30.00th=[ 5407], 40.00th=[ 10290], 50.00th=[ 14877], 60.00th=[ 19530], | 70.00th=[ 24511], 80.00th=[ 32375], 90.00th=[ 46400], 95.00th=[ 56361], | 99.00th=[ 76022], 99.50th=[ 94897], 99.90th=[122160], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 6, max= 168, per=25.43%, avg=89.78, stdev=28.02, samples=138 iops : min= 1, max= 42, avg=21.90, stdev= 7.03, samples=138 lat (usec) : 50=0.29%, 100=0.75%, 250=0.23%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=6.54%, 4=6.64%, 10=8.89%, 20=28.74%, 50=39.97% lat (msec) : 100=7.00%, 250=0.39%, 750=0.03% cpu : usr=0.08%, sys=10.75%, ctx=7197, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179869: Tue Jun 2 03:53:14 2026 read: IOPS=21, BW=85.8KiB/s (87.9kB/s)(6028KiB/70232msec) clat (usec): min=34, max=173145, avg=25324.98, stdev=15135.64 lat (usec): min=35, max=173146, avg=25325.97, stdev=15135.64 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 7373], 10.00th=[ 10421], 20.00th=[ 13566], | 30.00th=[ 16319], 40.00th=[ 19268], 50.00th=[ 22938], 60.00th=[ 26870], | 70.00th=[ 30540], 80.00th=[ 35390], 90.00th=[ 42730], 95.00th=[ 51643], | 99.00th=[ 73925], 99.50th=[ 79168], 99.90th=[131597], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 167, per=25.47%, avg=85.82, stdev=23.64, samples=138 iops : min= 7, max= 41, avg=20.90, stdev= 5.91, samples=138 write: IOPS=22, BW=89.1KiB/s (91.3kB/s)(6260KiB/70232msec); 0 zone resets clat (usec): min=790, max=758875, avg=20364.04, stdev=26320.34 lat (usec): min=791, max=758878, avg=20366.52, stdev=26320.24 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1336], 10.00th=[ 1860], 20.00th=[ 3261], | 30.00th=[ 5800], 40.00th=[ 10814], 50.00th=[ 15270], 60.00th=[ 20317], | 70.00th=[ 26084], 80.00th=[ 33424], 90.00th=[ 45351], 95.00th=[ 56886], | 99.00th=[ 82314], 99.50th=[ 92799], 99.90th=[143655], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 31, max= 183, per=25.21%, avg=88.99, stdev=28.23, samples=138 iops : min= 7, max= 45, avg=21.70, stdev= 7.10, samples=138 lat (usec) : 50=0.42%, 100=1.01%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.46% lat (msec) : 2=5.21%, 4=6.45%, 10=9.86%, 20=27.18%, 50=42.64% lat (msec) : 100=6.15%, 250=0.20%, 1000=0.03% cpu : usr=0.13%, sys=10.57%, ctx=7131, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179870: Tue Jun 2 03:53:14 2026 read: IOPS=21, BW=85.1KiB/s (87.1kB/s)(6052KiB/71113msec) clat (usec): min=27, max=166924, avg=25583.91, stdev=16019.35 lat (usec): min=28, max=166925, avg=25584.92, stdev=16019.46 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 7373], 10.00th=[ 10421], 20.00th=[ 13566], | 30.00th=[ 16188], 40.00th=[ 19006], 50.00th=[ 22152], 60.00th=[ 26346], | 70.00th=[ 31327], 80.00th=[ 36439], 90.00th=[ 45876], 95.00th=[ 52167], | 99.00th=[ 78119], 99.50th=[ 93848], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 15, max= 198, per=25.34%, avg=85.39, stdev=25.84, samples=140 iops : min= 3, max= 49, avg=20.79, stdev= 6.49, samples=140 write: IOPS=21, BW=87.7KiB/s (89.8kB/s)(6236KiB/71113msec); 0 zone resets clat (usec): min=867, max=724063, avg=20603.27, stdev=26186.33 lat (usec): min=868, max=724067, avg=20604.40, stdev=26186.36 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1369], 10.00th=[ 1893], 20.00th=[ 3130], | 30.00th=[ 5866], 40.00th=[ 11207], 50.00th=[ 15401], 60.00th=[ 20055], | 70.00th=[ 26084], 80.00th=[ 34341], 90.00th=[ 46400], 95.00th=[ 57410], | 99.00th=[ 80217], 99.50th=[100140], 99.90th=[160433], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 31, max= 213, per=24.91%, avg=87.93, stdev=30.66, samples=140 iops : min= 7, max= 53, avg=21.43, stdev= 7.64, samples=140 lat (usec) : 50=0.42%, 100=1.27%, 250=0.26%, 750=0.03%, 1000=0.20% lat (msec) : 2=5.53%, 4=6.71%, 10=9.47%, 20=28.03%, 50=40.95% lat (msec) : 100=6.71%, 250=0.39%, 750=0.03% cpu : usr=0.10%, sys=10.41%, ctx=7199, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=338KiB/s (346kB/s), 84.9KiB/s-86.4KiB/s (86.9kB/s-88.5kB/s), io=23.4MiB (24.6MB), run=69312-71113msec WRITE: bw=354KiB/s (362kB/s), 87.7KiB/s-90.8KiB/s (89.8kB/s-93.0kB/s), io=24.6MiB (25.7MB), run=69312-71113msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179862: Tue Jun 2 03:53:34 2026 read: IOPS=16, BW=65.6KiB/s (67.1kB/s)(5992KiB/91404msec) clat (msec): min=3, max=760, avg=23.85, stdev=27.02 lat (msec): min=3, max=760, avg=23.85, stdev=27.02 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 51], 95.00th=[ 67], | 99.00th=[ 94], 99.50th=[ 101], 99.90th=[ 138], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 192, per=24.90%, avg=65.25, stdev=39.00, samples=180 iops : min= 1, max= 48, avg=15.74, stdev= 9.81, samples=180 write: IOPS=17, BW=68.9KiB/s (70.5kB/s)(6296KiB/91404msec); 0 zone resets clat (msec): min=7, max=181, avg=35.22, stdev=23.07 lat (msec): min=7, max=181, avg=35.22, stdev=23.07 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 67], 95.00th=[ 82], | 99.00th=[ 113], 99.50th=[ 129], 99.90th=[ 148], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 8, max= 191, per=25.05%, avg=68.63, stdev=37.72, samples=180 iops : min= 2, max= 47, avg=16.59, stdev= 9.45, samples=180 lat (msec) : 4=0.10%, 10=11.00%, 20=33.66%, 50=39.36%, 100=14.65% lat (msec) : 250=1.20%, 1000=0.03% cpu : usr=0.09%, sys=4.51%, ctx=5282, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179863: Tue Jun 2 03:53:34 2026 read: IOPS=16, BW=64.9KiB/s (66.5kB/s)(5940KiB/91477msec) clat (msec): min=3, max=696, avg=23.33, stdev=25.54 lat (msec): min=3, max=696, avg=23.33, stdev=25.54 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 49], 95.00th=[ 64], | 99.00th=[ 96], 99.50th=[ 106], 99.90th=[ 136], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8, max= 200, per=24.69%, avg=64.70, stdev=40.10, samples=180 iops : min= 2, max= 50, avg=15.61, stdev=10.05, samples=180 write: IOPS=17, BW=69.4KiB/s (71.1kB/s)(6348KiB/91477msec); 0 zone resets clat (msec): min=5, max=188, avg=35.66, stdev=24.08 lat (msec): min=5, max=188, avg=35.66, stdev=24.08 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 67], 95.00th=[ 82], | 99.00th=[ 120], 99.50th=[ 144], 99.90th=[ 186], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 16, max= 191, per=25.18%, avg=68.98, stdev=37.25, samples=180 iops : min= 4, max= 47, avg=16.68, stdev= 9.34, samples=180 lat (msec) : 4=0.03%, 10=11.13%, 20=34.15%, 50=38.70%, 100=14.65% lat (msec) : 250=1.30%, 750=0.03% cpu : usr=0.07%, sys=4.63%, ctx=5278, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179864: Tue Jun 2 03:53:34 2026 read: IOPS=16, BW=65.0KiB/s (67.6kB/s)(6028KiB/91345msec) clat (msec): min=3, max=186, avg=24.09, stdev=20.74 lat (msec): min=3, max=186, avg=24.09, stdev=20.74 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 53], 95.00th=[ 67], | 99.00th=[ 102], 99.50th=[ 115], 99.90th=[ 132], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 15, max= 214, per=25.26%, avg=66.18, stdev=39.99, samples=179 iops : min= 3, max= 53, avg=15.98, stdev=10.03, samples=179 write: IOPS=17, BW=68.5KiB/s (70.2kB/s)(6260KiB/91345msec); 0 zone resets clat (msec): min=6, max=728, avg=35.00, stdev=28.82 lat (msec): min=6, max=728, avg=35.00, stdev=28.82 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 67], 95.00th=[ 80], | 99.00th=[ 115], 99.50th=[ 130], 99.90th=[ 184], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 23, max= 184, per=24.91%, avg=68.26, stdev=39.51, samples=180 iops : min= 5, max= 46, avg=16.50, stdev= 9.90, samples=180 lat (msec) : 4=0.07%, 10=11.13%, 20=34.24%, 50=38.44%, 100=14.39% lat (msec) : 250=1.69%, 750=0.03% cpu : usr=0.07%, sys=4.67%, ctx=5243, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179865: Tue Jun 2 03:53:34 2026 read: IOPS=16, BW=66.1KiB/s (67.7kB/s)(6052KiB/91510msec) clat (msec): min=3, max=188, avg=23.78, stdev=21.09 lat (msec): min=3, max=188, avg=23.79, stdev=21.09 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 53], 95.00th=[ 68], | 99.00th=[ 107], 99.50th=[ 116], 99.90th=[ 142], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 7, max= 192, per=25.34%, avg=66.39, stdev=39.55, samples=178 iops : min= 1, max= 48, avg=16.03, stdev= 9.93, samples=178 write: IOPS=17, BW=68.1KiB/s (69.8kB/s)(6236KiB/91510msec); 0 zone resets clat (msec): min=6, max=723, avg=35.44, stdev=29.36 lat (msec): min=6, max=723, avg=35.44, stdev=29.36 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 67], 95.00th=[ 81], | 99.00th=[ 117], 99.50th=[ 128], 99.90th=[ 192], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 15, max= 176, per=24.75%, avg=67.83, stdev=38.39, samples=180 iops : min= 3, max= 44, avg=16.39, stdev= 9.63, samples=180 lat (msec) : 4=0.07%, 10=12.04%, 20=33.33%, 50=38.31%, 100=14.29% lat (msec) : 250=1.92%, 750=0.03% cpu : usr=0.07%, sys=4.57%, ctx=5281, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=262KiB/s (269kB/s), 64.9KiB/s-66.1KiB/s (66.5kB/s-67.7kB/s), io=23.4MiB (24.6MB), run=91345-91510msec WRITE: bw=275KiB/s (281kB/s), 68.1KiB/s-69.4KiB/s (69.8kB/s-71.1kB/s), io=24.6MiB (25.7MB), run=91345-91510msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179896: Tue Jun 2 03:53:56 2026 read: IOPS=20, BW=332KiB/s (340kB/s)(5920KiB/17839msec) clat (usec): min=34, max=93075, avg=25246.95, stdev=16872.95 lat (usec): min=34, max=93076, avg=25247.85, stdev=16872.96 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 70], 10.00th=[ 2540], 20.00th=[13566], | 30.00th=[16909], 40.00th=[19530], 50.00th=[22676], 60.00th=[26346], | 70.00th=[30016], 80.00th=[35914], 90.00th=[44827], 95.00th=[58459], | 99.00th=[82314], 99.50th=[91751], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 608, per=24.79%, avg=329.26, stdev=102.31, samples=35 iops : min= 9, max= 38, avg=20.03, stdev= 6.40, samples=35 write: IOPS=22, BW=357KiB/s (366kB/s)(6368KiB/17839msec); 0 zone resets clat (usec): min=1170, max=114653, avg=21124.39, stdev=18183.62 lat (usec): min=1173, max=114655, avg=21125.99, stdev=18183.72 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2343], 10.00th=[ 3195], 20.00th=[ 5145], | 30.00th=[ 7570], 40.00th=[ 12256], 50.00th=[ 15926], 60.00th=[ 21627], | 70.00th=[ 27395], 80.00th=[ 35390], 90.00th=[ 46924], 95.00th=[ 58459], | 99.00th=[ 77071], 99.50th=[ 89654], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 127, max= 672, per=25.51%, avg=356.60, stdev=104.46, samples=35 iops : min= 7, max= 42, avg=21.74, stdev= 6.66, samples=35 lat (usec) : 50=0.52%, 100=2.60%, 250=1.43%, 500=0.13% lat (msec) : 2=1.43%, 4=6.25%, 10=11.46%, 20=26.04%, 50=42.19% lat (msec) : 100=7.81%, 250=0.13% cpu : usr=0.07%, sys=13.88%, ctx=2042, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179897: Tue Jun 2 03:53:56 2026 read: IOPS=19, BW=319KiB/s (326kB/s)(5744KiB/18025msec) clat (usec): min=31, max=86387, avg=26427.43, stdev=16394.26 lat (usec): min=31, max=86388, avg=26428.32, stdev=16394.28 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 95], 10.00th=[ 9110], 20.00th=[14615], | 30.00th=[17957], 40.00th=[21103], 50.00th=[25035], 60.00th=[27919], | 70.00th=[31589], 80.00th=[36963], 90.00th=[46924], 95.00th=[57410], | 99.00th=[78119], 99.50th=[83362], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 145, max= 576, per=23.89%, avg=317.26, stdev=96.15, samples=35 iops : min= 9, max= 36, avg=19.29, stdev= 6.16, samples=35 write: IOPS=22, BW=363KiB/s (372kB/s)(6544KiB/18025msec); 0 zone resets clat (usec): min=1319, max=88050, avg=20692.49, stdev=18103.89 lat (usec): min=1320, max=88051, avg=20694.57, stdev=18103.63 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1942], 10.00th=[ 2868], 20.00th=[ 5014], | 30.00th=[ 7635], 40.00th=[11338], 50.00th=[15008], 60.00th=[19530], | 70.00th=[27395], 80.00th=[35390], 90.00th=[46400], 95.00th=[57934], | 99.00th=[78119], 99.50th=[82314], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 190, max= 544, per=25.39%, avg=354.94, stdev=96.95, samples=35 iops : min= 11, max= 34, avg=21.63, stdev= 6.12, samples=35 lat (usec) : 50=0.52%, 100=2.08%, 250=1.56% lat (msec) : 2=2.99%, 4=5.73%, 10=11.59%, 20=24.22%, 50=43.23% lat (msec) : 100=8.07% cpu : usr=0.08%, sys=13.57%, ctx=2018, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179898: Tue Jun 2 03:53:56 2026 read: IOPS=21, BW=350KiB/s (358kB/s)(6256KiB/17899msec) clat (usec): min=36, max=106336, avg=25203.90, stdev=15023.10 lat (usec): min=37, max=106337, avg=25205.79, stdev=15022.93 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 79], 10.00th=[ 7635], 20.00th=[ 13960], | 30.00th=[ 17957], 40.00th=[ 20841], 50.00th=[ 23987], 60.00th=[ 27657], | 70.00th=[ 31065], 80.00th=[ 35914], 90.00th=[ 43779], 95.00th=[ 51119], | 99.00th=[ 72877], 99.50th=[ 78119], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 190, max= 542, per=26.31%, avg=349.43, stdev=80.07, samples=35 iops : min= 11, max= 33, avg=21.29, stdev= 4.96, samples=35 write: IOPS=21, BW=337KiB/s (345kB/s)(6032KiB/17899msec); 0 zone resets clat (usec): min=1522, max=100129, avg=21084.90, stdev=17922.78 lat (usec): min=1523, max=100130, avg=21086.50, stdev=17922.70 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2311], 10.00th=[ 3294], 20.00th=[ 5080], | 30.00th=[ 7635], 40.00th=[ 12125], 50.00th=[ 17171], 60.00th=[ 21627], | 70.00th=[ 26870], 80.00th=[ 33424], 90.00th=[ 46400], 95.00th=[ 55837], | 99.00th=[ 80217], 99.50th=[ 92799], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 158, max= 576, per=23.67%, avg=330.89, stdev=113.97, samples=35 iops : min= 9, max= 36, avg=20.14, stdev= 7.17, samples=35 lat (usec) : 50=0.26%, 100=2.99%, 250=1.30%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.69%, 4=4.95%, 10=11.72%, 20=23.57%, 50=46.61% lat (msec) : 100=6.38%, 250=0.26% cpu : usr=0.09%, sys=13.77%, ctx=2128, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179899: Tue Jun 2 03:53:56 2026 read: IOPS=22, BW=356KiB/s (364kB/s)(6032KiB/16952msec) clat (usec): min=47, max=103918, avg=23454.91, stdev=15351.80 lat (usec): min=47, max=103919, avg=23456.06, stdev=15351.35 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 145], 20.00th=[ 12256], | 30.00th=[ 15664], 40.00th=[ 18482], 50.00th=[ 21890], 60.00th=[ 26084], | 70.00th=[ 29492], 80.00th=[ 33424], 90.00th=[ 42206], 95.00th=[ 48497], | 99.00th=[ 72877], 99.50th=[ 87557], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 190, max= 704, per=26.76%, avg=355.42, stdev=106.98, samples=33 iops : min= 11, max= 44, avg=21.67, stdev= 6.80, samples=33 write: IOPS=23, BW=369KiB/s (378kB/s)(6256KiB/16952msec); 0 zone resets clat (usec): min=1224, max=120017, avg=20516.39, stdev=18483.36 lat (usec): min=1225, max=120018, avg=20518.56, stdev=18483.76 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2311], 10.00th=[ 3130], 20.00th=[ 5669], | 30.00th=[ 7898], 40.00th=[ 11207], 50.00th=[ 15270], 60.00th=[ 19792], | 70.00th=[ 25297], 80.00th=[ 33424], 90.00th=[ 42206], 95.00th=[ 61080], | 99.00th=[ 84411], 99.50th=[102237], 99.90th=[120062], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 159, max= 698, per=26.38%, avg=368.76, stdev=105.30, samples=33 iops : min= 9, max= 43, avg=22.48, stdev= 6.74, samples=33 lat (usec) : 50=0.39%, 100=3.91%, 250=1.04%, 750=0.13% lat (msec) : 2=1.69%, 4=6.12%, 10=12.76%, 20=26.43%, 50=41.93% lat (msec) : 100=5.21%, 250=0.39% cpu : usr=0.09%, sys=13.96%, ctx=1975, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1329KiB/s (1361kB/s), 319KiB/s-356KiB/s (326kB/s-364kB/s), io=23.4MiB (24.5MB), run=16952-18025msec WRITE: bw=1398KiB/s (1432kB/s), 337KiB/s-369KiB/s (345kB/s-378kB/s), io=24.6MiB (25.8MB), run=16952-18025msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179901: Tue Jun 2 03:54:01 2026 read: IOPS=16, BW=261KiB/s (268kB/s)(5920KiB/22651msec) clat (msec): min=5, max=139, avg=24.79, stdev=21.32 lat (msec): min=5, max=139, avg=24.79, stdev=21.32 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 37], 90.00th=[ 57], 95.00th=[ 73], | 99.00th=[ 95], 99.50th=[ 112], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 95, max= 640, per=24.31%, avg=254.75, stdev=140.93, samples=44 iops : min= 5, max= 40, avg=15.34, stdev= 8.95, samples=44 write: IOPS=17, BW=281KiB/s (288kB/s)(6368KiB/22651msec); 0 zone resets clat (msec): min=9, max=119, avg=33.79, stdev=20.96 lat (msec): min=9, max=119, avg=33.79, stdev=20.96 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 64], 95.00th=[ 84], | 99.00th=[ 104], 99.50th=[ 113], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 94, max= 702, per=25.23%, avg=278.05, stdev=147.05, samples=44 iops : min= 5, max= 43, avg=16.80, stdev= 9.31, samples=44 lat (msec) : 10=8.33%, 20=37.63%, 50=38.02%, 100=14.97%, 250=1.04% cpu : usr=0.09%, sys=5.50%, ctx=1342, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179902: Tue Jun 2 03:54:01 2026 read: IOPS=15, BW=253KiB/s (259kB/s)(5744KiB/22673msec) clat (msec): min=4, max=134, avg=24.08, stdev=18.79 lat (msec): min=4, max=134, avg=24.08, stdev=18.79 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 50], 95.00th=[ 65], | 99.00th=[ 99], 99.50th=[ 105], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 44, max= 640, per=24.04%, avg=251.93, stdev=142.57, samples=44 iops : min= 2, max= 40, avg=15.16, stdev= 9.05, samples=44 write: IOPS=18, BW=289KiB/s (296kB/s)(6544KiB/22673msec); 0 zone resets clat (msec): min=9, max=143, avg=34.24, stdev=21.57 lat (msec): min=9, max=143, avg=34.24, stdev=21.57 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 64], 95.00th=[ 80], | 99.00th=[ 109], 99.50th=[ 123], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 95, max= 734, per=25.47%, avg=280.70, stdev=143.56, samples=44 iops : min= 5, max= 45, avg=16.98, stdev= 9.09, samples=44 lat (msec) : 10=8.33%, 20=33.98%, 50=42.97%, 100=13.54%, 250=1.17% cpu : usr=0.09%, sys=5.75%, ctx=1370, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179903: Tue Jun 2 03:54:01 2026 read: IOPS=17, BW=274KiB/s (280kB/s)(6256KiB/22847msec) clat (msec): min=4, max=126, avg=24.66, stdev=21.15 lat (msec): min=4, max=126, avg=24.66, stdev=21.15 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 58], 95.00th=[ 71], | 99.00th=[ 103], 99.50th=[ 126], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 63, max= 763, per=26.24%, avg=275.02, stdev=170.02, samples=45 iops : min= 3, max= 47, avg=16.62, stdev=10.75, samples=45 write: IOPS=16, BW=264KiB/s (270kB/s)(6032KiB/22847msec); 0 zone resets clat (msec): min=7, max=123, avg=34.90, stdev=21.95 lat (msec): min=7, max=123, avg=34.90, stdev=21.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 68], 95.00th=[ 78], | 99.00th=[ 105], 99.50th=[ 112], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 91, max= 832, per=23.93%, avg=263.71, stdev=152.10, samples=45 iops : min= 5, max= 52, avg=15.91, stdev= 9.65, samples=45 lat (msec) : 10=11.98%, 20=32.81%, 50=38.54%, 100=15.23%, 250=1.43% cpu : usr=0.07%, sys=5.31%, ctx=1292, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179904: Tue Jun 2 03:54:01 2026 read: IOPS=16, BW=265KiB/s (271kB/s)(6032KiB/22763msec) clat (msec): min=4, max=128, avg=23.54, stdev=18.81 lat (msec): min=4, max=128, avg=23.54, stdev=18.81 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 51], 95.00th=[ 62], | 99.00th=[ 95], 99.50th=[ 100], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 95, max= 702, per=24.53%, avg=257.05, stdev=141.26, samples=44 iops : min= 5, max= 43, avg=15.50, stdev= 8.93, samples=44 write: IOPS=17, BW=275KiB/s (281kB/s)(6256KiB/22763msec); 0 zone resets clat (msec): min=8, max=133, avg=35.46, stdev=22.64 lat (msec): min=8, max=133, avg=35.47, stdev=22.64 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 68], 95.00th=[ 84], | 99.00th=[ 113], 99.50th=[ 117], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 127, max= 704, per=24.35%, avg=268.39, stdev=134.30, samples=44 iops : min= 7, max= 44, avg=16.18, stdev= 8.50, samples=44 lat (msec) : 10=10.29%, 20=34.11%, 50=39.06%, 100=15.36%, 250=1.17% cpu : usr=0.10%, sys=5.63%, ctx=1352, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1048KiB/s (1074kB/s), 253KiB/s-274KiB/s (259kB/s-280kB/s), io=23.4MiB (24.5MB), run=22651-22847msec WRITE: bw=1103KiB/s (1129kB/s), 264KiB/s-289KiB/s (270kB/s-296kB/s), io=24.6MiB (25.8MB), run=22651-22847msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179912: Tue Jun 2 03:54:09 2026 read: IOPS=2, BW=2643KiB/s (2707kB/s)(7168KiB/2712msec) clat (msec): min=40, max=613, avg=232.60, stdev=221.30 lat (msec): min=40, max=613, avg=232.60, stdev=221.30 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 77], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 159], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 472], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1681, max= 4087, per=45.44%, avg=2931.00, stdev=1242.72, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1888KiB/s (1933kB/s)(5120KiB/2712msec); 0 zone resets clat (msec): min=120, max=346, avg=199.64, stdev=94.66 lat (msec): min=121, max=346, avg=199.71, stdev=94.64 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 2043, max= 6144, per=45.33%, avg=4093.50, stdev=2899.84, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=11.66%, ctx=129, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179913: Tue Jun 2 03:54:09 2026 read: IOPS=0, BW=651KiB/s (667kB/s)(2048KiB/3144msec) clat (msec): min=59, max=509, avg=284.70, stdev=318.36 lat (msec): min=59, max=509, avg=284.70, stdev=318.36 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 60], | 30.00th=[ 60], 40.00th=[ 60], 50.00th=[ 60], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1625, max= 1954, per=27.74%, avg=1789.50, stdev=232.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3257KiB/s (3335kB/s)(10.0MiB/3144msec); 0 zone resets clat (msec): min=64, max=532, avg=254.64, stdev=162.23 lat (msec): min=64, max=532, avg=254.72, stdev=162.22 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 130], | 30.00th=[ 165], 40.00th=[ 176], 50.00th=[ 178], 60.00th=[ 182], | 70.00th=[ 259], 80.00th=[ 334], 90.00th=[ 531], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1625, max= 4087, per=32.80%, avg=2961.75, stdev=1310.75, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.03%, sys=10.02%, ctx=104, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179914: Tue Jun 2 03:54:09 2026 read: IOPS=1, BW=1935KiB/s (1982kB/s)(6144KiB/3175msec) clat (msec): min=59, max=296, avg=131.35, stdev=93.99 lat (msec): min=59, max=296, avg=131.35, stdev=93.99 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 70], | 30.00th=[ 70], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 93], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 2039, max= 4096, per=51.90%, avg=3347.67, stdev=1137.23, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1935KiB/s (1982kB/s)(6144KiB/3175msec); 0 zone resets clat (msec): min=189, max=579, avg=364.55, stdev=143.60 lat (msec): min=189, max=579, avg=364.63, stdev=143.60 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 376], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2043, max= 4087, per=33.93%, avg=3064.25, stdev=1176.36, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=9.70%, ctx=128, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179915: Tue Jun 2 03:54:09 2026 read: IOPS=1, BW=1715KiB/s (1756kB/s)(5120KiB/2985msec) clat (msec): min=69, max=592, avg=257.76, stdev=217.98 lat (msec): min=69, max=592, avg=257.76, stdev=217.98 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 3908, max= 4087, per=61.98%, avg=3997.50, stdev=126.57, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2401KiB/s (2459kB/s)(7168KiB/2985msec); 0 zone resets clat (msec): min=80, max=439, avg=235.07, stdev=157.01 lat (msec): min=80, max=439, avg=235.14, stdev=157.02 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 87], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 215], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 409], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 2048, max= 4087, per=35.02%, avg=3162.00, stdev=1032.56, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (msec) : 100=41.67%, 250=16.67%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=7.54%, ctx=98, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6450KiB/s (6605kB/s), 651KiB/s-2643KiB/s (667kB/s-2707kB/s), io=20.0MiB (20.0MB), run=2712-3175msec WRITE: bw=9031KiB/s (9247kB/s), 1888KiB/s-3257KiB/s (1933kB/s-3335kB/s), io=28.0MiB (29.4MB), run=2712-3175msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179917: Tue Jun 2 03:54:09 2026 read: IOPS=3, BW=3361KiB/s (3441kB/s)(7168KiB/2133msec) clat (usec): min=530, max=341906, avg=160024.25, stdev=102318.70 lat (usec): min=531, max=341907, avg=160025.40, stdev=102318.72 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[117965], | 30.00th=[123208], 40.00th=[123208], 50.00th=[173016], 60.00th=[181404], | 70.00th=[181404], 80.00th=[183501], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 1992, max= 5260, per=43.28%, avg=2833.50, stdev=1617.83, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=2, BW=2400KiB/s (2458kB/s)(5120KiB/2133msec); 0 zone resets clat (msec): min=151, max=244, avg=198.53, stdev=38.75 lat (msec): min=151, max=244, avg=198.60, stdev=38.75 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 2039, max= 3984, per=29.33%, avg=2688.67, stdev=1121.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=83.33%, 500=8.33% cpu : usr=0.00%, sys=43.15%, ctx=347, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179918: Tue Jun 2 03:54:09 2026 read: IOPS=0, BW=655KiB/s (670kB/s)(2048KiB/3128msec) clat (msec): min=192, max=230, avg=211.85, stdev=26.72 lat (msec): min=192, max=230, avg=211.85, stdev=26.72 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 1802, max= 2039, per=29.33%, avg=1920.50, stdev=167.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3274KiB/s (3352kB/s)(10.0MiB/3128msec); 0 zone resets clat (msec): min=61, max=530, avg=255.34, stdev=150.64 lat (msec): min=61, max=530, avg=255.41, stdev=150.64 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 82], | 30.00th=[ 165], 40.00th=[ 186], 50.00th=[ 209], 60.00th=[ 271], | 70.00th=[ 275], 80.00th=[ 317], 90.00th=[ 460], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1992, max= 6131, per=40.02%, avg=3668.20, stdev=2248.32, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=28.30%, ctx=259, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179919: Tue Jun 2 03:54:09 2026 read: IOPS=2, BW=2425KiB/s (2483kB/s)(6144KiB/2534msec) clat (usec): min=532, max=196344, avg=74949.86, stdev=78368.75 lat (usec): min=533, max=196345, avg=74951.05, stdev=78368.55 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 603], | 30.00th=[ 603], 40.00th=[ 28443], 50.00th=[ 28443], 60.00th=[109577], | 70.00th=[114820], 80.00th=[114820], 90.00th=[196084], 95.00th=[196084], | 99.00th=[196084], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 2039, max= 7968, per=76.42%, avg=5003.50, stdev=4192.44, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=2, BW=2425KiB/s (2483kB/s)(6144KiB/2534msec); 0 zone resets clat (msec): min=117, max=755, avg=337.42, stdev=253.50 lat (msec): min=117, max=755, avg=337.48, stdev=253.50 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2039, max= 3984, per=34.88%, avg=3196.67, stdev=1024.02, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 250=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=26.14%, ctx=170, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179920: Tue Jun 2 03:54:09 2026 read: IOPS=1, BW=1685KiB/s (1725kB/s)(5120KiB/3039msec) clat (usec): min=476, max=406577, avg=170479.06, stdev=153123.04 lat (usec): min=478, max=406579, avg=170480.35, stdev=153123.30 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 94897], 40.00th=[ 94897], 50.00th=[133694], 60.00th=[133694], | 70.00th=[217056], 80.00th=[217056], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 2039, max= 6144, per=62.49%, avg=4091.50, stdev=2902.67, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2359KiB/s (2415kB/s)(7168KiB/3039msec); 0 zone resets clat (msec): min=92, max=727, avg=305.47, stdev=198.80 lat (msec): min=92, max=727, avg=305.56, stdev=198.81 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 201], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 271], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 296], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1774, max= 2048, per=21.59%, avg=1979.20, stdev=116.89, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=22.48%, ctx=477, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6547KiB/s (6704kB/s), 655KiB/s-3361KiB/s (670kB/s-3441kB/s), io=20.0MiB (20.0MB), run=2133-3128msec WRITE: bw=9166KiB/s (9386kB/s), 2359KiB/s-3274KiB/s (2415kB/s-3352kB/s), io=28.0MiB (29.4MB), run=2133-3128msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179931: Tue Jun 2 03:54:17 2026 read: IOPS=1, BW=6491KiB/s (6647kB/s)(12.0MiB/1893msec) clat (msec): min=309, max=956, avg=605.85, stdev=326.93 lat (msec): min=309, max=956, avg=605.86, stdev=326.93 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8192, max= 8192, per=94.65%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=12.79%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179932: Tue Jun 2 03:54:17 2026 read: IOPS=0, BW=2166KiB/s (2218kB/s)(4096KiB/1891msec) clat (nsec): min=814632k, max=814632k, avg=814632379.00, stdev= 0.00 lat (nsec): min=814635k, max=814635k, avg=814634590.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8192, max= 8192, per=94.65%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4332KiB/s (4436kB/s)(8192KiB/1891msec); 0 zone resets clat (msec): min=257, max=768, avg=513.15, stdev=361.44 lat (msec): min=257, max=769, avg=513.67, stdev=361.71 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8192, max= 8192, per=55.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.07%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179933: Tue Jun 2 03:54:17 2026 write: IOPS=1, BW=5528KiB/s (5660kB/s)(12.0MiB/2223msec); 0 zone resets clat (msec): min=177, max=1286, avg=699.23, stdev=557.47 lat (msec): min=177, max=1286, avg=699.53, stdev=557.50 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7968, max= 8192, per=54.82%, avg=8080.00, stdev=158.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.09%, sys=7.92%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179934: Tue Jun 2 03:54:17 2026 write: IOPS=1, BW=6393KiB/s (6547kB/s)(12.0MiB/1922msec); 0 zone resets clat (msec): min=129, max=1478, avg=629.17, stdev=739.20 lat (msec): min=130, max=1478, avg=629.55, stdev=739.17 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min=14346, max=14346, per=97.33%, avg=14346.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=13.69%, ctx=86, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8655KiB/s (8863kB/s), 2166KiB/s-6491KiB/s (2218kB/s-6647kB/s), io=16.0MiB (16.8MB), run=1891-1893msec WRITE: bw=14.4MiB/s (15.1MB/s), 4332KiB/s-6393KiB/s (4436kB/s-6547kB/s), io=32.0MiB (33.6MB), run=1891-2223msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179927: Tue Jun 2 03:54:17 2026 read: IOPS=1, BW=8021KiB/s (8213kB/s)(12.0MiB/1532msec) clat (msec): min=413, max=552, avg=465.56, stdev=75.64 lat (msec): min=413, max=552, avg=465.57, stdev=75.64 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 5696, max= 8192, per=68.28%, avg=6944.00, stdev=1764.94, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=36.64%, ctx=1242, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179928: Tue Jun 2 03:54:17 2026 read: IOPS=0, BW=2543KiB/s (2604kB/s)(4096KiB/1611msec) clat (nsec): min=713795k, max=713795k, avg=713795412.00, stdev= 0.00 lat (nsec): min=713798k, max=713798k, avg=713798249.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8192, max= 8192, per=80.55%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5085KiB/s (5207kB/s)(8192KiB/1611msec); 0 zone resets clat (msec): min=222, max=503, avg=362.99, stdev=198.40 lat (msec): min=223, max=503, avg=363.45, stdev=198.47 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 8192, max= 8192, per=60.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.06%, sys=16.09%, ctx=170, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179929: Tue Jun 2 03:54:17 2026 write: IOPS=1, BW=5071KiB/s (5193kB/s)(12.0MiB/2423msec); 0 zone resets clat (msec): min=99, max=1999, avg=787.42, stdev=1053.06 lat (msec): min=100, max=2000, avg=787.86, stdev=1052.90 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] lat (msec) : 100=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.12%, sys=10.65%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179930: Tue Jun 2 03:54:17 2026 write: IOPS=1, BW=6693KiB/s (6853kB/s)(12.0MiB/1836msec); 0 zone resets clat (msec): min=148, max=1363, avg=566.57, stdev=690.33 lat (msec): min=148, max=1363, avg=566.95, stdev=690.24 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min=13003, max=13003, per=96.15%, avg=13003.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.61%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9.93MiB/s (10.4MB/s), 2543KiB/s-8021KiB/s (2604kB/s-8213kB/s), io=16.0MiB (16.8MB), run=1532-1611msec WRITE: bw=13.2MiB/s (13.8MB/s), 5071KiB/s-6693KiB/s (5193kB/s-6853kB/s), io=32.0MiB (33.6MB), run=1611-2423msec