== sanity test 398b: DIO and buffer IO race ============== 03:48:31 (1778658511) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.72755 s, 10.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182924: Wed May 13 03:50:34 2026 read: IOPS=14, BW=56.8KiB/s (58.2kB/s)(5992KiB/105400msec) clat (usec): min=36, max=741269, avg=38388.22, stdev=30773.23 lat (usec): min=36, max=741271, avg=38390.94, stdev=30773.47 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9896], 10.00th=[ 14877], 20.00th=[ 20055], | 30.00th=[ 23987], 40.00th=[ 27919], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 66847], 95.00th=[ 79168], | 99.00th=[135267], 99.50th=[154141], 99.90th=[227541], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 103, per=25.15%, avg=56.59, stdev=17.74, samples=207 iops : min= 1, max= 25, avg=13.51, stdev= 4.47, samples=207 write: IOPS=14, BW=59.7KiB/s (61.2kB/s)(6296KiB/105400msec); 0 zone resets clat (usec): min=1083, max=243543, avg=30226.55, stdev=29501.92 lat (usec): min=1084, max=243545, avg=30231.25, stdev=29505.45 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1385], 10.00th=[ 1909], 20.00th=[ 3818], | 30.00th=[ 7504], 40.00th=[ 15926], 50.00th=[ 22938], 60.00th=[ 29492], | 70.00th=[ 39060], 80.00th=[ 51643], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[116917], 99.50th=[145753], 99.90th=[191890], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 127, per=25.17%, avg=59.39, stdev=22.40, samples=207 iops : min= 1, max= 31, avg=14.21, stdev= 5.60, samples=207 lat (usec) : 50=0.29%, 100=1.37%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.60%, 4=5.11%, 10=7.13%, 20=13.22%, 50=44.47% lat (msec) : 100=19.89%, 250=2.57%, 750=0.03% cpu : usr=0.08%, sys=6.55%, ctx=6760, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182925: Wed May 13 03:50:34 2026 read: IOPS=14, BW=57.3KiB/s (58.7kB/s)(5940KiB/103706msec) clat (usec): min=36, max=218390, avg=39243.01, stdev=25548.35 lat (usec): min=36, max=218391, avg=39250.33, stdev=25543.36 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11207], 10.00th=[ 15533], 20.00th=[ 20055], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 45876], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[130548], 99.50th=[149947], 99.90th=[191890], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 23, max= 111, per=25.32%, avg=56.98, stdev=17.27, samples=204 iops : min= 5, max= 27, avg=13.60, stdev= 4.32, samples=204 write: IOPS=15, BW=61.2KiB/s (62.7kB/s)(6348KiB/103706msec); 0 zone resets clat (usec): min=1107, max=710440, avg=28427.94, stdev=32862.26 lat (usec): min=1108, max=710441, avg=28429.40, stdev=32862.22 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1745], 20.00th=[ 3458], | 30.00th=[ 6587], 40.00th=[ 12125], 50.00th=[ 20841], 60.00th=[ 27132], | 70.00th=[ 35390], 80.00th=[ 49021], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[117965], 99.50th=[128451], 99.90th=[177210], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 175, per=25.77%, avg=60.82, stdev=25.38, samples=204 iops : min= 1, max= 43, avg=14.57, stdev= 6.41, samples=204 lat (usec) : 50=0.33%, 100=1.24%, 250=0.13%, 500=0.03%, 750=0.03% lat (msec) : 2=6.22%, 4=4.88%, 10=8.56%, 20=13.48%, 50=43.00% lat (msec) : 100=19.34%, 250=2.73%, 750=0.03% cpu : usr=0.09%, sys=6.38%, ctx=6653, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182926: Wed May 13 03:50:34 2026 read: IOPS=14, BW=57.1KiB/s (58.4kB/s)(6028KiB/105657msec) clat (usec): min=37, max=760124, avg=38560.32, stdev=29438.76 lat (usec): min=37, max=760126, avg=38563.29, stdev=29440.30 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9372], 10.00th=[ 15270], 20.00th=[ 20055], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 39060], | 70.00th=[ 45876], 80.00th=[ 54264], 90.00th=[ 65799], 95.00th=[ 80217], | 99.00th=[114820], 99.50th=[129500], 99.90th=[181404], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 15, max= 118, per=25.21%, avg=56.72, stdev=19.37, samples=208 iops : min= 3, max= 29, avg=13.54, stdev= 4.86, samples=208 write: IOPS=14, BW=59.2KiB/s (60.7kB/s)(6260KiB/105657msec); 0 zone resets clat (usec): min=1135, max=167813, avg=30157.04, stdev=29836.53 lat (usec): min=1136, max=167814, avg=30164.97, stdev=29832.25 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1401], 10.00th=[ 1926], 20.00th=[ 3982], | 30.00th=[ 7504], 40.00th=[ 15139], 50.00th=[ 22414], 60.00th=[ 29492], | 70.00th=[ 38536], 80.00th=[ 50594], 90.00th=[ 70779], 95.00th=[ 91751], | 99.00th=[127402], 99.50th=[137364], 99.90th=[166724], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 7, max= 151, per=24.93%, avg=58.85, stdev=22.09, samples=208 iops : min= 1, max= 37, avg=14.07, stdev= 5.56, samples=208 lat (usec) : 50=0.29%, 100=1.66%, 250=0.23%, 500=0.03%, 750=0.03% lat (msec) : 2=5.47%, 4=4.82%, 10=7.39%, 20=13.25%, 50=44.04% lat (msec) : 100=19.86%, 250=2.90%, 1000=0.03% cpu : usr=0.07%, sys=6.51%, ctx=6830, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182927: Wed May 13 03:50:34 2026 read: IOPS=14, BW=56.9KiB/s (58.3kB/s)(6052KiB/106333msec) clat (usec): min=32, max=201897, avg=38440.76, stdev=24863.10 lat (usec): min=33, max=201898, avg=38443.69, stdev=24864.37 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9634], 10.00th=[ 14746], 20.00th=[ 19792], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 33162], 60.00th=[ 39584], | 70.00th=[ 45876], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 84411], | 99.00th=[131597], 99.50th=[149947], 99.90th=[164627], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 127, per=25.11%, avg=56.49, stdev=18.48, samples=209 iops : min= 1, max= 31, avg=13.49, stdev= 4.66, samples=209 write: IOPS=14, BW=58.6KiB/s (60.1kB/s)(6236KiB/106333msec); 0 zone resets clat (usec): min=1103, max=679884, avg=30653.39, stdev=34107.71 lat (usec): min=1105, max=679885, avg=30654.89, stdev=34107.65 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 2073], 20.00th=[ 4228], | 30.00th=[ 7767], 40.00th=[ 14877], 50.00th=[ 22676], 60.00th=[ 29230], | 70.00th=[ 38011], 80.00th=[ 53216], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[130548], 99.50th=[152044], 99.90th=[208667], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 166, per=24.65%, avg=58.17, stdev=22.65, samples=209 iops : min= 1, max= 41, avg=13.90, stdev= 5.69, samples=209 lat (usec) : 50=0.39%, 100=1.46%, 250=0.20%, 500=0.07% lat (msec) : 2=4.88%, 4=4.72%, 10=8.07%, 20=13.64%, 50=43.52% lat (msec) : 100=19.95%, 250=3.06%, 750=0.03% cpu : usr=0.06%, sys=6.49%, ctx=6985, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=226KiB/s (231kB/s), 56.8KiB/s-57.3KiB/s (58.2kB/s-58.7kB/s), io=23.4MiB (24.6MB), run=103706-106333msec WRITE: bw=236KiB/s (242kB/s), 58.6KiB/s-61.2KiB/s (60.1kB/s-62.7kB/s), io=24.6MiB (25.7MB), run=103706-106333msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182929: Wed May 13 03:51:17 2026 read: IOPS=10, BW=40.4KiB/s (41.3kB/s)(5992KiB/148491msec) clat (msec): min=5, max=764, avg=38.15, stdev=37.49 lat (msec): min=5, max=764, avg=38.15, stdev=37.49 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 78], 95.00th=[ 105], | 99.00th=[ 165], 99.50th=[ 194], 99.90th=[ 330], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 127, per=25.11%, avg=40.43, stdev=23.76, samples=289 iops : min= 1, max= 31, avg= 9.44, stdev= 5.98, samples=289 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6296KiB/148491msec); 0 zone resets clat (msec): min=11, max=299, avg=57.94, stdev=36.12 lat (msec): min=11, max=299, avg=57.94, stdev=36.12 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 108], 95.00th=[ 127], | 99.00th=[ 186], 99.50th=[ 222], 99.90th=[ 262], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 111, per=24.87%, avg=42.03, stdev=21.89, samples=292 iops : min= 1, max= 27, avg= 9.83, stdev= 5.50, samples=292 lat (msec) : 10=1.89%, 20=14.71%, 50=49.93%, 100=24.67%, 250=8.53% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=2.41%, ctx=4888, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182930: Wed May 13 03:51:17 2026 read: IOPS=10, BW=40.3KiB/s (41.2kB/s)(5940KiB/147533msec) clat (msec): min=5, max=743, avg=38.56, stdev=36.30 lat (msec): min=5, max=743, avg=38.56, stdev=36.30 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 104], | 99.00th=[ 161], 99.50th=[ 184], 99.90th=[ 268], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 111, per=24.69%, avg=39.75, stdev=22.38, samples=291 iops : min= 1, max= 27, avg= 9.26, stdev= 5.64, samples=291 write: IOPS=10, BW=43.0KiB/s (44.1kB/s)(6348KiB/147533msec); 0 zone resets clat (msec): min=8, max=362, avg=56.79, stdev=35.34 lat (msec): min=8, max=362, avg=56.79, stdev=35.34 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 81], 90.00th=[ 102], 95.00th=[ 126], | 99.00th=[ 176], 99.50th=[ 213], 99.90th=[ 305], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 111, per=25.27%, avg=42.70, stdev=22.18, samples=290 iops : min= 1, max= 27, avg=10.00, stdev= 5.57, samples=290 lat (msec) : 10=2.05%, 20=15.17%, 50=49.09%, 100=25.65%, 250=7.81% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.06%, sys=2.43%, ctx=4960, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182931: Wed May 13 03:51:17 2026 read: IOPS=10, BW=40.8KiB/s (41.7kB/s)(6028KiB/147901msec) clat (msec): min=4, max=319, avg=39.09, stdev=32.77 lat (msec): min=4, max=319, avg=39.09, stdev=32.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 86], 95.00th=[ 107], | 99.00th=[ 153], 99.50th=[ 176], 99.90th=[ 255], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 126, per=25.27%, avg=40.68, stdev=23.13, samples=288 iops : min= 1, max= 31, avg= 9.50, stdev= 5.82, samples=288 write: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6260KiB/147901msec); 0 zone resets clat (msec): min=12, max=800, avg=56.79, stdev=38.69 lat (msec): min=12, max=800, avg=56.79, stdev=38.69 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 102], 95.00th=[ 123], | 99.00th=[ 169], 99.50th=[ 190], 99.90th=[ 363], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 126, per=24.90%, avg=42.08, stdev=21.88, samples=289 iops : min= 1, max= 31, avg= 9.85, stdev= 5.51, samples=289 lat (msec) : 10=1.92%, 20=15.20%, 50=48.70%, 100=25.62%, 250=8.43% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=2.48%, ctx=4875, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182932: Wed May 13 03:51:17 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6052KiB/148676msec) clat (msec): min=5, max=283, avg=37.95, stdev=31.32 lat (msec): min=5, max=283, avg=37.96, stdev=31.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 79], 95.00th=[ 106], | 99.00th=[ 155], 99.50th=[ 171], 99.90th=[ 218], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 112, per=25.49%, avg=41.05, stdev=23.76, samples=288 iops : min= 1, max= 28, avg= 9.61, stdev= 5.98, samples=288 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6236KiB/148676msec); 0 zone resets clat (msec): min=12, max=782, avg=58.44, stdev=39.93 lat (msec): min=12, max=782, avg=58.44, stdev=39.92 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 82], 90.00th=[ 107], 95.00th=[ 131], | 99.00th=[ 190], 99.50th=[ 211], 99.90th=[ 359], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 103, per=24.58%, avg=41.54, stdev=21.17, samples=293 iops : min= 1, max= 25, avg= 9.73, stdev= 5.32, samples=293 lat (msec) : 10=1.79%, 20=15.07%, 50=48.73%, 100=25.36%, 250=8.95% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=2.39%, ctx=4899, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=162KiB/s (165kB/s), 40.3KiB/s-40.8KiB/s (41.2kB/s-41.7kB/s), io=23.4MiB (24.6MB), run=147533-148676msec WRITE: bw=169KiB/s (173kB/s), 41.9KiB/s-43.0KiB/s (42.9kB/s-44.1kB/s), io=24.6MiB (25.7MB), run=147533-148676msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182973: Wed May 13 03:51:59 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5920KiB/29531msec) clat (usec): min=43, max=176579, avg=40810.70, stdev=25687.64 lat (usec): min=44, max=176581, avg=40817.42, stdev=25680.60 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 3654], 20.00th=[ 23462], | 30.00th=[ 28443], 40.00th=[ 32637], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 48497], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 84411], | 99.00th=[119014], 99.50th=[141558], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 62, max= 350, per=25.85%, avg=200.09, stdev=68.83, samples=58 iops : min= 3, max= 21, avg=11.81, stdev= 4.32, samples=58 write: IOPS=13, BW=216KiB/s (221kB/s)(6368KiB/29531msec); 0 zone resets clat (usec): min=1498, max=199965, avg=36159.23, stdev=33999.02 lat (usec): min=1501, max=199968, avg=36161.48, stdev=33998.94 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2212], 10.00th=[ 3294], 20.00th=[ 6259], | 30.00th=[ 11338], 40.00th=[ 19792], 50.00th=[ 28443], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 61604], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[158335], 99.50th=[170918], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 407, per=26.51%, avg=216.03, stdev=80.49, samples=58 iops : min= 1, max= 25, avg=12.81, stdev= 5.18, samples=58 lat (usec) : 50=0.52%, 100=3.39%, 250=0.39%, 500=0.13% lat (msec) : 2=2.47%, 4=4.95%, 10=8.07%, 20=8.46%, 50=43.49% lat (msec) : 100=23.83%, 250=4.30% cpu : usr=0.06%, sys=6.34%, ctx=1690, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182974: Wed May 13 03:51:59 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(5744KiB/30918msec) clat (usec): min=39, max=205541, avg=45705.24, stdev=30554.64 lat (usec): min=39, max=205542, avg=45716.01, stdev=30549.50 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 15139], 20.00th=[ 25035], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 54789], 80.00th=[ 67634], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[162530], 99.50th=[196084], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 54, max= 347, per=24.01%, avg=185.80, stdev=72.37, samples=61 iops : min= 3, max= 21, avg=10.92, stdev= 4.61, samples=61 write: IOPS=13, BW=212KiB/s (217kB/s)(6544KiB/30918msec); 0 zone resets clat (usec): min=1691, max=154963, avg=35331.70, stdev=31475.16 lat (usec): min=1694, max=154965, avg=35334.09, stdev=31475.09 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 1926], 10.00th=[ 3654], 20.00th=[ 7177], | 30.00th=[ 11731], 40.00th=[ 20841], 50.00th=[ 27395], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 57934], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[135267], 99.50th=[143655], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 62, max= 416, per=25.86%, avg=210.72, stdev=88.99, samples=61 iops : min= 3, max= 26, avg=12.49, stdev= 5.68, samples=61 lat (usec) : 50=0.39%, 100=2.99%, 250=0.26%, 1000=0.13% lat (msec) : 2=3.12%, 4=2.47%, 10=8.85%, 20=8.98%, 50=41.67% lat (msec) : 100=25.78%, 250=5.34% cpu : usr=0.06%, sys=5.98%, ctx=1763, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182975: Wed May 13 03:51:59 2026 read: IOPS=13, BW=209KiB/s (215kB/s)(6256KiB/29864msec) clat (usec): min=39, max=195497, avg=42873.76, stdev=28138.37 lat (usec): min=40, max=195498, avg=42875.28, stdev=28138.32 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 15139], 20.00th=[ 22938], | 30.00th=[ 28967], 40.00th=[ 33162], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 51119], 80.00th=[ 59507], 90.00th=[ 70779], 95.00th=[ 90702], | 99.00th=[158335], 99.50th=[175113], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 62, max= 350, per=27.17%, avg=210.29, stdev=69.27, samples=58 iops : min= 3, max= 21, avg=12.47, stdev= 4.38, samples=58 write: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29864msec); 0 zone resets clat (usec): min=1604, max=163525, avg=34606.87, stdev=31291.49 lat (usec): min=1606, max=163527, avg=34611.51, stdev=31289.45 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2040], 10.00th=[ 3228], 20.00th=[ 5866], | 30.00th=[ 9110], 40.00th=[ 16909], 50.00th=[ 27132], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 61080], 90.00th=[ 82314], 95.00th=[ 94897], | 99.00th=[128451], 99.50th=[139461], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 31, max= 432, per=24.47%, avg=199.40, stdev=76.12, samples=58 iops : min= 1, max= 27, avg=11.76, stdev= 4.86, samples=58 lat (usec) : 50=0.26%, 100=3.26%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.21%, 4=3.65%, 10=9.90%, 20=8.72%, 50=41.15% lat (msec) : 100=26.69%, 250=3.65% cpu : usr=0.08%, sys=6.44%, ctx=1829, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182976: Wed May 13 03:51:59 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28821msec) clat (usec): min=51, max=214985, avg=41844.62, stdev=28902.15 lat (usec): min=52, max=214992, avg=41845.84, stdev=28902.28 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 63], 10.00th=[ 96], 20.00th=[ 22152], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 38536], 60.00th=[ 45351], | 70.00th=[ 51119], 80.00th=[ 59507], 90.00th=[ 77071], 95.00th=[ 87557], | 99.00th=[139461], 99.50th=[208667], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 62, max= 384, per=26.67%, avg=206.46, stdev=70.48, samples=56 iops : min= 3, max= 24, avg=12.20, stdev= 4.52, samples=56 write: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28821msec); 0 zone resets clat (usec): min=1600, max=193045, avg=33212.79, stdev=32409.63 lat (usec): min=1603, max=193047, avg=33215.64, stdev=32410.21 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2376], 10.00th=[ 3523], 20.00th=[ 6128], | 30.00th=[ 9503], 40.00th=[ 17433], 50.00th=[ 23200], 60.00th=[ 30016], | 70.00th=[ 41681], 80.00th=[ 55313], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[145753], 99.50th=[160433], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 62, max= 384, per=26.44%, avg=215.50, stdev=81.77, samples=56 iops : min= 3, max= 24, avg=12.77, stdev= 5.19, samples=56 lat (usec) : 100=4.95%, 500=0.39%, 750=0.13% lat (msec) : 2=1.82%, 4=4.95%, 10=9.38%, 20=10.29%, 50=39.97% lat (msec) : 100=24.48%, 250=3.65% cpu : usr=0.07%, sys=6.54%, ctx=1744, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=775KiB/s (793kB/s), 186KiB/s-209KiB/s (190kB/s-215kB/s), io=23.4MiB (24.5MB), run=28821-30918msec WRITE: bw=815KiB/s (835kB/s), 202KiB/s-217KiB/s (207kB/s-222kB/s), io=24.6MiB (25.8MB), run=28821-30918msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182968: Wed May 13 03:52:11 2026 read: IOPS=8, BW=138KiB/s (142kB/s)(5920KiB/42755msec) clat (msec): min=6, max=237, avg=45.01, stdev=37.38 lat (msec): min=6, max=237, avg=45.01, stdev=37.38 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 96], 95.00th=[ 132], | 99.00th=[ 188], 99.50th=[ 220], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 30, max= 383, per=24.60%, avg=136.76, stdev=81.08, samples=84 iops : min= 1, max= 23, avg= 7.74, stdev= 5.11, samples=84 write: IOPS=9, BW=149KiB/s (153kB/s)(6368KiB/42755msec); 0 zone resets clat (msec): min=12, max=191, avg=65.12, stdev=36.72 lat (msec): min=12, max=191, avg=65.12, stdev=36.72 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 97], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 188], 99.50th=[ 190], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 31, max= 384, per=25.23%, avg=147.62, stdev=73.74, samples=84 iops : min= 1, max= 24, avg= 8.44, stdev= 4.69, samples=84 lat (msec) : 10=0.52%, 20=10.29%, 50=48.05%, 100=27.34%, 250=13.80% cpu : usr=0.06%, sys=2.43%, ctx=1295, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182969: Wed May 13 03:52:11 2026 read: IOPS=8, BW=133KiB/s (137kB/s)(5744KiB/43038msec) clat (msec): min=5, max=236, avg=43.76, stdev=35.91 lat (msec): min=5, max=236, avg=43.76, stdev=35.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 95], 95.00th=[ 121], | 99.00th=[ 169], 99.50th=[ 224], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 378, per=24.26%, avg=134.88, stdev=80.21, samples=84 iops : min= 1, max= 23, avg= 7.63, stdev= 5.05, samples=84 write: IOPS=9, BW=152KiB/s (156kB/s)(6544KiB/43038msec); 0 zone resets clat (msec): min=14, max=258, avg=66.69, stdev=42.96 lat (msec): min=14, max=258, avg=66.69, stdev=42.96 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 60], | 70.00th=[ 74], 80.00th=[ 100], 90.00th=[ 131], 95.00th=[ 159], | 99.00th=[ 199], 99.50th=[ 226], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 412, per=25.90%, avg=151.53, stdev=85.57, samples=85 iops : min= 1, max= 25, avg= 8.67, stdev= 5.43, samples=85 lat (msec) : 10=1.56%, 20=10.81%, 50=47.01%, 100=26.30%, 250=14.19% lat (msec) : 500=0.13% cpu : usr=0.03%, sys=2.22%, ctx=1255, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182970: Wed May 13 03:52:11 2026 read: IOPS=9, BW=147KiB/s (150kB/s)(6256KiB/42701msec) clat (msec): min=8, max=239, avg=46.92, stdev=38.67 lat (msec): min=8, max=239, avg=46.92, stdev=38.67 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 100], 95.00th=[ 133], | 99.00th=[ 184], 99.50th=[ 213], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 413, per=26.66%, avg=148.23, stdev=93.49, samples=83 iops : min= 1, max= 25, avg= 8.48, stdev= 5.90, samples=83 write: IOPS=8, BW=141KiB/s (145kB/s)(6032KiB/42701msec); 0 zone resets clat (msec): min=15, max=208, avg=64.19, stdev=35.69 lat (msec): min=15, max=208, avg=64.19, stdev=35.69 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 63], | 70.00th=[ 75], 80.00th=[ 92], 90.00th=[ 117], 95.00th=[ 136], | 99.00th=[ 180], 99.50th=[ 186], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 30, max= 382, per=23.84%, avg=139.46, stdev=71.21, samples=84 iops : min= 1, max= 23, avg= 7.92, stdev= 4.51, samples=84 lat (msec) : 10=0.52%, 20=11.20%, 50=45.96%, 100=28.91%, 250=13.41% cpu : usr=0.08%, sys=2.25%, ctx=1266, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182971: Wed May 13 03:52:11 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6032KiB/42315msec) clat (msec): min=5, max=184, avg=43.75, stdev=34.26 lat (msec): min=5, max=184, avg=43.75, stdev=34.26 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 59], 90.00th=[ 97], 95.00th=[ 126], | 99.00th=[ 165], 99.50th=[ 184], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 448, per=25.60%, avg=142.32, stdev=82.92, samples=82 iops : min= 1, max= 28, avg= 8.11, stdev= 5.23, samples=82 write: IOPS=9, BW=148KiB/s (151kB/s)(6256KiB/42315msec); 0 zone resets clat (msec): min=18, max=265, avg=65.56, stdev=38.73 lat (msec): min=18, max=265, avg=65.56, stdev=38.72 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 93], 90.00th=[ 117], 95.00th=[ 142], | 99.00th=[ 199], 99.50th=[ 236], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 382, per=25.17%, avg=147.23, stdev=70.31, samples=83 iops : min= 1, max= 23, avg= 8.41, stdev= 4.46, samples=83 lat (msec) : 10=1.17%, 20=9.51%, 50=49.87%, 100=26.17%, 250=13.15% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.36%, ctx=1268, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=557KiB/s (570kB/s), 133KiB/s-147KiB/s (137kB/s-150kB/s), io=23.4MiB (24.5MB), run=42315-43038msec WRITE: bw=586KiB/s (600kB/s), 141KiB/s-152KiB/s (145kB/s-156kB/s), io=24.6MiB (25.8MB), run=42315-43038msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182993: Wed May 13 03:52:28 2026 read: IOPS=1, BW=1298KiB/s (1329kB/s)(7168KiB/5524msec) clat (msec): min=5, max=2840, avg=596.67, stdev=999.15 lat (msec): min=5, max=2840, avg=596.67, stdev=999.15 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 142], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 203], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 418], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1662, max= 4055, per=65.10%, avg=2363.80, stdev=959.09, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=927KiB/s (949kB/s)(5120KiB/5524msec); 0 zone resets clat (msec): min=143, max=314, avg=223.22, stdev=74.87 lat (msec): min=143, max=314, avg=223.30, stdev=74.87 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2027, max= 3992, per=52.81%, avg=2684.67, stdev=1132.19, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 250=50.00%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.78%, ctx=295, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182994: Wed May 13 03:52:28 2026 read: IOPS=0, BW=363KiB/s (372kB/s)(2048KiB/5639msec) clat (msec): min=217, max=472, avg=344.88, stdev=180.19 lat (msec): min=217, max=472, avg=344.88, stdev=180.19 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2019, max= 2043, per=55.94%, avg=2031.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1816KiB/s (1860kB/s)(10.0MiB/5639msec); 0 zone resets clat (msec): min=168, max=1264, avg=472.51, stdev=333.54 lat (msec): min=168, max=1264, avg=472.66, stdev=333.50 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 180], | 30.00th=[ 190], 40.00th=[ 268], 50.00th=[ 430], 60.00th=[ 456], | 70.00th=[ 464], 80.00th=[ 617], 90.00th=[ 701], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 2027, max= 4039, per=51.33%, avg=2609.43, stdev=973.88, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=11.83%, ctx=160, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182995: Wed May 13 03:52:28 2026 read: IOPS=1, BW=1103KiB/s (1130kB/s)(6144KiB/5569msec) clat (msec): min=7, max=366, avg=191.19, stdev=120.54 lat (msec): min=7, max=366, avg=191.19, stdev=120.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 224], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2043, max= 4096, per=75.11%, avg=2727.33, stdev=1185.30, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1103KiB/s (1130kB/s)(6144KiB/5569msec); 0 zone resets clat (msec): min=198, max=1434, avg=701.77, stdev=541.38 lat (msec): min=198, max=1434, avg=701.89, stdev=541.40 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 485], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 1675, max= 2048, per=38.63%, avg=1964.00, stdev=161.93, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 10=8.33%, 250=33.33%, 500=41.67%, 2000=16.67% cpu : usr=0.00%, sys=7.53%, ctx=145, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182996: Wed May 13 03:52:28 2026 read: IOPS=0, BW=988KiB/s (1012kB/s)(5120KiB/5180msec) clat (usec): min=770, max=302277, avg=189046.37, stdev=120727.22 lat (usec): min=773, max=302278, avg=189047.71, stdev=120726.89 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], 20.00th=[ 775], | 30.00th=[160433], 40.00th=[160433], 50.00th=[196084], 60.00th=[196084], | 70.00th=[283116], 80.00th=[283116], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 4039, max= 4087, per=100.00%, avg=4063.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1384KiB/s (1417kB/s)(7168KiB/5180msec); 0 zone resets clat (msec): min=261, max=1575, avg=597.09, stdev=483.62 lat (msec): min=261, max=1576, avg=597.52, stdev=483.79 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 271], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 355], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 860], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1600, max= 4031, per=45.92%, avg=2334.60, stdev=965.18, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.50%, ctx=150, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3632KiB/s (3719kB/s), 363KiB/s-1298KiB/s (372kB/s-1329kB/s), io=20.0MiB (20.0MB), run=5180-5639msec WRITE: bw=5085KiB/s (5207kB/s), 927KiB/s-1816KiB/s (949kB/s-1860kB/s), io=28.0MiB (29.4MB), run=5180-5639msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182989: Wed May 13 03:52:28 2026 read: IOPS=2, BW=2339KiB/s (2396kB/s)(7168KiB/3064msec) clat (msec): min=67, max=462, avg=173.28, stdev=154.46 lat (msec): min=67, max=462, avg=173.28, stdev=154.46 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 90], 60.00th=[ 107], | 70.00th=[ 107], 80.00th=[ 317], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 3828, max= 4726, per=100.00%, avg=4277.00, stdev=634.98, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1671KiB/s (1711kB/s)(5120KiB/3064msec); 0 zone resets clat (msec): min=123, max=613, avg=364.23, stdev=207.21 lat (msec): min=123, max=613, avg=364.30, stdev=207.19 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1575, max= 4063, per=53.88%, avg=2552.33, stdev=1326.98, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=16.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=5.62%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182990: Wed May 13 03:52:28 2026 read: IOPS=0, BW=338KiB/s (347kB/s)(2048KiB/6052msec) clat (msec): min=124, max=374, avg=249.68, stdev=176.69 lat (msec): min=124, max=374, avg=249.68, stdev=176.69 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1469, max= 2011, per=51.42%, avg=1740.00, stdev=383.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1692KiB/s (1733kB/s)(10.0MiB/6052msec); 0 zone resets clat (msec): min=128, max=1120, avg=533.60, stdev=357.10 lat (msec): min=128, max=1121, avg=533.71, stdev=357.11 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 153], | 30.00th=[ 159], 40.00th=[ 393], 50.00th=[ 426], 60.00th=[ 527], | 70.00th=[ 584], 80.00th=[ 852], 90.00th=[ 1003], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1914, max= 4039, per=54.41%, avg=2577.29, stdev=986.09, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.02%, sys=3.57%, ctx=84, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182991: Wed May 13 03:52:28 2026 read: IOPS=1, BW=1027KiB/s (1052kB/s)(6144KiB/5982msec) clat (msec): min=94, max=561, avg=336.82, stdev=194.20 lat (msec): min=94, max=561, avg=336.82, stdev=194.20 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 430], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2023, max= 4023, per=74.80%, avg=2531.25, stdev=994.55, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1027KiB/s (1052kB/s)(6144KiB/5982msec); 0 zone resets clat (msec): min=168, max=1491, avg=647.77, stdev=531.25 lat (msec): min=168, max=1491, avg=647.86, stdev=531.25 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 384], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 2011, max= 2801, per=45.92%, avg=2175.40, stdev=349.77, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.16%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182992: Wed May 13 03:52:28 2026 read: IOPS=0, BW=942KiB/s (964kB/s)(5120KiB/5437msec) clat (msec): min=96, max=705, avg=306.96, stdev=238.74 lat (msec): min=96, max=705, avg=306.96, stdev=238.74 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1914, max= 4039, per=78.81%, avg=2667.00, stdev=1190.07, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1318KiB/s (1350kB/s)(7168KiB/5437msec); 0 zone resets clat (msec): min=111, max=1961, avg=542.36, stdev=641.14 lat (msec): min=111, max=1961, avg=542.91, stdev=641.05 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 115], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 384], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 443], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 2000, max= 4055, per=67.53%, avg=3199.00, stdev=939.46, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.92%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3384KiB/s (3465kB/s), 338KiB/s-2339KiB/s (347kB/s-2396kB/s), io=20.0MiB (20.0MB), run=3064-6052msec WRITE: bw=4738KiB/s (4851kB/s), 1027KiB/s-1692KiB/s (1052kB/s-1733kB/s), io=28.0MiB (29.4MB), run=3064-6052msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183004: Wed May 13 03:52:43 2026 read: IOPS=1, BW=4249KiB/s (4351kB/s)(12.0MiB/2892msec) clat (msec): min=449, max=1411, avg=952.69, stdev=482.70 lat (msec): min=449, max=1411, avg=952.69, stdev=482.70 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7922, max= 8015, per=100.00%, avg=7968.50, stdev=65.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.42%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183006: Wed May 13 03:52:43 2026 read: IOPS=0, BW=1265KiB/s (1295kB/s)(4096KiB/3238msec) clat (nsec): min=1466.9M, max=1466.9M, avg=1466925391.00, stdev= 0.00 lat (nsec): min=1466.9M, max=1466.9M, avg=1466927057.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1469], 5.00th=[ 1469], 10.00th=[ 1469], 20.00th=[ 1469], | 30.00th=[ 1469], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2530KiB/s (2591kB/s)(8192KiB/3238msec); 0 zone resets clat (msec): min=515, max=1099, avg=807.17, stdev=413.06 lat (msec): min=515, max=1099, avg=807.49, stdev=413.08 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7713, max= 7713, per=84.32%, avg=7713.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.68%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183009: Wed May 13 03:52:43 2026 write: IOPS=0, BW=3430KiB/s (3513kB/s)(12.0MiB/3582msec); 0 zone resets clat (msec): min=223, max=2011, avg=1153.30, stdev=896.45 lat (msec): min=223, max=2012, avg=1153.60, stdev=896.50 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8015, max= 8015, per=87.62%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.41%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183011: Wed May 13 03:52:43 2026 write: IOPS=0, BW=3853KiB/s (3946kB/s)(12.0MiB/3189msec); 0 zone resets clat (msec): min=223, max=1778, avg=1026.90, stdev=778.79 lat (msec): min=223, max=1778, avg=1027.27, stdev=778.76 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7922, max= 8175, per=87.99%, avg=8048.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.30%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5060KiB/s (5181kB/s), 1265KiB/s-4249KiB/s (1295kB/s-4351kB/s), io=16.0MiB (16.8MB), run=2892-3238msec WRITE: bw=9148KiB/s (9368kB/s), 2530KiB/s-3853KiB/s (2591kB/s-3946kB/s), io=32.0MiB (33.6MB), run=3189-3582msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183005: Wed May 13 03:52:44 2026 read: IOPS=1, BW=4504KiB/s (4613kB/s)(12.0MiB/2728msec) clat (msec): min=828, max=935, avg=882.47, stdev=53.90 lat (msec): min=828, max=935, avg=882.47, stdev=53.90 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=13.79%, ctx=328, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183007: Wed May 13 03:52:44 2026 read: IOPS=0, BW=1363KiB/s (1395kB/s)(4096KiB/3006msec) clat (nsec): min=994539k, max=994539k, avg=994538717.00, stdev= 0.00 lat (nsec): min=994541k, max=994541k, avg=994540860.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2725KiB/s (2791kB/s)(8192KiB/3006msec); 0 zone resets clat (msec): min=688, max=1280, avg=984.60, stdev=418.61 lat (msec): min=689, max=1280, avg=985.03, stdev=418.49 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8062, max= 8062, per=99.60%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.00%, ctx=223, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183008: Wed May 13 03:52:44 2026 write: IOPS=0, BW=3036KiB/s (3108kB/s)(12.0MiB/4048msec); 0 zone resets clat (msec): min=160, max=2824, avg=1262.06, stdev=1390.66 lat (msec): min=160, max=2832, avg=1265.09, stdev=1394.48 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 7907, max= 7907, per=97.69%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=4.20%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183010: Wed May 13 03:52:44 2026 write: IOPS=0, BW=3916KiB/s (4010kB/s)(12.0MiB/3138msec); 0 zone resets clat (msec): min=575, max=1833, avg=1009.74, stdev=713.37 lat (msec): min=576, max=1833, avg=1010.24, stdev=713.23 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 5490, max= 7922, per=82.85%, avg=6706.00, stdev=1719.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.10%, sys=3.38%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5450KiB/s (5581kB/s), 1363KiB/s-4504KiB/s (1395kB/s-4613kB/s), io=16.0MiB (16.8MB), run=2728-3006msec WRITE: bw=8095KiB/s (8289kB/s), 2725KiB/s-3916KiB/s (2791kB/s-4010kB/s), io=32.0MiB (33.6MB), run=3006-4048msec