== sanity test 398b: DIO and buffer IO race ============== 02:42:43 (1788849763) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.70124 s, 10.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Tue Sep 8 02:44:29 2026 read: IOPS=16, BW=67.5KiB/s (69.1kB/s)(5992KiB/88750msec) clat (usec): min=33, max=978494, avg=33436.96, stdev=32369.60 lat (usec): min=34, max=978496, avg=33447.26, stdev=32372.20 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 237], 10.00th=[ 11863], 20.00th=[ 16909], | 30.00th=[ 20841], 40.00th=[ 24249], 50.00th=[ 28705], 60.00th=[ 33424], | 70.00th=[ 39584], 80.00th=[ 46924], 90.00th=[ 58983], 95.00th=[ 72877], | 99.00th=[110625], 99.50th=[131597], 99.90th=[149947], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 23, max= 127, per=25.34%, avg=67.14, stdev=20.03, samples=174 iops : min= 5, max= 31, avg=16.20, stdev= 5.03, samples=174 write: IOPS=17, BW=70.9KiB/s (72.6kB/s)(6296KiB/88750msec); 0 zone resets clat (usec): min=637, max=147634, avg=24336.47, stdev=24421.79 lat (usec): min=638, max=147635, avg=24339.40, stdev=24420.64 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1188], 10.00th=[ 1369], 20.00th=[ 2606], | 30.00th=[ 4817], 40.00th=[ 10421], 50.00th=[ 18482], 60.00th=[ 24511], | 70.00th=[ 32637], 80.00th=[ 43254], 90.00th=[ 57410], 95.00th=[ 72877], | 99.00th=[102237], 99.50th=[113771], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 15, max= 148, per=25.41%, avg=70.64, stdev=24.93, samples=174 iops : min= 3, max= 37, avg=17.07, stdev= 6.28, samples=174 lat (usec) : 50=0.29%, 100=2.02%, 250=0.13%, 750=0.10%, 1000=0.36% lat (msec) : 2=7.88%, 4=5.57%, 10=7.62%, 20=16.67%, 50=43.59% lat (msec) : 100=14.45%, 250=1.30%, 1000=0.03% cpu : usr=0.10%, sys=6.85%, ctx=6483, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Tue Sep 8 02:44:29 2026 read: IOPS=16, BW=67.1KiB/s (68.7kB/s)(5940KiB/88575msec) clat (usec): min=36, max=188141, avg=30912.13, stdev=18747.64 lat (usec): min=36, max=188142, avg=30915.90, stdev=18749.03 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 8356], 10.00th=[ 12518], 20.00th=[ 16581], | 30.00th=[ 20055], 40.00th=[ 23200], 50.00th=[ 27919], 60.00th=[ 32375], | 70.00th=[ 36963], 80.00th=[ 43779], 90.00th=[ 53740], 95.00th=[ 63701], | 99.00th=[ 93848], 99.50th=[103285], 99.90th=[173016], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 23, max= 132, per=25.28%, avg=67.00, stdev=20.18, samples=174 iops : min= 5, max= 33, avg=16.16, stdev= 5.05, samples=174 write: IOPS=17, BW=71.7KiB/s (73.4kB/s)(6348KiB/88575msec); 0 zone resets clat (usec): min=880, max=960873, avg=26689.09, stdev=35449.09 lat (usec): min=882, max=960874, avg=26691.57, stdev=35448.69 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1369], 20.00th=[ 2573], | 30.00th=[ 5014], 40.00th=[ 11863], 50.00th=[ 19530], 60.00th=[ 26084], | 70.00th=[ 34341], 80.00th=[ 45876], 90.00th=[ 63177], 95.00th=[ 78119], | 99.00th=[113771], 99.50th=[135267], 99.90th=[183501], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 23, max= 149, per=25.64%, avg=71.29, stdev=24.98, samples=174 iops : min= 5, max= 37, avg=17.24, stdev= 6.27, samples=174 lat (usec) : 50=0.23%, 100=1.63%, 250=0.13%, 750=0.03%, 1000=0.39% lat (msec) : 2=7.98%, 4=5.70%, 10=6.54%, 20=18.20%, 50=44.37% lat (msec) : 100=13.64%, 250=1.14%, 1000=0.03% cpu : usr=0.10%, sys=6.94%, ctx=6497, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Tue Sep 8 02:44:29 2026 read: IOPS=16, BW=66.7KiB/s (68.3kB/s)(6028KiB/90316msec) clat (usec): min=37, max=213106, avg=31977.70, stdev=20596.70 lat (usec): min=38, max=213107, avg=31984.40, stdev=20602.60 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 7635], 10.00th=[ 12125], 20.00th=[ 16450], | 30.00th=[ 20055], 40.00th=[ 23462], 50.00th=[ 27395], 60.00th=[ 32637], | 70.00th=[ 39060], 80.00th=[ 45876], 90.00th=[ 56361], 95.00th=[ 66847], | 99.00th=[100140], 99.50th=[114820], 99.90th=[164627], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 167, per=25.13%, avg=66.60, stdev=23.32, samples=177 iops : min= 1, max= 41, avg=16.06, stdev= 5.88, samples=177 write: IOPS=17, BW=69.3KiB/s (70.0kB/s)(6260KiB/90316msec); 0 zone resets clat (usec): min=593, max=937227, avg=26732.31, stdev=34761.82 lat (usec): min=594, max=937228, avg=26735.54, stdev=34760.98 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1172], 10.00th=[ 1516], 20.00th=[ 2769], | 30.00th=[ 5669], 40.00th=[ 12911], 50.00th=[ 19530], 60.00th=[ 25822], | 70.00th=[ 34341], 80.00th=[ 45876], 90.00th=[ 63177], 95.00th=[ 77071], | 99.00th=[102237], 99.50th=[122160], 99.90th=[227541], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 15, max= 151, per=24.84%, avg=69.06, stdev=24.71, samples=177 iops : min= 3, max= 37, avg=16.67, stdev= 6.21, samples=177 lat (usec) : 50=0.36%, 100=1.66%, 250=0.20%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.55% lat (msec) : 2=6.61%, 4=5.50%, 10=7.03%, 20=18.29%, 50=43.07% lat (msec) : 100=15.49%, 250=1.11%, 1000=0.03% cpu : usr=0.09%, sys=6.66%, ctx=6607, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Tue Sep 8 02:44:29 2026 read: IOPS=17, BW=68.3KiB/s (69.0kB/s)(6052KiB/88569msec) clat (usec): min=36, max=995146, avg=33280.92, stdev=32181.65 lat (usec): min=37, max=995147, avg=33283.35, stdev=32181.62 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 9110], 10.00th=[ 13042], 20.00th=[ 17171], | 30.00th=[ 20317], 40.00th=[ 23987], 50.00th=[ 28443], 60.00th=[ 33817], | 70.00th=[ 39584], 80.00th=[ 45876], 90.00th=[ 57410], 95.00th=[ 71828], | 99.00th=[107480], 99.50th=[125305], 99.90th=[185598], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 23, max= 135, per=25.73%, avg=68.18, stdev=21.98, samples=174 iops : min= 5, max= 33, avg=16.45, stdev= 5.54, samples=174 write: IOPS=17, BW=70.4KiB/s (72.1kB/s)(6236KiB/88569msec); 0 zone resets clat (usec): min=640, max=159925, avg=24329.06, stdev=24695.39 lat (usec): min=641, max=159927, avg=24332.12, stdev=24694.10 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1139], 10.00th=[ 1319], 20.00th=[ 2343], | 30.00th=[ 4490], 40.00th=[ 10421], 50.00th=[ 17957], 60.00th=[ 24511], | 70.00th=[ 32375], 80.00th=[ 43779], 90.00th=[ 59507], 95.00th=[ 74974], | 99.00th=[101188], 99.50th=[116917], 99.90th=[154141], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 15, max= 167, per=25.25%, avg=70.18, stdev=24.83, samples=174 iops : min= 3, max= 41, avg=16.95, stdev= 6.25, samples=174 lat (usec) : 50=0.20%, 100=1.43%, 250=0.16%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.62% lat (msec) : 2=8.43%, 4=4.98%, 10=7.00%, 20=18.55%, 50=43.23% lat (msec) : 100=14.13%, 250=1.11%, 1000=0.03% cpu : usr=0.11%, sys=6.86%, ctx=6496, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=266KiB/s (272kB/s), 66.7KiB/s-68.3KiB/s (68.3kB/s-69.0kB/s), io=23.4MiB (24.6MB), run=88569-90316msec WRITE: bw=278KiB/s (285kB/s), 69.3KiB/s-71.7KiB/s (70.0kB/s-73.4kB/s), io=24.6MiB (25.7MB), run=88569-90316msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179701: Tue Sep 8 02:45:00 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(5992KiB/120778msec) clat (msec): min=4, max=1001, avg=31.18, stdev=36.39 lat (msec): min=4, max=1001, avg=31.19, stdev=36.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 66], 95.00th=[ 86], | 99.00th=[ 125], 99.50th=[ 167], 99.90th=[ 262], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 175, per=25.05%, avg=49.60, stdev=31.70, samples=237 iops : min= 1, max= 43, avg=11.74, stdev= 7.97, samples=237 write: IOPS=13, BW=52.1KiB/s (53.4kB/s)(6296KiB/120778msec); 0 zone resets clat (msec): min=9, max=268, avg=46.97, stdev=30.94 lat (msec): min=9, max=268, avg=46.98, stdev=30.94 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 68], 90.00th=[ 88], 95.00th=[ 109], | 99.00th=[ 155], 99.50th=[ 176], 99.90th=[ 249], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 182, per=25.02%, avg=51.80, stdev=29.27, samples=238 iops : min= 1, max= 45, avg=12.30, stdev= 7.38, samples=238 lat (msec) : 10=5.14%, 20=23.11%, 50=46.32%, 100=20.77%, 250=4.56% lat (msec) : 500=0.07%, 2000=0.03% cpu : usr=0.07%, sys=2.19%, ctx=4761, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179702: Tue Sep 8 02:45:00 2026 read: IOPS=12, BW=49.0KiB/s (50.2kB/s)(5940KiB/121156msec) clat (msec): min=4, max=839, avg=30.94, stdev=34.45 lat (msec): min=4, max=839, avg=30.94, stdev=34.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 68], 95.00th=[ 89], | 99.00th=[ 144], 99.50th=[ 159], 99.90th=[ 209], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 160, per=24.83%, avg=49.16, stdev=32.04, samples=235 iops : min= 1, max= 40, avg=11.64, stdev= 8.08, samples=235 write: IOPS=13, BW=52.4KiB/s (53.7kB/s)(6348KiB/121156msec); 0 zone resets clat (msec): min=9, max=250, avg=47.30, stdev=31.68 lat (msec): min=9, max=250, avg=47.30, stdev=31.68 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 70], 90.00th=[ 91], 95.00th=[ 109], | 99.00th=[ 148], 99.50th=[ 201], 99.90th=[ 245], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 7, max= 143, per=25.01%, avg=51.76, stdev=28.99, samples=238 iops : min= 1, max= 35, avg=12.29, stdev= 7.30, samples=238 lat (msec) : 10=5.14%, 20=25.07%, 50=44.21%, 100=20.64%, 250=4.88% lat (msec) : 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=2.27%, ctx=4794, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179703: Tue Sep 8 02:45:00 2026 read: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6028KiB/120681msec) clat (msec): min=4, max=218, avg=30.51, stdev=26.24 lat (msec): min=4, max=218, avg=30.51, stdev=26.24 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 64], 95.00th=[ 87], | 99.00th=[ 126], 99.50th=[ 138], 99.90th=[ 213], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 7, max= 127, per=25.42%, avg=50.34, stdev=28.70, samples=235 iops : min= 1, max= 31, avg=11.94, stdev= 7.21, samples=235 write: IOPS=12, BW=51.9KiB/s (53.1kB/s)(6260KiB/120681msec); 0 zone resets clat (msec): min=8, max=853, avg=47.66, stdev=37.03 lat (msec): min=8, max=853, avg=47.66, stdev=37.03 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 68], 90.00th=[ 87], 95.00th=[ 105], | 99.00th=[ 161], 99.50th=[ 207], 99.90th=[ 241], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 159, per=24.94%, avg=51.62, stdev=29.73, samples=238 iops : min= 1, max= 39, avg=12.25, stdev= 7.50, samples=238 lat (msec) : 10=4.62%, 20=24.51%, 50=45.02%, 100=21.29%, 250=4.52% lat (msec) : 1000=0.03% cpu : usr=0.07%, sys=2.24%, ctx=4744, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179704: Tue Sep 8 02:45:00 2026 read: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6052KiB/121013msec) clat (msec): min=4, max=265, avg=30.78, stdev=27.39 lat (msec): min=4, max=265, avg=30.78, stdev=27.38 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 68], 95.00th=[ 89], | 99.00th=[ 130], 99.50th=[ 150], 99.90th=[ 220], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 7, max= 143, per=25.33%, avg=50.14, stdev=30.05, samples=235 iops : min= 1, max= 35, avg=11.88, stdev= 7.57, samples=235 write: IOPS=12, BW=51.5KiB/s (52.8kB/s)(6236KiB/121013msec); 0 zone resets clat (msec): min=9, max=845, avg=47.67, stdev=37.62 lat (msec): min=9, max=845, avg=47.67, stdev=37.62 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 88], 95.00th=[ 108], | 99.00th=[ 174], 99.50th=[ 224], 99.90th=[ 268], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 166, per=24.77%, avg=51.28, stdev=28.82, samples=237 iops : min= 1, max= 41, avg=12.16, stdev= 7.27, samples=237 lat (msec) : 10=5.63%, 20=23.99%, 50=44.30%, 100=21.00%, 250=4.95% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=2.23%, ctx=4786, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=198KiB/s (203kB/s), 49.0KiB/s-50.0KiB/s (50.2kB/s-51.2kB/s), io=23.4MiB (24.6MB), run=120681-121156msec WRITE: bw=208KiB/s (212kB/s), 51.5KiB/s-52.4KiB/s (52.8kB/s-53.7kB/s), io=24.6MiB (25.7MB), run=120681-121156msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179736: Tue Sep 8 02:45:30 2026 read: IOPS=16, BW=260KiB/s (266kB/s)(5920KiB/22786msec) clat (usec): min=36, max=136443, avg=32717.40, stdev=21552.66 lat (usec): min=37, max=136443, avg=32721.18, stdev=21552.99 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 979], 20.00th=[ 16712], | 30.00th=[ 21365], 40.00th=[ 24511], 50.00th=[ 28967], 60.00th=[ 34866], | 70.00th=[ 41157], 80.00th=[ 47973], 90.00th=[ 59507], 95.00th=[ 69731], | 99.00th=[102237], 99.50th=[130548], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 94, max= 573, per=25.15%, avg=259.78, stdev=91.53, samples=45 iops : min= 5, max= 35, avg=15.58, stdev= 5.73, samples=45 write: IOPS=17, BW=279KiB/s (286kB/s)(6368KiB/22786msec); 0 zone resets clat (usec): min=1269, max=161085, avg=26566.92, stdev=26260.60 lat (usec): min=1271, max=161088, avg=26569.38, stdev=26260.45 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1795], 10.00th=[ 2638], 20.00th=[ 4424], | 30.00th=[ 7111], 40.00th=[ 11600], 50.00th=[ 19530], 60.00th=[ 26084], | 70.00th=[ 32900], 80.00th=[ 45876], 90.00th=[ 61604], 95.00th=[ 78119], | 99.00th=[113771], 99.50th=[145753], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 127, max= 447, per=25.75%, avg=279.93, stdev=86.48, samples=45 iops : min= 7, max= 27, avg=16.84, stdev= 5.47, samples=45 lat (usec) : 50=0.39%, 100=3.39%, 250=0.26%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=3.52%, 4=5.47%, 10=10.81%, 20=14.06%, 50=43.75% lat (msec) : 100=15.89%, 250=1.69% cpu : usr=0.05%, sys=7.71%, ctx=1703, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179737: Tue Sep 8 02:45:30 2026 read: IOPS=15, BW=248KiB/s (254kB/s)(5744KiB/23177msec) clat (usec): min=50, max=130205, avg=34280.50, stdev=20474.41 lat (usec): min=51, max=130205, avg=34281.71, stdev=20474.39 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 13566], 20.00th=[ 19530], | 30.00th=[ 22938], 40.00th=[ 26084], 50.00th=[ 32113], 60.00th=[ 36439], | 70.00th=[ 41157], 80.00th=[ 48497], 90.00th=[ 61080], 95.00th=[ 69731], | 99.00th=[101188], 99.50th=[108528], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 127, max= 414, per=23.65%, avg=244.33, stdev=79.11, samples=45 iops : min= 7, max= 25, avg=14.62, stdev= 4.86, samples=45 write: IOPS=17, BW=282KiB/s (289kB/s)(6544KiB/23177msec); 0 zone resets clat (usec): min=1028, max=133348, avg=26404.48, stdev=25440.54 lat (usec): min=1030, max=133350, avg=26408.84, stdev=25438.86 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1811], 10.00th=[ 2606], 20.00th=[ 4359], | 30.00th=[ 7177], 40.00th=[ 11731], 50.00th=[ 18220], 60.00th=[ 26346], | 70.00th=[ 34341], 80.00th=[ 45351], 90.00th=[ 62653], 95.00th=[ 78119], | 99.00th=[102237], 99.50th=[110625], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 95, max= 447, per=25.30%, avg=274.98, stdev=87.65, samples=45 iops : min= 5, max= 27, avg=16.53, stdev= 5.59, samples=45 lat (usec) : 100=3.12%, 250=0.39% lat (msec) : 2=3.78%, 4=6.25%, 10=9.38%, 20=14.32%, 50=45.31% lat (msec) : 100=15.89%, 250=1.56% cpu : usr=0.09%, sys=7.79%, ctx=1755, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179738: Tue Sep 8 02:45:30 2026 read: IOPS=16, BW=272KiB/s (278kB/s)(6256KiB/23013msec) clat (usec): min=34, max=168936, avg=32143.84, stdev=22525.94 lat (usec): min=34, max=168938, avg=32149.17, stdev=22523.92 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 766], 20.00th=[ 15926], | 30.00th=[ 21103], 40.00th=[ 24773], 50.00th=[ 28443], 60.00th=[ 32900], | 70.00th=[ 39060], 80.00th=[ 46400], 90.00th=[ 58459], 95.00th=[ 69731], | 99.00th=[114820], 99.50th=[130548], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 127, max= 472, per=26.39%, avg=272.64, stdev=81.89, samples=45 iops : min= 7, max= 29, avg=16.38, stdev= 5.18, samples=45 write: IOPS=16, BW=262KiB/s (268kB/s)(6032KiB/23013msec); 0 zone resets clat (usec): min=1391, max=164183, avg=26791.70, stdev=24743.18 lat (usec): min=1391, max=164187, avg=26793.92, stdev=24743.00 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2212], 10.00th=[ 2900], 20.00th=[ 4752], | 30.00th=[ 8717], 40.00th=[ 13829], 50.00th=[ 19268], 60.00th=[ 26870], | 70.00th=[ 34341], 80.00th=[ 46400], 90.00th=[ 61604], 95.00th=[ 73925], | 99.00th=[ 99091], 99.50th=[108528], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 95, max= 480, per=23.76%, avg=258.31, stdev=101.39, samples=45 iops : min= 5, max= 30, avg=15.49, stdev= 6.47, samples=45 lat (usec) : 50=0.78%, 100=4.04%, 250=0.26%, 1000=0.13% lat (msec) : 2=2.21%, 4=6.38%, 10=7.81%, 20=17.32%, 50=43.88% lat (msec) : 100=16.02%, 250=1.17% cpu : usr=0.07%, sys=7.82%, ctx=1817, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179739: Tue Sep 8 02:45:30 2026 read: IOPS=16, BW=268KiB/s (274kB/s)(6032KiB/22514msec) clat (usec): min=41, max=153693, avg=32773.31, stdev=23862.16 lat (usec): min=42, max=153693, avg=32776.33, stdev=23861.53 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 75], 20.00th=[ 16712], | 30.00th=[ 21365], 40.00th=[ 25560], 50.00th=[ 29230], 60.00th=[ 35390], | 70.00th=[ 41157], 80.00th=[ 47973], 90.00th=[ 58983], 95.00th=[ 73925], | 99.00th=[117965], 99.50th=[145753], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 158, max= 445, per=25.74%, avg=265.93, stdev=73.62, samples=44 iops : min= 9, max= 27, avg=15.98, stdev= 4.60, samples=44 write: IOPS=17, BW=278KiB/s (285kB/s)(6256KiB/22514msec); 0 zone resets clat (usec): min=1276, max=122773, avg=25534.05, stdev=25654.62 lat (usec): min=1277, max=122775, avg=25537.88, stdev=25654.35 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1795], 10.00th=[ 2737], 20.00th=[ 4490], | 30.00th=[ 6521], 40.00th=[ 11469], 50.00th=[ 18482], 60.00th=[ 23725], | 70.00th=[ 31851], 80.00th=[ 43254], 90.00th=[ 61080], 95.00th=[ 81265], | 99.00th=[111674], 99.50th=[114820], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 126, max= 561, per=25.48%, avg=276.98, stdev=94.39, samples=44 iops : min= 7, max= 35, avg=16.68, stdev= 5.93, samples=44 lat (usec) : 50=0.65%, 100=4.95%, 250=0.78%, 500=0.26% lat (msec) : 2=3.39%, 4=5.34%, 10=11.20%, 20=13.80%, 50=43.10% lat (msec) : 100=14.32%, 250=2.21% cpu : usr=0.07%, sys=7.56%, ctx=1693, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1033KiB/s (1058kB/s), 248KiB/s-272KiB/s (254kB/s-278kB/s), io=23.4MiB (24.5MB), run=22514-23177msec WRITE: bw=1087KiB/s (1113kB/s), 262KiB/s-282KiB/s (268kB/s-289kB/s), io=24.6MiB (25.8MB), run=22514-23177msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Tue Sep 8 02:45:39 2026 read: IOPS=11, BW=186KiB/s (191kB/s)(5920KiB/31775msec) clat (msec): min=5, max=149, avg=34.40, stdev=27.02 lat (msec): min=5, max=149, avg=34.40, stdev=27.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 78], 95.00th=[ 99], | 99.00th=[ 115], 99.50th=[ 138], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 31, max= 510, per=24.60%, avg=184.03, stdev=102.60, samples=62 iops : min= 1, max= 31, avg=10.74, stdev= 6.44, samples=62 write: IOPS=12, BW=200KiB/s (205kB/s)(6368KiB/31775msec); 0 zone resets clat (msec): min=10, max=228, avg=47.68, stdev=30.26 lat (msec): min=10, max=228, avg=47.69, stdev=30.26 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 71], 90.00th=[ 90], 95.00th=[ 107], | 99.00th=[ 159], 99.50th=[ 192], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 446, per=25.36%, avg=199.55, stdev=97.96, samples=62 iops : min= 1, max= 27, avg=11.73, stdev= 6.14, samples=62 lat (msec) : 10=2.47%, 20=19.14%, 50=51.95%, 100=21.09%, 250=5.34% cpu : usr=0.05%, sys=2.37%, ctx=1244, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179741: Tue Sep 8 02:45:39 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(5744KiB/31814msec) clat (msec): min=5, max=181, avg=33.60, stdev=28.09 lat (msec): min=5, max=181, avg=33.61, stdev=28.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 83], 95.00th=[ 101], | 99.00th=[ 140], 99.50th=[ 148], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 32, max= 568, per=24.81%, avg=185.57, stdev=111.55, samples=60 iops : min= 2, max= 35, avg=10.85, stdev= 6.98, samples=60 write: IOPS=12, BW=206KiB/s (211kB/s)(6544KiB/31814msec); 0 zone resets clat (msec): min=11, max=156, avg=47.90, stdev=30.12 lat (msec): min=11, max=156, avg=47.91, stdev=30.12 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 72], 90.00th=[ 89], 95.00th=[ 114], | 99.00th=[ 144], 99.50th=[ 153], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 30, max= 477, per=25.71%, avg=202.35, stdev=105.27, samples=62 iops : min= 1, max= 29, avg=11.90, stdev= 6.63, samples=62 lat (msec) : 10=3.39%, 20=21.35%, 50=48.96%, 100=20.44%, 250=5.86% cpu : usr=0.05%, sys=2.45%, ctx=1225, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Tue Sep 8 02:45:39 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6256KiB/32020msec) clat (msec): min=5, max=159, avg=34.39, stdev=27.33 lat (msec): min=5, max=159, avg=34.39, stdev=27.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 78], 95.00th=[ 94], | 99.00th=[ 138], 99.50th=[ 148], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 28, max= 479, per=26.22%, avg=196.13, stdev=118.74, samples=63 iops : min= 1, max= 29, avg=11.49, stdev= 7.44, samples=63 write: IOPS=11, BW=188KiB/s (193kB/s)(6032KiB/32020msec); 0 zone resets clat (msec): min=10, max=191, avg=48.50, stdev=30.26 lat (msec): min=10, max=191, avg=48.50, stdev=30.26 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 72], 90.00th=[ 89], 95.00th=[ 110], | 99.00th=[ 140], 99.50th=[ 182], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 31, max= 416, per=23.60%, avg=185.76, stdev=95.77, samples=63 iops : min= 1, max= 26, avg=10.86, stdev= 6.01, samples=63 lat (msec) : 10=3.91%, 20=20.31%, 50=46.74%, 100=23.83%, 250=5.21% cpu : usr=0.06%, sys=2.43%, ctx=1251, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179743: Tue Sep 8 02:45:39 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(6032KiB/31770msec) clat (msec): min=6, max=150, avg=35.13, stdev=27.38 lat (msec): min=6, max=150, avg=35.13, stdev=27.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 97], | 99.00th=[ 136], 99.50th=[ 144], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 28, max= 542, per=25.19%, avg=188.44, stdev=112.80, samples=62 iops : min= 1, max= 33, avg=11.02, stdev= 7.10, samples=62 write: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31770msec); 0 zone resets clat (msec): min=10, max=228, avg=46.77, stdev=30.49 lat (msec): min=10, max=228, avg=46.78, stdev=30.49 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 66], 90.00th=[ 86], 95.00th=[ 109], | 99.00th=[ 161], 99.50th=[ 182], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 504, per=24.74%, avg=194.71, stdev=106.40, samples=62 iops : min= 1, max= 31, avg=11.44, stdev= 6.69, samples=62 lat (msec) : 10=1.82%, 20=21.88%, 50=49.22%, 100=21.88%, 250=5.21% cpu : usr=0.08%, sys=2.34%, ctx=1218, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=748KiB/s (766kB/s), 181KiB/s-195KiB/s (185kB/s-200kB/s), io=23.4MiB (24.5MB), run=31770-32020msec WRITE: bw=787KiB/s (806kB/s), 188KiB/s-206KiB/s (193kB/s-211kB/s), io=24.6MiB (25.8MB), run=31770-32020msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179754: Tue Sep 8 02:45:52 2026 read: IOPS=1, BW=1669KiB/s (1709kB/s)(7168KiB/4296msec) clat (msec): min=114, max=265, avg=194.29, stdev=54.09 lat (msec): min=114, max=265, avg=194.29, stdev=54.09 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 161], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 180], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 262], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 1943, max= 6059, per=68.76%, avg=3011.00, stdev=2032.36, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1192KiB/s (1220kB/s)(5120KiB/4296msec); 0 zone resets clat (msec): min=129, max=1841, avg=565.18, stdev=720.49 lat (msec): min=130, max=1841, avg=565.26, stdev=720.50 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 2007, max= 4087, per=41.38%, avg=2537.00, stdev=1033.40, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=11.55%, ctx=249, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179755: Tue Sep 8 02:45:52 2026 read: IOPS=0, BW=438KiB/s (448kB/s)(2048KiB/4676msec) clat (msec): min=117, max=2319, avg=1218.65, stdev=1557.22 lat (msec): min=117, max=2319, avg=1218.65, stdev=1557.22 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2007, max= 2031, per=46.11%, avg=2019.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2190KiB/s (2242kB/s)(10.0MiB/4676msec); 0 zone resets clat (msec): min=80, max=617, avg=203.94, stdev=156.93 lat (msec): min=80, max=617, avg=204.08, stdev=156.90 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 142], 50.00th=[ 169], 60.00th=[ 171], | 70.00th=[ 194], 80.00th=[ 224], 90.00th=[ 259], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1984, max= 6107, per=74.22%, avg=4550.25, stdev=1948.73, samples=4 iops : min= 1, max= 5, avg= 3.50, stdev= 1.91, samples=4 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=13.22%, ctx=517, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179756: Tue Sep 8 02:45:52 2026 read: IOPS=1, BW=2026KiB/s (2074kB/s)(6144KiB/3033msec) clat (usec): min=816, max=994097, avg=261941.92, stdev=370092.49 lat (usec): min=817, max=994098, avg=261942.99, stdev=370092.29 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 816], 10.00th=[ 816], 20.00th=[ 17695], | 30.00th=[ 17695], 40.00th=[137364], 50.00th=[137364], 60.00th=[198181], | 70.00th=[223347], 80.00th=[223347], 90.00th=[994051], 95.00th=[994051], | 99.00th=[994051], 99.50th=[994051], 99.90th=[994051], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 2031, max= 6107, per=92.92%, avg=4069.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=2026KiB/s (2074kB/s)(6144KiB/3033msec); 0 zone resets clat (msec): min=82, max=574, avg=227.30, stdev=174.54 lat (msec): min=83, max=576, avg=227.95, stdev=174.90 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 184], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 3842, max= 4071, per=64.53%, avg=3956.50, stdev=161.93, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (usec) : 1000=8.33% lat (msec) : 20=8.33%, 100=8.33%, 250=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=13.89%, ctx=301, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179757: Tue Sep 8 02:45:52 2026 read: IOPS=1, BW=1570KiB/s (1607kB/s)(5120KiB/3262msec) clat (usec): min=369, max=1179.9k, avg=264757.21, stdev=515246.55 lat (usec): min=370, max=1179.9k, avg=264758.38, stdev=515246.27 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 371], 10.00th=[ 371], | 20.00th=[ 371], 30.00th=[ 523], 40.00th=[ 523], | 50.00th=[ 766], 60.00th=[ 766], 70.00th=[ 141558], | 80.00th=[ 141558], 90.00th=[1182794], 95.00th=[1182794], | 99.00th=[1182794], 99.50th=[1182794], 99.90th=[1182794], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 2035, max= 6095, per=92.83%, avg=4065.00, stdev=2870.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2197KiB/s (2250kB/s)(7168KiB/3262msec); 0 zone resets clat (msec): min=124, max=651, avg=270.30, stdev=180.54 lat (msec): min=124, max=652, avg=270.50, stdev=180.56 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 159], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 197], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 305], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1868, max= 4071, per=48.63%, avg=2981.50, stdev=1200.90, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=13.43%, ctx=273, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4380KiB/s (4485kB/s), 438KiB/s-2026KiB/s (448kB/s-2074kB/s), io=20.0MiB (20.0MB), run=3033-4676msec WRITE: bw=6132KiB/s (6279kB/s), 1192KiB/s-2197KiB/s (1220kB/s-2250kB/s), io=28.0MiB (29.4MB), run=3033-4676msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179758: Tue Sep 8 02:45:53 2026 read: IOPS=1, BW=1649KiB/s (1688kB/s)(7168KiB/4348msec) clat (msec): min=55, max=783, avg=251.41, stdev=252.85 lat (msec): min=55, max=783, avg=251.41, stdev=252.85 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 80], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 150], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 326], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1368, max= 4096, per=70.89%, avg=2886.50, stdev=1406.92, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1178KiB/s (1206kB/s)(5120KiB/4348msec); 0 zone resets clat (msec): min=184, max=1408, avg=472.43, stdev=527.65 lat (msec): min=184, max=1409, avg=472.67, stdev=527.56 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 2035, max= 4063, per=59.18%, avg=3373.67, stdev=1159.49, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.44%, ctx=96, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179759: Tue Sep 8 02:45:53 2026 read: IOPS=0, BW=407KiB/s (417kB/s)(2048KiB/5029msec) clat (msec): min=56, max=2627, avg=1342.26, stdev=1818.03 lat (msec): min=56, max=2627, avg=1342.26, stdev=1818.03 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 57], 60.00th=[ 2635], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1984, max= 2035, per=49.35%, avg=2009.50, stdev=36.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2036KiB/s (2085kB/s)(10.0MiB/5029msec); 0 zone resets clat (msec): min=53, max=488, avg=217.75, stdev=141.20 lat (msec): min=53, max=488, avg=217.96, stdev=141.22 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 59], | 30.00th=[ 120], 40.00th=[ 150], 50.00th=[ 176], 60.00th=[ 178], | 70.00th=[ 264], 80.00th=[ 317], 90.00th=[ 372], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2011, max= 6095, per=82.20%, avg=4686.33, stdev=2317.99, samples=3 iops : min= 1, max= 5, avg= 3.67, stdev= 2.31, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, >=2000=8.33% cpu : usr=0.04%, sys=4.36%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179760: Tue Sep 8 02:45:53 2026 read: IOPS=1, BW=1281KiB/s (1312kB/s)(6144KiB/4797msec) clat (msec): min=69, max=309, avg=174.89, stdev=108.89 lat (msec): min=69, max=309, avg=174.89, stdev=108.89 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 70], | 30.00th=[ 70], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 199], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 4023, max= 4063, per=99.29%, avg=4043.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1281KiB/s (1312kB/s)(6144KiB/4797msec); 0 zone resets clat (msec): min=68, max=2591, avg=580.12, stdev=990.69 lat (msec): min=68, max=2591, avg=580.26, stdev=990.70 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 213], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 4063, max= 4071, per=71.34%, avg=4067.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.17%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179761: Tue Sep 8 02:45:53 2026 read: IOPS=1, BW=1107KiB/s (1133kB/s)(5120KiB/4626msec) clat (msec): min=49, max=280, avg=145.70, stdev=101.97 lat (msec): min=49, max=280, avg=145.70, stdev=101.97 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 105], 60.00th=[ 105], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 2027, max= 6059, per=99.29%, avg=4043.00, stdev=2851.05, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1550KiB/s (1587kB/s)(7168KiB/4626msec); 0 zone resets clat (msec): min=73, max=2442, avg=494.94, stdev=861.10 lat (msec): min=73, max=2442, avg=495.63, stdev=860.91 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 126], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 205], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 262], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 4047, max= 4071, per=71.17%, avg=4057.67, stdev=12.22, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=50.00%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=4.19%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4072KiB/s (4170kB/s), 407KiB/s-1649KiB/s (417kB/s-1688kB/s), io=20.0MiB (20.0MB), run=4348-5029msec WRITE: bw=5701KiB/s (5838kB/s), 1178KiB/s-2036KiB/s (1206kB/s-2085kB/s), io=28.0MiB (29.4MB), run=4348-5029msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179767: Tue Sep 8 02:46:04 2026 read: IOPS=1, BW=5994KiB/s (6138kB/s)(12.0MiB/2050msec) clat (msec): min=559, max=762, avg=674.06, stdev=104.00 lat (msec): min=559, max=762, avg=674.07, stdev=104.00 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.15%, sys=15.23%, ctx=412, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179768: Tue Sep 8 02:46:04 2026 read: IOPS=0, BW=1376KiB/s (1409kB/s)(4096KiB/2976msec) clat (nsec): min=641082k, max=641082k, avg=641082029.00, stdev= 0.00 lat (nsec): min=641085k, max=641085k, avg=641085079.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2753KiB/s (2819kB/s)(8192KiB/2976msec); 0 zone resets clat (msec): min=1046, max=1233, avg=1139.82, stdev=131.91 lat (msec): min=1047, max=1233, avg=1140.30, stdev=131.78 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8031, max= 8031, per=72.94%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=5.38%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179769: Tue Sep 8 02:46:04 2026 write: IOPS=1, BW=5211KiB/s (5336kB/s)(12.0MiB/2358msec); 0 zone resets clat (msec): min=295, max=1266, avg=763.63, stdev=486.49 lat (msec): min=296, max=1266, avg=765.22, stdev=485.87 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8031, max= 8175, per=73.60%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.59%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179770: Tue Sep 8 02:46:04 2026 write: IOPS=1, BW=6341KiB/s (6493kB/s)(12.0MiB/1938msec); 0 zone resets clat (msec): min=289, max=976, avg=633.51, stdev=343.47 lat (msec): min=289, max=976, avg=633.90, stdev=343.47 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 5919, max= 8143, per=63.86%, avg=7031.00, stdev=1572.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.71%, ctx=67, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5505KiB/s (5638kB/s), 1376KiB/s-5994KiB/s (1409kB/s-6138kB/s), io=16.0MiB (16.8MB), run=2050-2976msec WRITE: bw=10.8MiB/s (11.3MB/s), 2753KiB/s-6341KiB/s (2819kB/s-6493kB/s), io=32.0MiB (33.6MB), run=1938-2976msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179772: Tue Sep 8 02:46:04 2026 read: IOPS=1, BW=4993KiB/s (5113kB/s)(12.0MiB/2461msec) clat (msec): min=154, max=1273, avg=811.09, stdev=584.20 lat (msec): min=154, max=1273, avg=811.09, stdev=584.20 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.23%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179773: Tue Sep 8 02:46:04 2026 read: IOPS=0, BW=1374KiB/s (1407kB/s)(4096KiB/2981msec) clat (nsec): min=1161.1M, max=1161.1M, avg=1161116823.00, stdev= 0.00 lat (nsec): min=1161.1M, max=1161.1M, avg=1161119254.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2748KiB/s (2814kB/s)(8192KiB/2981msec); 0 zone resets clat (msec): min=816, max=959, avg=888.21, stdev=100.73 lat (msec): min=822, max=959, avg=891.20, stdev=96.96 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8143, max= 8143, per=74.08%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.90%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179774: Tue Sep 8 02:46:04 2026 write: IOPS=1, BW=4541KiB/s (4650kB/s)(12.0MiB/2706msec); 0 zone resets clat (msec): min=219, max=1427, avg=879.90, stdev=611.79 lat (msec): min=219, max=1427, avg=880.32, stdev=611.75 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8031, max= 8031, per=73.06%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.18%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179775: Tue Sep 8 02:46:04 2026 write: IOPS=1, BW=5663KiB/s (5799kB/s)(12.0MiB/2170msec); 0 zone resets clat (msec): min=227, max=1005, avg=713.54, stdev=423.88 lat (msec): min=227, max=1005, avg=713.93, stdev=423.80 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8159, max= 8159, per=74.23%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.81%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5496KiB/s (5628kB/s), 1374KiB/s-4993KiB/s (1407kB/s-5113kB/s), io=16.0MiB (16.8MB), run=2461-2981msec WRITE: bw=10.7MiB/s (11.3MB/s), 2748KiB/s-5663KiB/s (2814kB/s-5799kB/s), io=32.0MiB (33.6MB), run=2170-2981msec