== sanity test 398b: DIO and buffer IO race ============== 01:00:50 (1788843650) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.77767 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145133: Tue Sep 8 01:03:17 2026 read: IOPS=11, BW=46.9KiB/s (48.0kB/s)(5992KiB/127817msec) clat (usec): min=35, max=1012.4k, avg=41686.27, stdev=39901.76 lat (usec): min=35, max=1012.4k, avg=41690.65, stdev=39902.70 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 1172], | 20.00th=[ 19268], 30.00th=[ 24773], 40.00th=[ 29754], | 50.00th=[ 35914], 60.00th=[ 43254], 70.00th=[ 51643], | 80.00th=[ 62129], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[ 129500], 99.50th=[ 154141], 99.90th=[ 455082], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 5, max= 127, per=25.08%, avg=46.90, stdev=18.67, samples=249 iops : min= 1, max= 31, avg=11.07, stdev= 4.68, samples=249 write: IOPS=12, BW=49.3KiB/s (50.4kB/s)(6296KiB/127817msec); 0 zone resets clat (usec): min=982, max=358276, avg=41205.92, stdev=39540.90 lat (usec): min=982, max=358277, avg=41208.43, stdev=39541.97 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1418], 10.00th=[ 2376], 20.00th=[ 5145], | 30.00th=[ 9896], 40.00th=[ 21627], 50.00th=[ 32375], 60.00th=[ 43254], | 70.00th=[ 56886], 80.00th=[ 70779], 90.00th=[ 91751], 95.00th=[114820], | 99.00th=[177210], 99.50th=[189793], 99.90th=[233833], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=49.12, stdev=19.25, samples=250 iops : min= 1, max= 25, avg=11.63, stdev= 4.81, samples=250 lat (usec) : 50=0.20%, 100=3.71%, 250=0.46%, 500=0.29%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=4.46%, 4=4.33%, 10=7.06%, 20=9.41%, 50=36.62% lat (msec) : 100=27.90%, 250=5.24%, 500=0.10%, 2000=0.03% cpu : usr=0.09%, sys=5.35%, ctx=6793, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145134: Tue Sep 8 01:03:17 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(5940KiB/127441msec) clat (usec): min=36, max=563667, avg=41716.18, stdev=30743.45 lat (usec): min=36, max=563669, avg=41718.87, stdev=30742.18 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 9896], 20.00th=[ 20055], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 53216], 80.00th=[ 63701], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[127402], 99.50th=[145753], 99.90th=[219153], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 5, max= 96, per=24.97%, avg=46.69, stdev=17.84, samples=248 iops : min= 1, max= 24, avg=11.02, stdev= 4.50, samples=248 write: IOPS=12, BW=49.8KiB/s (51.0kB/s)(6348KiB/127441msec); 0 zone resets clat (usec): min=966, max=955780, avg=40856.10, stdev=44870.44 lat (usec): min=967, max=955782, avg=40858.83, stdev=44870.88 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1319], 10.00th=[ 1876], 20.00th=[ 4555], | 30.00th=[ 8225], 40.00th=[ 19530], 50.00th=[ 30802], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[115868], | 99.00th=[162530], 99.50th=[170918], 99.90th=[283116], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 119, per=25.43%, avg=49.85, stdev=19.38, samples=248 iops : min= 1, max= 29, avg=11.83, stdev= 4.90, samples=248 lat (usec) : 50=0.16%, 100=3.78%, 250=0.49%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.47%, 4=3.87%, 10=7.68%, 20=8.56%, 50=35.64% lat (msec) : 100=28.32%, 250=5.70%, 500=0.03%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.36%, ctx=6885, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145135: Tue Sep 8 01:03:17 2026 read: IOPS=11, BW=47.2KiB/s (48.4kB/s)(6028KiB/127579msec) clat (usec): min=30, max=973226, avg=40677.92, stdev=37795.03 lat (usec): min=30, max=973227, avg=40682.36, stdev=37795.27 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 750], 20.00th=[ 19530], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[160433], 99.90th=[316670], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 6, max= 109, per=25.26%, avg=47.23, stdev=18.53, samples=248 iops : min= 1, max= 27, avg=11.17, stdev= 4.65, samples=248 write: IOPS=12, BW=49.1KiB/s (50.2kB/s)(6260KiB/127579msec); 0 zone resets clat (usec): min=971, max=374164, avg=42001.19, stdev=40702.93 lat (usec): min=972, max=374167, avg=42007.63, stdev=40702.74 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1401], 10.00th=[ 2474], 20.00th=[ 5604], | 30.00th=[ 11469], 40.00th=[ 22938], 50.00th=[ 33162], 60.00th=[ 42730], | 70.00th=[ 54789], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[117965], | 99.00th=[173016], 99.50th=[196084], 99.90th=[320865], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 120, per=24.76%, avg=48.53, stdev=19.17, samples=250 iops : min= 1, max= 30, avg=11.48, stdev= 4.82, samples=250 lat (usec) : 50=0.46%, 100=3.94%, 250=0.33%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=4.17%, 4=3.81%, 10=6.54%, 20=9.67%, 50=38.83% lat (msec) : 100=25.88%, 250=5.86%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=5.24%, ctx=6802, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145136: Tue Sep 8 01:03:17 2026 read: IOPS=12, BW=48.6KiB/s (49.8kB/s)(6052KiB/124507msec) clat (usec): min=33, max=386994, avg=39509.29, stdev=29557.20 lat (usec): min=33, max=386995, avg=39514.62, stdev=29560.07 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 121], 20.00th=[ 19006], | 30.00th=[ 23725], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 49021], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[126354], 99.50th=[158335], 99.90th=[233833], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 119, per=26.45%, avg=49.46, stdev=19.05, samples=239 iops : min= 1, max= 29, avg=11.72, stdev= 4.77, samples=239 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6236KiB/124507msec); 0 zone resets clat (usec): min=1041, max=1423.4k, avg=41165.64, stdev=55435.10 lat (usec): min=1042, max=1423.4k, avg=41170.86, stdev=55438.89 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 2114], | 20.00th=[ 4752], 30.00th=[ 8717], 40.00th=[ 19268], | 50.00th=[ 30802], 60.00th=[ 40109], 70.00th=[ 52167], | 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[ 115868], | 99.00th=[ 181404], 99.50th=[ 225444], 99.90th=[ 591397], | 99.95th=[1417675], 99.99th=[1417675] bw ( KiB/s): min= 7, max= 96, per=25.73%, avg=50.43, stdev=19.52, samples=241 iops : min= 1, max= 24, avg=11.97, stdev= 4.94, samples=241 lat (usec) : 50=0.49%, 100=4.00%, 250=0.85%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=4.82%, 4=4.10%, 10=7.36%, 20=9.44%, 50=38.57% lat (msec) : 100=24.67%, 250=5.24%, 500=0.16%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=5.49%, ctx=6736, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (192kB/s), 46.6KiB/s-48.6KiB/s (47.7kB/s-49.8kB/s), io=23.4MiB (24.6MB), run=124507-127817msec WRITE: bw=197KiB/s (201kB/s), 49.1KiB/s-50.1KiB/s (50.2kB/s-51.3kB/s), io=24.6MiB (25.7MB), run=124507-127817msec fio: pid=145140, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=145137: Tue Sep 8 01:05:29 2026 read: IOPS=5, BW=23.2KiB/s (23.8kB/s)(5992KiB/258247msec) clat (msec): min=5, max=1036, avg=35.46, stdev=43.98 lat (msec): min=5, max=1036, avg=35.46, stdev=43.98 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 49], 90.00th=[ 75], 95.00th=[ 103], | 99.00th=[ 176], 99.50th=[ 243], 99.90th=[ 368], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 103, per=30.28%, avg=25.74, stdev=17.94, samples=450 iops : min= 1, max= 25, avg= 5.80, stdev= 4.53, samples=450 write: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6296KiB/258247msec); 0 zone resets clat (msec): min=35, max=634, avg=130.02, stdev=62.12 lat (msec): min=35, max=634, avg=130.03, stdev=62.13 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 116], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 209], 95.00th=[ 249], | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 625], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 55, per=27.02%, avg=24.05, stdev=10.98, samples=504 iops : min= 1, max= 13, avg= 5.37, stdev= 2.80, samples=504 lat (msec) : 10=3.45%, 20=18.03%, 50=18.75%, 100=24.97%, 250=32.13% lat (msec) : 500=2.57%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5172, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145138: Tue Sep 8 01:05:29 2026 read: IOPS=5, BW=22.8KiB/s (23.4kB/s)(5940KiB/260207msec) clat (msec): min=5, max=1182, avg=36.38, stdev=45.99 lat (msec): min=5, max=1182, avg=36.38, stdev=45.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 79], 95.00th=[ 106], | 99.00th=[ 192], 99.50th=[ 228], 99.90th=[ 300], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 102, per=29.95%, avg=25.46, stdev=16.97, samples=450 iops : min= 1, max= 25, avg= 5.72, stdev= 4.29, samples=450 write: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6348KiB/260207msec); 0 zone resets clat (msec): min=35, max=457, avg=129.60, stdev=57.19 lat (msec): min=35, max=457, avg=129.61, stdev=57.20 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 236], | 99.00th=[ 309], 99.50th=[ 338], 99.90th=[ 435], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 55, per=26.91%, avg=23.95, stdev=11.02, samples=510 iops : min= 1, max= 13, avg= 5.34, stdev= 2.81, samples=510 lat (msec) : 10=3.52%, 20=16.99%, 50=18.68%, 100=24.90%, 250=33.82% lat (msec) : 500=2.05%, 2000=0.03% cpu : usr=0.04%, sys=1.17%, ctx=5218, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145139: Tue Sep 8 01:05:29 2026 read: IOPS=5, BW=23.2KiB/s (23.8kB/s)(6028KiB/259682msec) clat (msec): min=5, max=302, avg=35.31, stdev=33.34 lat (msec): min=5, max=302, avg=35.31, stdev=33.34 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 54], 90.00th=[ 81], 95.00th=[ 106], | 99.00th=[ 155], 99.50th=[ 176], 99.90th=[ 259], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 104, per=29.30%, avg=24.91, stdev=16.64, samples=467 iops : min= 1, max= 26, avg= 5.59, stdev= 4.20, samples=467 write: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6260KiB/259682msec); 0 zone resets clat (msec): min=33, max=1306, avg=131.62, stdev=66.46 lat (msec): min=33, max=1306, avg=131.62, stdev=66.46 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 153], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 249], | 99.00th=[ 309], 99.50th=[ 363], 99.90th=[ 625], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 55, per=26.59%, avg=23.66, stdev=11.20, samples=509 iops : min= 1, max= 13, avg= 5.27, stdev= 2.85, samples=509 lat (msec) : 10=3.68%, 20=17.97%, 50=17.48%, 100=25.33%, 250=33.04% lat (msec) : 500=2.44%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5274, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145140: Tue Sep 8 01:05:29 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(4316KiB/207316msec) clat (msec): min=5, max=488, avg=41.52, stdev=40.00 lat (msec): min=5, max=488, avg=41.53, stdev=40.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 89], 95.00th=[ 112], | 99.00th=[ 209], 99.50th=[ 245], 99.90th=[ 268], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 96, per=27.64%, avg=23.49, stdev=15.87, samples=354 iops : min= 1, max= 24, avg= 5.22, stdev= 3.98, samples=354 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(4468KiB/207316msec); 0 zone resets clat (msec): min=35, max=1412, avg=145.10, stdev=76.59 lat (msec): min=35, max=1412, avg=145.10, stdev=76.60 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 115], 50.00th=[ 130], 60.00th=[ 144], | 70.00th=[ 167], 80.00th=[ 192], 90.00th=[ 234], 95.00th=[ 271], | 99.00th=[ 359], 99.50th=[ 414], 99.90th=[ 625], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 55, per=23.85%, avg=21.23, stdev=10.24, samples=403 iops : min= 1, max= 13, avg= 4.65, stdev= 2.61, samples=403 lat (msec) : 10=2.32%, 20=14.66%, 50=19.62%, 100=23.30%, 250=36.50% lat (msec) : 500=3.46%, 750=0.05%, 2000=0.05% cpu : usr=0.04%, sys=1.06%, ctx=3573, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1080,1117,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=85.6KiB/s (87.7kB/s), 20.8KiB/s-23.2KiB/s (21.3kB/s-23.8kB/s), io=21.8MiB (22.8MB), run=207316-260207msec WRITE: bw=89.8KiB/s (91.0kB/s), 21.6KiB/s-24.4KiB/s (22.1kB/s-24.0kB/s), io=22.8MiB (23.9MB), run=207316-260207msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145195: Tue Sep 8 01:06:11 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5920KiB/28735msec) clat (usec): min=34, max=287031, avg=39333.33, stdev=36420.68 lat (usec): min=34, max=287033, avg=39334.54, stdev=36420.76 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 91], | 30.00th=[ 20841], 40.00th=[ 28705], 50.00th=[ 34866], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[177210], 99.50th=[191890], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 61, max= 507, per=25.21%, avg=206.50, stdev=84.03, samples=56 iops : min= 3, max= 31, avg=12.21, stdev= 5.29, samples=56 write: IOPS=13, BW=222KiB/s (227kB/s)(6368KiB/28735msec); 0 zone resets clat (usec): min=1472, max=272500, avg=35446.39, stdev=36224.43 lat (usec): min=1474, max=272503, avg=35450.31, stdev=36226.64 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2008], 10.00th=[ 2474], 20.00th=[ 5080], | 30.00th=[ 7898], 40.00th=[ 14615], 50.00th=[ 24249], 60.00th=[ 35390], | 70.00th=[ 44827], 80.00th=[ 63177], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[173016], 99.50th=[181404], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 448, per=25.89%, avg=223.18, stdev=96.23, samples=56 iops : min= 1, max= 28, avg=13.27, stdev= 6.12, samples=56 lat (usec) : 50=2.08%, 100=8.07%, 250=1.56%, 500=0.65%, 1000=0.13% lat (msec) : 2=2.73%, 4=5.47%, 10=8.98%, 20=8.20%, 50=31.77% lat (msec) : 100=24.74%, 250=5.34%, 500=0.26% cpu : usr=0.06%, sys=5.92%, ctx=1565, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145196: Tue Sep 8 01:06:11 2026 read: IOPS=12, BW=197KiB/s (201kB/s)(5744KiB/29224msec) clat (usec): min=40, max=277252, avg=41387.47, stdev=34200.84 lat (usec): min=41, max=277252, avg=41402.36, stdev=34210.94 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 68], 20.00th=[ 3228], | 30.00th=[ 25822], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[149947], 99.50th=[254804], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 49, max= 416, per=24.42%, avg=199.96, stdev=81.35, samples=56 iops : min= 3, max= 26, avg=11.82, stdev= 5.16, samples=56 write: IOPS=13, BW=224KiB/s (229kB/s)(6544KiB/29224msec); 0 zone resets clat (usec): min=1357, max=232706, avg=34814.89, stdev=38148.77 lat (usec): min=1362, max=232708, avg=34829.92, stdev=38147.64 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2040], 10.00th=[ 3326], 20.00th=[ 6194], | 30.00th=[ 8717], 40.00th=[ 13698], 50.00th=[ 21890], 60.00th=[ 31327], | 70.00th=[ 41157], 80.00th=[ 57410], 90.00th=[ 82314], 95.00th=[112722], | 99.00th=[166724], 99.50th=[210764], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 30, max= 537, per=25.94%, avg=223.60, stdev=94.55, samples=57 iops : min= 1, max= 33, avg=13.30, stdev= 5.92, samples=57 lat (usec) : 50=0.52%, 100=7.16%, 250=0.78%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.73%, 4=4.43%, 10=10.81%, 20=9.51%, 50=34.77% lat (msec) : 100=23.05%, 250=5.60%, 500=0.26% cpu : usr=0.08%, sys=6.09%, ctx=1580, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145197: Tue Sep 8 01:06:11 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(6256KiB/28669msec) clat (usec): min=40, max=256698, avg=38151.19, stdev=31280.36 lat (usec): min=40, max=256698, avg=38153.69, stdev=31279.65 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 65], 20.00th=[ 108], | 30.00th=[ 23987], 40.00th=[ 31327], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[130548], 99.50th=[154141], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 30, max= 568, per=26.82%, avg=219.66, stdev=99.69, samples=56 iops : min= 1, max= 35, avg=13.04, stdev= 6.28, samples=56 write: IOPS=13, BW=210KiB/s (215kB/s)(6032KiB/28669msec); 0 zone resets clat (usec): min=1394, max=238882, avg=36276.04, stdev=39674.61 lat (usec): min=1396, max=238885, avg=36280.92, stdev=39673.23 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2212], 10.00th=[ 3261], 20.00th=[ 5473], | 30.00th=[ 8586], 40.00th=[ 13566], 50.00th=[ 21890], 60.00th=[ 31065], | 70.00th=[ 44827], 80.00th=[ 64226], 90.00th=[ 88605], 95.00th=[113771], | 99.00th=[183501], 99.50th=[238027], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 94, max= 383, per=24.33%, avg=209.70, stdev=77.89, samples=56 iops : min= 5, max= 23, avg=12.41, stdev= 4.89, samples=56 lat (usec) : 50=0.65%, 100=9.11%, 250=1.17%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.34%, 4=5.08%, 10=10.03%, 20=8.59%, 50=33.46% lat (msec) : 100=24.09%, 250=5.08%, 500=0.13% cpu : usr=0.07%, sys=5.40%, ctx=1526, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145198: Tue Sep 8 01:06:11 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27946msec) clat (usec): min=33, max=225397, avg=41234.65, stdev=33830.36 lat (usec): min=34, max=225399, avg=41254.42, stdev=33826.34 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 65], 20.00th=[ 141], | 30.00th=[ 23725], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 82314], 95.00th=[ 94897], | 99.00th=[137364], 99.50th=[162530], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 32, max= 448, per=25.99%, avg=212.89, stdev=84.26, samples=54 iops : min= 2, max= 28, avg=12.63, stdev= 5.35, samples=54 write: IOPS=13, BW=224KiB/s (229kB/s)(6256KiB/27946msec); 0 zone resets clat (usec): min=1429, max=311757, avg=31573.72, stdev=36673.52 lat (usec): min=1432, max=311760, avg=31576.31, stdev=36673.39 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1811], 10.00th=[ 2540], 20.00th=[ 4424], | 30.00th=[ 6456], 40.00th=[ 9765], 50.00th=[ 17171], 60.00th=[ 28443], | 70.00th=[ 39060], 80.00th=[ 56886], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[217056], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 480, per=25.79%, avg=222.35, stdev=94.82, samples=54 iops : min= 1, max= 30, avg=13.20, stdev= 6.03, samples=54 lat (usec) : 50=0.78%, 100=8.07%, 250=1.30%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=4.17%, 4=5.21%, 10=11.72%, 20=8.20%, 50=29.95% lat (msec) : 100=25.26%, 250=4.56%, 500=0.13% cpu : usr=0.08%, sys=5.99%, ctx=1459, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=820KiB/s (839kB/s), 197KiB/s-218KiB/s (201kB/s-223kB/s), io=23.4MiB (24.5MB), run=27946-29224msec WRITE: bw=862KiB/s (883kB/s), 210KiB/s-224KiB/s (215kB/s-229kB/s), io=24.6MiB (25.8MB), run=27946-29224msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145190: Tue Sep 8 01:06:52 2026 read: IOPS=5, BW=85.0KiB/s (87.1kB/s)(5920KiB/69611msec) clat (msec): min=7, max=406, avg=44.66, stdev=41.13 lat (msec): min=7, max=406, avg=44.66, stdev=41.13 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 60], 90.00th=[ 81], 95.00th=[ 120], | 99.00th=[ 222], 99.50th=[ 296], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 382, per=27.37%, avg=93.32, stdev=55.44, samples=124 iops : min= 1, max= 23, avg= 5.08, stdev= 3.56, samples=124 write: IOPS=5, BW=91.5KiB/s (93.7kB/s)(6368KiB/69611msec); 0 zone resets clat (msec): min=44, max=425, avg=133.03, stdev=60.42 lat (msec): min=44, max=425, avg=133.03, stdev=60.42 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 95], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 215], 95.00th=[ 251], | 99.00th=[ 376], 99.50th=[ 397], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 29, max= 191, per=25.54%, avg=91.69, stdev=39.30, samples=136 iops : min= 1, max= 11, avg= 4.97, stdev= 2.53, samples=136 lat (msec) : 10=0.65%, 20=11.20%, 50=23.44%, 100=28.39%, 250=33.20% lat (msec) : 500=3.12% cpu : usr=0.04%, sys=1.28%, ctx=1429, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145191: Tue Sep 8 01:06:52 2026 read: IOPS=5, BW=81.9KiB/s (83.8kB/s)(5744KiB/70168msec) clat (msec): min=7, max=259, avg=43.80, stdev=36.23 lat (msec): min=7, max=259, avg=43.81, stdev=36.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 124], | 99.00th=[ 186], 99.50th=[ 249], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 314, per=26.66%, avg=90.93, stdev=59.58, samples=123 iops : min= 1, max= 19, avg= 4.91, stdev= 3.80, samples=123 write: IOPS=5, BW=93.3KiB/s (95.5kB/s)(6544KiB/70168msec); 0 zone resets clat (msec): min=38, max=462, avg=132.96, stdev=63.49 lat (msec): min=38, max=462, avg=132.96, stdev=63.49 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 67], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 259], | 99.00th=[ 355], 99.50th=[ 393], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 29, max= 192, per=25.79%, avg=92.58, stdev=42.15, samples=138 iops : min= 1, max= 12, avg= 5.02, stdev= 2.73, samples=138 lat (msec) : 10=1.04%, 20=9.11%, 50=24.22%, 100=26.43%, 250=35.81% lat (msec) : 500=3.39% cpu : usr=0.05%, sys=1.29%, ctx=1450, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145192: Tue Sep 8 01:06:52 2026 read: IOPS=5, BW=93.4KiB/s (95.6kB/s)(6256KiB/67016msec) clat (msec): min=6, max=248, avg=39.34, stdev=32.34 lat (msec): min=6, max=248, avg=39.34, stdev=32.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 68], 95.00th=[ 109], | 99.00th=[ 163], 99.50th=[ 215], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 29, max= 416, per=29.64%, avg=101.06, stdev=66.49, samples=122 iops : min= 1, max= 26, avg= 5.56, stdev= 4.27, samples=122 write: IOPS=5, BW=90.0KiB/s (92.2kB/s)(6032KiB/67016msec); 0 zone resets clat (msec): min=41, max=467, avg=136.57, stdev=62.43 lat (msec): min=41, max=467, avg=136.57, stdev=62.43 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 70], 10.00th=[ 77], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 268], | 99.00th=[ 393], 99.50th=[ 405], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 30, max= 191, per=25.08%, avg=90.04, stdev=36.09, samples=131 iops : min= 1, max= 11, avg= 4.85, stdev= 2.35, samples=131 lat (msec) : 10=2.08%, 20=10.03%, 50=28.52%, 100=21.61%, 250=35.16% lat (msec) : 500=2.60% cpu : usr=0.05%, sys=1.38%, ctx=1424, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145193: Tue Sep 8 01:06:52 2026 read: IOPS=5, BW=86.5KiB/s (88.6kB/s)(6032KiB/69736msec) clat (msec): min=8, max=247, avg=42.56, stdev=37.21 lat (msec): min=8, max=247, avg=42.56, stdev=37.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 87], 95.00th=[ 113], | 99.00th=[ 218], 99.50th=[ 245], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 29, max= 319, per=27.37%, avg=93.33, stdev=55.98, samples=126 iops : min= 1, max= 19, avg= 5.09, stdev= 3.59, samples=126 write: IOPS=5, BW=89.7KiB/s (91.9kB/s)(6256KiB/69736msec); 0 zone resets clat (msec): min=39, max=464, avg=136.97, stdev=62.24 lat (msec): min=39, max=464, avg=136.97, stdev=62.24 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 100], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 211], 95.00th=[ 266], | 99.00th=[ 347], 99.50th=[ 409], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 31, max= 222, per=25.26%, avg=90.70, stdev=38.16, samples=135 iops : min= 1, max= 13, avg= 4.91, stdev= 2.44, samples=135 lat (msec) : 10=1.17%, 20=10.81%, 50=25.13%, 100=24.48%, 250=35.55% lat (msec) : 500=2.86% cpu : usr=0.04%, sys=1.14%, ctx=1399, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=341KiB/s (350kB/s), 81.9KiB/s-93.4KiB/s (83.8kB/s-95.6kB/s), io=23.4MiB (24.5MB), run=67016-70168msec WRITE: bw=359KiB/s (368kB/s), 89.7KiB/s-93.3KiB/s (91.9kB/s-95.5kB/s), io=24.6MiB (25.8MB), run=67016-70168msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145219: Tue Sep 8 01:07:10 2026 read: IOPS=1, BW=1431KiB/s (1466kB/s)(7168KiB/5008msec) clat (usec): min=788, max=2406.5k, avg=501968.44, stdev=844710.37 lat (usec): min=789, max=2406.5k, avg=501970.15, stdev=844710.13 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], | 20.00th=[ 154141], 30.00th=[ 193987], 40.00th=[ 193987], | 50.00th=[ 233833], 60.00th=[ 250610], 70.00th=[ 250610], | 80.00th=[ 274727], 90.00th=[2399142], 95.00th=[2399142], | 99.00th=[2399142], 99.50th=[2399142], 99.90th=[2399142], | 99.95th=[2399142], 99.99th=[2399142] bw ( KiB/s): min= 1422, max= 3828, per=81.43%, avg=2270.40, stdev=910.24, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=1022KiB/s (1047kB/s)(5120KiB/5008msec); 0 zone resets clat (msec): min=182, max=401, avg=288.63, stdev=93.93 lat (msec): min=182, max=401, avg=288.72, stdev=93.90 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2048, max= 4079, per=83.63%, avg=3263.33, stdev=1072.87, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=41.67%, >=2000=8.33% cpu : usr=0.10%, sys=9.11%, ctx=533, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145220: Tue Sep 8 01:07:10 2026 read: IOPS=0, BW=287KiB/s (294kB/s)(2048KiB/7137msec) clat (msec): min=3, max=140, avg=71.94, stdev=96.92 lat (msec): min=3, max=140, avg=71.94, stdev=96.92 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 4], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 140], 95.00th=[ 140], | 99.00th=[ 140], 99.50th=[ 140], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 1475, max= 2035, per=62.95%, avg=1755.00, stdev=395.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1435KiB/s (1469kB/s)(10.0MiB/7137msec); 0 zone resets clat (msec): min=114, max=2517, avg=661.13, stdev=690.49 lat (msec): min=114, max=2517, avg=661.23, stdev=690.48 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 153], | 30.00th=[ 397], 40.00th=[ 401], 50.00th=[ 443], 60.00th=[ 485], | 70.00th=[ 498], 80.00th=[ 760], 90.00th=[ 844], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1831, max= 4071, per=65.97%, avg=2574.14, stdev=1003.54, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 4=8.33%, 250=25.00%, 500=41.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.06%, sys=7.29%, ctx=158, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145221: Tue Sep 8 01:07:10 2026 read: IOPS=0, BW=852KiB/s (872kB/s)(6144KiB/7213msec) clat (msec): min=78, max=362, avg=252.62, stdev=108.05 lat (msec): min=78, max=362, avg=252.62, stdev=108.05 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 321], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2000, max= 4071, per=90.54%, avg=2524.25, stdev=1031.22, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=852KiB/s (872kB/s)(6144KiB/7213msec); 0 zone resets clat (msec): min=166, max=3620, avg=932.32, stdev=1322.72 lat (msec): min=166, max=3620, avg=932.39, stdev=1322.72 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1570, max= 2048, per=49.63%, avg=1936.60, stdev=205.65, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=6.52%, ctx=196, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145222: Tue Sep 8 01:07:10 2026 read: IOPS=0, BW=697KiB/s (714kB/s)(5120KiB/7344msec) clat (usec): min=477, max=277352, avg=56271.29, stdev=123591.55 lat (usec): min=479, max=277353, avg=56272.10, stdev=123591.28 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[ 486], 60.00th=[ 486], | 70.00th=[ 2573], 80.00th=[ 2573], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2023, max= 6011, per=100.00%, avg=4017.00, stdev=2819.94, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=976KiB/s (999kB/s)(7168KiB/7348msec); 0 zone resets clat (msec): min=338, max=3277, avg=955.38, stdev=1045.38 lat (msec): min=338, max=3277, avg=955.47, stdev=1045.38 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 401], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 531], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 927], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1831, max= 2048, per=50.93%, avg=1987.40, stdev=89.20, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=25.00% lat (msec) : 4=8.33%, 500=33.33%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=4.63%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2789KiB/s (2856kB/s), 287KiB/s-1431KiB/s (294kB/s-1466kB/s), io=20.0MiB (20.0MB), run=5008-7344msec WRITE: bw=3902KiB/s (3996kB/s), 852KiB/s-1435KiB/s (872kB/s-1469kB/s), io=28.0MiB (29.4MB), run=5008-7348msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145215: Tue Sep 8 01:07:10 2026 read: IOPS=1, BW=1067KiB/s (1092kB/s)(7168KiB/6721msec) clat (msec): min=65, max=2411, avg=572.87, stdev=819.11 lat (msec): min=65, max=2411, avg=572.87, stdev=819.11 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 241], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 275], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 468], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1521, max= 4047, per=87.46%, avg=2273.00, stdev=1008.12, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=762KiB/s (780kB/s)(5120KiB/6721msec); 0 zone resets clat (msec): min=247, max=1246, avg=524.87, stdev=407.13 lat (msec): min=248, max=1246, avg=524.96, stdev=407.14 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1885, max= 4071, per=72.25%, avg=2629.33, stdev=1248.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.44%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145216: Tue Sep 8 01:07:10 2026 read: IOPS=0, BW=260KiB/s (266kB/s)(2048KiB/7877msec) clat (msec): min=138, max=164, avg=151.50, stdev=18.20 lat (msec): min=138, max=164, avg=151.51, stdev=18.20 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 165], 95.00th=[ 165], | 99.00th=[ 165], 99.50th=[ 165], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 1418, max= 2035, per=66.43%, avg=1726.50, stdev=436.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1300KiB/s (1331kB/s)(10.0MiB/7877msec); 0 zone resets clat (msec): min=254, max=2706, avg=751.61, stdev=723.20 lat (msec): min=254, max=2706, avg=751.69, stdev=723.19 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 271], | 30.00th=[ 305], 40.00th=[ 363], 50.00th=[ 558], 60.00th=[ 701], | 70.00th=[ 735], 80.00th=[ 760], 90.00th=[ 860], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1885, max= 2048, per=54.97%, avg=2000.44, stdev=56.91, samples=9 iops : min= 1, max= 2, avg= 1.11, stdev= 0.33, samples=9 lat (msec) : 250=16.67%, 500=33.33%, 750=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.21%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145217: Tue Sep 8 01:07:10 2026 read: IOPS=0, BW=915KiB/s (937kB/s)(6144KiB/6714msec) clat (msec): min=79, max=588, avg=342.70, stdev=203.17 lat (msec): min=79, max=588, avg=342.70, stdev=203.17 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 422], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1932, max= 4071, per=100.00%, avg=2661.00, stdev=1221.33, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=915KiB/s (937kB/s)(6144KiB/6714msec); 0 zone resets clat (msec): min=230, max=3056, avg=761.80, stdev=1125.32 lat (msec): min=230, max=3056, avg=761.88, stdev=1125.32 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1703, max= 2043, per=52.97%, avg=1927.60, stdev=139.82, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=2.20%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145218: Tue Sep 8 01:07:10 2026 read: IOPS=0, BW=650KiB/s (665kB/s)(5120KiB/7879msec) clat (msec): min=69, max=869, avg=378.90, stdev=359.42 lat (msec): min=69, max=869, avg=378.91, stdev=359.42 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1980, max= 4055, per=100.00%, avg=2690.00, stdev=1182.44, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=910KiB/s (932kB/s)(7168KiB/7879msec); 0 zone resets clat (msec): min=228, max=2831, avg=841.50, stdev=920.75 lat (msec): min=228, max=2831, avg=841.59, stdev=920.75 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 241], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 659], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 852], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1592, max= 4087, per=64.23%, avg=2337.20, stdev=995.13, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 750=16.67%, 1000=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=2.20%, ctx=92, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2599KiB/s (2662kB/s), 260KiB/s-1067KiB/s (266kB/s-1092kB/s), io=20.0MiB (20.0MB), run=6714-7879msec WRITE: bw=3639KiB/s (3726kB/s), 762KiB/s-1300KiB/s (780kB/s-1331kB/s), io=28.0MiB (29.4MB), run=6714-7879msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145233: Tue Sep 8 01:07:26 2026 read: IOPS=1, BW=4237KiB/s (4339kB/s)(12.0MiB/2900msec) clat (msec): min=287, max=1360, avg=919.19, stdev=561.14 lat (msec): min=287, max=1360, avg=919.20, stdev=561.14 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7699, max= 7968, per=100.00%, avg=7833.50, stdev=190.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.62%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145236: Tue Sep 8 01:07:26 2026 read: IOPS=0, BW=1307KiB/s (1338kB/s)(4096KiB/3135msec) clat (nsec): min=520675k, max=520675k, avg=520675205.00, stdev= 0.00 lat (nsec): min=520678k, max=520678k, avg=520677860.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2613KiB/s (2676kB/s)(8192KiB/3135msec); 0 zone resets clat (msec): min=1001, max=1488, avg=1245.05, stdev=344.25 lat (msec): min=1002, max=1488, avg=1245.43, stdev=344.19 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7699, max= 7699, per=89.85%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.06%, sys=4.85%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145238: Tue Sep 8 01:07:26 2026 write: IOPS=0, BW=3213KiB/s (3291kB/s)(12.0MiB/3824msec); 0 zone resets clat (msec): min=391, max=1714, avg=1229.26, stdev=728.43 lat (msec): min=392, max=1715, avg=1229.80, stdev=728.56 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8159, max= 8192, per=95.41%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.59%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145239: Tue Sep 8 01:07:26 2026 write: IOPS=1, BW=5663KiB/s (5799kB/s)(12.0MiB/2170msec); 0 zone resets clat (msec): min=516, max=1026, avg=699.69, stdev=283.31 lat (msec): min=517, max=1026, avg=700.31, stdev=283.06 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7699, max= 7922, per=91.15%, avg=7810.50, stdev=157.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.14%, sys=6.04%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5226KiB/s (5352kB/s), 1307KiB/s-4237KiB/s (1338kB/s-4339kB/s), io=16.0MiB (16.8MB), run=2900-3135msec WRITE: bw=8569KiB/s (8775kB/s), 2613KiB/s-5663KiB/s (2676kB/s-5799kB/s), io=32.0MiB (33.6MB), run=2170-3824msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145232: Tue Sep 8 01:07:27 2026 read: IOPS=1, BW=4683KiB/s (4795kB/s)(12.0MiB/2624msec) clat (msec): min=673, max=975, avg=843.53, stdev=154.68 lat (msec): min=673, max=975, avg=843.53, stdev=154.68 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7713, max= 8078, per=100.00%, avg=7895.50, stdev=258.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=12.54%, ctx=210, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145234: Tue Sep 8 01:07:27 2026 read: IOPS=0, BW=1051KiB/s (1076kB/s)(4096KiB/3897msec) clat (nsec): min=878373k, max=878373k, avg=878373480.00, stdev= 0.00 lat (nsec): min=878374k, max=878374k, avg=878374468.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7713, max= 7713, per=100.00%, avg=7713.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2102KiB/s (2153kB/s)(8192KiB/3897msec); 0 zone resets clat (msec): min=1034, max=1846, avg=1440.45, stdev=573.74 lat (msec): min=1035, max=1847, avg=1441.22, stdev=574.34 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.31%, ctx=97, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145235: Tue Sep 8 01:07:27 2026 write: IOPS=0, BW=2747KiB/s (2813kB/s)(12.0MiB/4473msec); 0 zone resets clat (msec): min=306, max=2318, avg=1443.74, stdev=1031.44 lat (msec): min=306, max=2318, avg=1444.19, stdev=1031.48 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 7515, max= 8110, per=100.00%, avg=7812.50, stdev=420.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.93%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145237: Tue Sep 8 01:07:27 2026 write: IOPS=1, BW=4427KiB/s (4533kB/s)(12.0MiB/2776msec); 0 zone resets clat (msec): min=574, max=1133, avg=908.70, stdev=295.11 lat (msec): min=574, max=1133, avg=909.00, stdev=295.18 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7515, max= 8175, per=100.00%, avg=7845.00, stdev=466.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.41%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4204KiB/s (4305kB/s), 1051KiB/s-4683KiB/s (1076kB/s-4795kB/s), io=16.0MiB (16.8MB), run=2624-3897msec WRITE: bw=7326KiB/s (7502kB/s), 2102KiB/s-4427KiB/s (2153kB/s-4533kB/s), io=32.0MiB (33.6MB), run=2776-4473msec