== sanity test 398b: DIO and buffer IO race ============== 07:40:14 (1788867614) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.11134 s, 16.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155018: Tue Sep 8 07:41:17 2026 read: IOPS=28, BW=114KiB/s (116kB/s)(5992KiB/52786msec) clat (usec): min=34, max=627784, avg=17608.27, stdev=19738.72 lat (usec): min=35, max=627785, avg=17609.34, stdev=19738.88 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 110], 10.00th=[ 7046], 20.00th=[ 9110], | 30.00th=[ 10421], 40.00th=[ 12387], 50.00th=[ 14484], 60.00th=[ 16909], | 70.00th=[ 20841], 80.00th=[ 25035], 90.00th=[ 31327], 95.00th=[ 38536], | 99.00th=[ 53216], 99.50th=[ 61080], 99.90th=[127402], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 26, max= 184, per=25.04%, avg=113.20, stdev=33.07, samples=104 iops : min= 6, max= 46, avg=27.91, stdev= 8.26, samples=104 write: IOPS=29, BW=119KiB/s (122kB/s)(6296KiB/52786msec); 0 zone resets clat (usec): min=737, max=185314, avg=16738.77, stdev=15979.18 lat (usec): min=738, max=185315, avg=16739.93, stdev=15979.18 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1532], 10.00th=[ 2114], 20.00th=[ 2999], | 30.00th=[ 4490], 40.00th=[ 9241], 50.00th=[ 13304], 60.00th=[ 17171], | 70.00th=[ 21365], 80.00th=[ 27395], 90.00th=[ 38011], 95.00th=[ 45876], | 99.00th=[ 71828], 99.50th=[ 83362], 99.90th=[116917], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 5, max= 214, per=25.10%, avg=118.70, stdev=35.47, samples=104 iops : min= 1, max= 53, avg=29.29, stdev= 8.88, samples=104 lat (usec) : 50=0.36%, 100=1.73%, 250=1.37%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.55% lat (msec) : 2=3.84%, 4=9.77%, 10=16.47%, 20=33.40%, 50=29.82% lat (msec) : 100=2.31%, 250=0.23%, 750=0.03% cpu : usr=0.12%, sys=20.57%, ctx=7549, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155019: Tue Sep 8 07:41:17 2026 read: IOPS=28, BW=113KiB/s (116kB/s)(5940KiB/52445msec) clat (usec): min=31, max=637375, avg=17479.87, stdev=20522.83 lat (usec): min=31, max=637377, avg=17481.32, stdev=20523.04 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 122], 10.00th=[ 7046], 20.00th=[ 9110], | 30.00th=[ 10552], 40.00th=[ 12256], 50.00th=[ 14091], 60.00th=[ 16581], | 70.00th=[ 20055], 80.00th=[ 24773], 90.00th=[ 31065], 95.00th=[ 38011], | 99.00th=[ 59507], 99.50th=[ 71828], 99.90th=[231736], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 5, max= 223, per=25.09%, avg=113.39, stdev=34.00, samples=104 iops : min= 1, max= 55, avg=27.96, stdev= 8.46, samples=104 write: IOPS=30, BW=121KiB/s (124kB/s)(6348KiB/52445msec); 0 zone resets clat (usec): min=796, max=150553, avg=16653.18, stdev=15576.92 lat (usec): min=798, max=150555, avg=16654.39, stdev=15576.95 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1483], 10.00th=[ 2114], 20.00th=[ 3097], | 30.00th=[ 4948], 40.00th=[ 9372], 50.00th=[ 13173], 60.00th=[ 17171], | 70.00th=[ 21890], 80.00th=[ 27657], 90.00th=[ 36439], 95.00th=[ 44827], | 99.00th=[ 63701], 99.50th=[ 84411], 99.90th=[130548], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 10, max= 256, per=25.61%, avg=121.14, stdev=36.85, samples=104 iops : min= 2, max= 64, avg=29.89, stdev= 9.29, samples=104 lat (usec) : 50=0.33%, 100=1.30%, 250=1.95%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.52% lat (msec) : 2=4.10%, 4=8.76%, 10=16.93%, 20=34.24%, 50=29.17% lat (msec) : 100=2.31%, 250=0.20%, 750=0.03% cpu : usr=0.14%, sys=20.61%, ctx=7626, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155020: Tue Sep 8 07:41:17 2026 read: IOPS=28, BW=115KiB/s (118kB/s)(6028KiB/52355msec) clat (usec): min=34, max=100161, avg=16622.65, stdev=10948.65 lat (usec): min=35, max=100162, avg=16624.73, stdev=10951.60 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 114], 10.00th=[ 6587], 20.00th=[ 9241], | 30.00th=[ 10552], 40.00th=[ 12256], 50.00th=[ 14484], 60.00th=[ 16909], | 70.00th=[ 20055], 80.00th=[ 23725], 90.00th=[ 30016], 95.00th=[ 35914], | 99.00th=[ 50594], 99.50th=[ 59507], 99.90th=[ 98042], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 5, max= 184, per=25.45%, avg=115.05, stdev=31.53, samples=103 iops : min= 1, max= 46, avg=28.37, stdev= 7.91, samples=103 write: IOPS=29, BW=120KiB/s (122kB/s)(6260KiB/52355msec); 0 zone resets clat (usec): min=751, max=647357, avg=17407.93, stdev=23330.94 lat (usec): min=752, max=647359, avg=17409.17, stdev=23330.97 clat percentiles (usec): | 1.00th=[ 955], 5.00th=[ 1352], 10.00th=[ 1958], 20.00th=[ 2966], | 30.00th=[ 4817], 40.00th=[ 9634], 50.00th=[ 13698], 60.00th=[ 17433], | 70.00th=[ 21365], 80.00th=[ 27395], 90.00th=[ 36963], 95.00th=[ 45876], | 99.00th=[ 71828], 99.50th=[ 98042], 99.90th=[254804], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 16, max= 198, per=25.16%, avg=119.03, stdev=32.57, samples=103 iops : min= 4, max= 49, avg=29.37, stdev= 8.14, samples=103 lat (usec) : 50=0.39%, 100=1.63%, 250=1.60%, 500=0.10%, 1000=0.65% lat (msec) : 2=4.59%, 4=8.20%, 10=16.24%, 20=34.51%, 50=29.75% lat (msec) : 100=2.15%, 250=0.13%, 500=0.03%, 750=0.03% cpu : usr=0.12%, sys=20.74%, ctx=7578, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155021: Tue Sep 8 07:41:17 2026 read: IOPS=28, BW=114KiB/s (117kB/s)(6052KiB/53056msec) clat (usec): min=33, max=192722, avg=16607.74, stdev=12188.92 lat (usec): min=34, max=192723, avg=16608.83, stdev=12188.93 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 101], 10.00th=[ 5932], 20.00th=[ 8717], | 30.00th=[ 10421], 40.00th=[ 12125], 50.00th=[ 14091], 60.00th=[ 16712], | 70.00th=[ 19792], 80.00th=[ 24511], 90.00th=[ 30278], 95.00th=[ 36963], | 99.00th=[ 53216], 99.50th=[ 59507], 99.90th=[116917], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 48, max= 191, per=25.47%, avg=115.13, stdev=31.27, samples=104 iops : min= 12, max= 47, avg=28.39, stdev= 7.83, samples=104 write: IOPS=29, BW=118KiB/s (120kB/s)(6236KiB/53056msec); 0 zone resets clat (usec): min=662, max=670727, avg=17881.93, stdev=24629.06 lat (usec): min=663, max=670729, avg=17883.33, stdev=24629.05 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1598], 10.00th=[ 2180], 20.00th=[ 2900], | 30.00th=[ 4424], 40.00th=[ 8586], 50.00th=[ 13173], 60.00th=[ 17433], | 70.00th=[ 22152], 80.00th=[ 28967], 90.00th=[ 38536], 95.00th=[ 49021], | 99.00th=[ 78119], 99.50th=[103285], 99.90th=[265290], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 10, max= 207, per=24.82%, avg=117.41, stdev=35.42, samples=105 iops : min= 2, max= 51, avg=28.96, stdev= 8.86, samples=105 lat (usec) : 50=0.23%, 100=2.18%, 250=1.89%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.49% lat (msec) : 2=3.61%, 4=10.06%, 10=16.21%, 20=33.17%, 50=29.07% lat (msec) : 100=2.54%, 250=0.29%, 500=0.03%, 750=0.03% cpu : usr=0.12%, sys=20.09%, ctx=7404, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=453KiB/s (463kB/s), 113KiB/s-115KiB/s (116kB/s-118kB/s), io=23.4MiB (24.6MB), run=52355-53056msec WRITE: bw=474KiB/s (485kB/s), 118KiB/s-121KiB/s (120kB/s-124kB/s), io=24.6MiB (25.7MB), run=52355-53056msec fio: pid=155013, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=155013: Tue Sep 8 07:42:07 2026 read: IOPS=13, BW=55.6KiB/s (56.0kB/s)(5544KiB/99668msec) clat (msec): min=3, max=717, avg=17.56, stdev=23.85 lat (msec): min=3, max=717, avg=17.56, stdev=23.85 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 78], 99.50th=[ 96], 99.90th=[ 157], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 144, per=24.38%, avg=55.58, stdev=29.35, samples=197 iops : min= 1, max= 36, avg=13.52, stdev= 7.39, samples=197 write: IOPS=14, BW=58.5KiB/s (59.9kB/s)(5828KiB/99668msec); 0 zone resets clat (msec): min=18, max=178, avg=51.54, stdev=20.88 lat (msec): min=18, max=178, avg=51.54, stdev=20.88 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 40], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 52], | 70.00th=[ 58], 80.00th=[ 66], 90.00th=[ 79], 95.00th=[ 91], | 99.00th=[ 127], 99.50th=[ 142], 99.90th=[ 169], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 8, max= 104, per=24.53%, avg=58.39, stdev=20.99, samples=197 iops : min= 2, max= 26, avg=14.22, stdev= 5.33, samples=197 lat (msec) : 4=0.04%, 10=18.53%, 20=17.83%, 50=40.44%, 100=21.59% lat (msec) : 250=1.51%, 750=0.04% cpu : usr=0.07%, sys=4.42%, ctx=5094, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1387,1457,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155014: Tue Sep 8 07:42:07 2026 read: IOPS=14, BW=57.5KiB/s (58.9kB/s)(5940KiB/103243msec) clat (msec): min=3, max=726, avg=16.84, stdev=23.85 lat (msec): min=3, max=726, avg=16.84, stdev=23.85 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 44], | 99.00th=[ 72], 99.50th=[ 115], 99.90th=[ 157], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 192, per=25.16%, avg=57.36, stdev=33.31, samples=204 iops : min= 1, max= 48, avg=13.98, stdev= 8.37, samples=204 write: IOPS=15, BW=61.5KiB/s (62.0kB/s)(6348KiB/103243msec); 0 zone resets clat (msec): min=12, max=260, avg=49.15, stdev=21.79 lat (msec): min=12, max=260, avg=49.15, stdev=21.79 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 50], | 70.00th=[ 55], 80.00th=[ 64], 90.00th=[ 78], 95.00th=[ 89], | 99.00th=[ 122], 99.50th=[ 148], 99.90th=[ 180], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 152, per=25.67%, avg=61.09, stdev=24.24, samples=204 iops : min= 1, max= 38, avg=14.91, stdev= 6.15, samples=204 lat (msec) : 4=0.52%, 10=19.66%, 20=18.39%, 50=40.46%, 100=19.34% lat (msec) : 250=1.56%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=4.49%, ctx=5773, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155015: Tue Sep 8 07:42:07 2026 read: IOPS=14, BW=58.5KiB/s (59.9kB/s)(6028KiB/102988msec) clat (msec): min=2, max=141, avg=16.48, stdev=13.91 lat (msec): min=2, max=141, avg=16.48, stdev=13.91 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 71], 99.50th=[ 87], 99.90th=[ 125], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 8, max= 144, per=25.67%, avg=58.53, stdev=30.76, samples=204 iops : min= 2, max= 36, avg=14.27, stdev= 7.75, samples=204 write: IOPS=15, BW=60.8KiB/s (62.2kB/s)(6260KiB/102988msec); 0 zone resets clat (msec): min=14, max=746, avg=49.80, stdev=28.16 lat (msec): min=14, max=746, avg=49.80, stdev=28.16 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 49], | 70.00th=[ 56], 80.00th=[ 64], 90.00th=[ 78], 95.00th=[ 90], | 99.00th=[ 122], 99.50th=[ 142], 99.90th=[ 288], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8, max= 136, per=25.50%, avg=60.70, stdev=24.53, samples=204 iops : min= 2, max= 34, avg=14.81, stdev= 6.22, samples=204 lat (msec) : 4=0.46%, 10=18.26%, 20=19.27%, 50=41.31%, 100=18.91% lat (msec) : 250=1.73%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=4.53%, ctx=5584, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155016: Tue Sep 8 07:42:07 2026 read: IOPS=14, BW=58.7KiB/s (60.1kB/s)(6052KiB/103050msec) clat (msec): min=2, max=112, avg=16.37, stdev=13.98 lat (msec): min=2, max=112, avg=16.37, stdev=13.98 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 46], | 99.00th=[ 68], 99.50th=[ 84], 99.90th=[ 106], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 7, max= 168, per=25.74%, avg=58.70, stdev=31.33, samples=204 iops : min= 1, max= 42, avg=14.31, stdev= 7.91, samples=204 write: IOPS=15, BW=60.5KiB/s (61.0kB/s)(6236KiB/103050msec); 0 zone resets clat (msec): min=14, max=761, avg=50.07, stdev=28.18 lat (msec): min=14, max=761, avg=50.07, stdev=28.18 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 51], | 70.00th=[ 56], 80.00th=[ 64], 90.00th=[ 78], 95.00th=[ 89], | 99.00th=[ 120], 99.50th=[ 142], 99.90th=[ 288], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 15, max= 144, per=25.40%, avg=60.46, stdev=23.53, samples=204 iops : min= 3, max= 36, avg=14.75, stdev= 5.98, samples=204 lat (msec) : 4=0.72%, 10=19.50%, 20=17.84%, 50=39.81%, 100=20.74% lat (msec) : 250=1.33%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=4.53%, ctx=5456, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=228KiB/s (234kB/s), 55.6KiB/s-58.7KiB/s (56.0kB/s-60.1kB/s), io=23.0MiB (24.1MB), run=99668-103243msec WRITE: bw=239KiB/s (245kB/s), 58.5KiB/s-61.5KiB/s (59.9kB/s-62.0kB/s), io=24.1MiB (25.3MB), run=99668-103243msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155059: Tue Sep 8 07:42:26 2026 read: IOPS=27, BW=437KiB/s (447kB/s)(5920KiB/13553msec) clat (usec): min=49, max=138980, avg=18329.13, stdev=15462.96 lat (usec): min=50, max=138981, avg=18330.05, stdev=15462.97 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 86], 10.00th=[ 109], 20.00th=[ 9110], | 30.00th=[ 11994], 40.00th=[ 14353], 50.00th=[ 16712], 60.00th=[ 19268], | 70.00th=[ 22938], 80.00th=[ 26870], 90.00th=[ 32113], 95.00th=[ 37487], | 99.00th=[ 76022], 99.50th=[123208], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 288, max= 638, per=24.27%, avg=428.88, stdev=80.33, samples=26 iops : min= 18, max= 39, avg=26.23, stdev= 5.00, samples=26 write: IOPS=29, BW=470KiB/s (481kB/s)(6368KiB/13553msec); 0 zone resets clat (usec): min=1361, max=89404, avg=16758.66, stdev=14838.46 lat (usec): min=1362, max=89407, avg=16760.75, stdev=14838.44 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2245], 10.00th=[ 2900], 20.00th=[ 3916], | 30.00th=[ 5276], 40.00th=[ 8291], 50.00th=[11994], 60.00th=[16319], | 70.00th=[21627], 80.00th=[28705], 90.00th=[38536], 95.00th=[46400], | 99.00th=[62653], 99.50th=[79168], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 286, max= 702, per=25.19%, avg=468.31, stdev=111.75, samples=26 iops : min= 17, max= 43, avg=28.69, stdev= 7.00, samples=26 lat (usec) : 50=0.13%, 100=4.17%, 250=3.39%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.95%, 4=8.85%, 10=14.58%, 20=30.99%, 50=33.20% lat (msec) : 100=1.82%, 250=0.39% cpu : usr=0.13%, sys=22.82%, ctx=1947, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155060: Tue Sep 8 07:42:26 2026 read: IOPS=26, BW=425KiB/s (435kB/s)(5744KiB/13510msec) clat (usec): min=37, max=74448, avg=18488.49, stdev=12567.93 lat (usec): min=38, max=74449, avg=18489.50, stdev=12567.90 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 74], 10.00th=[ 118], 20.00th=[10290], | 30.00th=[12911], 40.00th=[14484], 50.00th=[16712], 60.00th=[19792], | 70.00th=[22938], 80.00th=[27657], 90.00th=[35390], 95.00th=[39584], | 99.00th=[56886], 99.50th=[71828], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 160, max= 704, per=24.05%, avg=424.96, stdev=134.41, samples=26 iops : min= 10, max= 44, avg=25.96, stdev= 8.48, samples=26 write: IOPS=30, BW=484KiB/s (496kB/s)(6544KiB/13510msec); 0 zone resets clat (usec): min=1146, max=150741, avg=16564.36, stdev=16857.24 lat (usec): min=1147, max=150742, avg=16566.35, stdev=16857.20 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 2040], 10.00th=[ 2900], 20.00th=[ 4015], | 30.00th=[ 4948], 40.00th=[ 8029], 50.00th=[ 12387], 60.00th=[ 16450], | 70.00th=[ 20579], 80.00th=[ 26608], 90.00th=[ 35914], 95.00th=[ 44303], | 99.00th=[ 76022], 99.50th=[ 86508], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 159, max= 828, per=25.61%, avg=476.15, stdev=134.03, samples=26 iops : min= 9, max= 51, avg=29.19, stdev= 8.48, samples=26 lat (usec) : 50=0.52%, 100=3.12%, 250=3.12%, 500=0.26% lat (msec) : 2=2.60%, 4=7.94%, 10=15.23%, 20=32.16%, 50=32.68% lat (msec) : 100=2.08%, 250=0.26% cpu : usr=0.16%, sys=23.58%, ctx=1927, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155061: Tue Sep 8 07:42:26 2026 read: IOPS=29, BW=475KiB/s (486kB/s)(6256KiB/13170msec) clat (usec): min=40, max=165501, avg=17171.51, stdev=14263.38 lat (usec): min=40, max=165502, avg=17172.47, stdev=14263.41 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 89], 10.00th=[ 103], 20.00th=[ 8029], | 30.00th=[ 11731], 40.00th=[ 13566], 50.00th=[ 15664], 60.00th=[ 17695], | 70.00th=[ 20841], 80.00th=[ 26084], 90.00th=[ 32637], 95.00th=[ 39584], | 99.00th=[ 57934], 99.50th=[ 66323], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 224, max= 796, per=26.92%, avg=475.65, stdev=129.09, samples=26 iops : min= 14, max= 49, avg=29.15, stdev= 8.08, samples=26 write: IOPS=28, BW=458KiB/s (469kB/s)(6032KiB/13170msec); 0 zone resets clat (usec): min=1361, max=87016, avg=17039.05, stdev=14898.90 lat (usec): min=1363, max=87018, avg=17052.03, stdev=14890.48 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 2245], 10.00th=[ 3130], 20.00th=[ 4424], | 30.00th=[ 6128], 40.00th=[ 8848], 50.00th=[12387], 60.00th=[17433], | 70.00th=[20841], 80.00th=[28443], 90.00th=[38011], 95.00th=[47449], | 99.00th=[66323], 99.50th=[79168], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 255, max= 766, per=24.48%, avg=455.12, stdev=123.64, samples=26 iops : min= 15, max= 47, avg=27.88, stdev= 7.73, samples=26 lat (usec) : 50=0.26%, 100=4.43%, 250=4.30%, 500=0.26%, 750=0.52% lat (msec) : 2=2.34%, 4=5.21%, 10=14.84%, 20=34.77%, 50=30.21% lat (msec) : 100=2.73%, 250=0.13% cpu : usr=0.15%, sys=23.64%, ctx=1947, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155062: Tue Sep 8 07:42:26 2026 read: IOPS=28, BW=464KiB/s (475kB/s)(6032KiB/13014msec) clat (usec): min=37, max=76500, avg=16768.58, stdev=12648.75 lat (usec): min=37, max=76501, avg=16769.46, stdev=12648.74 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 83], 10.00th=[ 110], 20.00th=[ 474], | 30.00th=[11207], 40.00th=[13173], 50.00th=[15401], 60.00th=[18220], | 70.00th=[21890], 80.00th=[26084], 90.00th=[33162], 95.00th=[38536], | 99.00th=[55837], 99.50th=[62129], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 183, max= 702, per=26.55%, avg=469.12, stdev=128.54, samples=25 iops : min= 11, max= 43, avg=28.76, stdev= 7.99, samples=25 write: IOPS=30, BW=481KiB/s (492kB/s)(6256KiB/13014msec); 0 zone resets clat (usec): min=1158, max=98534, avg=16915.38, stdev=16174.03 lat (usec): min=1160, max=98536, avg=16917.27, stdev=16173.98 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2573], 10.00th=[ 3064], 20.00th=[ 4228], | 30.00th=[ 5538], 40.00th=[ 7701], 50.00th=[11863], 60.00th=[15795], | 70.00th=[20841], 80.00th=[26608], 90.00th=[38011], 95.00th=[50594], | 99.00th=[72877], 99.50th=[77071], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 224, max= 800, per=26.10%, avg=485.16, stdev=127.40, samples=25 iops : min= 14, max= 50, avg=29.76, stdev= 7.94, samples=25 lat (usec) : 50=0.39%, 100=3.65%, 250=5.60%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.30%, 4=8.20%, 10=16.41%, 20=30.34%, 50=30.08% lat (msec) : 100=3.39% cpu : usr=0.12%, sys=23.75%, ctx=1947, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1767KiB/s (1810kB/s), 425KiB/s-475KiB/s (435kB/s-486kB/s), io=23.4MiB (24.5MB), run=13014-13553msec WRITE: bw=1859KiB/s (1904kB/s), 458KiB/s-484KiB/s (469kB/s-496kB/s), io=24.6MiB (25.8MB), run=13014-13553msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155054: Tue Sep 8 07:42:42 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5920KiB/28908msec) clat (msec): min=5, max=135, avg=17.58, stdev=15.86 lat (msec): min=5, max=135, avg=17.58, stdev=15.86 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 16], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 55], | 99.00th=[ 73], 99.50th=[ 113], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 63, max= 416, per=24.66%, avg=202.67, stdev=87.36, samples=57 iops : min= 3, max= 26, avg=12.14, stdev= 5.53, samples=57 write: IOPS=13, BW=220KiB/s (226kB/s)(6368KiB/28908msec); 0 zone resets clat (msec): min=26, max=197, avg=56.13, stdev=22.17 lat (msec): min=26, max=197, avg=56.13, stdev=22.17 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 36], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 52], 60.00th=[ 56], | 70.00th=[ 62], 80.00th=[ 68], 90.00th=[ 82], 95.00th=[ 94], | 99.00th=[ 161], 99.50th=[ 184], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 64, max= 352, per=25.42%, avg=219.91, stdev=77.90, samples=57 iops : min= 4, max= 22, avg=13.21, stdev= 4.97, samples=57 lat (msec) : 10=18.36%, 20=17.45%, 50=33.07%, 100=28.78%, 250=2.34% cpu : usr=0.06%, sys=4.30%, ctx=1469, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155055: Tue Sep 8 07:42:42 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(5744KiB/29132msec) clat (msec): min=5, max=104, avg=16.07, stdev=14.66 lat (msec): min=5, max=104, avg=16.07, stdev=14.66 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 36], 95.00th=[ 47], | 99.00th=[ 86], 99.50th=[ 105], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 52, max= 512, per=23.93%, avg=196.74, stdev=104.81, samples=57 iops : min= 3, max= 32, avg=11.77, stdev= 6.57, samples=57 write: IOPS=14, BW=225KiB/s (230kB/s)(6544KiB/29132msec); 0 zone resets clat (msec): min=23, max=197, avg=56.99, stdev=22.54 lat (msec): min=23, max=197, avg=57.00, stdev=22.55 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 32], 10.00th=[ 35], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 47], 50.00th=[ 53], 60.00th=[ 57], | 70.00th=[ 63], 80.00th=[ 71], 90.00th=[ 87], 95.00th=[ 101], | 99.00th=[ 130], 99.50th=[ 140], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 95, max= 352, per=25.65%, avg=221.89, stdev=69.19, samples=57 iops : min= 5, max= 22, avg=13.33, stdev= 4.47, samples=57 lat (msec) : 10=20.83%, 20=16.93%, 50=31.38%, 100=27.86%, 250=2.99% cpu : usr=0.09%, sys=4.15%, ctx=1450, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155056: Tue Sep 8 07:42:42 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(6256KiB/28665msec) clat (msec): min=5, max=105, avg=17.08, stdev=15.67 lat (msec): min=5, max=105, avg=17.08, stdev=15.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 57], | 99.00th=[ 77], 99.50th=[ 92], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 31, max= 480, per=26.87%, avg=220.91, stdev=117.98, samples=56 iops : min= 1, max= 30, avg=13.29, stdev= 7.39, samples=56 write: IOPS=13, BW=210KiB/s (215kB/s)(6032KiB/28665msec); 0 zone resets clat (msec): min=25, max=197, avg=58.23, stdev=22.88 lat (msec): min=25, max=197, avg=58.23, stdev=22.88 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 33], 10.00th=[ 36], 20.00th=[ 43], | 30.00th=[ 46], 40.00th=[ 50], 50.00th=[ 55], 60.00th=[ 59], | 70.00th=[ 63], 80.00th=[ 69], 90.00th=[ 84], 95.00th=[ 107], | 99.00th=[ 144], 99.50th=[ 171], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 63, max= 320, per=24.21%, avg=209.41, stdev=68.83, samples=56 iops : min= 3, max= 20, avg=12.57, stdev= 4.48, samples=56 lat (msec) : 10=21.22%, 20=18.10%, 50=29.43%, 100=28.39%, 250=2.86% cpu : usr=0.09%, sys=4.50%, ctx=1541, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155057: Tue Sep 8 07:42:42 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28109msec) clat (msec): min=4, max=132, avg=17.12, stdev=17.12 lat (msec): min=4, max=132, avg=17.12, stdev=17.12 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 53], | 99.00th=[ 105], 99.50th=[ 108], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 32, max= 448, per=25.95%, avg=213.35, stdev=107.07, samples=55 iops : min= 2, max= 28, avg=12.82, stdev= 6.75, samples=55 write: IOPS=13, BW=223KiB/s (228kB/s)(6256KiB/28109msec); 0 zone resets clat (msec): min=25, max=196, avg=55.26, stdev=22.46 lat (msec): min=25, max=196, avg=55.27, stdev=22.45 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 32], 10.00th=[ 35], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 47], 50.00th=[ 52], 60.00th=[ 55], | 70.00th=[ 60], 80.00th=[ 66], 90.00th=[ 83], 95.00th=[ 93], | 99.00th=[ 163], 99.50th=[ 184], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 63, max= 352, per=25.51%, avg=220.69, stdev=75.35, samples=55 iops : min= 3, max= 22, avg=13.27, stdev= 4.85, samples=55 lat (msec) : 10=20.83%, 20=17.45%, 50=33.07%, 100=26.56%, 250=2.08% cpu : usr=0.08%, sys=4.45%, ctx=1507, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=822KiB/s (842kB/s), 197KiB/s-218KiB/s (202kB/s-223kB/s), io=23.4MiB (24.5MB), run=28109-29132msec WRITE: bw=865KiB/s (886kB/s), 210KiB/s-225KiB/s (215kB/s-230kB/s), io=24.6MiB (25.8MB), run=28109-29132msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155071: Tue Sep 8 07:42:50 2026 read: IOPS=2, BW=2542KiB/s (2603kB/s)(7168KiB/2820msec) clat (usec): min=421, max=146060, avg=86076.51, stdev=61761.07 lat (usec): min=421, max=146061, avg=86077.64, stdev=61761.51 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 478], | 30.00th=[ 92799], 40.00th=[ 92799], 50.00th=[ 98042], 60.00th=[122160], | 70.00th=[122160], 80.00th=[141558], 90.00th=[145753], 95.00th=[145753], | 99.00th=[145753], 99.50th=[145753], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 1976, max= 5370, per=68.21%, avg=3792.33, stdev=1709.54, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1816KiB/s (1859kB/s)(5120KiB/2820msec); 0 zone resets clat (msec): min=109, max=1225, avg=419.78, stdev=460.02 lat (msec): min=109, max=1225, avg=419.82, stdev=460.02 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1976, max= 6047, per=51.54%, avg=4011.50, stdev=2878.63, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=16.67% lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=26.74%, ctx=291, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155073: Tue Sep 8 07:42:50 2026 read: IOPS=0, BW=556KiB/s (569kB/s)(2048KiB/3683msec) clat (msec): min=251, max=1257, avg=754.23, stdev=711.38 lat (msec): min=251, max=1257, avg=754.23, stdev=711.38 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2043, max= 2043, per=36.74%, avg=2043.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2780KiB/s (2847kB/s)(10.0MiB/3683msec); 0 zone resets clat (msec): min=95, max=520, avg=207.58, stdev=131.35 lat (msec): min=95, max=520, avg=207.66, stdev=131.34 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 106], | 30.00th=[ 117], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 163], | 70.00th=[ 186], 80.00th=[ 296], 90.00th=[ 296], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2043, max= 6047, per=57.87%, avg=4504.75, stdev=1906.81, samples=4 iops : min= 1, max= 5, avg= 3.50, stdev= 1.91, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=32.89%, ctx=402, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155074: Tue Sep 8 07:42:50 2026 read: IOPS=3, BW=3417KiB/s (3499kB/s)(6144KiB/1798msec) clat (usec): min=24429, max=96641, avg=70839.59, stdev=26157.71 lat (usec): min=24430, max=96642, avg=70840.61, stdev=26157.73 clat percentiles (usec): | 1.00th=[24511], 5.00th=[24511], 10.00th=[24511], 20.00th=[57410], | 30.00th=[57410], 40.00th=[79168], 50.00th=[79168], 60.00th=[81265], | 70.00th=[86508], 80.00th=[86508], 90.00th=[96994], 95.00th=[96994], | 99.00th=[96994], 99.50th=[96994], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 2048, max= 6131, per=73.55%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=3, BW=3417KiB/s (3499kB/s)(6144KiB/1798msec); 0 zone resets clat (msec): min=62, max=328, avg=192.69, stdev=96.60 lat (msec): min=62, max=329, avg=192.76, stdev=96.60 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 224], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1799, max= 4096, per=42.75%, avg=3327.33, stdev=1323.58, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 50=8.33%, 100=50.00%, 250=25.00%, 500=16.67% cpu : usr=0.00%, sys=45.24%, ctx=501, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155075: Tue Sep 8 07:42:50 2026 read: IOPS=1, BW=1695KiB/s (1736kB/s)(5120KiB/3020msec) clat (usec): min=565, max=318795, avg=93772.23, stdev=140198.86 lat (usec): min=566, max=318796, avg=93773.21, stdev=140198.95 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 1811], 40.00th=[ 1811], 50.00th=[ 2966], 60.00th=[ 2966], | 70.00th=[145753], 80.00th=[145753], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2374KiB/s (2430kB/s)(7168KiB/3020msec); 0 zone resets clat (msec): min=103, max=1199, avg=359.27, stdev=393.62 lat (msec): min=103, max=1199, avg=359.33, stdev=393.62 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 121], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 180], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 477], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1750, max= 2048, per=25.02%, avg=1947.25, stdev=134.75, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=25.27%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5561KiB/s (5694kB/s), 556KiB/s-3417KiB/s (569kB/s-3499kB/s), io=20.0MiB (20.0MB), run=1798-3683msec WRITE: bw=7785KiB/s (7972kB/s), 1816KiB/s-3417KiB/s (1859kB/s-3499kB/s), io=28.0MiB (29.4MB), run=1798-3683msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155076: Tue Sep 8 07:42:50 2026 read: IOPS=2, BW=2111KiB/s (2162kB/s)(7168KiB/3395msec) clat (msec): min=44, max=393, avg=172.40, stdev=132.07 lat (msec): min=44, max=393, avg=172.40, stdev=132.07 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 56], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 138], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 305], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1802, max= 4087, per=62.91%, avg=3306.67, stdev=1303.38, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1508KiB/s (1544kB/s)(5120KiB/3395msec); 0 zone resets clat (msec): min=119, max=1310, avg=417.42, stdev=505.12 lat (msec): min=120, max=1310, avg=417.58, stdev=505.06 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2048, max= 3992, per=41.04%, avg=3020.00, stdev=1374.62, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=8.07%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155077: Tue Sep 8 07:42:50 2026 read: IOPS=0, BW=526KiB/s (538kB/s)(2048KiB/3896msec) clat (msec): min=60, max=1203, avg=631.93, stdev=807.61 lat (msec): min=60, max=1203, avg=631.94, stdev=807.61 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 62], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1996, max= 2027, per=38.27%, avg=2011.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2628KiB/s (2691kB/s)(10.0MiB/3896msec); 0 zone resets clat (msec): min=79, max=460, avg=242.02, stdev=116.56 lat (msec): min=79, max=461, avg=242.13, stdev=116.56 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 107], | 30.00th=[ 146], 40.00th=[ 220], 50.00th=[ 236], 60.00th=[ 241], | 70.00th=[ 264], 80.00th=[ 300], 90.00th=[ 372], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2048, max= 4096, per=48.13%, avg=3541.75, stdev=996.76, samples=4 iops : min= 2, max= 4, avg= 3.00, stdev= 0.82, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=12.61%, ctx=100, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155078: Tue Sep 8 07:42:50 2026 read: IOPS=1, BW=1900KiB/s (1945kB/s)(6144KiB/3234msec) clat (msec): min=56, max=1177, avg=260.65, stdev=449.44 lat (msec): min=56, max=1177, avg=260.65, stdev=449.44 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 77], 50.00th=[ 77], 60.00th=[ 84], | 70.00th=[ 101], 80.00th=[ 101], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 4087, max= 6047, per=96.40%, avg=5067.00, stdev=1385.93, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1900KiB/s (1945kB/s)(6144KiB/3234msec); 0 zone resets clat (msec): min=82, max=588, avg=254.43, stdev=199.34 lat (msec): min=82, max=588, avg=254.50, stdev=199.34 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 171], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2015, max= 4087, per=43.80%, avg=3223.00, stdev=1077.98, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=41.67%, 250=33.33%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=7.30%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155079: Tue Sep 8 07:42:50 2026 read: IOPS=1, BW=1361KiB/s (1394kB/s)(5120KiB/3762msec) clat (msec): min=39, max=225, avg=154.38, stdev=83.62 lat (msec): min=39, max=225, avg=154.38, stdev=83.62 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 40], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 3992, max= 4096, per=76.94%, avg=4044.00, stdev=73.54, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1905KiB/s (1951kB/s)(7168KiB/3762msec); 0 zone resets clat (msec): min=115, max=1391, avg=422.52, stdev=441.62 lat (msec): min=115, max=1391, avg=422.65, stdev=441.59 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 169], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 264], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 464], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1768, max= 4096, per=40.56%, avg=2984.50, stdev=1251.25, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=9.57%, ctx=124, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5257KiB/s (5383kB/s), 526KiB/s-2111KiB/s (538kB/s-2162kB/s), io=20.0MiB (20.0MB), run=3234-3896msec WRITE: bw=7359KiB/s (7536kB/s), 1508KiB/s-2628KiB/s (1544kB/s-2691kB/s), io=28.0MiB (29.4MB), run=3234-3896msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155089: Tue Sep 8 07:42:58 2026 read: IOPS=1, BW=7271KiB/s (7446kB/s)(12.0MiB/1690msec) clat (msec): min=503, max=628, avg=556.44, stdev=64.23 lat (msec): min=503, max=628, avg=556.44, stdev=64.23 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8159, max= 8175, per=96.26%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=44.40%, ctx=1121, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155090: Tue Sep 8 07:42:58 2026 read: IOPS=0, BW=2121KiB/s (2172kB/s)(4096KiB/1931msec) clat (nsec): min=469070k, max=469070k, avg=469069668.00, stdev= 0.00 lat (nsec): min=469072k, max=469072k, avg=469071708.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 5497, max= 5497, per=64.79%, avg=5497.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4242KiB/s (4344kB/s)(8192KiB/1931msec); 0 zone resets clat (msec): min=545, max=849, avg=697.51, stdev=214.80 lat (msec): min=546, max=849, avg=697.96, stdev=214.79 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8159, max= 8159, per=55.58%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=14.97%, ctx=632, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155091: Tue Sep 8 07:42:58 2026 write: IOPS=1, BW=5505KiB/s (5638kB/s)(12.0MiB/2232msec); 0 zone resets clat (msec): min=178, max=1031, avg=724.07, stdev=473.78 lat (msec): min=178, max=1031, avg=724.39, stdev=473.77 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8159, max= 8159, per=55.58%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.25%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155092: Tue Sep 8 07:42:58 2026 write: IOPS=1, BW=7301KiB/s (7476kB/s)(12.0MiB/1683msec); 0 zone resets clat (msec): min=346, max=867, avg=550.05, stdev=278.64 lat (msec): min=347, max=868, avg=550.44, stdev=278.69 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 5490, max= 5490, per=37.40%, avg=5490.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.11%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8485KiB/s (8688kB/s), 2121KiB/s-7271KiB/s (2172kB/s-7446kB/s), io=16.0MiB (16.8MB), run=1690-1931msec WRITE: bw=14.3MiB/s (15.0MB/s), 4242KiB/s-7301KiB/s (4344kB/s-7476kB/s), io=32.0MiB (33.6MB), run=1683-2232msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155084: Tue Sep 8 07:42:58 2026 read: IOPS=1, BW=6156KiB/s (6304kB/s)(12.0MiB/1996msec) clat (msec): min=174, max=907, avg=639.04, stdev=404.24 lat (msec): min=174, max=907, avg=639.05, stdev=404.24 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.05%, sys=12.38%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155085: Tue Sep 8 07:42:58 2026 read: IOPS=0, BW=1764KiB/s (1806kB/s)(4096KiB/2322msec) clat (nsec): min=673065k, max=673065k, avg=673064836.00, stdev= 0.00 lat (nsec): min=673067k, max=673067k, avg=673067080.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3528KiB/s (3613kB/s)(8192KiB/2322msec); 0 zone resets clat (msec): min=675, max=904, avg=790.22, stdev=162.05 lat (msec): min=675, max=905, avg=790.48, stdev=162.23 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8192, max= 8192, per=58.05%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.67%, ctx=58, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155086: Tue Sep 8 07:42:58 2026 write: IOPS=3, BW=14.9MiB/s (15.7MB/s)(12.0MiB/803msec); 0 zone resets clat (msec): min=193, max=339, avg=250.28, stdev=78.39 lat (msec): min=194, max=340, avg=251.63, stdev=77.77 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7327, max= 7327, per=51.92%, avg=7327.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=28.93%, ctx=186, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155087: Tue Sep 8 07:42:58 2026 write: IOPS=2, BW=8690KiB/s (8899kB/s)(12.0MiB/1414msec); 0 zone resets clat (msec): min=236, max=665, avg=459.91, stdev=214.97 lat (msec): min=236, max=665, avg=460.29, stdev=215.01 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7876, max= 8175, per=56.87%, avg=8025.50, stdev=211.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=16.70%, ctx=131, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7056KiB/s (7225kB/s), 1764KiB/s-6156KiB/s (1806kB/s-6304kB/s), io=16.0MiB (16.8MB), run=1996-2322msec WRITE: bw=13.8MiB/s (14.5MB/s), 3528KiB/s-14.9MiB/s (3613kB/s-15.7MB/s), io=32.0MiB (33.6MB), run=803-2322msec