== sanity test 398b: DIO and buffer IO race ============== 14:11:01 (1782929461) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.86551 s, 17.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153846: Wed Jul 1 14:11:59 2026 read: IOPS=30, BW=122KiB/s (125kB/s)(5992KiB/49098msec) clat (usec): min=32, max=872075, avg=17550.87, stdev=24317.78 lat (usec): min=32, max=872077, avg=17551.67, stdev=24317.81 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 5669], 10.00th=[ 7767], 20.00th=[ 9503], | 30.00th=[ 11207], 40.00th=[ 13173], 50.00th=[ 15008], 60.00th=[ 17433], | 70.00th=[ 19792], 80.00th=[ 23462], 90.00th=[ 29230], 95.00th=[ 34341], | 99.00th=[ 55313], 99.50th=[ 60031], 99.90th=[122160], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 6, max= 191, per=25.29%, avg=122.92, stdev=31.21, samples=96 iops : min= 1, max= 47, avg=30.38, stdev= 7.85, samples=96 write: IOPS=32, BW=128KiB/s (131kB/s)(6296KiB/49098msec); 0 zone resets clat (usec): min=728, max=79655, avg=14282.13, stdev=11534.20 lat (usec): min=728, max=79656, avg=14283.14, stdev=11534.32 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2311], 10.00th=[ 2868], 20.00th=[ 3818], | 30.00th=[ 5997], 40.00th=[ 8979], 50.00th=[11600], 60.00th=[14484], | 70.00th=[18220], 80.00th=[22676], 90.00th=[29754], 95.00th=[36439], | 99.00th=[49021], 99.50th=[66847], 99.90th=[76022], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 31, max= 223, per=25.56%, avg=130.12, stdev=35.83, samples=95 iops : min= 7, max= 55, avg=32.18, stdev= 9.00, samples=95 lat (usec) : 50=0.03%, 100=0.55%, 250=1.17%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=1.82%, 4=9.31%, 10=20.18%, 20=38.96%, 50=26.66% lat (msec) : 100=1.01%, 250=0.03%, 1000=0.03% cpu : usr=0.16%, sys=24.19%, ctx=8714, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153847: Wed Jul 1 14:11:59 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(5940KiB/48985msec) clat (usec): min=51, max=113779, avg=16752.75, stdev=10316.34 lat (usec): min=51, max=113780, avg=16753.66, stdev=10316.46 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 5997], 10.00th=[ 7635], 20.00th=[ 9634], | 30.00th=[ 11338], 40.00th=[ 12911], 50.00th=[ 14746], 60.00th=[ 16909], | 70.00th=[ 19006], 80.00th=[ 22414], 90.00th=[ 28181], 95.00th=[ 34866], | 99.00th=[ 55837], 99.50th=[ 64226], 99.90th=[ 96994], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 6, max= 214, per=25.15%, avg=122.25, stdev=34.16, samples=96 iops : min= 1, max= 53, avg=30.21, stdev= 8.59, samples=96 write: IOPS=32, BW=130KiB/s (133kB/s)(6348KiB/48985msec); 0 zone resets clat (usec): min=771, max=863985, avg=14987.09, stdev=24558.59 lat (usec): min=771, max=863987, avg=14989.59, stdev=24558.09 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2311], 10.00th=[ 2802], 20.00th=[ 3785], | 30.00th=[ 6063], 40.00th=[ 9503], 50.00th=[ 11600], 60.00th=[ 14222], | 70.00th=[ 18220], 80.00th=[ 22414], 90.00th=[ 29754], 95.00th=[ 35914], | 99.00th=[ 56886], 99.50th=[ 65274], 99.90th=[135267], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 63, max= 206, per=25.88%, avg=131.71, stdev=31.25, samples=95 iops : min= 15, max= 51, avg=32.58, stdev= 7.89, samples=95 lat (usec) : 100=0.81%, 250=1.04%, 500=0.03%, 1000=0.36% lat (msec) : 2=1.53%, 4=9.41%, 10=19.43%, 20=41.15%, 50=24.61% lat (msec) : 100=1.53%, 250=0.07%, 1000=0.03% cpu : usr=0.13%, sys=24.31%, ctx=8626, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153848: Wed Jul 1 14:11:59 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(6028KiB/48986msec) clat (usec): min=36, max=112556, avg=16522.10, stdev=10315.06 lat (usec): min=37, max=112557, avg=16523.00, stdev=10315.10 clat percentiles (usec): | 1.00th=[ 78], 5.00th=[ 5407], 10.00th=[ 7832], 20.00th=[ 9372], | 30.00th=[ 10683], 40.00th=[ 12518], 50.00th=[ 14615], 60.00th=[ 16909], | 70.00th=[ 19268], 80.00th=[ 22676], 90.00th=[ 27919], 95.00th=[ 34341], | 99.00th=[ 52691], 99.50th=[ 63701], 99.90th=[110625], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 55, max= 222, per=25.83%, avg=125.54, stdev=35.26, samples=95 iops : min= 13, max= 55, avg=31.04, stdev= 8.87, samples=95 write: IOPS=31, BW=128KiB/s (131kB/s)(6260KiB/48986msec); 0 zone resets clat (usec): min=755, max=877334, avg=15188.96, stdev=25290.56 lat (usec): min=757, max=877338, avg=15191.72, stdev=25292.25 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2278], 10.00th=[ 2868], 20.00th=[ 3589], | 30.00th=[ 5932], 40.00th=[ 8848], 50.00th=[ 11469], 60.00th=[ 14091], | 70.00th=[ 18220], 80.00th=[ 23200], 90.00th=[ 30802], 95.00th=[ 37487], | 99.00th=[ 61080], 99.50th=[ 78119], 99.90th=[114820], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 55, max= 216, per=25.58%, avg=130.20, stdev=32.99, samples=95 iops : min= 13, max= 54, avg=32.20, stdev= 8.30, samples=95 lat (usec) : 50=0.07%, 100=1.17%, 250=1.01%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=1.40%, 4=9.70%, 10=20.93%, 20=38.51%, 50=25.46% lat (msec) : 100=1.30%, 250=0.10%, 1000=0.03% cpu : usr=0.14%, sys=24.20%, ctx=8460, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153849: Wed Jul 1 14:11:59 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(6052KiB/49322msec) clat (usec): min=30, max=90484, avg=16781.49, stdev=10364.50 lat (usec): min=30, max=90485, avg=16782.27, stdev=10364.51 clat percentiles (usec): | 1.00th=[ 74], 5.00th=[ 4883], 10.00th=[ 7767], 20.00th=[ 9372], | 30.00th=[10814], 40.00th=[12780], 50.00th=[14877], 60.00th=[17433], | 70.00th=[19792], 80.00th=[22938], 90.00th=[27919], 95.00th=[34341], | 99.00th=[56361], 99.50th=[69731], 99.90th=[88605], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 56, max= 208, per=25.69%, avg=124.84, stdev=31.71, samples=96 iops : min= 14, max= 52, avg=30.85, stdev= 7.92, samples=96 write: IOPS=31, BW=126KiB/s (129kB/s)(6236KiB/49322msec); 0 zone resets clat (usec): min=802, max=860729, avg=15132.67, stdev=24501.20 lat (usec): min=802, max=860732, avg=15133.70, stdev=24501.27 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2343], 10.00th=[ 2868], 20.00th=[ 3916], | 30.00th=[ 6063], 40.00th=[ 9372], 50.00th=[ 11469], 60.00th=[ 14484], | 70.00th=[ 18744], 80.00th=[ 23725], 90.00th=[ 30802], 95.00th=[ 36439], | 99.00th=[ 52691], 99.50th=[ 57934], 99.90th=[127402], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 71, max= 223, per=25.26%, avg=128.59, stdev=34.44, samples=96 iops : min= 17, max= 55, avg=31.79, stdev= 8.65, samples=96 lat (usec) : 50=0.20%, 100=0.91%, 250=1.20%, 500=0.07%, 1000=0.13% lat (msec) : 2=1.46%, 4=8.95%, 10=20.54%, 20=38.54%, 50=26.66% lat (msec) : 100=1.27%, 250=0.03%, 1000=0.03% cpu : usr=0.15%, sys=23.88%, ctx=8698, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=487KiB/s (499kB/s), 121KiB/s-123KiB/s (124kB/s-126kB/s), io=23.4MiB (24.6MB), run=48985-49322msec WRITE: bw=510KiB/s (522kB/s), 126KiB/s-130KiB/s (129kB/s-133kB/s), io=24.6MiB (25.7MB), run=48985-49322msec fio: pid=153851, err=5/file:backend.c:481, func=full resid, error=Input/output error fio: pid=153854, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=153851: Wed Jul 1 14:12:20 2026 read: IOPS=14, BW=58.7KiB/s (60.1kB/s)(2984KiB/50833msec) clat (msec): min=3, max=880, avg=21.48, stdev=34.50 lat (msec): min=3, max=880, avg=21.48, stdev=34.50 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 66], 99.50th=[ 90], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8, max= 184, per=21.74%, avg=58.92, stdev=29.68, samples=100 iops : min= 2, max= 46, avg=14.34, stdev= 7.45, samples=100 write: IOPS=15, BW=60.9KiB/s (62.4kB/s)(3096KiB/50833msec); 0 zone resets clat (msec): min=13, max=162, avg=44.71, stdev=19.07 lat (msec): min=13, max=162, avg=44.71, stdev=19.07 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 38], 50.00th=[ 42], 60.00th=[ 46], | 70.00th=[ 51], 80.00th=[ 58], 90.00th=[ 68], 95.00th=[ 79], | 99.00th=[ 107], 99.50th=[ 146], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 15, max= 152, per=21.75%, avg=61.78, stdev=18.63, samples=99 iops : min= 3, max= 38, avg=15.05, stdev= 4.74, samples=99 lat (msec) : 4=0.33%, 10=10.65%, 20=21.30%, 50=49.70%, 100=16.96% lat (msec) : 250=0.92%, 1000=0.07% cpu : usr=0.06%, sys=8.78%, ctx=2682, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=747,774,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153852: Wed Jul 1 14:12:20 2026 read: IOPS=21, BW=85.0KiB/s (87.1kB/s)(5940KiB/69872msec) clat (msec): min=2, max=846, avg=14.35, stdev=25.32 lat (msec): min=2, max=846, avg=14.35, stdev=25.32 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 20], 90.00th=[ 31], 95.00th=[ 42], | 99.00th=[ 65], 99.50th=[ 80], 99.90th=[ 116], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 264, per=31.56%, avg=85.52, stdev=57.25, samples=138 iops : min= 1, max= 66, avg=21.09, stdev=14.45, samples=138 write: IOPS=22, BW=90.9KiB/s (93.0kB/s)(6348KiB/69872msec); 0 zone resets clat (msec): min=10, max=160, avg=30.46, stdev=19.87 lat (msec): min=10, max=160, avg=30.46, stdev=19.87 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 56], 95.00th=[ 69], | 99.00th=[ 103], 99.50th=[ 121], 99.90th=[ 159], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 8, max= 224, per=32.15%, avg=91.32, stdev=54.19, samples=138 iops : min= 2, max= 56, avg=22.54, stdev=13.70, samples=138 lat (msec) : 4=5.47%, 10=21.71%, 20=33.95%, 50=30.34%, 100=7.88% lat (msec) : 250=0.62%, 1000=0.03% cpu : usr=0.12%, sys=9.30%, ctx=6243, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153853: Wed Jul 1 14:12:20 2026 read: IOPS=21, BW=86.3KiB/s (88.3kB/s)(6028KiB/69875msec) clat (msec): min=2, max=104, avg=13.64, stdev=12.84 lat (msec): min=2, max=104, avg=13.64, stdev=12.84 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 21], 90.00th=[ 30], 95.00th=[ 41], | 99.00th=[ 61], 99.50th=[ 78], 99.90th=[ 102], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 7, max= 264, per=32.26%, avg=87.43, stdev=55.98, samples=137 iops : min= 1, max= 66, avg=21.56, stdev=14.16, samples=137 write: IOPS=22, BW=89.6KiB/s (91.7kB/s)(6260KiB/69875msec); 0 zone resets clat (msec): min=10, max=863, avg=31.36, stdev=29.07 lat (msec): min=10, max=863, avg=31.37, stdev=29.07 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 58], 95.00th=[ 70], | 99.00th=[ 107], 99.50th=[ 122], 99.90th=[ 150], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 16, max= 216, per=31.71%, avg=90.04, stdev=54.03, samples=138 iops : min= 4, max= 54, avg=22.22, stdev=13.66, samples=138 lat (msec) : 4=6.71%, 10=21.06%, 20=33.37%, 50=30.27%, 100=7.85% lat (msec) : 250=0.72%, 1000=0.03% cpu : usr=0.10%, sys=9.27%, ctx=6145, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=153854: Wed Jul 1 14:12:20 2026 read: IOPS=17, BW=69.3KiB/s (70.9kB/s)(4028KiB/58155msec) clat (msec): min=2, max=112, avg=17.28, stdev=13.94 lat (msec): min=2, max=112, avg=17.28, stdev=13.94 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 63], 99.50th=[ 81], 99.90th=[ 106], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 7, max= 192, per=25.74%, avg=69.76, stdev=41.20, samples=113 iops : min= 1, max= 48, avg=17.09, stdev=10.43, samples=113 write: IOPS=17, BW=71.4KiB/s (73.1kB/s)(4152KiB/58155msec); 0 zone resets clat (msec): min=12, max=859, avg=39.06, stdev=33.06 lat (msec): min=12, max=859, avg=39.06, stdev=33.06 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 54], 90.00th=[ 65], 95.00th=[ 77], | 99.00th=[ 113], 99.50th=[ 128], 99.90th=[ 163], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 16, max= 192, per=25.11%, avg=71.32, stdev=36.73, samples=114 iops : min= 4, max= 48, avg=17.48, stdev= 9.31, samples=114 lat (msec) : 4=2.00%, 10=16.67%, 20=26.20%, 50=41.40%, 100=12.56% lat (msec) : 250=1.08%, 1000=0.05% cpu : usr=0.08%, sys=8.85%, ctx=3909, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1008,1038,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=272KiB/s (278kB/s), 58.7KiB/s-86.3KiB/s (60.1kB/s-88.3kB/s), io=18.5MiB (19.4MB), run=50833-69875msec WRITE: bw=284KiB/s (291kB/s), 60.9KiB/s-90.9KiB/s (62.4kB/s-93.0kB/s), io=19.4MiB (20.3MB), run=50833-69875msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153879: Wed Jul 1 14:12:39 2026 read: IOPS=26, BW=423KiB/s (434kB/s)(5920KiB/13982msec) clat (usec): min=68, max=57984, avg=18621.98, stdev=10747.68 lat (usec): min=68, max=57985, avg=18623.04, stdev=10747.81 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 120], 10.00th=[ 6063], 20.00th=[10683], | 30.00th=[13698], 40.00th=[15533], 50.00th=[17433], 60.00th=[19530], | 70.00th=[22152], 80.00th=[26346], 90.00th=[31851], 95.00th=[39584], | 99.00th=[49021], 99.50th=[54264], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 222, max= 574, per=24.05%, avg=412.00, stdev=103.17, samples=27 iops : min= 13, max= 35, avg=25.22, stdev= 6.49, samples=27 write: IOPS=28, BW=455KiB/s (466kB/s)(6368KiB/13982msec); 0 zone resets clat (usec): min=1207, max=94961, avg=17760.05, stdev=14276.15 lat (usec): min=1209, max=94963, avg=17761.98, stdev=14276.19 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 3490], 10.00th=[ 4178], 20.00th=[ 5211], | 30.00th=[ 8029], 40.00th=[11076], 50.00th=[13698], 60.00th=[17433], | 70.00th=[22152], 80.00th=[27395], 90.00th=[34866], 95.00th=[48497], | 99.00th=[64226], 99.50th=[76022], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 128, max= 672, per=24.92%, avg=449.15, stdev=121.73, samples=27 iops : min= 8, max= 42, avg=27.52, stdev= 7.59, samples=27 lat (usec) : 100=1.17%, 250=2.99%, 1000=0.13% lat (msec) : 2=0.65%, 4=3.26%, 10=19.40%, 20=36.20%, 50=33.72% lat (msec) : 100=2.47% cpu : usr=0.17%, sys=27.49%, ctx=2608, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153880: Wed Jul 1 14:12:39 2026 read: IOPS=26, BW=423KiB/s (434kB/s)(5744KiB/13565msec) clat (usec): min=38, max=72917, avg=19523.79, stdev=11620.35 lat (usec): min=39, max=72917, avg=19524.74, stdev=11620.38 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 128], 10.00th=[ 8848], 20.00th=[11731], | 30.00th=[13698], 40.00th=[15533], 50.00th=[17171], 60.00th=[19792], | 70.00th=[22414], 80.00th=[26084], 90.00th=[34341], 95.00th=[43779], | 99.00th=[54789], 99.50th=[69731], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 191, max= 640, per=24.58%, avg=421.12, stdev=118.53, samples=26 iops : min= 11, max= 40, avg=25.81, stdev= 7.47, samples=26 write: IOPS=30, BW=482KiB/s (494kB/s)(6544KiB/13565msec); 0 zone resets clat (usec): min=1654, max=71132, avg=15875.75, stdev=11433.25 lat (usec): min=1655, max=71133, avg=15877.51, stdev=11433.40 clat percentiles (usec): | 1.00th=[ 2769], 5.00th=[ 3752], 10.00th=[ 4621], 20.00th=[ 6194], | 30.00th=[ 8225], 40.00th=[10552], 50.00th=[12911], 60.00th=[15533], | 70.00th=[19268], 80.00th=[24511], 90.00th=[31065], 95.00th=[36439], | 99.00th=[52691], 99.50th=[62653], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 191, max= 764, per=26.30%, avg=473.92, stdev=156.94, samples=26 iops : min= 11, max= 47, avg=29.12, stdev= 9.86, samples=26 lat (usec) : 50=0.13%, 100=0.65%, 250=2.47% lat (msec) : 2=0.13%, 4=3.12%, 10=19.01%, 20=40.62%, 50=31.90% lat (msec) : 100=1.95% cpu : usr=0.16%, sys=28.66%, ctx=2823, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153881: Wed Jul 1 14:12:39 2026 read: IOPS=28, BW=453KiB/s (464kB/s)(6256KiB/13805msec) clat (usec): min=55, max=81675, avg=19329.48, stdev=12170.94 lat (usec): min=56, max=81676, avg=19330.57, stdev=12171.06 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 117], 10.00th=[ 8291], 20.00th=[11076], | 30.00th=[13435], 40.00th=[15533], 50.00th=[17433], 60.00th=[20055], | 70.00th=[22414], 80.00th=[26608], 90.00th=[34341], 95.00th=[42206], | 99.00th=[62653], 99.50th=[78119], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 191, max= 702, per=26.31%, avg=450.67, stdev=125.11, samples=27 iops : min= 11, max= 43, avg=27.63, stdev= 7.77, samples=27 write: IOPS=27, BW=437KiB/s (447kB/s)(6032KiB/13805msec); 0 zone resets clat (usec): min=1634, max=72372, avg=16459.22, stdev=12428.71 lat (usec): min=1635, max=72375, avg=16461.03, stdev=12428.78 clat percentiles (usec): | 1.00th=[ 2573], 5.00th=[ 3851], 10.00th=[ 4424], 20.00th=[ 5276], | 30.00th=[ 8094], 40.00th=[10814], 50.00th=[13566], 60.00th=[16712], | 70.00th=[20317], 80.00th=[24773], 90.00th=[32375], 95.00th=[42730], | 99.00th=[56361], 99.50th=[69731], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 159, max= 638, per=23.66%, avg=426.41, stdev=138.87, samples=27 iops : min= 9, max= 39, avg=26.11, stdev= 8.69, samples=27 lat (usec) : 100=1.56%, 250=2.86% lat (msec) : 2=0.52%, 4=2.86%, 10=17.32%, 20=39.06%, 50=33.20% lat (msec) : 100=2.60% cpu : usr=0.12%, sys=27.76%, ctx=2694, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153882: Wed Jul 1 14:12:39 2026 read: IOPS=27, BW=445KiB/s (456kB/s)(6032KiB/13551msec) clat (usec): min=57, max=72021, avg=19426.38, stdev=12415.82 lat (usec): min=58, max=72023, avg=19450.21, stdev=12472.46 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 109], 10.00th=[ 219], 20.00th=[10814], | 30.00th=[13042], 40.00th=[15795], 50.00th=[18220], 60.00th=[20841], | 70.00th=[23200], 80.00th=[26870], 90.00th=[33817], 95.00th=[45876], | 99.00th=[62653], 99.50th=[67634], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 256, max= 669, per=25.63%, avg=439.00, stdev=104.01, samples=26 iops : min= 16, max= 41, avg=26.92, stdev= 6.47, samples=26 write: IOPS=28, BW=462KiB/s (473kB/s)(6256KiB/13551msec); 0 zone resets clat (usec): min=1376, max=97096, avg=15812.85, stdev=12336.05 lat (usec): min=1377, max=97099, avg=15814.56, stdev=12336.11 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3326], 10.00th=[ 4178], 20.00th=[ 5211], | 30.00th=[ 7242], 40.00th=[ 9634], 50.00th=[12649], 60.00th=[16188], | 70.00th=[19530], 80.00th=[25297], 90.00th=[30802], 95.00th=[40109], | 99.00th=[59507], 99.50th=[67634], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 223, max= 670, per=25.69%, avg=462.92, stdev=139.61, samples=26 iops : min= 13, max= 41, avg=28.42, stdev= 8.71, samples=26 lat (usec) : 100=1.82%, 250=3.12%, 500=0.13% lat (msec) : 2=1.04%, 4=3.26%, 10=20.18%, 20=34.64%, 50=33.72% lat (msec) : 100=2.08% cpu : usr=0.11%, sys=27.90%, ctx=2623, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1713KiB/s (1754kB/s), 423KiB/s-453KiB/s (434kB/s-464kB/s), io=23.4MiB (24.5MB), run=13551-13982msec WRITE: bw=1802KiB/s (1846kB/s), 437KiB/s-482KiB/s (447kB/s-494kB/s), io=24.6MiB (25.8MB), run=13551-13982msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153884: Wed Jul 1 14:12:46 2026 read: IOPS=18, BW=293KiB/s (301kB/s)(5920KiB/20172msec) clat (msec): min=2, max=138, avg=17.43, stdev=17.84 lat (msec): min=2, max=138, avg=17.43, stdev=17.84 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 57], | 99.00th=[ 88], 99.50th=[ 95], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 95, max= 640, per=23.92%, avg=283.92, stdev=145.28, samples=39 iops : min= 5, max= 40, avg=17.36, stdev= 9.31, samples=39 write: IOPS=19, BW=316KiB/s (323kB/s)(6368KiB/20172msec); 0 zone resets clat (msec): min=10, max=164, avg=34.36, stdev=17.97 lat (msec): min=10, max=164, avg=34.36, stdev=17.97 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 56], 95.00th=[ 66], | 99.00th=[ 105], 99.50th=[ 128], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 127, max= 608, per=24.68%, avg=308.23, stdev=148.45, samples=39 iops : min= 7, max= 38, avg=18.87, stdev= 9.48, samples=39 lat (msec) : 4=2.34%, 10=19.53%, 20=20.05%, 50=47.53%, 100=9.90% lat (msec) : 250=0.65% cpu : usr=0.11%, sys=10.11%, ctx=1637, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153885: Wed Jul 1 14:12:46 2026 read: IOPS=17, BW=287KiB/s (294kB/s)(5744KiB/20000msec) clat (msec): min=3, max=102, avg=16.16, stdev=15.32 lat (msec): min=3, max=102, avg=16.16, stdev=15.32 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 25], 90.00th=[ 39], 95.00th=[ 53], | 99.00th=[ 69], 99.50th=[ 88], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 63, max= 704, per=24.08%, avg=285.85, stdev=165.80, samples=39 iops : min= 3, max= 44, avg=17.49, stdev=10.60, samples=39 write: IOPS=20, BW=327KiB/s (335kB/s)(6544KiB/20000msec); 0 zone resets clat (msec): min=14, max=138, avg=34.47, stdev=19.25 lat (msec): min=14, max=138, avg=34.47, stdev=19.25 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 46], 90.00th=[ 63], 95.00th=[ 75], | 99.00th=[ 100], 99.50th=[ 101], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 128, max= 672, per=25.84%, avg=322.69, stdev=151.35, samples=39 iops : min= 8, max= 42, avg=19.77, stdev= 9.67, samples=39 lat (msec) : 4=1.30%, 10=21.88%, 20=21.35%, 50=44.14%, 100=10.81% lat (msec) : 250=0.52% cpu : usr=0.12%, sys=10.46%, ctx=1690, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153886: Wed Jul 1 14:12:46 2026 read: IOPS=19, BW=313KiB/s (321kB/s)(6256KiB/19967msec) clat (msec): min=2, max=158, avg=15.87, stdev=15.47 lat (msec): min=2, max=158, avg=15.87, stdev=15.47 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 49], | 99.00th=[ 66], 99.50th=[ 96], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 63, max= 800, per=26.46%, avg=314.13, stdev=190.88, samples=39 iops : min= 3, max= 50, avg=19.26, stdev=12.16, samples=39 write: IOPS=18, BW=302KiB/s (309kB/s)(6032KiB/19967msec); 0 zone resets clat (msec): min=14, max=166, avg=36.20, stdev=20.96 lat (msec): min=14, max=166, avg=36.20, stdev=20.96 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 63], 95.00th=[ 77], | 99.00th=[ 108], 99.50th=[ 163], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 95, max= 640, per=23.87%, avg=298.18, stdev=142.77, samples=39 iops : min= 5, max= 40, avg=18.26, stdev= 9.11, samples=39 lat (msec) : 4=1.04%, 10=21.88%, 20=23.18%, 50=41.93%, 100=11.07% lat (msec) : 250=0.91% cpu : usr=0.06%, sys=10.25%, ctx=1654, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153887: Wed Jul 1 14:12:46 2026 read: IOPS=19, BW=308KiB/s (315kB/s)(6032KiB/19602msec) clat (usec): min=3821, max=97830, avg=17160.36, stdev=16231.72 lat (usec): min=3823, max=97831, avg=17161.37, stdev=16231.65 clat percentiles (usec): | 1.00th=[ 3982], 5.00th=[ 4490], 10.00th=[ 5145], 20.00th=[ 6063], | 30.00th=[ 7308], 40.00th=[ 9241], 50.00th=[11076], 60.00th=[13960], | 70.00th=[17695], 80.00th=[23725], 90.00th=[39060], 95.00th=[52691], | 99.00th=[79168], 99.50th=[86508], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 95, max= 766, per=25.46%, avg=302.26, stdev=149.52, samples=38 iops : min= 5, max= 47, avg=18.50, stdev= 9.45, samples=38 write: IOPS=19, BW=319KiB/s (327kB/s)(6256KiB/19602msec); 0 zone resets clat (msec): min=14, max=101, avg=33.34, stdev=14.43 lat (msec): min=14, max=101, avg=33.34, stdev=14.43 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 47], 90.00th=[ 54], 95.00th=[ 61], | 99.00th=[ 77], 99.50th=[ 90], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 95, max= 640, per=25.53%, avg=318.92, stdev=150.68, samples=38 iops : min= 5, max= 40, avg=19.55, stdev= 9.61, samples=38 lat (msec) : 4=0.52%, 10=21.35%, 20=22.53%, 50=45.31%, 100=10.16% lat (msec) : 250=0.13% cpu : usr=0.11%, sys=10.52%, ctx=1570, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1187KiB/s (1216kB/s), 287KiB/s-313KiB/s (294kB/s-321kB/s), io=23.4MiB (24.5MB), run=19602-20172msec WRITE: bw=1249KiB/s (1279kB/s), 302KiB/s-327KiB/s (309kB/s-335kB/s), io=24.6MiB (25.8MB), run=19602-20172msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153900: Wed Jul 1 14:12:54 2026 read: IOPS=3, BW=3107KiB/s (3182kB/s)(7168KiB/2307msec) clat (usec): min=790, max=152601, avg=110311.14, stdev=53006.95 lat (usec): min=792, max=152602, avg=110312.61, stdev=53006.95 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 88605], | 30.00th=[116917], 40.00th=[116917], 50.00th=[125305], 60.00th=[141558], | 70.00th=[141558], 80.00th=[147850], 90.00th=[152044], 95.00th=[152044], | 99.00th=[152044], 99.50th=[152044], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 2048, max= 5094, per=54.37%, avg=3647.00, stdev=1528.68, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2219KiB/s (2273kB/s)(5120KiB/2307msec); 0 zone resets clat (msec): min=139, max=713, avg=303.18, stdev=232.45 lat (msec): min=139, max=714, avg=303.23, stdev=232.46 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 3799, max= 4096, per=42.03%, avg=3947.50, stdev=210.01, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=75.00%, 750=8.33% cpu : usr=0.00%, sys=46.92%, ctx=830, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153901: Wed Jul 1 14:12:54 2026 read: IOPS=0, BW=712KiB/s (729kB/s)(2048KiB/2875msec) clat (msec): min=124, max=155, avg=140.37, stdev=21.91 lat (msec): min=124, max=155, avg=140.38, stdev=21.91 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 157], 95.00th=[ 157], | 99.00th=[ 157], 99.50th=[ 157], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 1715, max= 2048, per=28.05%, avg=1881.50, stdev=235.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3562KiB/s (3647kB/s)(10.0MiB/2875msec); 0 zone resets clat (msec): min=85, max=566, avg=253.08, stdev=154.33 lat (msec): min=85, max=566, avg=253.15, stdev=154.33 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 125], | 30.00th=[ 142], 40.00th=[ 165], 50.00th=[ 182], 60.00th=[ 224], | 70.00th=[ 251], 80.00th=[ 359], 90.00th=[ 439], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2031, max= 5699, per=42.39%, avg=3980.50, stdev=1503.38, samples=4 iops : min= 1, max= 5, avg= 3.50, stdev= 1.73, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=41.96%, ctx=288, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153902: Wed Jul 1 14:12:54 2026 read: IOPS=1, BW=2012KiB/s (2061kB/s)(6144KiB/3053msec) clat (usec): min=486, max=252857, avg=142323.16, stdev=114470.02 lat (usec): min=487, max=252881, avg=142328.21, stdev=114474.44 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[156238], 50.00th=[156238], 60.00th=[214959], | 70.00th=[229639], 80.00th=[229639], 90.00th=[252707], 95.00th=[252707], | 99.00th=[252707], 99.50th=[252707], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 4096, max= 6095, per=75.96%, avg=5095.50, stdev=1413.51, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2012KiB/s (2061kB/s)(6144KiB/3053msec); 0 zone resets clat (msec): min=169, max=630, avg=351.98, stdev=210.98 lat (msec): min=169, max=630, avg=352.03, stdev=210.99 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 284], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2048, max= 4063, per=33.91%, avg=3184.33, stdev=1031.92, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.03%, sys=37.81%, ctx=806, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153903: Wed Jul 1 14:12:54 2026 read: IOPS=2, BW=2112KiB/s (2163kB/s)(5120KiB/2424msec) clat (usec): min=507, max=125819, avg=56760.45, stdev=59775.48 lat (usec): min=508, max=125820, avg=56761.32, stdev=59775.47 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 44827], 60.00th=[ 44827], | 70.00th=[111674], 80.00th=[111674], 90.00th=[125305], 95.00th=[125305], | 99.00th=[125305], 99.50th=[125305], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 4096, max= 4096, per=61.06%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2957KiB/s (3028kB/s)(7168KiB/2424msec); 0 zone resets clat (msec): min=150, max=455, avg=290.97, stdev=112.12 lat (msec): min=150, max=455, avg=291.04, stdev=112.12 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 165], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 388], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1715, max= 3799, per=25.58%, avg=2402.50, stdev=944.14, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 250=33.33%, 500=41.67% cpu : usr=0.04%, sys=40.94%, ctx=517, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6708KiB/s (6869kB/s), 712KiB/s-3107KiB/s (729kB/s-3182kB/s), io=20.0MiB (20.0MB), run=2307-3053msec WRITE: bw=9391KiB/s (9617kB/s), 2012KiB/s-3562KiB/s (2061kB/s-3647kB/s), io=28.0MiB (29.4MB), run=2307-3053msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153895: Wed Jul 1 14:12:55 2026 read: IOPS=2, BW=2289KiB/s (2344kB/s)(7168KiB/3131msec) clat (msec): min=47, max=251, avg=130.17, stdev=66.82 lat (msec): min=47, max=251, avg=130.17, stdev=66.82 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 78], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 138], 80.00th=[ 171], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 2035, max= 5189, per=48.29%, avg=3090.67, stdev=1817.22, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1635KiB/s (1675kB/s)(5120KiB/3131msec); 0 zone resets clat (msec): min=149, max=604, avg=440.60, stdev=170.87 lat (msec): min=149, max=604, avg=440.66, stdev=170.87 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1954, max= 2035, per=22.19%, avg=1988.33, stdev=41.88, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=12.43%, ctx=238, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153897: Wed Jul 1 14:12:55 2026 read: IOPS=0, BW=640KiB/s (655kB/s)(2048KiB/3200msec) clat (msec): min=151, max=181, avg=166.31, stdev=20.85 lat (msec): min=151, max=181, avg=166.31, stdev=20.85 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1721, max= 1954, per=28.71%, avg=1837.50, stdev=164.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3200KiB/s (3277kB/s)(10.0MiB/3200msec); 0 zone resets clat (msec): min=41, max=750, avg=275.14, stdev=231.61 lat (msec): min=41, max=750, avg=275.20, stdev=231.61 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 54], | 30.00th=[ 73], 40.00th=[ 123], 50.00th=[ 155], 60.00th=[ 317], | 70.00th=[ 351], 80.00th=[ 380], 90.00th=[ 514], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1954, max= 5930, per=35.85%, avg=3212.60, stdev=1767.18, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.82, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=11.47%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153898: Wed Jul 1 14:12:55 2026 read: IOPS=1, BW=1957KiB/s (2004kB/s)(6144KiB/3139msec) clat (msec): min=41, max=435, avg=153.99, stdev=147.64 lat (msec): min=41, max=435, avg=153.99, stdev=147.64 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 58], | 30.00th=[ 58], 40.00th=[ 65], 50.00th=[ 65], 60.00th=[ 155], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1976, max= 2048, per=31.44%, avg=2012.00, stdev=50.91, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1957KiB/s (2004kB/s)(6144KiB/3139msec); 0 zone resets clat (msec): min=75, max=886, avg=356.09, stdev=324.36 lat (msec): min=75, max=886, avg=356.15, stdev=324.35 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 275], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1954, max= 3453, per=27.69%, avg=2480.67, stdev=843.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=15.39%, ctx=219, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153899: Wed Jul 1 14:12:55 2026 read: IOPS=1, BW=1627KiB/s (1667kB/s)(5120KiB/3146msec) clat (msec): min=37, max=492, avg=170.90, stdev=188.37 lat (msec): min=37, max=492, avg=170.91, stdev=188.37 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 38], | 30.00th=[ 48], 40.00th=[ 48], 50.00th=[ 96], 60.00th=[ 96], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1954, max= 4096, per=41.80%, avg=2675.33, stdev=1230.38, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2278KiB/s (2333kB/s)(7168KiB/3146msec); 0 zone resets clat (msec): min=84, max=598, avg=321.27, stdev=189.28 lat (msec): min=85, max=598, avg=321.35, stdev=189.28 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 92], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 305], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 468], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1954, max= 4096, per=30.35%, avg=2719.60, stdev=994.48, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 50=16.67%, 100=25.00%, 250=8.33%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=11.80%, ctx=177, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6400KiB/s (6554kB/s), 640KiB/s-2289KiB/s (655kB/s-2344kB/s), io=20.0MiB (20.0MB), run=3131-3200msec WRITE: bw=8960KiB/s (9175kB/s), 1635KiB/s-3200KiB/s (1675kB/s-3277kB/s), io=28.0MiB (29.4MB), run=3131-3200msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153908: Wed Jul 1 14:13:03 2026 read: IOPS=1, BW=5294KiB/s (5421kB/s)(12.0MiB/2321msec) clat (msec): min=483, max=1264, avg=763.14, stdev=435.05 lat (msec): min=483, max=1264, avg=763.14, stdev=435.05 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=37.20%, ctx=2107, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153909: Wed Jul 1 14:13:03 2026 read: IOPS=0, BW=1542KiB/s (1579kB/s)(4096KiB/2656msec) clat (nsec): min=1110.2M, max=1110.2M, avg=1110223349.00, stdev= 0.00 lat (nsec): min=1110.2M, max=1110.2M, avg=1110225934.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3084KiB/s (3158kB/s)(8192KiB/2656msec); 0 zone resets clat (msec): min=632, max=878, avg=755.80, stdev=173.87 lat (msec): min=633, max=879, avg=756.12, stdev=173.82 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8192, max= 8192, per=70.38%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=20.45%, ctx=1070, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153910: Wed Jul 1 14:13:03 2026 write: IOPS=1, BW=4365KiB/s (4470kB/s)(12.0MiB/2815msec); 0 zone resets clat (msec): min=281, max=1491, avg=927.88, stdev=609.02 lat (msec): min=282, max=1491, avg=928.22, stdev=609.02 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8110, max= 8175, per=69.95%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.81%, ctx=191, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153912: Wed Jul 1 14:13:03 2026 write: IOPS=1, BW=5122KiB/s (5245kB/s)(12.0MiB/2399msec); 0 zone resets clat (msec): min=167, max=1277, avg=781.41, stdev=564.23 lat (msec): min=167, max=1277, avg=781.68, stdev=564.22 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8175, max= 8175, per=70.23%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.93%, ctx=82, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6169KiB/s (6317kB/s), 1542KiB/s-5294KiB/s (1579kB/s-5421kB/s), io=16.0MiB (16.8MB), run=2321-2656msec WRITE: bw=11.4MiB/s (11.9MB/s), 3084KiB/s-5122KiB/s (3158kB/s-5245kB/s), io=32.0MiB (33.6MB), run=2399-2815msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153913: Wed Jul 1 14:13:03 2026 read: IOPS=1, BW=4793KiB/s (4908kB/s)(12.0MiB/2564msec) clat (msec): min=514, max=1230, avg=835.64, stdev=363.40 lat (msec): min=514, max=1230, avg=835.64, stdev=363.40 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=10.69%, ctx=90, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153914: Wed Jul 1 14:13:03 2026 read: IOPS=0, BW=1405KiB/s (1438kB/s)(4096KiB/2916msec) clat (nsec): min=1618.8M, max=1618.8M, avg=1618781639.00, stdev= 0.00 lat (nsec): min=1618.8M, max=1618.8M, avg=1618782821.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1620], 5.00th=[ 1620], 10.00th=[ 1620], 20.00th=[ 1620], | 30.00th=[ 1620], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2809KiB/s (2877kB/s)(8192KiB/2916msec); 0 zone resets clat (msec): min=542, max=701, avg=621.67, stdev=112.19 lat (msec): min=542, max=701, avg=621.97, stdev=112.23 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8175, max= 8175, per=73.02%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.39%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153915: Wed Jul 1 14:13:03 2026 write: IOPS=1, BW=4198KiB/s (4299kB/s)(12.0MiB/2927msec); 0 zone resets clat (msec): min=159, max=2117, avg=970.90, stdev=1020.81 lat (msec): min=159, max=2117, avg=971.22, stdev=1020.80 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8175, max= 8175, per=73.02%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=8.07%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153916: Wed Jul 1 14:13:03 2026 write: IOPS=1, BW=4755KiB/s (4870kB/s)(12.0MiB/2584msec); 0 zone resets clat (msec): min=187, max=1684, avg=856.34, stdev=760.63 lat (msec): min=188, max=1684, avg=856.65, stdev=760.67 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8175, max= 8192, per=73.10%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=10.26%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5619KiB/s (5754kB/s), 1405KiB/s-4793KiB/s (1438kB/s-4908kB/s), io=16.0MiB (16.8MB), run=2564-2916msec WRITE: bw=10.9MiB/s (11.5MB/s), 2809KiB/s-4755KiB/s (2877kB/s-4870kB/s), io=32.0MiB (33.6MB), run=2584-2927msec