== sanity test 398b: DIO and buffer IO race ============== 04:32:53 (1788597173) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.24705 s, 6.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144749: Sat Sep 5 04:35:22 2026 read: IOPS=11, BW=47.5KiB/s (48.7kB/s)(5992KiB/126034msec) clat (usec): min=32, max=805108, avg=39865.90, stdev=35733.17 lat (usec): min=32, max=805111, avg=39867.46, stdev=35733.18 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 74], 20.00th=[ 17171], | 30.00th=[ 22938], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[139461], 99.50th=[152044], 99.90th=[219153], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 111, per=25.41%, avg=47.77, stdev=21.76, samples=245 iops : min= 1, max= 27, avg=11.29, stdev= 5.47, samples=245 write: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6296KiB/126034msec); 0 zone resets clat (usec): min=779, max=656885, avg=42038.02, stdev=45617.13 lat (usec): min=781, max=656886, avg=42040.94, stdev=45616.97 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1483], 20.00th=[ 3916], | 30.00th=[ 8029], 40.00th=[ 19006], 50.00th=[ 30016], 60.00th=[ 44303], | 70.00th=[ 56886], 80.00th=[ 73925], 90.00th=[ 96994], 95.00th=[122160], | 99.00th=[185598], 99.50th=[231736], 99.90th=[354419], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 134, per=25.18%, avg=49.60, stdev=21.02, samples=248 iops : min= 1, max= 33, avg=11.75, stdev= 5.28, samples=248 lat (usec) : 50=0.85%, 100=4.59%, 250=0.55%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=6.15%, 4=4.23%, 10=6.45%, 20=9.64%, 50=34.77% lat (msec) : 100=25.72%, 250=6.45%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.78%, ctx=6364, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144750: Sat Sep 5 04:35:22 2026 read: IOPS=11, BW=47.2KiB/s (48.3kB/s)(5940KiB/125940msec) clat (usec): min=34, max=748680, avg=38826.38, stdev=35946.42 lat (usec): min=34, max=748681, avg=38828.00, stdev=35946.78 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 69], 20.00th=[ 16450], | 30.00th=[ 22152], 40.00th=[ 27395], 50.00th=[ 33162], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[130548], 99.50th=[156238], 99.90th=[404751], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 102, per=25.31%, avg=47.58, stdev=20.28, samples=244 iops : min= 1, max= 25, avg=11.24, stdev= 5.12, samples=244 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6348KiB/125940msec); 0 zone resets clat (usec): min=768, max=535342, avg=42922.03, stdev=45725.28 lat (usec): min=769, max=535344, avg=42923.68, stdev=45725.29 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1516], 20.00th=[ 3851], | 30.00th=[ 8455], 40.00th=[ 20317], 50.00th=[ 31327], 60.00th=[ 44303], | 70.00th=[ 56886], 80.00th=[ 72877], 90.00th=[100140], 95.00th=[127402], | 99.00th=[193987], 99.50th=[242222], 99.90th=[295699], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 7, max= 111, per=25.50%, avg=50.24, stdev=21.64, samples=247 iops : min= 1, max= 27, avg=11.92, stdev= 5.43, samples=247 lat (usec) : 50=0.85%, 100=4.95%, 250=0.46%, 500=0.10%, 1000=0.13% lat (msec) : 2=6.58%, 4=4.13%, 10=6.22%, 20=9.57%, 50=35.42% lat (msec) : 100=24.71%, 250=6.54%, 500=0.29%, 750=0.07% cpu : usr=0.08%, sys=4.85%, ctx=6151, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144751: Sat Sep 5 04:35:22 2026 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6028KiB/127061msec) clat (usec): min=28, max=388246, avg=39513.24, stdev=31900.99 lat (usec): min=28, max=388247, avg=39516.30, stdev=31904.75 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 77], 20.00th=[ 16712], | 30.00th=[ 22414], 40.00th=[ 27657], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 93848], | 99.00th=[132645], 99.50th=[166724], 99.90th=[270533], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 110, per=25.21%, avg=47.40, stdev=20.64, samples=248 iops : min= 1, max= 27, avg=11.19, stdev= 5.18, samples=248 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6260KiB/127061msec); 0 zone resets clat (usec): min=592, max=878562, avg=43056.48, stdev=48531.37 lat (usec): min=593, max=878565, avg=43058.83, stdev=48531.29 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1369], 20.00th=[ 3523], | 30.00th=[ 8291], 40.00th=[ 20055], 50.00th=[ 31589], 60.00th=[ 44303], | 70.00th=[ 60031], 80.00th=[ 74974], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[185598], 99.50th=[208667], 99.90th=[379585], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 126, per=24.76%, avg=48.77, stdev=20.11, samples=250 iops : min= 1, max= 31, avg=11.55, stdev= 5.05, samples=250 lat (usec) : 50=0.85%, 100=4.65%, 250=0.39%, 500=0.16%, 750=0.20% lat (usec) : 1000=0.16% lat (msec) : 2=7.58%, 4=3.55%, 10=5.73%, 20=9.70%, 50=34.83% lat (msec) : 100=25.39%, 250=6.58%, 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=4.92%, ctx=6378, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144752: Sat Sep 5 04:35:22 2026 read: IOPS=12, BW=49.0KiB/s (50.2kB/s)(6052KiB/123431msec) clat (usec): min=31, max=261230, avg=39953.95, stdev=31599.74 lat (usec): min=31, max=261231, avg=39965.89, stdev=31607.02 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 67], 20.00th=[ 16057], | 30.00th=[ 22414], 40.00th=[ 27919], 50.00th=[ 34341], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[173016], 99.90th=[244319], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 103, per=26.14%, avg=49.14, stdev=19.36, samples=241 iops : min= 1, max= 25, avg=11.63, stdev= 4.86, samples=241 write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6236KiB/123431msec); 0 zone resets clat (usec): min=766, max=933803, avg=40264.46, stdev=46886.55 lat (usec): min=767, max=933806, avg=40272.08, stdev=46900.78 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1401], 20.00th=[ 3523], | 30.00th=[ 7373], 40.00th=[ 17433], 50.00th=[ 28181], 60.00th=[ 40633], | 70.00th=[ 53740], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[173016], 99.50th=[212861], 99.90th=[304088], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 118, per=25.47%, avg=50.19, stdev=21.87, samples=243 iops : min= 1, max= 29, avg=11.90, stdev= 5.49, samples=243 lat (usec) : 50=1.01%, 100=5.01%, 250=0.55%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.80%, 4=3.97%, 10=6.38%, 20=9.83%, 50=34.31% lat (msec) : 100=24.84%, 250=6.80%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=5.01%, ctx=6306, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=189KiB/s (194kB/s), 47.2KiB/s-49.0KiB/s (48.3kB/s-50.2kB/s), io=23.4MiB (24.6MB), run=123431-127061msec WRITE: bw=198KiB/s (203kB/s), 49.3KiB/s-50.5KiB/s (50.5kB/s-51.7kB/s), io=24.6MiB (25.7MB), run=123431-127061msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144744: Sat Sep 5 04:37:37 2026 read: IOPS=5, BW=22.9KiB/s (23.4kB/s)(5992KiB/261895msec) clat (msec): min=4, max=911, avg=35.29, stdev=41.57 lat (msec): min=4, max=911, avg=35.29, stdev=41.57 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 74], 95.00th=[ 104], | 99.00th=[ 194], 99.50th=[ 230], 99.90th=[ 380], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 88, per=27.78%, avg=25.28, stdev=16.84, samples=459 iops : min= 1, max= 22, avg= 5.71, stdev= 4.31, samples=459 write: IOPS=6, BW=24.0KiB/s (24.6kB/s)(6296KiB/261895msec); 0 zone resets clat (msec): min=30, max=742, avg=132.53, stdev=64.04 lat (msec): min=30, max=742, avg=132.54, stdev=64.04 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 134], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 218], 95.00th=[ 251], | 99.00th=[ 334], 99.50th=[ 359], 99.90th=[ 514], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 63, per=25.28%, avg=24.02, stdev=10.97, samples=506 iops : min= 1, max= 15, avg= 5.39, stdev= 2.84, samples=506 lat (msec) : 10=5.31%, 20=16.02%, 50=19.27%, 100=24.35%, 250=32.36% lat (msec) : 500=2.60%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5107, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144745: Sat Sep 5 04:37:37 2026 read: IOPS=5, BW=22.8KiB/s (23.3kB/s)(5940KiB/260599msec) clat (msec): min=4, max=874, avg=35.32, stdev=46.62 lat (msec): min=4, max=874, avg=35.32, stdev=46.62 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 105], | 99.00th=[ 163], 99.50th=[ 249], 99.90th=[ 701], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 104, per=28.06%, avg=25.53, stdev=17.64, samples=450 iops : min= 1, max= 26, avg= 5.77, stdev= 4.47, samples=450 write: IOPS=6, BW=24.4KiB/s (24.9kB/s)(6348KiB/260599msec); 0 zone resets clat (msec): min=29, max=416, avg=130.90, stdev=60.17 lat (msec): min=29, max=416, avg=130.90, stdev=60.17 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 134], | 70.00th=[ 153], 80.00th=[ 176], 90.00th=[ 213], 95.00th=[ 249], | 99.00th=[ 321], 99.50th=[ 334], 99.90th=[ 409], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 56, per=25.39%, avg=24.12, stdev=10.77, samples=508 iops : min= 1, max= 14, avg= 5.42, stdev= 2.80, samples=508 lat (msec) : 10=5.57%, 20=16.02%, 50=18.42%, 100=24.38%, 250=32.88% lat (msec) : 500=2.64%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=4917, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144746: Sat Sep 5 04:37:37 2026 read: IOPS=5, BW=23.1KiB/s (23.6kB/s)(6028KiB/261236msec) clat (msec): min=4, max=708, avg=35.81, stdev=42.05 lat (msec): min=4, max=708, avg=35.81, stdev=42.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 75], 95.00th=[ 102], | 99.00th=[ 161], 99.50th=[ 243], 99.90th=[ 592], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 103, per=28.48%, avg=25.92, stdev=18.22, samples=451 iops : min= 1, max= 25, avg= 5.88, stdev= 4.62, samples=451 write: IOPS=5, BW=23.0KiB/s (24.5kB/s)(6260KiB/261236msec); 0 zone resets clat (msec): min=34, max=987, avg=132.19, stdev=66.44 lat (msec): min=34, max=987, avg=132.20, stdev=66.44 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 103], 50.00th=[ 116], 60.00th=[ 133], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 224], 95.00th=[ 255], | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 422], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 64, per=25.00%, avg=23.75, stdev=11.47, samples=509 iops : min= 1, max= 16, avg= 5.32, stdev= 2.97, samples=509 lat (msec) : 10=5.40%, 20=15.98%, 50=19.56%, 100=24.93%, 250=30.96% lat (msec) : 500=3.06%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.06%, ctx=5124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144747: Sat Sep 5 04:37:37 2026 read: IOPS=5, BW=23.0KiB/s (23.6kB/s)(6052KiB/262644msec) clat (msec): min=4, max=422, avg=35.45, stdev=38.19 lat (msec): min=4, max=422, avg=35.45, stdev=38.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 53], 90.00th=[ 81], 95.00th=[ 106], | 99.00th=[ 157], 99.50th=[ 234], 99.90th=[ 418], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 111, per=27.88%, avg=25.37, stdev=17.82, samples=461 iops : min= 1, max= 27, avg= 5.74, stdev= 4.53, samples=461 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6236KiB/262644msec); 0 zone resets clat (msec): min=34, max=995, avg=133.80, stdev=65.49 lat (msec): min=34, max=995, avg=133.81, stdev=65.49 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 94], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 215], 95.00th=[ 247], | 99.00th=[ 326], 99.50th=[ 384], 99.90th=[ 498], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 64, per=24.68%, avg=23.45, stdev=10.85, samples=512 iops : min= 1, max= 16, avg= 5.25, stdev= 2.82, samples=512 lat (msec) : 10=5.57%, 20=16.60%, 50=17.55%, 100=24.22%, 250=33.53% lat (msec) : 500=2.51%, 1000=0.03% cpu : usr=0.03%, sys=1.10%, ctx=5057, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=91.4KiB/s (93.6kB/s), 22.8KiB/s-23.1KiB/s (23.3kB/s-23.6kB/s), io=23.4MiB (24.6MB), run=260599-262644msec WRITE: bw=95.7KiB/s (98.0kB/s), 23.7KiB/s-24.4KiB/s (24.3kB/s-24.9kB/s), io=24.6MiB (25.7MB), run=260599-262644msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144809: Sat Sep 5 04:38:14 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(5920KiB/27133msec) clat (usec): min=38, max=212854, avg=35563.03, stdev=33176.20 lat (usec): min=38, max=212856, avg=35569.89, stdev=33174.65 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 69], | 30.00th=[ 6587], 40.00th=[ 24511], 50.00th=[ 32637], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[147850], 99.50th=[200279], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 479, per=26.13%, avg=218.23, stdev=83.26, samples=53 iops : min= 1, max= 29, avg=12.89, stdev= 5.21, samples=53 write: IOPS=14, BW=235KiB/s (240kB/s)(6368KiB/27133msec); 0 zone resets clat (usec): min=1302, max=335216, avg=34693.96, stdev=40265.83 lat (usec): min=1303, max=335218, avg=34697.09, stdev=40265.36 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1696], 10.00th=[ 2442], 20.00th=[ 4490], | 30.00th=[ 7635], 40.00th=[ 12125], 50.00th=[ 20055], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 58983], 90.00th=[ 84411], 95.00th=[107480], | 99.00th=[166724], 99.50th=[295699], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 94, max= 542, per=26.73%, avg=234.96, stdev=99.97, samples=53 iops : min= 5, max= 33, avg=13.96, stdev= 6.32, samples=53 lat (usec) : 50=1.82%, 100=11.20%, 250=0.39%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=4.43%, 4=4.69%, 10=10.81%, 20=8.98%, 50=30.34% lat (msec) : 100=22.01%, 250=4.56%, 500=0.26% cpu : usr=0.10%, sys=4.96%, ctx=1302, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144810: Sat Sep 5 04:38:14 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5744KiB/28661msec) clat (usec): min=38, max=203475, avg=39708.49, stdev=33933.11 lat (usec): min=38, max=203477, avg=39710.70, stdev=33932.45 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 85], | 30.00th=[ 19792], 40.00th=[ 31327], 50.00th=[ 35914], 60.00th=[ 45351], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[156238], 99.50th=[196084], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 28, max= 441, per=24.41%, avg=203.80, stdev=85.94, samples=55 iops : min= 1, max= 27, avg=11.98, stdev= 5.48, samples=55 write: IOPS=14, BW=228KiB/s (234kB/s)(6544KiB/28661msec); 0 zone resets clat (usec): min=1201, max=242706, avg=34476.89, stdev=36022.15 lat (usec): min=1203, max=242708, avg=34483.76, stdev=36020.02 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1647], 10.00th=[ 1860], 20.00th=[ 5276], | 30.00th=[ 9110], 40.00th=[ 13960], 50.00th=[ 22676], 60.00th=[ 33162], | 70.00th=[ 44303], 80.00th=[ 60556], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[160433], 99.50th=[168821], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 28, max= 415, per=26.12%, avg=229.61, stdev=83.75, samples=56 iops : min= 1, max= 25, avg=13.62, stdev= 5.26, samples=56 lat (usec) : 50=1.43%, 100=8.85%, 250=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=5.99%, 4=2.60%, 10=8.72%, 20=11.33%, 50=30.99% lat (msec) : 100=23.70%, 250=5.60% cpu : usr=0.09%, sys=5.27%, ctx=1417, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144811: Sat Sep 5 04:38:14 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(6256KiB/27027msec) clat (usec): min=25, max=202205, avg=36054.15, stdev=31454.76 lat (usec): min=25, max=202206, avg=36055.82, stdev=31454.87 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 15795], 40.00th=[ 26608], 50.00th=[ 33817], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 62653], 90.00th=[ 74974], 95.00th=[ 87557], | 99.00th=[122160], 99.50th=[162530], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 95, max= 446, per=28.43%, avg=237.42, stdev=80.58, samples=52 iops : min= 5, max= 27, avg=14.12, stdev= 5.14, samples=52 write: IOPS=13, BW=223KiB/s (229kB/s)(6032KiB/27027msec); 0 zone resets clat (usec): min=1425, max=219748, avg=33323.79, stdev=37502.38 lat (usec): min=1427, max=219750, avg=33325.91, stdev=37502.36 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1729], 10.00th=[ 2540], 20.00th=[ 4490], | 30.00th=[ 7439], 40.00th=[ 11469], 50.00th=[ 18220], 60.00th=[ 30016], | 70.00th=[ 41157], 80.00th=[ 60031], 90.00th=[ 82314], 95.00th=[110625], | 99.00th=[158335], 99.50th=[210764], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 56, max= 447, per=25.27%, avg=222.11, stdev=98.91, samples=53 iops : min= 3, max= 27, avg=13.15, stdev= 6.27, samples=53 lat (usec) : 50=1.95%, 100=10.29%, 250=1.04%, 500=0.52%, 1000=0.26% lat (msec) : 2=3.91%, 4=5.21%, 10=8.85%, 20=10.29%, 50=30.60% lat (msec) : 100=22.40%, 250=4.69% cpu : usr=0.07%, sys=5.36%, ctx=1356, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144812: Sat Sep 5 04:38:14 2026 read: IOPS=14, BW=233KiB/s (239kB/s)(6032KiB/25887msec) clat (usec): min=34, max=177984, avg=35569.33, stdev=32946.28 lat (usec): min=35, max=177986, avg=35574.45, stdev=32948.05 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 52], 10.00th=[ 61], 20.00th=[ 74], | 30.00th=[ 13042], 40.00th=[ 24511], 50.00th=[ 31851], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 58983], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[173016], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 62, max= 568, per=28.44%, avg=237.44, stdev=97.59, samples=50 iops : min= 3, max= 35, avg=14.12, stdev= 6.19, samples=50 write: IOPS=15, BW=242KiB/s (247kB/s)(6256KiB/25887msec); 0 zone resets clat (usec): min=1257, max=218732, avg=30701.35, stdev=35468.85 lat (usec): min=1259, max=218735, avg=30706.97, stdev=35466.22 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1614], 10.00th=[ 1909], 20.00th=[ 3458], | 30.00th=[ 5800], 40.00th=[ 8455], 50.00th=[ 14877], 60.00th=[ 26346], | 70.00th=[ 41157], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[156238], 99.50th=[206570], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 27, max= 476, per=27.52%, avg=241.90, stdev=99.84, samples=51 iops : min= 1, max= 29, avg=14.41, stdev= 6.32, samples=51 lat (usec) : 50=2.21%, 100=9.51%, 250=0.91%, 500=0.39% lat (msec) : 2=5.99%, 4=6.64%, 10=10.29%, 20=8.98%, 50=28.39% lat (msec) : 100=22.53%, 250=4.17% cpu : usr=0.08%, sys=5.68%, ctx=1384, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=836KiB/s (856kB/s), 200KiB/s-233KiB/s (205kB/s-239kB/s), io=23.4MiB (24.5MB), run=25887-28661msec WRITE: bw=879KiB/s (900kB/s), 223KiB/s-242KiB/s (229kB/s-247kB/s), io=24.6MiB (25.8MB), run=25887-28661msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144805: Sat Sep 5 04:38:54 2026 read: IOPS=5, BW=86.2KiB/s (88.3kB/s)(5920KiB/68674msec) clat (msec): min=5, max=280, avg=39.04, stdev=34.11 lat (msec): min=5, max=280, avg=39.04, stdev=34.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 85], 95.00th=[ 110], | 99.00th=[ 161], 99.50th=[ 190], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 28, max= 287, per=27.20%, avg=94.38, stdev=55.00, samples=124 iops : min= 1, max= 17, avg= 5.16, stdev= 3.58, samples=124 write: IOPS=5, BW=92.7KiB/s (94.0kB/s)(6368KiB/68674msec); 0 zone resets clat (msec): min=40, max=373, avg=135.18, stdev=57.54 lat (msec): min=40, max=373, avg=135.18, stdev=57.54 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 120], 60.00th=[ 134], | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 262], | 99.00th=[ 342], 99.50th=[ 359], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 28, max= 191, per=25.47%, avg=92.96, stdev=38.66, samples=135 iops : min= 1, max= 11, avg= 5.07, stdev= 2.49, samples=135 lat (msec) : 10=1.95%, 20=14.58%, 50=20.05%, 100=24.09%, 250=36.20% lat (msec) : 500=3.12% cpu : usr=0.04%, sys=1.26%, ctx=1274, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144806: Sat Sep 5 04:38:54 2026 read: IOPS=5, BW=83.4KiB/s (85.4kB/s)(5744KiB/68858msec) clat (msec): min=5, max=208, avg=37.40, stdev=35.97 lat (msec): min=5, max=208, avg=37.41, stdev=35.97 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 203], 99.50th=[ 207], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 28, max= 380, per=27.79%, avg=96.42, stdev=62.51, samples=117 iops : min= 1, max= 23, avg= 5.29, stdev= 3.90, samples=117 write: IOPS=5, BW=95.0KiB/s (97.3kB/s)(6544KiB/68858msec); 0 zone resets clat (msec): min=42, max=371, avg=134.92, stdev=58.60 lat (msec): min=42, max=371, avg=134.93, stdev=58.61 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 75], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 112], 50.00th=[ 121], 60.00th=[ 132], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 262], | 99.00th=[ 330], 99.50th=[ 347], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 28, max= 192, per=25.92%, avg=94.62, stdev=39.47, samples=136 iops : min= 1, max= 12, avg= 5.17, stdev= 2.58, samples=136 lat (msec) : 10=2.08%, 20=17.06%, 50=18.62%, 100=21.09%, 250=37.76% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.24%, ctx=1364, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144807: Sat Sep 5 04:38:54 2026 read: IOPS=5, BW=93.8KiB/s (96.0kB/s)(6256KiB/66705msec) clat (msec): min=6, max=212, avg=35.44, stdev=29.44 lat (msec): min=6, max=212, avg=35.44, stdev=29.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 74], 95.00th=[ 93], | 99.00th=[ 161], 99.50th=[ 182], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 30, max= 416, per=28.98%, avg=100.57, stdev=68.83, samples=123 iops : min= 1, max= 26, avg= 5.54, stdev= 4.40, samples=123 write: IOPS=5, BW=90.4KiB/s (92.6kB/s)(6032KiB/66705msec); 0 zone resets clat (msec): min=48, max=452, avg=139.98, stdev=63.00 lat (msec): min=48, max=452, avg=139.99, stdev=63.00 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 72], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 112], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 224], 95.00th=[ 266], | 99.00th=[ 376], 99.50th=[ 426], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 28, max= 160, per=25.03%, avg=91.38, stdev=35.92, samples=130 iops : min= 1, max= 10, avg= 4.97, stdev= 2.33, samples=130 lat (msec) : 10=2.86%, 20=14.97%, 50=22.53%, 100=22.01%, 250=34.77% lat (msec) : 500=2.86% cpu : usr=0.04%, sys=1.26%, ctx=1323, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144808: Sat Sep 5 04:38:54 2026 read: IOPS=5, BW=87.5KiB/s (89.6kB/s)(6032KiB/68915msec) clat (msec): min=7, max=227, avg=38.58, stdev=35.55 lat (msec): min=7, max=227, avg=38.58, stdev=35.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 117], | 99.00th=[ 186], 99.50th=[ 215], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 30, max= 287, per=29.22%, avg=101.38, stdev=62.59, samples=116 iops : min= 1, max= 17, avg= 5.60, stdev= 3.90, samples=116 write: IOPS=5, BW=90.8KiB/s (92.0kB/s)(6256KiB/68915msec); 0 zone resets clat (msec): min=43, max=370, avg=138.51, stdev=59.00 lat (msec): min=43, max=370, avg=138.51, stdev=59.00 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 102], 40.00th=[ 115], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 159], 80.00th=[ 182], 90.00th=[ 213], 95.00th=[ 247], | 99.00th=[ 359], 99.50th=[ 363], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 28, max= 191, per=24.96%, avg=91.12, stdev=38.41, samples=135 iops : min= 1, max= 11, avg= 4.95, stdev= 2.52, samples=135 lat (msec) : 10=1.17%, 20=15.10%, 50=22.66%, 100=21.74%, 250=37.11% lat (msec) : 500=2.21% cpu : usr=0.05%, sys=1.24%, ctx=1326, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=348KiB/s (356kB/s), 83.4KiB/s-93.8KiB/s (85.4kB/s-96.0kB/s), io=23.4MiB (24.5MB), run=66705-68915msec WRITE: bw=366KiB/s (374kB/s), 90.4KiB/s-95.0KiB/s (92.6kB/s-97.3kB/s), io=24.6MiB (25.8MB), run=66705-68915msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Sat Sep 5 04:39:12 2026 read: IOPS=1, BW=1189KiB/s (1218kB/s)(7168KiB/6028msec) clat (msec): min=104, max=286, avg=160.69, stdev=60.95 lat (msec): min=104, max=286, avg=160.69, stdev=60.95 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 113], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 144], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 171], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 2000, max= 4491, per=100.00%, avg=3459.00, stdev=1299.24, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=849KiB/s (870kB/s)(5120KiB/6028msec); 0 zone resets clat (msec): min=280, max=2655, avg=954.82, stdev=1007.47 lat (msec): min=280, max=2655, avg=955.13, stdev=1007.44 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 2000, max= 2035, per=50.46%, avg=2019.25, stdev=18.41, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=1.61%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Sat Sep 5 04:39:12 2026 read: IOPS=0, BW=286KiB/s (293kB/s)(2048KiB/7164msec) clat (msec): min=136, max=205, avg=170.84, stdev=49.27 lat (msec): min=136, max=205, avg=170.85, stdev=49.27 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 1523, max= 2000, per=61.63%, avg=1761.50, stdev=337.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1429KiB/s (1464kB/s)(10.0MiB/7164msec); 0 zone resets clat (msec): min=190, max=3529, avg=677.24, stdev=1011.35 lat (msec): min=190, max=3529, avg=677.69, stdev=1011.33 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 215], | 30.00th=[ 268], 40.00th=[ 288], 50.00th=[ 334], 60.00th=[ 401], | 70.00th=[ 426], 80.00th=[ 481], 90.00th=[ 642], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1523, max= 4087, per=55.85%, avg=2235.29, stdev=836.35, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.54%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144842: Sat Sep 5 04:39:12 2026 read: IOPS=0, BW=869KiB/s (889kB/s)(6144KiB/7074msec) clat (msec): min=89, max=826, avg=267.37, stdev=278.23 lat (msec): min=89, max=826, avg=267.37, stdev=278.23 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 199], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2043, max= 4071, per=100.00%, avg=3371.33, stdev=1150.92, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=869KiB/s (889kB/s)(6144KiB/7074msec); 0 zone resets clat (msec): min=262, max=2861, avg=899.41, stdev=989.43 lat (msec): min=262, max=2861, avg=899.52, stdev=989.43 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 451], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1943, max= 2043, per=50.27%, avg=2011.80, stdev=41.41, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.96%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144844: Sat Sep 5 04:39:12 2026 read: IOPS=0, BW=766KiB/s (785kB/s)(5120KiB/6681msec) clat (msec): min=69, max=650, avg=276.73, stdev=242.02 lat (msec): min=69, max=650, avg=276.73, stdev=242.02 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 4000, max= 4007, per=100.00%, avg=4003.50, stdev= 4.95, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1073KiB/s (1099kB/s)(7168KiB/6681msec); 0 zone resets clat (msec): min=251, max=2921, avg=743.33, stdev=967.86 lat (msec): min=251, max=2921, avg=743.44, stdev=967.88 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 296], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 625], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1992, max= 4071, per=74.91%, avg=2998.00, stdev=1134.89, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.62%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2859KiB/s (2927kB/s), 286KiB/s-1189KiB/s (293kB/s-1218kB/s), io=20.0MiB (20.0MB), run=6028-7164msec WRITE: bw=4002KiB/s (4098kB/s), 849KiB/s-1429KiB/s (870kB/s-1464kB/s), io=28.0MiB (29.4MB), run=6028-7164msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144838: Sat Sep 5 04:39:13 2026 read: IOPS=1, BW=1166KiB/s (1194kB/s)(7168KiB/6149msec) clat (usec): min=502, max=280654, avg=163366.63, stdev=95496.27 lat (usec): min=503, max=280655, avg=163369.61, stdev=95497.03 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[102237], | 30.00th=[122160], 40.00th=[122160], 50.00th=[187696], 60.00th=[208667], | 70.00th=[208667], 80.00th=[244319], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2043, max= 3976, per=100.00%, avg=2973.00, stdev=968.57, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=833KiB/s (853kB/s)(5120KiB/6149msec); 0 zone resets clat (msec): min=313, max=2514, avg=945.40, stdev=910.19 lat (msec): min=314, max=2514, avg=945.52, stdev=910.20 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1957, max= 2023, per=49.89%, avg=2000.50, stdev=30.26, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.03%, ctx=245, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144841: Sat Sep 5 04:39:13 2026 read: IOPS=0, BW=286KiB/s (293kB/s)(2048KiB/7150msec) clat (usec): min=519, max=2491.1k, avg=1245812.57, stdev=1761109.79 lat (usec): min=521, max=2491.1k, avg=1245814.39, stdev=1761110.72 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], | 20.00th=[ 519], 30.00th=[ 519], 40.00th=[ 519], | 50.00th=[ 519], 60.00th=[2499806], 70.00th=[2499806], | 80.00th=[2499806], 90.00th=[2499806], 95.00th=[2499806], | 99.00th=[2499806], 99.50th=[2499806], 99.90th=[2499806], | 99.95th=[2499806], 99.99th=[2499806] bw ( KiB/s): min= 2019, max= 2035, per=70.78%, avg=2027.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1432KiB/s (1467kB/s)(10.0MiB/7150msec); 0 zone resets clat (msec): min=155, max=1616, avg=457.45, stdev=448.77 lat (msec): min=156, max=1616, avg=457.59, stdev=448.76 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 211], | 30.00th=[ 220], 40.00th=[ 222], 50.00th=[ 284], 60.00th=[ 288], | 70.00th=[ 342], 80.00th=[ 414], 90.00th=[ 818], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 1914, max= 4039, per=79.15%, avg=3174.00, stdev=1110.71, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.13%, ctx=599, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144843: Sat Sep 5 04:39:13 2026 read: IOPS=1, BW=1145KiB/s (1172kB/s)(6144KiB/5366msec) clat (usec): min=387, max=506174, avg=162968.05, stdev=211028.57 lat (usec): min=387, max=506176, avg=162969.34, stdev=211028.74 clat percentiles (usec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 734], 50.00th=[ 734], 60.00th=[147850], | 70.00th=[320865], 80.00th=[320865], 90.00th=[505414], 95.00th=[505414], | 99.00th=[505414], 99.50th=[505414], 99.90th=[505414], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 1957, max= 3976, per=100.00%, avg=3287.67, stdev=1152.62, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1145KiB/s (1172kB/s)(6144KiB/5366msec); 0 zone resets clat (msec): min=110, max=2825, avg=679.01, stdev=1054.49 lat (msec): min=111, max=2826, avg=679.14, stdev=1054.48 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 313], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1957, max= 3976, per=62.09%, avg=2489.75, stdev=991.22, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.87%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144845: Sat Sep 5 04:39:13 2026 read: IOPS=0, BW=832KiB/s (852kB/s)(5120KiB/6154msec) clat (usec): min=761, max=201892, avg=106950.56, stdev=100390.33 lat (usec): min=763, max=201894, avg=106951.96, stdev=100390.36 clat percentiles (usec): | 1.00th=[ 758], 5.00th=[ 758], 10.00th=[ 758], 20.00th=[ 758], | 30.00th=[ 1745], 40.00th=[ 1745], 50.00th=[132645], 60.00th=[132645], | 70.00th=[198181], 80.00th=[198181], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 3915, max= 3930, per=100.00%, avg=3922.50, stdev=10.61, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1165KiB/s (1193kB/s)(7168KiB/6154msec); 0 zone resets clat (msec): min=118, max=3259, avg=750.53, stdev=1115.35 lat (msec): min=119, max=3259, avg=750.74, stdev=1115.29 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 224], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 359], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 542], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1965, max= 4047, per=62.46%, avg=2504.75, stdev=1028.40, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.70%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2864KiB/s (2933kB/s), 286KiB/s-1166KiB/s (293kB/s-1194kB/s), io=20.0MiB (20.0MB), run=5366-7150msec WRITE: bw=4010KiB/s (4106kB/s), 833KiB/s-1432KiB/s (853kB/s-1467kB/s), io=28.0MiB (29.4MB), run=5366-7150msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144853: Sat Sep 5 04:39:28 2026 read: IOPS=1, BW=4467KiB/s (4574kB/s)(12.0MiB/2751msec) clat (msec): min=801, max=942, avg=868.63, stdev=70.89 lat (msec): min=801, max=942, avg=868.64, stdev=70.89 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=10.84%, ctx=280, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144854: Sat Sep 5 04:39:28 2026 read: IOPS=0, BW=1228KiB/s (1257kB/s)(4096KiB/3336msec) clat (nsec): min=813983k, max=813983k, avg=813983074.00, stdev= 0.00 lat (nsec): min=813986k, max=813986k, avg=813985586.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2456KiB/s (2515kB/s)(8192KiB/3336msec); 0 zone resets clat (msec): min=425, max=1685, avg=1055.63, stdev=890.82 lat (msec): min=426, max=1686, avg=1056.40, stdev=891.32 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 1687], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8047, max= 8047, per=85.05%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=7.17%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144855: Sat Sep 5 04:39:28 2026 write: IOPS=0, BW=3548KiB/s (3634kB/s)(12.0MiB/3463msec); 0 zone resets clat (msec): min=884, max=1439, avg=1134.34, stdev=281.35 lat (msec): min=885, max=1439, avg=1135.30, stdev=281.18 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8094, max= 8175, per=85.97%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.06%, sys=4.13%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144857: Sat Sep 5 04:39:28 2026 write: IOPS=1, BW=4357KiB/s (4462kB/s)(12.0MiB/2820msec); 0 zone resets clat (msec): min=534, max=1192, avg=862.52, stdev=329.11 lat (msec): min=534, max=1194, avg=864.44, stdev=329.93 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8000, max= 8047, per=84.80%, avg=8023.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=6.31%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4911KiB/s (5029kB/s), 1228KiB/s-4467KiB/s (1257kB/s-4574kB/s), io=16.0MiB (16.8MB), run=2751-3336msec WRITE: bw=9462KiB/s (9689kB/s), 2456KiB/s-4357KiB/s (2515kB/s-4462kB/s), io=32.0MiB (33.6MB), run=2820-3463msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144856: Sat Sep 5 04:39:29 2026 read: IOPS=0, BW=3381KiB/s (3463kB/s)(12.0MiB/3634msec) clat (msec): min=506, max=1762, avg=1193.32, stdev=635.99 lat (msec): min=506, max=1762, avg=1193.32, stdev=635.99 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7922, max= 8143, per=100.00%, avg=8032.50, stdev=156.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.31%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144858: Sat Sep 5 04:39:29 2026 read: IOPS=0, BW=1060KiB/s (1085kB/s)(4096KiB/3864msec) clat (nsec): min=1714.9M, max=1714.9M, avg=1714947628.00, stdev= 0.00 lat (nsec): min=1714.9M, max=1714.9M, avg=1714949016.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2120KiB/s (2171kB/s)(8192KiB/3864msec); 0 zone resets clat (msec): min=740, max=1152, avg=946.32, stdev=291.47 lat (msec): min=740, max=1152, avg=946.65, stdev=291.63 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8143, max= 8143, per=97.99%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.16%, ctx=95, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144859: Sat Sep 5 04:39:29 2026 write: IOPS=0, BW=3116KiB/s (3191kB/s)(12.0MiB/3943msec); 0 zone resets clat (msec): min=489, max=1686, avg=1282.58, stdev=687.20 lat (msec): min=489, max=1687, avg=1283.04, stdev=687.25 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8143, max= 8159, per=98.09%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.18%, ctx=39, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144860: Sat Sep 5 04:39:29 2026 write: IOPS=1, BW=5285KiB/s (5412kB/s)(12.0MiB/2325msec); 0 zone resets clat (msec): min=338, max=1534, avg=751.11, stdev=679.12 lat (msec): min=339, max=1535, avg=751.69, stdev=679.33 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8094, max= 8192, per=97.99%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.96%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4240KiB/s (4342kB/s), 1060KiB/s-3381KiB/s (1085kB/s-3463kB/s), io=16.0MiB (16.8MB), run=3634-3864msec WRITE: bw=8310KiB/s (8510kB/s), 2120KiB/s-5285KiB/s (2171kB/s-5412kB/s), io=32.0MiB (33.6MB), run=2325-3943msec