== sanity test 398b: DIO and buffer IO race ============== 12:41:28 (1782232888) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.46103 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144769: Tue Jun 23 12:44:29 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(5992KiB/159212msec) clat (usec): min=35, max=997941, avg=53373.47, stdev=44924.78 lat (usec): min=36, max=997942, avg=53375.49, stdev=44924.88 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 76], 10.00th=[ 13960], 20.00th=[ 26608], | 30.00th=[ 32637], 40.00th=[ 39584], 50.00th=[ 46400], 60.00th=[ 54264], | 70.00th=[ 64226], 80.00th=[ 76022], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[181404], 99.50th=[210764], 99.90th=[413139], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 5, max= 87, per=25.34%, avg=37.50, stdev=17.48, samples=310 iops : min= 1, max= 21, avg= 8.72, stdev= 4.42, samples=310 write: IOPS=9, BW=39.5KiB/s (40.5kB/s)(6296KiB/159212msec); 0 zone resets clat (usec): min=1203, max=661809, avg=49956.21, stdev=50534.36 lat (usec): min=1204, max=661812, avg=49960.05, stdev=50534.60 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1680], 10.00th=[ 2999], 20.00th=[ 7046], | 30.00th=[ 13698], 40.00th=[ 26608], 50.00th=[ 38536], 60.00th=[ 50070], | 70.00th=[ 64226], 80.00th=[ 82314], 90.00th=[113771], 95.00th=[143655], | 99.00th=[206570], 99.50th=[278922], 99.90th=[387974], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 95, per=25.64%, avg=39.75, stdev=18.29, samples=307 iops : min= 1, max= 23, avg= 9.29, stdev= 4.61, samples=307 lat (usec) : 50=0.07%, 100=3.19%, 250=0.55%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=3.68%, 4=3.12%, 10=6.58%, 20=6.80%, 50=33.11% lat (msec) : 100=30.89%, 250=11.20%, 500=0.42%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=4.51%, ctx=6895, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144771: Tue Jun 23 12:44:29 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(5940KiB/160163msec) clat (usec): min=27, max=661016, avg=53514.07, stdev=39224.19 lat (usec): min=27, max=661017, avg=53521.38, stdev=39227.82 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 77], 10.00th=[ 17433], 20.00th=[ 26346], | 30.00th=[ 32637], 40.00th=[ 40109], 50.00th=[ 46924], 60.00th=[ 55313], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[113771], | 99.00th=[170918], 99.50th=[229639], 99.90th=[291505], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 5, max= 95, per=25.17%, avg=37.25, stdev=16.79, samples=309 iops : min= 1, max= 23, avg= 8.66, stdev= 4.24, samples=309 write: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6348KiB/160163msec); 0 zone resets clat (usec): min=1161, max=964221, avg=50449.81, stdev=58295.66 lat (usec): min=1195, max=964223, avg=50454.66, stdev=58296.37 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1614], 10.00th=[ 2868], 20.00th=[ 6652], | 30.00th=[ 13435], 40.00th=[ 25035], 50.00th=[ 36439], 60.00th=[ 50594], | 70.00th=[ 65274], 80.00th=[ 83362], 90.00th=[110625], 95.00th=[143655], | 99.00th=[229639], 99.50th=[295699], 99.90th=[884999], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 112, per=25.56%, avg=39.62, stdev=18.41, samples=311 iops : min= 1, max= 28, avg= 9.26, stdev= 4.65, samples=311 lat (usec) : 50=0.20%, 100=2.80%, 250=0.36% lat (msec) : 2=3.91%, 4=2.51%, 10=7.55%, 20=7.03%, 50=32.49% lat (msec) : 100=32.03%, 250=10.58%, 500=0.46%, 750=0.03%, 1000=0.07% cpu : usr=0.08%, sys=4.59%, ctx=6895, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144774: Tue Jun 23 12:44:29 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6028KiB/159793msec) clat (usec): min=30, max=974020, avg=52725.82, stdev=43997.13 lat (usec): min=31, max=974021, avg=52729.90, stdev=43995.94 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 13829], 20.00th=[ 25297], | 30.00th=[ 32375], 40.00th=[ 39060], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 95945], 95.00th=[114820], | 99.00th=[196084], 99.50th=[219153], 99.90th=[320865], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 5, max= 103, per=25.46%, avg=37.69, stdev=18.43, samples=310 iops : min= 1, max= 25, avg= 8.76, stdev= 4.63, samples=310 write: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6260KiB/159793msec); 0 zone resets clat (usec): min=1267, max=929734, avg=50959.24, stdev=55245.16 lat (usec): min=1268, max=929736, avg=50963.88, stdev=55246.25 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1582], 10.00th=[ 2704], 20.00th=[ 6456], | 30.00th=[ 13042], 40.00th=[ 23725], 50.00th=[ 36439], 60.00th=[ 50070], | 70.00th=[ 67634], 80.00th=[ 87557], 90.00th=[117965], 95.00th=[152044], | 99.00th=[227541], 99.50th=[254804], 99.90th=[354419], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 111, per=25.15%, avg=38.98, stdev=17.88, samples=311 iops : min= 1, max= 27, avg= 9.09, stdev= 4.50, samples=311 lat (usec) : 50=0.23%, 100=3.45%, 250=0.46%, 500=0.10%, 1000=0.03% lat (msec) : 2=4.04%, 4=3.06%, 10=6.51%, 20=7.98%, 50=32.32% lat (msec) : 100=30.24%, 250=11.17%, 500=0.36%, 1000=0.07% cpu : usr=0.07%, sys=4.59%, ctx=6983, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144775: Tue Jun 23 12:44:29 2026 read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(6052KiB/161828msec) clat (usec): min=30, max=768069, avg=53551.77, stdev=43972.88 lat (usec): min=31, max=768070, avg=53556.38, stdev=43976.10 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 15533], 20.00th=[ 25560], | 30.00th=[ 31851], 40.00th=[ 38536], 50.00th=[ 45876], 60.00th=[ 54264], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[100140], 95.00th=[119014], | 99.00th=[181404], 99.50th=[231736], 99.90th=[608175], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 94, per=25.54%, avg=37.81, stdev=17.73, samples=310 iops : min= 1, max= 23, avg= 8.79, stdev= 4.49, samples=310 write: IOPS=9, BW=38.5KiB/s (39.5kB/s)(6236KiB/161828msec); 0 zone resets clat (usec): min=1043, max=902907, avg=51406.60, stdev=56804.95 lat (usec): min=1045, max=902911, avg=51418.41, stdev=56805.87 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1582], 10.00th=[ 2606], 20.00th=[ 6783], | 30.00th=[ 12649], 40.00th=[ 24249], 50.00th=[ 37487], 60.00th=[ 50594], | 70.00th=[ 65274], 80.00th=[ 87557], 90.00th=[122160], 95.00th=[149947], | 99.00th=[219153], 99.50th=[238027], 99.90th=[666895], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 104, per=24.78%, avg=38.41, stdev=17.54, samples=314 iops : min= 1, max= 26, avg= 8.95, stdev= 4.43, samples=314 lat (usec) : 50=0.29%, 100=3.03%, 250=0.36%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=4.04%, 4=3.12%, 10=6.18%, 20=7.91%, 50=31.80% lat (msec) : 100=30.11%, 250=12.40%, 500=0.23%, 750=0.10%, 1000=0.07% cpu : usr=0.07%, sys=4.47%, ctx=6928, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=148KiB/s (152kB/s), 37.1KiB/s-37.7KiB/s (37.0kB/s-38.6kB/s), io=23.4MiB (24.6MB), run=159212-161828msec WRITE: bw=155KiB/s (159kB/s), 38.5KiB/s-39.6KiB/s (39.5kB/s-40.6kB/s), io=24.6MiB (25.7MB), run=159212-161828msec fio: pid=144773, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=144768: Tue Jun 23 12:46:46 2026 read: IOPS=5, BW=20.2KiB/s (20.6kB/s)(5992KiB/297310msec) clat (msec): min=7, max=1033, avg=43.85, stdev=54.09 lat (msec): min=7, max=1033, avg=43.86, stdev=54.09 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 89], 95.00th=[ 124], | 99.00th=[ 255], 99.50th=[ 321], 99.90th=[ 684], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 103, per=31.48%, avg=22.98, stdev=15.58, samples=500 iops : min= 1, max= 25, avg= 5.09, stdev= 3.92, samples=500 write: IOPS=5, BW=21.2KiB/s (21.7kB/s)(6296KiB/297310msec); 0 zone resets clat (msec): min=44, max=972, avg=146.80, stdev=82.23 lat (msec): min=44, max=972, avg=146.81, stdev=82.24 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 165], 80.00th=[ 201], 90.00th=[ 255], 95.00th=[ 317], | 99.00th=[ 414], 99.50th=[ 477], 99.90th=[ 768], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 48, per=27.37%, avg=21.08, stdev=10.81, samples=571 iops : min= 1, max= 12, avg= 4.60, stdev= 2.75, samples=571 lat (msec) : 10=1.17%, 20=14.16%, 50=21.65%, 100=25.07%, 250=31.97% lat (msec) : 500=5.79%, 750=0.10%, 1000=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.41%, ctx=5647, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144770: Tue Jun 23 12:46:46 2026 read: IOPS=4, BW=19.9KiB/s (20.4kB/s)(5940KiB/298406msec) clat (msec): min=5, max=953, avg=42.52, stdev=49.38 lat (msec): min=5, max=953, avg=42.53, stdev=49.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 93], 95.00th=[ 129], | 99.00th=[ 232], 99.50th=[ 249], 99.90th=[ 472], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 102, per=32.31%, avg=23.59, stdev=16.05, samples=484 iops : min= 1, max= 25, avg= 5.24, stdev= 4.04, samples=484 write: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6348KiB/298406msec); 0 zone resets clat (msec): min=37, max=895, avg=147.94, stdev=83.34 lat (msec): min=37, max=895, avg=147.94, stdev=83.34 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 199], 90.00th=[ 264], 95.00th=[ 305], | 99.00th=[ 443], 99.50th=[ 506], 99.90th=[ 659], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 48, per=27.44%, avg=21.13, stdev=10.65, samples=575 iops : min= 1, max= 12, avg= 4.61, stdev= 2.73, samples=575 lat (msec) : 10=1.56%, 20=14.71%, 50=21.03%, 100=23.83%, 250=32.55% lat (msec) : 500=6.02%, 750=0.23%, 1000=0.07% cpu : usr=0.05%, sys=1.35%, ctx=5696, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144772: Tue Jun 23 12:46:46 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6028KiB/296744msec) clat (msec): min=6, max=513, avg=43.10, stdev=41.54 lat (msec): min=6, max=513, avg=43.11, stdev=41.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 97], 95.00th=[ 123], | 99.00th=[ 194], 99.50th=[ 239], 99.90th=[ 405], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 6, max= 103, per=31.57%, avg=23.05, stdev=15.70, samples=503 iops : min= 1, max= 25, avg= 5.10, stdev= 3.96, samples=503 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6260KiB/296744msec); 0 zone resets clat (msec): min=42, max=1069, avg=147.77, stdev=84.85 lat (msec): min=42, max=1069, avg=147.77, stdev=84.85 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 163], 80.00th=[ 207], 90.00th=[ 257], 95.00th=[ 296], | 99.00th=[ 430], 99.50th=[ 510], 99.90th=[ 776], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 48, per=27.46%, avg=21.14, stdev=10.83, samples=567 iops : min= 1, max= 12, avg= 4.62, stdev= 2.77, samples=567 lat (msec) : 10=1.79%, 20=13.31%, 50=21.16%, 100=25.23%, 250=32.52% lat (msec) : 500=5.66%, 750=0.26%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.36%, ctx=5677, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144773: Tue Jun 23 12:46:46 2026 read: IOPS=4, BW=17.4KiB/s (17.8kB/s)(3980KiB/228946msec) clat (msec): min=5, max=480, avg=50.37, stdev=54.69 lat (msec): min=5, max=480, avg=50.37, stdev=54.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 72], 90.00th=[ 112], 95.00th=[ 150], | 99.00th=[ 313], 99.50th=[ 351], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 79, per=29.67%, avg=21.66, stdev=15.12, samples=352 iops : min= 1, max= 19, avg= 4.73, stdev= 3.80, samples=352 write: IOPS=4, BW=17.0KiB/s (18.4kB/s)(4120KiB/228946msec); 0 zone resets clat (msec): min=51, max=1070, avg=172.99, stdev=99.65 lat (msec): min=51, max=1070, avg=173.00, stdev=99.65 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 128], 50.00th=[ 146], 60.00th=[ 171], | 70.00th=[ 205], 80.00th=[ 234], 90.00th=[ 292], 95.00th=[ 351], | 99.00th=[ 502], 99.50th=[ 567], 99.90th=[ 986], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 6, max= 48, per=23.43%, avg=18.04, stdev= 9.65, samples=433 iops : min= 1, max= 12, avg= 3.82, stdev= 2.45, samples=433 lat (msec) : 10=1.28%, 20=12.93%, 50=20.58%, 100=19.74%, 250=36.28% lat (msec) : 500=8.59%, 750=0.44%, 1000=0.05%, 2000=0.05% cpu : usr=0.03%, sys=1.14%, ctx=3360, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=996,1030,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=73.5KiB/s (75.3kB/s), 17.4KiB/s-20.3KiB/s (17.8kB/s-20.8kB/s), io=21.4MiB (22.5MB), run=228946-298406msec WRITE: bw=77.2KiB/s (79.0kB/s), 17.0KiB/s-21.3KiB/s (18.4kB/s-21.8kB/s), io=22.5MiB (23.6MB), run=228946-298406msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144841: Tue Jun 23 12:47:38 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(5920KiB/36801msec) clat (usec): min=35, max=224980, avg=50169.50, stdev=37100.14 lat (usec): min=35, max=224982, avg=50171.14, stdev=37100.14 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 65], 10.00th=[ 82], 20.00th=[ 13960], | 30.00th=[ 32637], 40.00th=[ 41157], 50.00th=[ 47973], 60.00th=[ 53740], | 70.00th=[ 65274], 80.00th=[ 78119], 90.00th=[ 98042], 95.00th=[120062], | 99.00th=[156238], 99.50th=[164627], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 30, max= 319, per=26.22%, avg=160.49, stdev=70.34, samples=72 iops : min= 1, max= 19, avg= 9.19, stdev= 4.43, samples=72 write: IOPS=10, BW=173KiB/s (177kB/s)(6368KiB/36801msec); 0 zone resets clat (usec): min=1818, max=323123, avg=44591.80, stdev=45242.54 lat (usec): min=1821, max=323126, avg=44598.58, stdev=45239.64 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2278], 10.00th=[ 4293], 20.00th=[ 8029], | 30.00th=[ 11469], 40.00th=[ 18482], 50.00th=[ 26870], 60.00th=[ 40633], | 70.00th=[ 57934], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[130548], | 99.00th=[173016], 99.50th=[274727], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 60, max= 381, per=27.23%, avg=175.35, stdev=78.06, samples=71 iops : min= 3, max= 23, avg=10.13, stdev= 4.90, samples=71 lat (usec) : 50=0.91%, 100=5.73%, 250=1.56%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.69%, 4=3.65%, 10=9.11%, 20=8.46%, 50=28.39% lat (msec) : 100=29.04%, 250=10.68%, 500=0.26% cpu : usr=0.08%, sys=5.05%, ctx=1639, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144842: Tue Jun 23 12:47:38 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(5744KiB/39079msec) clat (usec): min=40, max=203819, avg=53021.31, stdev=37953.95 lat (usec): min=40, max=203822, avg=53023.60, stdev=37953.15 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 79], 20.00th=[ 21103], | 30.00th=[ 35390], 40.00th=[ 41681], 50.00th=[ 48497], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 84411], 90.00th=[103285], 95.00th=[122160], | 99.00th=[166724], 99.50th=[181404], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 383, per=25.64%, avg=156.89, stdev=67.02, samples=72 iops : min= 1, max= 23, avg= 8.96, stdev= 4.23, samples=72 write: IOPS=10, BW=167KiB/s (171kB/s)(6544KiB/39080msec); 0 zone resets clat (usec): min=1600, max=480143, avg=48053.59, stdev=54887.90 lat (usec): min=1601, max=480146, avg=48057.77, stdev=54887.03 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2212], 10.00th=[ 3851], 20.00th=[ 7111], | 30.00th=[ 11338], 40.00th=[ 17957], 50.00th=[ 30278], 60.00th=[ 45351], | 70.00th=[ 60556], 80.00th=[ 81265], 90.00th=[108528], 95.00th=[147850], | 99.00th=[283116], 99.50th=[308282], 99.90th=[480248], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 30, max= 469, per=25.92%, avg=166.91, stdev=84.12, samples=77 iops : min= 1, max= 29, avg= 9.58, stdev= 5.32, samples=77 lat (usec) : 50=0.39%, 100=4.95%, 250=1.82%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.82%, 4=3.91%, 10=8.72%, 20=9.64%, 50=25.78% lat (msec) : 100=29.95%, 250=12.11%, 500=0.65% cpu : usr=0.06%, sys=4.91%, ctx=1716, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144843: Tue Jun 23 12:47:38 2026 read: IOPS=10, BW=174KiB/s (179kB/s)(6256KiB/35872msec) clat (usec): min=37, max=205248, avg=50330.47, stdev=35527.92 lat (usec): min=38, max=205249, avg=50333.89, stdev=35525.75 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 73], 20.00th=[ 22414], | 30.00th=[ 32900], 40.00th=[ 40633], 50.00th=[ 47973], 60.00th=[ 54789], | 70.00th=[ 64226], 80.00th=[ 79168], 90.00th=[ 96994], 95.00th=[109577], | 99.00th=[149947], 99.50th=[177210], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 383, per=29.06%, avg=177.87, stdev=71.31, samples=69 iops : min= 1, max= 23, avg=10.30, stdev= 4.51, samples=69 write: IOPS=10, BW=168KiB/s (172kB/s)(6032KiB/35872msec); 0 zone resets clat (usec): min=1550, max=278505, avg=41866.24, stdev=45780.16 lat (usec): min=1552, max=278508, avg=41869.41, stdev=45779.96 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2089], 10.00th=[ 3458], 20.00th=[ 6915], | 30.00th=[ 10290], 40.00th=[ 14877], 50.00th=[ 25035], 60.00th=[ 36963], | 70.00th=[ 52167], 80.00th=[ 72877], 90.00th=[106431], 95.00th=[130548], | 99.00th=[219153], 99.50th=[227541], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 315, per=25.83%, avg=166.31, stdev=70.53, samples=70 iops : min= 1, max= 19, avg= 9.56, stdev= 4.45, samples=70 lat (usec) : 50=0.78%, 100=6.12%, 250=0.52%, 500=0.52%, 1000=0.13% lat (msec) : 2=2.08%, 4=4.69%, 10=8.33%, 20=8.59%, 50=29.43% lat (msec) : 100=29.17%, 250=9.51%, 500=0.13% cpu : usr=0.09%, sys=5.13%, ctx=1592, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144844: Tue Jun 23 12:47:38 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37964msec) clat (usec): min=37, max=261207, avg=56474.75, stdev=43826.01 lat (usec): min=37, max=261208, avg=56479.94, stdev=43825.76 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 22414], | 30.00th=[ 36439], 40.00th=[ 44827], 50.00th=[ 51643], 60.00th=[ 61080], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[105382], 95.00th=[131597], | 99.00th=[227541], 99.50th=[250610], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 316, per=25.68%, avg=157.19, stdev=65.61, samples=74 iops : min= 1, max= 19, avg= 8.99, stdev= 4.16, samples=74 write: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37964msec); 0 zone resets clat (usec): min=1724, max=346460, avg=42366.14, stdev=45555.84 lat (usec): min=1725, max=346463, avg=42370.16, stdev=45555.82 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 1975], 10.00th=[ 2966], 20.00th=[ 6718], | 30.00th=[ 10421], 40.00th=[ 16450], 50.00th=[ 26346], 60.00th=[ 41681], | 70.00th=[ 54789], 80.00th=[ 74974], 90.00th=[ 98042], 95.00th=[126354], | 99.00th=[221250], 99.50th=[263193], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 441, per=25.50%, avg=164.22, stdev=74.77, samples=74 iops : min= 1, max= 27, avg= 9.43, stdev= 4.71, samples=74 lat (usec) : 50=0.78%, 100=6.38%, 250=0.91%, 500=0.52%, 750=0.26% lat (msec) : 2=2.60%, 4=3.91%, 10=8.46%, 20=7.42%, 50=26.69% lat (msec) : 100=31.25%, 250=10.29%, 500=0.52% cpu : usr=0.07%, sys=4.84%, ctx=1545, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=613KiB/s (628kB/s), 147KiB/s-174KiB/s (151kB/s-179kB/s), io=23.4MiB (24.5MB), run=35872-39079msec WRITE: bw=645KiB/s (660kB/s), 165KiB/s-173KiB/s (169kB/s-177kB/s), io=24.6MiB (25.8MB), run=35872-39080msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Tue Jun 23 12:48:19 2026 read: IOPS=4, BW=74.3KiB/s (76.1kB/s)(5920KiB/79709msec) clat (msec): min=9, max=355, avg=47.82, stdev=45.04 lat (msec): min=9, max=355, avg=47.82, stdev=45.04 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 64], 90.00th=[ 96], 95.00th=[ 136], | 99.00th=[ 243], 99.50th=[ 313], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 320, per=29.34%, avg=86.55, stdev=56.35, samples=134 iops : min= 1, max= 20, avg= 4.63, stdev= 3.58, samples=134 write: IOPS=4, BW=79.9KiB/s (81.8kB/s)(6368KiB/79709msec); 0 zone resets clat (msec): min=40, max=513, avg=155.08, stdev=78.36 lat (msec): min=40, max=513, avg=155.08, stdev=78.36 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 174], 80.00th=[ 218], 90.00th=[ 268], 95.00th=[ 309], | 99.00th=[ 430], 99.50th=[ 477], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 30, max= 160, per=26.04%, avg=80.99, stdev=38.81, samples=154 iops : min= 1, max= 10, avg= 4.27, stdev= 2.47, samples=154 lat (msec) : 10=0.26%, 20=9.51%, 50=24.48%, 100=23.18%, 250=35.16% lat (msec) : 500=7.29%, 750=0.13% cpu : usr=0.03%, sys=1.44%, ctx=1399, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144838: Tue Jun 23 12:48:19 2026 read: IOPS=4, BW=70.0KiB/s (72.7kB/s)(5744KiB/80938msec) clat (msec): min=8, max=288, avg=48.18, stdev=47.95 lat (msec): min=8, max=288, avg=48.18, stdev=47.95 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 103], 95.00th=[ 163], | 99.00th=[ 241], 99.50th=[ 279], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 351, per=28.84%, avg=85.07, stdev=59.51, samples=133 iops : min= 1, max= 21, avg= 4.53, stdev= 3.77, samples=133 write: IOPS=5, BW=80.9KiB/s (82.8kB/s)(6544KiB/80938msec); 0 zone resets clat (msec): min=44, max=527, avg=154.84, stdev=75.22 lat (msec): min=44, max=527, avg=154.85, stdev=75.22 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 72], 10.00th=[ 81], 20.00th=[ 96], | 30.00th=[ 108], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 157], | 70.00th=[ 180], 80.00th=[ 205], 90.00th=[ 257], 95.00th=[ 296], | 99.00th=[ 388], 99.50th=[ 489], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 30, max= 192, per=26.34%, avg=81.92, stdev=39.16, samples=157 iops : min= 1, max= 12, avg= 4.34, stdev= 2.54, samples=157 lat (msec) : 10=0.65%, 20=8.85%, 50=24.74%, 100=20.18%, 250=39.06% lat (msec) : 500=6.25%, 750=0.26% cpu : usr=0.05%, sys=1.33%, ctx=1354, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Tue Jun 23 12:48:19 2026 read: IOPS=5, BW=80.5KiB/s (82.4kB/s)(6256KiB/77727msec) clat (msec): min=8, max=338, avg=48.89, stdev=49.13 lat (msec): min=8, max=338, avg=48.89, stdev=49.13 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 103], 95.00th=[ 167], | 99.00th=[ 255], 99.50th=[ 284], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 29, max= 288, per=30.52%, avg=90.03, stdev=63.37, samples=137 iops : min= 1, max= 18, avg= 4.84, stdev= 4.02, samples=137 write: IOPS=4, BW=77.6KiB/s (79.5kB/s)(6032KiB/77727msec); 0 zone resets clat (msec): min=58, max=474, avg=155.09, stdev=70.36 lat (msec): min=58, max=474, avg=155.09, stdev=70.36 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 74], 10.00th=[ 84], 20.00th=[ 97], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 178], 80.00th=[ 209], 90.00th=[ 253], 95.00th=[ 296], | 99.00th=[ 384], 99.50th=[ 447], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 160, per=25.41%, avg=79.02, stdev=34.19, samples=149 iops : min= 1, max= 10, avg= 4.13, stdev= 2.19, samples=149 lat (msec) : 10=0.65%, 20=8.72%, 50=28.52%, 100=18.88%, 250=37.63% lat (msec) : 500=5.60% cpu : usr=0.04%, sys=1.43%, ctx=1305, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Tue Jun 23 12:48:19 2026 read: IOPS=4, BW=76.9KiB/s (78.7kB/s)(6032KiB/78454msec) clat (msec): min=10, max=348, avg=51.89, stdev=52.61 lat (msec): min=10, max=348, avg=51.90, stdev=52.60 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 106], 95.00th=[ 161], | 99.00th=[ 296], 99.50th=[ 347], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 286, per=30.86%, avg=91.02, stdev=58.64, samples=130 iops : min= 1, max= 17, avg= 4.89, stdev= 3.70, samples=130 write: IOPS=4, BW=79.7KiB/s (81.7kB/s)(6256KiB/78454msec); 0 zone resets clat (msec): min=55, max=418, avg=149.68, stdev=67.19 lat (msec): min=55, max=418, avg=149.69, stdev=67.19 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 94], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 134], 60.00th=[ 148], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 288], | 99.00th=[ 355], 99.50th=[ 384], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 160, per=26.41%, avg=82.13, stdev=38.24, samples=150 iops : min= 1, max= 10, avg= 4.34, stdev= 2.47, samples=150 lat (msec) : 20=8.33%, 50=26.04%, 100=22.79%, 250=37.63%, 500=5.21% cpu : usr=0.05%, sys=1.40%, ctx=1318, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=296KiB/s (303kB/s), 70.0KiB/s-80.5KiB/s (72.7kB/s-82.4kB/s), io=23.4MiB (24.5MB), run=77727-80938msec WRITE: bw=311KiB/s (319kB/s), 77.6KiB/s-80.9KiB/s (79.5kB/s-82.8kB/s), io=24.6MiB (25.8MB), run=77727-80938msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144863: Tue Jun 23 12:48:37 2026 read: IOPS=1, BW=1688KiB/s (1729kB/s)(7168KiB/4246msec) clat (msec): min=206, max=455, avg=295.88, stdev=91.08 lat (msec): min=206, max=455, avg=295.88, stdev=91.08 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 222], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 284], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 376], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1988, max= 4047, per=61.44%, avg=2425.80, stdev=906.53, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1206KiB/s (1235kB/s)(5120KiB/4246msec); 0 zone resets clat (msec): min=293, max=522, avg=407.47, stdev=102.05 lat (msec): min=293, max=522, avg=407.58, stdev=102.05 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1988, max= 2048, per=36.54%, avg=2019.40, stdev=24.79, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=11.12%, ctx=245, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144864: Tue Jun 23 12:48:37 2026 read: IOPS=0, BW=395KiB/s (404kB/s)(2048KiB/5187msec) clat (usec): min=631, max=149087, avg=74859.44, stdev=104974.36 lat (usec): min=632, max=149090, avg=74861.40, stdev=104975.12 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[ 635], 50.00th=[ 635], 60.00th=[149947], | 70.00th=[149947], 80.00th=[149947], 90.00th=[149947], 95.00th=[149947], | 99.00th=[149947], 99.50th=[149947], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 1376, max= 2048, per=43.36%, avg=1712.00, stdev=475.18, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1974KiB/s (2022kB/s)(10.0MiB/5187msec); 0 zone resets clat (msec): min=156, max=963, avg=499.12, stdev=268.63 lat (msec): min=156, max=963, avg=499.96, stdev=269.04 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 259], | 30.00th=[ 338], 40.00th=[ 372], 50.00th=[ 409], 60.00th=[ 435], | 70.00th=[ 447], 80.00th=[ 735], 90.00th=[ 877], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2000, max= 4096, per=47.28%, avg=2613.14, stdev=1010.02, samples=7 iops : min= 1, max= 4, avg= 1.86, stdev= 1.21, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.04%, sys=9.54%, ctx=130, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144865: Tue Jun 23 12:48:37 2026 read: IOPS=1, BW=1463KiB/s (1498kB/s)(6144KiB/4200msec) clat (usec): min=458, max=606825, avg=224338.70, stdev=247509.79 lat (usec): min=460, max=606827, avg=224340.23, stdev=247509.78 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 4817], | 30.00th=[ 4817], 40.00th=[ 47449], 50.00th=[ 47449], 60.00th=[312476], | 70.00th=[375391], 80.00th=[375391], 90.00th=[608175], 95.00th=[608175], | 99.00th=[608175], 99.50th=[608175], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 2000, max= 4055, per=64.07%, avg=2529.50, stdev=1017.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1463KiB/s (1498kB/s)(6144KiB/4200msec); 0 zone resets clat (msec): min=264, max=596, avg=438.49, stdev=123.20 lat (msec): min=264, max=600, avg=439.21, stdev=124.18 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 435], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1374, max= 2048, per=34.22%, avg=1891.20, stdev=289.67, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 10=8.33%, 50=8.33%, 500=50.00%, 750=25.00% cpu : usr=0.00%, sys=9.95%, ctx=165, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144866: Tue Jun 23 12:48:37 2026 read: IOPS=1, BW=1222KiB/s (1252kB/s)(5120KiB/4189msec) clat (usec): min=632, max=295202, avg=62824.75, stdev=129933.60 lat (usec): min=635, max=295204, avg=62826.61, stdev=129933.42 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 4359], 40.00th=[ 4359], 50.00th=[ 5473], 60.00th=[ 5473], | 70.00th=[ 8455], 80.00th=[ 8455], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1711KiB/s (1752kB/s)(7168KiB/4189msec); 0 zone resets clat (msec): min=258, max=1116, avg=516.33, stdev=286.88 lat (msec): min=258, max=1117, avg=516.45, stdev=286.88 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 321], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 430], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 575], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1422, max= 2048, per=34.46%, avg=1904.60, stdev=270.17, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 10=25.00%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.10%, sys=8.67%, ctx=119, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3948KiB/s (4043kB/s), 395KiB/s-1688KiB/s (404kB/s-1729kB/s), io=20.0MiB (20.0MB), run=4189-5187msec WRITE: bw=5528KiB/s (5660kB/s), 1206KiB/s-1974KiB/s (1235kB/s-2022kB/s), io=28.0MiB (29.4MB), run=4189-5187msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144867: Tue Jun 23 12:48:38 2026 read: IOPS=1, BW=1404KiB/s (1438kB/s)(7168KiB/5106msec) clat (msec): min=78, max=342, avg=198.57, stdev=93.16 lat (msec): min=78, max=342, avg=198.58, stdev=93.16 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 118], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 203], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 266], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1950, max= 2968, per=66.72%, avg=2201.60, stdev=429.97, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=0, BW=1003KiB/s (1027kB/s)(5120KiB/5106msec); 0 zone resets clat (msec): min=416, max=1027, avg=729.25, stdev=280.97 lat (msec): min=417, max=1028, avg=729.46, stdev=280.84 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 2019, max= 4039, per=58.30%, avg=2693.67, stdev=1165.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=3.86%, ctx=95, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144868: Tue Jun 23 12:48:38 2026 read: IOPS=0, BW=330KiB/s (338kB/s)(2048KiB/6206msec) clat (msec): min=124, max=753, avg=439.28, stdev=444.68 lat (msec): min=124, max=753, avg=439.28, stdev=444.69 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2019, max= 2048, per=61.62%, avg=2033.50, stdev=20.51, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1650KiB/s (1690kB/s)(10.0MiB/6206msec); 0 zone resets clat (msec): min=208, max=965, avg=496.91, stdev=229.20 lat (msec): min=208, max=965, avg=497.13, stdev=229.11 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 338], | 30.00th=[ 351], 40.00th=[ 368], 50.00th=[ 376], 60.00th=[ 430], | 70.00th=[ 550], 80.00th=[ 659], 90.00th=[ 743], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1996, max= 4039, per=57.62%, avg=2662.17, stdev=1013.67, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 1000=16.67% cpu : usr=0.05%, sys=2.68%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144869: Tue Jun 23 12:48:38 2026 read: IOPS=1, BW=1034KiB/s (1059kB/s)(6144KiB/5941msec) clat (msec): min=76, max=483, avg=206.20, stdev=144.19 lat (msec): min=76, max=483, avg=206.20, stdev=144.19 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 192], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1996, max= 4039, per=100.00%, avg=3358.00, stdev=1179.53, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1034KiB/s (1059kB/s)(6144KiB/5941msec); 0 zone resets clat (msec): min=289, max=1042, avg=720.71, stdev=319.54 lat (msec): min=289, max=1042, avg=720.81, stdev=319.53 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1996, max= 2035, per=43.65%, avg=2016.80, stdev=14.50, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 1000=25.00%, 2000=8.33% cpu : usr=0.00%, sys=2.88%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144870: Tue Jun 23 12:48:38 2026 read: IOPS=0, BW=884KiB/s (905kB/s)(5120KiB/5793msec) clat (msec): min=140, max=436, avg=258.96, stdev=144.19 lat (msec): min=140, max=436, avg=258.96, stdev=144.19 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1996, max= 4039, per=81.35%, avg=2684.67, stdev=1172.94, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1237KiB/s (1267kB/s)(7168KiB/5793msec); 0 zone resets clat (msec): min=175, max=1255, avg=590.37, stdev=377.94 lat (msec): min=175, max=1255, avg=590.48, stdev=377.93 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 313], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 451], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 860], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2011, max= 3992, per=50.86%, avg=2349.83, stdev=804.53, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.78%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3300KiB/s (3379kB/s), 330KiB/s-1404KiB/s (338kB/s-1438kB/s), io=20.0MiB (20.0MB), run=5106-6206msec WRITE: bw=4620KiB/s (4731kB/s), 1003KiB/s-1650KiB/s (1027kB/s-1690kB/s), io=28.0MiB (29.4MB), run=5106-6206msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144878: Tue Jun 23 12:48:56 2026 read: IOPS=0, BW=4057KiB/s (4154kB/s)(12.0MiB/3029msec) clat (msec): min=854, max=1146, avg=985.79, stdev=148.00 lat (msec): min=854, max=1146, avg=985.79, stdev=148.00 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.56%, ctx=309, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144879: Tue Jun 23 12:48:56 2026 read: IOPS=0, BW=1329KiB/s (1361kB/s)(4096KiB/3082msec) clat (nsec): min=739523k, max=739523k, avg=739522583.00, stdev= 0.00 lat (nsec): min=739525k, max=739525k, avg=739525220.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2658KiB/s (2722kB/s)(8192KiB/3082msec); 0 zone resets clat (msec): min=958, max=1282, avg=1120.81, stdev=229.16 lat (msec): min=959, max=1285, avg=1122.41, stdev=230.76 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.93%, ctx=175, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Tue Jun 23 12:48:56 2026 write: IOPS=0, BW=2839KiB/s (2907kB/s)(12.0MiB/4329msec); 0 zone resets clat (msec): min=554, max=2555, avg=1402.64, stdev=1034.78 lat (msec): min=554, max=2560, avg=1407.37, stdev=1035.87 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8062, max= 8126, per=100.00%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.92%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144881: Tue Jun 23 12:48:56 2026 write: IOPS=0, BW=3281KiB/s (3360kB/s)(12.0MiB/3745msec); 0 zone resets clat (msec): min=504, max=2453, avg=1237.01, stdev=1061.08 lat (msec): min=505, max=2454, avg=1237.48, stdev=1060.99 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.12%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5316KiB/s (5444kB/s), 1329KiB/s-4057KiB/s (1361kB/s-4154kB/s), io=16.0MiB (16.8MB), run=3029-3082msec WRITE: bw=7569KiB/s (7751kB/s), 2658KiB/s-3281KiB/s (2722kB/s-3360kB/s), io=32.0MiB (33.6MB), run=3082-4329msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144883: Tue Jun 23 12:48:57 2026 read: IOPS=0, BW=2768KiB/s (2835kB/s)(12.0MiB/4439msec) clat (msec): min=527, max=2615, avg=1456.47, stdev=1062.74 lat (msec): min=527, max=2615, avg=1456.47, stdev=1062.75 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.14%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144884: Tue Jun 23 12:48:57 2026 read: IOPS=0, BW=1276KiB/s (1306kB/s)(4096KiB/3211msec) clat (nsec): min=734796k, max=734796k, avg=734796060.00, stdev= 0.00 lat (nsec): min=734799k, max=734799k, avg=734799132.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2551KiB/s (2612kB/s)(8192KiB/3211msec); 0 zone resets clat (msec): min=1127, max=1306, avg=1216.89, stdev=126.46 lat (msec): min=1127, max=1306, avg=1217.23, stdev=126.60 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.36%, ctx=45, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144885: Tue Jun 23 12:48:57 2026 write: IOPS=0, BW=2603KiB/s (2665kB/s)(12.0MiB/4721msec); 0 zone resets clat (msec): min=372, max=2913, avg=1559.93, stdev=1278.77 lat (msec): min=377, max=2917, avg=1563.00, stdev=1278.36 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 8047, max= 8159, per=100.00%, avg=8103.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.16%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144886: Tue Jun 23 12:48:57 2026 write: IOPS=0, BW=3097KiB/s (3171kB/s)(12.0MiB/3968msec); 0 zone resets clat (msec): min=924, max=1675, avg=1301.12, stdev=375.14 lat (msec): min=925, max=1675, avg=1301.56, stdev=375.13 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7861, max= 8094, per=100.00%, avg=7977.50, stdev=164.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.40%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3691KiB/s (3780kB/s), 1276KiB/s-2768KiB/s (1306kB/s-2835kB/s), io=16.0MiB (16.8MB), run=3211-4439msec WRITE: bw=6941KiB/s (7107kB/s), 2551KiB/s-3097KiB/s (2612kB/s-3171kB/s), io=32.0MiB (33.6MB), run=3211-4721msec