== sanity test 398b: DIO and buffer IO race ============== 12:12:48 (1772471568) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.55176 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183710: Mon Mar 2 12:15:02 2026 read: IOPS=13, BW=52.7KiB/s (53.0kB/s)(5992KiB/113667msec) clat (usec): min=93, max=852978, avg=42213.66, stdev=34868.28 lat (usec): min=94, max=852979, avg=42216.17, stdev=34868.36 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 2606], 10.00th=[ 14877], 20.00th=[ 20317], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[131597], 99.50th=[154141], 99.90th=[214959], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 104, per=25.09%, avg=52.44, stdev=20.13, samples=223 iops : min= 1, max= 26, avg=12.45, stdev= 5.07, samples=223 write: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6296KiB/113667msec); 0 zone resets clat (usec): min=722, max=251234, avg=31769.72, stdev=34299.50 lat (usec): min=723, max=251236, avg=31772.65, stdev=34298.38 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1106], 10.00th=[ 1205], 20.00th=[ 2114], | 30.00th=[ 5014], 40.00th=[ 13173], 50.00th=[ 22676], 60.00th=[ 30802], | 70.00th=[ 41681], 80.00th=[ 55313], 90.00th=[ 76022], 95.00th=[103285], | 99.00th=[152044], 99.50th=[170918], 99.90th=[214959], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 7, max= 119, per=25.37%, avg=55.31, stdev=23.38, samples=222 iops : min= 1, max= 29, avg=13.18, stdev= 5.89, samples=222 lat (usec) : 100=0.03%, 250=1.99%, 500=0.13%, 750=0.16%, 1000=0.42% lat (msec) : 2=9.47%, 4=4.33%, 10=5.50%, 20=11.39%, 50=39.81% lat (msec) : 100=22.01%, 250=4.69%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.75%, ctx=5983, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183712: Mon Mar 2 12:15:02 2026 read: IOPS=12, BW=51.8KiB/s (53.1kB/s)(5940KiB/114569msec) clat (usec): min=90, max=196296, avg=41961.60, stdev=27704.17 lat (usec): min=91, max=196297, avg=41963.84, stdev=27702.90 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 2737], 10.00th=[ 15664], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[135267], 99.50th=[158335], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 7, max= 104, per=24.75%, avg=51.74, stdev=20.24, samples=224 iops : min= 1, max= 26, avg=12.29, stdev= 5.10, samples=224 write: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6348KiB/114569msec); 0 zone resets clat (usec): min=683, max=796778, avg=32628.68, stdev=40246.68 lat (usec): min=683, max=796779, avg=32630.45, stdev=40246.72 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 2024], | 30.00th=[ 5145], 40.00th=[ 13173], 50.00th=[ 21890], 60.00th=[ 31851], | 70.00th=[ 42206], 80.00th=[ 57410], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[183501], 99.90th=[367002], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 15, max= 135, per=25.31%, avg=55.17, stdev=22.86, samples=224 iops : min= 3, max= 33, avg=13.14, stdev= 5.76, samples=224 lat (usec) : 100=0.03%, 250=1.79%, 500=0.36%, 750=0.07%, 1000=0.52% lat (msec) : 2=9.73%, 4=3.58%, 10=5.79%, 20=11.43%, 50=39.49% lat (msec) : 100=22.88%, 250=4.23%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=4.89%, ctx=6361, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183713: Mon Mar 2 12:15:02 2026 read: IOPS=13, BW=53.5KiB/s (54.7kB/s)(6028KiB/112775msec) clat (usec): min=107, max=220079, avg=40873.99, stdev=28494.58 lat (usec): min=107, max=220079, avg=40875.61, stdev=28494.30 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 229], 10.00th=[ 13829], 20.00th=[ 19530], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[139461], 99.50th=[179307], 99.90th=[204473], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 111, per=25.58%, avg=53.46, stdev=20.95, samples=220 iops : min= 1, max= 27, avg=12.71, stdev= 5.29, samples=220 write: IOPS=13, BW=55.5KiB/s (56.8kB/s)(6260KiB/112775msec); 0 zone resets clat (usec): min=674, max=672532, avg=32404.57, stdev=37664.28 lat (usec): min=675, max=672534, avg=32406.44, stdev=37664.32 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1139], 10.00th=[ 1221], 20.00th=[ 2573], | 30.00th=[ 5669], 40.00th=[ 14484], 50.00th=[ 22938], 60.00th=[ 30278], | 70.00th=[ 41681], 80.00th=[ 56886], 90.00th=[ 79168], 95.00th=[102237], | 99.00th=[139461], 99.50th=[156238], 99.90th=[299893], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 126, per=25.22%, avg=54.99, stdev=23.35, samples=222 iops : min= 1, max= 31, avg=13.10, stdev= 5.87, samples=222 lat (usec) : 250=2.47%, 500=0.23%, 750=0.16%, 1000=0.26% lat (msec) : 2=8.85%, 4=4.00%, 10=5.89%, 20=11.95%, 50=39.32% lat (msec) : 100=22.56%, 250=4.20%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=4.91%, ctx=6161, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183714: Mon Mar 2 12:15:02 2026 read: IOPS=13, BW=52.7KiB/s (53.0kB/s)(6052KiB/114815msec) clat (usec): min=110, max=215928, avg=40870.11, stdev=27941.07 lat (usec): min=110, max=215929, avg=40880.84, stdev=27942.49 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 461], 10.00th=[ 13960], 20.00th=[ 20055], | 30.00th=[ 24511], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[139461], 99.50th=[173016], 99.90th=[206570], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 7, max= 111, per=25.27%, avg=52.81, stdev=19.99, samples=223 iops : min= 1, max= 27, avg=12.56, stdev= 5.03, samples=223 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6236KiB/114815msec); 0 zone resets clat (usec): min=837, max=727095, avg=33676.61, stdev=39898.11 lat (usec): min=838, max=727099, avg=33678.19, stdev=39898.09 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 2606], | 30.00th=[ 6390], 40.00th=[ 15008], 50.00th=[ 23987], 60.00th=[ 32637], | 70.00th=[ 42730], 80.00th=[ 56361], 90.00th=[ 79168], 95.00th=[104334], | 99.00th=[162530], 99.50th=[198181], 99.90th=[252707], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 152, per=24.98%, avg=54.45, stdev=22.51, samples=223 iops : min= 1, max= 38, avg=12.96, stdev= 5.69, samples=223 lat (usec) : 250=2.25%, 500=0.23%, 750=0.07%, 1000=0.26% lat (msec) : 2=8.56%, 4=4.17%, 10=5.08%, 20=12.37%, 50=40.27% lat (msec) : 100=22.01%, 250=4.65%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=4.86%, ctx=6234, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=209KiB/s (214kB/s), 51.8KiB/s-53.5KiB/s (53.1kB/s-54.7kB/s), io=23.4MiB (24.6MB), run=112775-114815msec WRITE: bw=219KiB/s (224kB/s), 54.3KiB/s-55.5KiB/s (55.6kB/s-56.8kB/s), io=24.6MiB (25.7MB), run=112775-114815msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183715: Mon Mar 2 12:15:38 2026 read: IOPS=9, BW=39.0KiB/s (40.9kB/s)(5992KiB/149929msec) clat (msec): min=5, max=848, avg=39.93, stdev=42.53 lat (msec): min=5, max=848, avg=39.93, stdev=42.53 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 88], 95.00th=[ 116], | 99.00th=[ 176], 99.50th=[ 218], 99.90th=[ 380], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 143, per=25.27%, avg=40.17, stdev=27.12, samples=289 iops : min= 1, max= 35, avg= 9.40, stdev= 6.84, samples=289 write: IOPS=10, BW=41.0KiB/s (43.0kB/s)(6296KiB/149929msec); 0 zone resets clat (msec): min=5, max=321, avg=56.98, stdev=39.85 lat (msec): min=5, max=321, avg=56.98, stdev=39.85 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 85], 90.00th=[ 110], 95.00th=[ 131], | 99.00th=[ 205], 99.50th=[ 230], 99.90th=[ 271], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 152, per=25.03%, avg=41.55, stdev=26.67, samples=294 iops : min= 1, max= 38, avg= 9.74, stdev= 6.72, samples=294 lat (msec) : 10=3.68%, 20=18.29%, 50=44.24%, 100=23.34%, 250=10.19% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=1.66%, ctx=4677, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183716: Mon Mar 2 12:15:38 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(5940KiB/150609msec) clat (msec): min=4, max=698, avg=39.02, stdev=41.36 lat (msec): min=4, max=698, avg=39.03, stdev=41.36 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 83], 95.00th=[ 114], | 99.00th=[ 194], 99.50th=[ 232], 99.90th=[ 376], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 152, per=24.88%, avg=39.57, stdev=28.73, samples=293 iops : min= 1, max= 38, avg= 9.25, stdev= 7.24, samples=293 write: IOPS=10, BW=42.1KiB/s (43.2kB/s)(6348KiB/150609msec); 0 zone resets clat (msec): min=9, max=455, avg=58.16, stdev=44.50 lat (msec): min=9, max=455, avg=58.16, stdev=44.50 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 115], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 251], 99.90th=[ 305], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 184, per=25.41%, avg=42.19, stdev=27.76, samples=294 iops : min= 1, max= 46, avg= 9.90, stdev= 7.01, samples=294 lat (msec) : 10=3.45%, 20=18.88%, 50=45.02%, 100=21.81%, 250=10.42% lat (msec) : 500=0.39%, 750=0.03% cpu : usr=0.05%, sys=1.69%, ctx=4670, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183717: Mon Mar 2 12:15:38 2026 read: IOPS=10, BW=40.1KiB/s (41.0kB/s)(6028KiB/150397msec) clat (msec): min=4, max=343, avg=39.31, stdev=37.58 lat (msec): min=4, max=343, avg=39.31, stdev=37.58 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 116], | 99.00th=[ 186], 99.50th=[ 224], 99.90th=[ 330], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 152, per=25.41%, avg=40.40, stdev=27.27, samples=290 iops : min= 1, max= 38, avg= 9.45, stdev= 6.86, samples=290 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6260KiB/150397msec); 0 zone resets clat (msec): min=8, max=727, avg=58.02, stdev=44.81 lat (msec): min=8, max=727, avg=58.02, stdev=44.81 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 207], 99.50th=[ 226], 99.90th=[ 372], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 142, per=24.73%, avg=41.06, stdev=26.44, samples=296 iops : min= 1, max= 35, avg= 9.61, stdev= 6.67, samples=296 lat (msec) : 10=3.29%, 20=18.16%, 50=45.12%, 100=22.95%, 250=10.25% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.06%, sys=1.65%, ctx=4790, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183718: Mon Mar 2 12:15:38 2026 read: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6052KiB/149635msec) clat (msec): min=4, max=321, avg=38.47, stdev=34.15 lat (msec): min=4, max=321, avg=38.47, stdev=34.15 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 167], 99.50th=[ 190], 99.90th=[ 232], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 136, per=25.90%, avg=41.18, stdev=27.64, samples=287 iops : min= 1, max= 34, avg= 9.64, stdev= 6.97, samples=287 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6236KiB/149635msec); 0 zone resets clat (msec): min=6, max=705, avg=58.41, stdev=43.34 lat (msec): min=6, max=705, avg=58.41, stdev=43.34 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 220], 99.90th=[ 372], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 136, per=25.02%, avg=41.53, stdev=25.97, samples=293 iops : min= 1, max= 34, avg= 9.73, stdev= 6.55, samples=293 lat (msec) : 10=3.94%, 20=17.77%, 50=43.78%, 100=24.19%, 250=10.19% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.05%, sys=1.67%, ctx=4672, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (163kB/s), 39.4KiB/s-40.4KiB/s (40.4kB/s-41.4kB/s), io=23.4MiB (24.6MB), run=149635-150609msec WRITE: bw=167KiB/s (171kB/s), 41.6KiB/s-42.1KiB/s (42.6kB/s-43.2kB/s), io=24.6MiB (25.7MB), run=149635-150609msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183763: Mon Mar 2 12:16:39 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5920KiB/45511msec) clat (usec): min=129, max=461483, avg=63184.25, stdev=50529.14 lat (usec): min=129, max=461485, avg=63185.48, stdev=50529.16 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 169], 10.00th=[ 3064], 20.00th=[ 28967], | 30.00th=[ 38011], 40.00th=[ 45876], 50.00th=[ 53216], 60.00th=[ 65274], | 70.00th=[ 73925], 80.00th=[ 92799], 90.00th=[117965], 95.00th=[139461], | 99.00th=[256902], 99.50th=[265290], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 30, max= 287, per=24.93%, avg=128.87, stdev=58.06, samples=87 iops : min= 1, max= 17, avg= 7.29, stdev= 3.66, samples=87 write: IOPS=8, BW=140KiB/s (143kB/s)(6368KiB/45511msec); 0 zone resets clat (usec): min=1472, max=277057, avg=54720.17, stdev=54215.36 lat (usec): min=1473, max=277059, avg=54746.33, stdev=54214.14 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1713], 10.00th=[ 3032], 20.00th=[ 8979], | 30.00th=[ 16450], 40.00th=[ 26870], 50.00th=[ 38536], 60.00th=[ 50594], | 70.00th=[ 69731], 80.00th=[ 94897], 90.00th=[127402], 95.00th=[181404], | 99.00th=[246416], 99.50th=[274727], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 445, per=26.44%, avg=143.85, stdev=73.30, samples=85 iops : min= 1, max= 27, avg= 8.22, stdev= 4.63, samples=85 lat (usec) : 250=3.65%, 500=0.91% lat (msec) : 2=3.78%, 4=3.12%, 10=5.21%, 20=6.64%, 50=29.30% lat (msec) : 100=31.12%, 250=15.23%, 500=1.04% cpu : usr=0.05%, sys=4.14%, ctx=1561, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183764: Mon Mar 2 12:16:39 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5744KiB/46306msec) clat (usec): min=133, max=602543, avg=65347.29, stdev=56140.27 lat (usec): min=133, max=602545, avg=65348.56, stdev=56140.31 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 176], 10.00th=[ 2933], 20.00th=[ 27657], | 30.00th=[ 37487], 40.00th=[ 45351], 50.00th=[ 54789], 60.00th=[ 66847], | 70.00th=[ 80217], 80.00th=[ 98042], 90.00th=[120062], 95.00th=[154141], | 99.00th=[223347], 99.50th=[362808], 99.90th=[599786], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 24, max= 375, per=24.66%, avg=127.47, stdev=71.76, samples=87 iops : min= 1, max= 23, avg= 7.20, stdev= 4.52, samples=87 write: IOPS=8, BW=141KiB/s (145kB/s)(6544KiB/46306msec); 0 zone resets clat (usec): min=1386, max=356517, avg=54526.46, stdev=56820.41 lat (usec): min=1388, max=356519, avg=54538.11, stdev=56827.37 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1696], 10.00th=[ 2769], 20.00th=[ 9110], | 30.00th=[ 15533], 40.00th=[ 25297], 50.00th=[ 37487], 60.00th=[ 49546], | 70.00th=[ 69731], 80.00th=[ 95945], 90.00th=[127402], 95.00th=[166724], | 99.00th=[246416], 99.50th=[287310], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 28, max= 447, per=26.46%, avg=143.94, stdev=80.08, samples=88 iops : min= 1, max= 27, avg= 8.22, stdev= 5.04, samples=88 lat (usec) : 250=3.52%, 500=0.52%, 1000=0.26% lat (msec) : 2=5.21%, 4=1.69%, 10=5.21%, 20=8.33%, 50=28.39% lat (msec) : 100=28.91%, 250=17.19%, 500=0.65%, 750=0.13% cpu : usr=0.06%, sys=4.22%, ctx=1654, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183765: Mon Mar 2 12:16:39 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/46081msec) clat (usec): min=126, max=432725, avg=66101.46, stdev=50830.85 lat (usec): min=127, max=432726, avg=66102.75, stdev=50830.93 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 178], 10.00th=[ 11994], 20.00th=[ 26608], | 30.00th=[ 36439], 40.00th=[ 47449], 50.00th=[ 59507], 60.00th=[ 67634], | 70.00th=[ 79168], 80.00th=[100140], 90.00th=[128451], 95.00th=[160433], | 99.00th=[246416], 99.50th=[295699], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 30, max= 349, per=26.18%, avg=135.33, stdev=68.81, samples=88 iops : min= 1, max= 21, avg= 7.68, stdev= 4.35, samples=88 write: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/46081msec); 0 zone resets clat (usec): min=1270, max=308008, avg=53238.44, stdev=53959.45 lat (usec): min=1272, max=308011, avg=53243.65, stdev=53957.47 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1663], 10.00th=[ 1811], 20.00th=[ 7635], | 30.00th=[ 13960], 40.00th=[ 23200], 50.00th=[ 35914], 60.00th=[ 51119], | 70.00th=[ 69731], 80.00th=[ 91751], 90.00th=[129500], 95.00th=[173016], | 99.00th=[231736], 99.50th=[248513], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 28, max= 349, per=23.53%, avg=127.99, stdev=61.32, samples=88 iops : min= 1, max= 21, avg= 7.22, stdev= 3.87, samples=88 lat (usec) : 250=3.78%, 500=0.39%, 1000=0.26% lat (msec) : 2=5.99%, 4=1.69%, 10=4.04%, 20=8.85%, 50=25.39% lat (msec) : 100=30.47%, 250=18.62%, 500=0.52% cpu : usr=0.05%, sys=4.08%, ctx=1656, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183766: Mon Mar 2 12:16:39 2026 read: IOPS=8, BW=133KiB/s (137kB/s)(6032KiB/45197msec) clat (usec): min=112, max=383867, avg=64954.53, stdev=52808.54 lat (usec): min=112, max=383868, avg=64955.94, stdev=52808.37 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 174], 10.00th=[ 2343], 20.00th=[ 27395], | 30.00th=[ 36439], 40.00th=[ 45351], 50.00th=[ 53216], 60.00th=[ 64226], | 70.00th=[ 74974], 80.00th=[ 95945], 90.00th=[129500], 95.00th=[166724], | 99.00th=[235930], 99.50th=[371196], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 30, max= 318, per=26.62%, avg=137.60, stdev=67.69, samples=85 iops : min= 1, max= 19, avg= 7.84, stdev= 4.29, samples=85 write: IOPS=8, BW=138KiB/s (142kB/s)(6256KiB/45197msec); 0 zone resets clat (usec): min=1326, max=459822, avg=51636.00, stdev=60203.66 lat (usec): min=1328, max=459825, avg=51639.17, stdev=60205.09 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1713], 10.00th=[ 2999], 20.00th=[ 7111], | 30.00th=[ 12256], 40.00th=[ 21627], 50.00th=[ 32637], 60.00th=[ 46924], | 70.00th=[ 62653], 80.00th=[ 84411], 90.00th=[124257], 95.00th=[164627], | 99.00th=[291505], 99.50th=[375391], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 30, max= 380, per=25.80%, avg=140.34, stdev=77.59, samples=87 iops : min= 1, max= 23, avg= 8.01, stdev= 4.93, samples=87 lat (usec) : 250=3.78%, 500=0.91% lat (msec) : 2=4.30%, 4=2.34%, 10=7.81%, 20=6.90%, 50=28.91% lat (msec) : 100=28.13%, 250=15.89%, 500=1.04% cpu : usr=0.06%, sys=3.95%, ctx=1602, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=517KiB/s (530kB/s), 124KiB/s-136KiB/s (127kB/s-139kB/s), io=23.4MiB (24.5MB), run=45197-46306msec WRITE: bw=544KiB/s (557kB/s), 131KiB/s-141KiB/s (134kB/s-145kB/s), io=24.6MiB (25.8MB), run=45197-46306msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183759: Mon Mar 2 12:16:49 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(5920KiB/56826msec) clat (msec): min=6, max=477, avg=60.45, stdev=62.37 lat (msec): min=6, max=477, avg=60.45, stdev=62.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 28], 50.00th=[ 37], 60.00th=[ 50], | 70.00th=[ 68], 80.00th=[ 93], 90.00th=[ 142], 95.00th=[ 188], | 99.00th=[ 284], 99.50th=[ 342], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 512, per=25.55%, avg=107.56, stdev=89.90, samples=104 iops : min= 1, max= 32, avg= 5.89, stdev= 5.74, samples=104 write: IOPS=7, BW=112KiB/s (115kB/s)(6368KiB/56826msec); 0 zone resets clat (msec): min=12, max=490, avg=86.31, stdev=71.99 lat (msec): min=12, max=490, avg=86.32, stdev=71.99 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 31], | 30.00th=[ 38], 40.00th=[ 47], 50.00th=[ 62], 60.00th=[ 79], | 70.00th=[ 107], 80.00th=[ 138], 90.00th=[ 188], 95.00th=[ 224], | 99.00th=[ 393], 99.50th=[ 439], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 29, max= 448, per=26.40%, avg=116.97, stdev=90.32, samples=104 iops : min= 1, max= 28, avg= 6.50, stdev= 5.72, samples=104 lat (msec) : 10=1.43%, 20=14.84%, 50=34.77%, 100=23.83%, 250=23.31% lat (msec) : 500=1.82% cpu : usr=0.03%, sys=1.32%, ctx=1200, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183760: Mon Mar 2 12:16:49 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(5744KiB/56452msec) clat (msec): min=5, max=321, avg=55.24, stdev=53.64 lat (msec): min=5, max=321, avg=55.24, stdev=53.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 59], 80.00th=[ 88], 90.00th=[ 128], 95.00th=[ 174], | 99.00th=[ 264], 99.50th=[ 300], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 25, max= 480, per=26.20%, avg=110.30, stdev=91.20, samples=102 iops : min= 1, max= 30, avg= 6.07, stdev= 5.80, samples=102 write: IOPS=7, BW=116KiB/s (119kB/s)(6544KiB/56452msec); 0 zone resets clat (msec): min=10, max=527, avg=88.93, stdev=74.63 lat (msec): min=10, max=527, avg=88.93, stdev=74.63 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 48], 50.00th=[ 65], 60.00th=[ 85], | 70.00th=[ 106], 80.00th=[ 136], 90.00th=[ 201], 95.00th=[ 241], | 99.00th=[ 338], 99.50th=[ 388], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 21, max= 510, per=26.51%, avg=117.44, stdev=93.58, samples=109 iops : min= 1, max= 31, avg= 6.53, stdev= 5.92, samples=109 lat (msec) : 10=3.26%, 20=12.37%, 50=37.11%, 100=22.53%, 250=22.14% lat (msec) : 500=2.47%, 750=0.13% cpu : usr=0.04%, sys=1.36%, ctx=1130, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183761: Mon Mar 2 12:16:49 2026 read: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55799msec) clat (msec): min=5, max=489, avg=61.95, stdev=69.93 lat (msec): min=5, max=489, avg=61.98, stdev=69.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 18], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 38], 60.00th=[ 50], | 70.00th=[ 65], 80.00th=[ 94], 90.00th=[ 138], 95.00th=[ 190], | 99.00th=[ 439], 99.50th=[ 472], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 21, max= 544, per=28.48%, avg=119.92, stdev=104.49, samples=102 iops : min= 1, max= 34, avg= 6.68, stdev= 6.64, samples=102 write: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55799msec); 0 zone resets clat (msec): min=9, max=377, avg=82.61, stdev=65.19 lat (msec): min=9, max=377, avg=82.61, stdev=65.19 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 29], | 30.00th=[ 38], 40.00th=[ 50], 50.00th=[ 63], 60.00th=[ 81], | 70.00th=[ 103], 80.00th=[ 125], 90.00th=[ 174], 95.00th=[ 215], | 99.00th=[ 309], 99.50th=[ 313], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 25, max= 544, per=25.60%, avg=113.40, stdev=93.25, samples=102 iops : min= 1, max= 34, avg= 6.26, stdev= 5.92, samples=102 lat (msec) : 10=2.86%, 20=14.06%, 50=33.85%, 100=25.52%, 250=20.70% lat (msec) : 500=2.99% cpu : usr=0.03%, sys=1.42%, ctx=1210, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183762: Mon Mar 2 12:16:49 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(6032KiB/56574msec) clat (msec): min=6, max=505, avg=63.83, stdev=68.02 lat (msec): min=6, max=505, avg=63.83, stdev=68.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 25], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 52], | 70.00th=[ 67], 80.00th=[ 92], 90.00th=[ 155], 95.00th=[ 218], | 99.00th=[ 292], 99.50th=[ 468], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 30, max= 416, per=26.93%, avg=113.37, stdev=90.02, samples=103 iops : min= 1, max= 26, avg= 6.27, stdev= 5.72, samples=103 write: IOPS=6, BW=111KiB/s (113kB/s)(6256KiB/56574msec); 0 zone resets clat (msec): min=10, max=433, avg=82.73, stdev=65.70 lat (msec): min=10, max=433, avg=82.73, stdev=65.70 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 19], 10.00th=[ 24], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 80], | 70.00th=[ 105], 80.00th=[ 125], 90.00th=[ 176], 95.00th=[ 220], | 99.00th=[ 296], 99.50th=[ 388], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 21, max= 512, per=26.23%, avg=116.20, stdev=93.25, samples=105 iops : min= 1, max= 32, avg= 6.45, stdev= 5.93, samples=105 lat (msec) : 10=1.43%, 20=13.54%, 50=35.81%, 100=24.61%, 250=22.14% lat (msec) : 500=2.34%, 750=0.13% cpu : usr=0.04%, sys=1.39%, ctx=1227, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=421KiB/s (432kB/s), 102KiB/s-112KiB/s (104kB/s-115kB/s), io=23.4MiB (24.5MB), run=55799-56826msec WRITE: bw=443KiB/s (454kB/s), 108KiB/s-116KiB/s (111kB/s-119kB/s), io=24.6MiB (25.8MB), run=55799-56826msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183782: Mon Mar 2 12:17:04 2026 read: IOPS=2, BW=2791KiB/s (2858kB/s)(7168KiB/2568msec) clat (msec): min=87, max=322, avg=170.01, stdev=79.11 lat (msec): min=87, max=322, avg=170.01, stdev=79.11 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 102], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 215], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 2039, max= 5595, per=62.39%, avg=3227.33, stdev=2050.46, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1994KiB/s (2042kB/s)(5120KiB/2568msec); 0 zone resets clat (msec): min=69, max=517, avg=250.80, stdev=171.15 lat (msec): min=69, max=517, avg=250.90, stdev=171.16 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1398, max= 3893, per=33.78%, avg=2446.33, stdev=1294.32, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.08%, sys=4.40%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183783: Mon Mar 2 12:17:04 2026 read: IOPS=0, BW=517KiB/s (530kB/s)(2048KiB/3959msec) clat (msec): min=75, max=302, avg=189.11, stdev=160.18 lat (msec): min=75, max=302, avg=189.11, stdev=160.18 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 77], 50.00th=[ 77], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1389, max= 2039, per=33.13%, avg=1714.00, stdev=459.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2587KiB/s (2649kB/s)(10.0MiB/3959msec); 0 zone resets clat (msec): min=131, max=652, avg=341.90, stdev=180.81 lat (msec): min=131, max=652, avg=341.98, stdev=180.81 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 161], | 30.00th=[ 176], 40.00th=[ 192], 50.00th=[ 271], 60.00th=[ 405], | 70.00th=[ 443], 80.00th=[ 456], 90.00th=[ 535], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1946, max= 3764, per=37.52%, avg=2717.50, stdev=851.80, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 0.89, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.05%, sys=5.38%, ctx=81, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183784: Mon Mar 2 12:17:04 2026 read: IOPS=1, BW=1639KiB/s (1678kB/s)(6144KiB/3749msec) clat (msec): min=83, max=1204, avg=435.04, stdev=405.42 lat (msec): min=83, max=1204, avg=435.04, stdev=405.42 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 447], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 2039, max= 4079, per=63.68%, avg=3294.00, stdev=1098.21, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1639KiB/s (1678kB/s)(6144KiB/3749msec); 0 zone resets clat (msec): min=84, max=283, avg=175.63, stdev=66.50 lat (msec): min=84, max=283, avg=175.82, stdev=66.68 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 180], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1882, max= 4351, per=37.65%, avg=2726.33, stdev=1407.37, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=3.18%, ctx=67, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183785: Mon Mar 2 12:17:04 2026 read: IOPS=1, BW=1556KiB/s (1594kB/s)(5120KiB/3290msec) clat (msec): min=172, max=539, avg=278.59, stdev=148.68 lat (msec): min=172, max=539, avg=278.59, stdev=148.68 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1372, max= 4079, per=47.66%, avg=2465.67, stdev=1426.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2179KiB/s (2231kB/s)(7168KiB/3290msec); 0 zone resets clat (msec): min=82, max=1019, avg=268.08, stdev=332.58 lat (msec): min=82, max=1019, avg=268.21, stdev=332.55 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 140], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 157], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 171], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 4096, max= 5490, per=66.18%, avg=4793.00, stdev=985.71, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=3.47%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5173KiB/s (5297kB/s), 517KiB/s-2791KiB/s (530kB/s-2858kB/s), io=20.0MiB (20.0MB), run=2568-3959msec WRITE: bw=7242KiB/s (7416kB/s), 1639KiB/s-2587KiB/s (1678kB/s-2649kB/s), io=28.0MiB (29.4MB), run=2568-3959msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183787: Mon Mar 2 12:17:05 2026 read: IOPS=1, BW=2029KiB/s (2078kB/s)(7168KiB/3532msec) clat (usec): min=602, max=247780, avg=136664.70, stdev=99614.24 lat (usec): min=603, max=247781, avg=136665.93, stdev=99614.10 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 2409], | 30.00th=[130548], 40.00th=[130548], 50.00th=[166724], 60.00th=[187696], | 70.00th=[187696], 80.00th=[221250], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 4039, max= 4357, per=90.30%, avg=4198.00, stdev=224.86, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1450KiB/s (1484kB/s)(5120KiB/3532msec); 0 zone resets clat (msec): min=227, max=852, avg=514.26, stdev=242.02 lat (msec): min=227, max=852, avg=514.77, stdev=241.74 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1875, max= 2043, per=30.47%, avg=1983.25, stdev=74.67, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.98%, ctx=187, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183788: Mon Mar 2 12:17:05 2026 read: IOPS=0, BW=465KiB/s (476kB/s)(2048KiB/4405msec) clat (msec): min=96, max=228, avg=162.33, stdev=93.70 lat (msec): min=96, max=228, avg=162.33, stdev=93.70 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 1359, max= 1917, per=35.23%, avg=1638.00, stdev=394.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2325KiB/s (2380kB/s)(10.0MiB/4405msec); 0 zone resets clat (msec): min=82, max=1033, avg=407.74, stdev=324.88 lat (msec): min=82, max=1033, avg=407.87, stdev=324.92 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 132], | 30.00th=[ 174], 40.00th=[ 188], 50.00th=[ 279], 60.00th=[ 321], | 70.00th=[ 355], 80.00th=[ 735], 90.00th=[ 785], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1875, max= 5752, per=45.04%, avg=2931.33, stdev=1603.85, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=11.74%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183789: Mon Mar 2 12:17:05 2026 read: IOPS=1, BW=1729KiB/s (1771kB/s)(6144KiB/3553msec) clat (msec): min=175, max=283, avg=220.56, stdev=48.02 lat (msec): min=175, max=283, avg=220.56, stdev=48.02 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 218], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1875, max= 4039, per=53.52%, avg=2488.25, stdev=1036.25, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1729KiB/s (1771kB/s)(6144KiB/3553msec); 0 zone resets clat (msec): min=143, max=545, avg=371.26, stdev=140.07 lat (msec): min=144, max=546, avg=371.33, stdev=140.07 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 435], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1494, max= 4031, per=36.27%, avg=2360.75, stdev=1136.94, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=13.34%, ctx=195, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183790: Mon Mar 2 12:17:05 2026 read: IOPS=1, BW=1173KiB/s (1201kB/s)(5120KiB/4366msec) clat (msec): min=5, max=157, avg=96.84, stdev=76.95 lat (msec): min=5, max=157, avg=96.84, stdev=76.95 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 20], 40.00th=[ 20], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 7670, max= 7670, per=100.00%, avg=7670.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1642KiB/s (1681kB/s)(7168KiB/4366msec); 0 zone resets clat (msec): min=176, max=1733, avg=552.63, stdev=544.63 lat (msec): min=176, max=1733, avg=552.89, stdev=544.64 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 180], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 380], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 567], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1387, max= 2043, per=28.58%, avg=1860.25, stdev=316.09, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 10=8.33%, 20=8.33%, 250=41.67%, 500=16.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=10.01%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4649KiB/s (4761kB/s), 465KiB/s-2029KiB/s (476kB/s-2078kB/s), io=20.0MiB (20.0MB), run=3532-4405msec WRITE: bw=6509KiB/s (6665kB/s), 1450KiB/s-2325KiB/s (1484kB/s-2380kB/s), io=28.0MiB (29.4MB), run=3532-4405msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183802: Mon Mar 2 12:17:23 2026 read: IOPS=0, BW=3482KiB/s (3566kB/s)(12.0MiB/3529msec) clat (msec): min=864, max=1417, avg=1163.72, stdev=279.37 lat (msec): min=864, max=1417, avg=1163.72, stdev=279.37 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.94%, ctx=384, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183803: Mon Mar 2 12:17:23 2026 read: IOPS=0, BW=1010KiB/s (1034kB/s)(4096KiB/4056msec) clat (nsec): min=1152.9M, max=1152.9M, avg=1152927973.00, stdev= 0.00 lat (nsec): min=1152.9M, max=1152.9M, avg=1152930522.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2020KiB/s (2068kB/s)(8192KiB/4056msec); 0 zone resets clat (msec): min=1134, max=1475, avg=1304.61, stdev=241.26 lat (msec): min=1134, max=1475, avg=1304.92, stdev=241.29 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7543, max= 7543, per=94.29%, avg=7543.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=5.30%, ctx=144, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183804: Mon Mar 2 12:17:23 2026 write: IOPS=0, BW=3000KiB/s (3072kB/s)(12.0MiB/4096msec); 0 zone resets clat (msec): min=792, max=2061, avg=1295.22, stdev=674.64 lat (msec): min=792, max=2068, avg=1297.85, stdev=677.78 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=4.15%, ctx=70, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183805: Mon Mar 2 12:17:23 2026 write: IOPS=0, BW=3140KiB/s (3216kB/s)(12.0MiB/3913msec); 0 zone resets clat (msec): min=968, max=1693, avg=1269.80, stdev=377.95 lat (msec): min=969, max=1694, avg=1270.11, stdev=377.95 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 7543, max= 7922, per=96.66%, avg=7732.50, stdev=267.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.91%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4039KiB/s (4136kB/s), 1010KiB/s-3482KiB/s (1034kB/s-3566kB/s), io=16.0MiB (16.8MB), run=3529-4056msec WRITE: bw=8000KiB/s (8192kB/s), 2020KiB/s-3140KiB/s (2068kB/s-3216kB/s), io=32.0MiB (33.6MB), run=3913-4096msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183798: Mon Mar 2 12:17:23 2026 read: IOPS=0, BW=3220KiB/s (3297kB/s)(12.0MiB/3816msec) clat (msec): min=937, max=1571, avg=1222.40, stdev=321.71 lat (msec): min=937, max=1571, avg=1222.40, stdev=321.71 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.09%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183799: Mon Mar 2 12:17:23 2026 read: IOPS=0, BW=1034KiB/s (1059kB/s)(4096KiB/3960msec) clat (nsec): min=1051.0M, max=1051.0M, avg=1051020371.00, stdev= 0.00 lat (nsec): min=1051.0M, max=1051.0M, avg=1051022613.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2069KiB/s (2118kB/s)(8192KiB/3960msec); 0 zone resets clat (msec): min=1220, max=1452, avg=1336.87, stdev=163.96 lat (msec): min=1221, max=1453, avg=1337.11, stdev=164.11 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 7699, max= 7699, per=100.00%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.05%, sys=4.57%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183800: Mon Mar 2 12:17:23 2026 write: IOPS=0, BW=2764KiB/s (2831kB/s)(12.0MiB/4445msec); 0 zone resets clat (msec): min=179, max=3371, avg=1449.37, stdev=1692.93 lat (msec): min=179, max=3371, avg=1449.67, stdev=1692.98 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 8047, max= 8110, per=100.00%, avg=8078.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.24%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183801: Mon Mar 2 12:17:23 2026 write: IOPS=1, BW=4743KiB/s (4856kB/s)(12.0MiB/2591msec); 0 zone resets clat (msec): min=313, max=1193, avg=827.54, stdev=458.51 lat (msec): min=313, max=1194, avg=829.17, stdev=459.54 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min=16062, max=16062, per=100.00%, avg=16062.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.06%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4137KiB/s (4237kB/s), 1034KiB/s-3220KiB/s (1059kB/s-3297kB/s), io=16.0MiB (16.8MB), run=3816-3960msec WRITE: bw=7372KiB/s (7549kB/s), 2069KiB/s-4743KiB/s (2118kB/s-4856kB/s), io=32.0MiB (33.6MB), run=2591-4445msec