== sanity test 398b: DIO and buffer IO race ============== 02:58:56 (1785394736) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.11281 s, 8.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143587: Thu Jul 30 03:02:17 2026 read: IOPS=8, BW=35.0KiB/s (35.8kB/s)(5992KiB/171171msec) clat (usec): min=31, max=449579, avg=57208.79, stdev=46663.04 lat (usec): min=31, max=449580, avg=57210.33, stdev=46662.83 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 96], 20.00th=[ 25560], | 30.00th=[ 34341], 40.00th=[ 39584], 50.00th=[ 47449], 60.00th=[ 55837], | 70.00th=[ 70779], 80.00th=[ 86508], 90.00th=[108528], 95.00th=[133694], | 99.00th=[212861], 99.50th=[299893], 99.90th=[442500], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 87, per=25.50%, avg=35.19, stdev=16.77, samples=329 iops : min= 1, max= 21, avg= 8.13, stdev= 4.26, samples=329 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6296KiB/171171msec); 0 zone resets clat (usec): min=1013, max=1602.9k, avg=53876.87, stdev=67619.97 lat (usec): min=1013, max=1602.9k, avg=53879.35, stdev=67620.22 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1270], 10.00th=[ 1778], | 20.00th=[ 5276], 30.00th=[ 9634], 40.00th=[ 23200], | 50.00th=[ 38011], 60.00th=[ 53216], 70.00th=[ 70779], | 80.00th=[ 94897], 90.00th=[ 128451], 95.00th=[ 156238], | 99.00th=[ 238027], 99.50th=[ 299893], 99.90th=[ 505414], | 99.95th=[1602225], 99.99th=[1602225] bw ( KiB/s): min= 7, max= 87, per=25.41%, avg=36.60, stdev=17.46, samples=332 iops : min= 1, max= 21, avg= 8.49, stdev= 4.42, samples=332 lat (usec) : 50=1.43%, 100=3.48%, 250=0.33%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.37%, 4=2.96%, 10=7.49%, 20=5.92%, 50=28.61% lat (msec) : 100=28.84%, 250=14.81%, 500=0.59%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=3.29%, ctx=5948, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143588: Thu Jul 30 03:02:17 2026 read: IOPS=8, BW=34.3KiB/s (35.1kB/s)(5940KiB/173324msec) clat (usec): min=29, max=406329, avg=57288.52, stdev=42083.80 lat (usec): min=29, max=406330, avg=57289.48, stdev=42083.84 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 13042], 20.00th=[ 26870], | 30.00th=[ 34341], 40.00th=[ 42206], 50.00th=[ 50070], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 85459], 90.00th=[109577], 95.00th=[128451], | 99.00th=[187696], 99.50th=[248513], 99.90th=[379585], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 5, max= 87, per=24.96%, avg=34.44, stdev=15.61, samples=334 iops : min= 1, max= 21, avg= 7.94, stdev= 3.93, samples=334 write: IOPS=9, BW=36.6KiB/s (37.5kB/s)(6348KiB/173324msec); 0 zone resets clat (usec): min=1041, max=1552.4k, avg=55194.44, stdev=68417.16 lat (usec): min=1041, max=1552.5k, avg=55205.32, stdev=68416.96 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1237], 10.00th=[ 1434], | 20.00th=[ 5080], 30.00th=[ 10683], 40.00th=[ 23462], | 50.00th=[ 40109], 60.00th=[ 53216], 70.00th=[ 70779], | 80.00th=[ 96994], 90.00th=[ 131597], 95.00th=[ 164627], | 99.00th=[ 242222], 99.50th=[ 304088], 99.90th=[ 480248], | 99.95th=[1551893], 99.99th=[1551893] bw ( KiB/s): min= 7, max= 111, per=25.34%, avg=36.49, stdev=17.71, samples=337 iops : min= 1, max= 27, avg= 8.46, stdev= 4.46, samples=337 lat (usec) : 50=1.50%, 100=2.60%, 250=0.20%, 500=0.07%, 750=0.07% lat (msec) : 2=6.28%, 4=2.57%, 10=6.64%, 20=6.41%, 50=27.44% lat (msec) : 100=30.21%, 250=15.33%, 500=0.65%, 2000=0.03% cpu : usr=0.04%, sys=3.27%, ctx=6011, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143589: Thu Jul 30 03:02:17 2026 read: IOPS=8, BW=34.7KiB/s (35.5kB/s)(6028KiB/173814msec) clat (usec): min=31, max=465044, avg=56879.98, stdev=44294.93 lat (usec): min=31, max=465044, avg=56883.28, stdev=44295.47 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 52], 10.00th=[ 133], 20.00th=[ 24773], | 30.00th=[ 32900], 40.00th=[ 40109], 50.00th=[ 48497], 60.00th=[ 57934], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[112722], 95.00th=[139461], | 99.00th=[202376], 99.50th=[238027], 99.90th=[316670], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 87, per=25.23%, avg=34.81, stdev=16.19, samples=335 iops : min= 1, max= 21, avg= 8.04, stdev= 4.09, samples=335 write: IOPS=9, BW=36.0KiB/s (36.9kB/s)(6260KiB/173814msec); 0 zone resets clat (usec): min=1042, max=1567.9k, avg=55855.87, stdev=70399.03 lat (usec): min=1043, max=1567.9k, avg=55857.34, stdev=70399.03 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1237], 10.00th=[ 1516], | 20.00th=[ 5407], 30.00th=[ 12125], 40.00th=[ 24773], | 50.00th=[ 41157], 60.00th=[ 55837], 70.00th=[ 71828], | 80.00th=[ 93848], 90.00th=[ 131597], 95.00th=[ 164627], | 99.00th=[ 233833], 99.50th=[ 278922], 99.90th=[ 843056], | 99.95th=[1568670], 99.99th=[1568670] bw ( KiB/s): min= 7, max= 103, per=24.97%, avg=35.96, stdev=17.91, samples=337 iops : min= 1, max= 25, avg= 8.32, stdev= 4.53, samples=337 lat (usec) : 50=1.79%, 100=2.99%, 250=0.36%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.83%, 4=2.44%, 10=5.92%, 20=7.29%, 50=27.47% lat (msec) : 100=30.01%, 250=15.10%, 500=0.59%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=3.33%, ctx=6050, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143590: Thu Jul 30 03:02:17 2026 read: IOPS=8, BW=35.6KiB/s (36.4kB/s)(6052KiB/170164msec) clat (usec): min=26, max=1705.7k, avg=55861.14, stdev=58966.68 lat (usec): min=27, max=1705.7k, avg=55862.90, stdev=58966.58 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 52], 10.00th=[ 221], | 20.00th=[ 25297], 30.00th=[ 32113], 40.00th=[ 39060], | 50.00th=[ 46924], 60.00th=[ 55837], 70.00th=[ 67634], | 80.00th=[ 83362], 90.00th=[ 106431], 95.00th=[ 127402], | 99.00th=[ 185598], 99.50th=[ 248513], 99.90th=[ 379585], | 99.95th=[1702888], 99.99th=[1702888] bw ( KiB/s): min= 7, max= 94, per=26.26%, avg=36.24, stdev=16.76, samples=323 iops : min= 1, max= 23, avg= 8.40, stdev= 4.21, samples=323 write: IOPS=9, BW=36.6KiB/s (37.5kB/s)(6236KiB/170164msec); 0 zone resets clat (usec): min=980, max=872550, avg=54526.36, stdev=58839.30 lat (usec): min=981, max=872551, avg=54529.38, stdev=58839.87 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1254], 10.00th=[ 1565], 20.00th=[ 5604], | 30.00th=[ 11076], 40.00th=[ 24249], 50.00th=[ 39584], 60.00th=[ 54789], | 70.00th=[ 71828], 80.00th=[ 98042], 90.00th=[130548], 95.00th=[158335], | 99.00th=[227541], 99.50th=[287310], 99.90th=[450888], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 132, per=25.55%, avg=36.79, stdev=16.44, samples=327 iops : min= 1, max= 33, avg= 8.54, stdev= 4.18, samples=327 lat (usec) : 50=1.89%, 100=2.93%, 250=0.13%, 500=0.07%, 1000=0.10% lat (msec) : 2=5.57%, 4=2.51%, 10=6.74%, 20=6.18%, 50=29.49% lat (msec) : 100=28.32%, 250=15.53%, 500=0.49%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=3.47%, ctx=6123, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=138KiB/s (141kB/s), 34.3KiB/s-35.6KiB/s (35.1kB/s-36.4kB/s), io=23.4MiB (24.6MB), run=170164-173814msec WRITE: bw=145KiB/s (148kB/s), 36.0KiB/s-36.8KiB/s (36.9kB/s-37.7kB/s), io=24.6MiB (25.7MB), run=170164-173814msec fio: pid=143594, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=143592: Thu Jul 30 03:05:24 2026 read: IOPS=4, BW=16.7KiB/s (17.1kB/s)(5992KiB/359614msec) clat (msec): min=5, max=1879, avg=48.74, stdev=68.01 lat (msec): min=5, max=1879, avg=48.74, stdev=68.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 67], 90.00th=[ 103], 95.00th=[ 142], | 99.00th=[ 262], 99.50th=[ 313], 99.90th=[ 439], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 7, max= 87, per=33.55%, avg=20.13, stdev=14.04, samples=571 iops : min= 1, max= 21, avg= 4.42, stdev= 3.55, samples=571 write: IOPS=4, BW=17.5KiB/s (17.9kB/s)(6296KiB/359614msec); 0 zone resets clat (msec): min=36, max=956, avg=182.02, stdev=89.33 lat (msec): min=36, max=956, avg=182.02, stdev=89.33 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 75], 10.00th=[ 91], 20.00th=[ 112], | 30.00th=[ 130], 40.00th=[ 146], 50.00th=[ 167], 60.00th=[ 186], | 70.00th=[ 207], 80.00th=[ 239], 90.00th=[ 296], 95.00th=[ 351], | 99.00th=[ 477], 99.50th=[ 542], 99.90th=[ 936], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 48, per=28.00%, avg=17.64, stdev= 8.33, samples=681 iops : min= 1, max= 12, avg= 3.79, stdev= 2.15, samples=681 lat (msec) : 10=2.15%, 20=11.20%, 50=21.61%, 100=16.18%, 250=39.49% lat (msec) : 500=8.98%, 750=0.29%, 1000=0.07%, 2000=0.03% cpu : usr=0.02%, sys=0.92%, ctx=5272, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143593: Thu Jul 30 03:05:24 2026 read: IOPS=4, BW=16.6KiB/s (16.0kB/s)(5940KiB/357973msec) clat (msec): min=5, max=1676, avg=48.26, stdev=67.05 lat (msec): min=5, max=1676, avg=48.27, stdev=67.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 105], 95.00th=[ 146], | 99.00th=[ 268], 99.50th=[ 296], 99.90th=[ 802], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7, max= 79, per=34.15%, avg=20.49, stdev=13.74, samples=557 iops : min= 1, max= 19, avg= 4.52, stdev= 3.45, samples=557 write: IOPS=4, BW=17.7KiB/s (18.2kB/s)(6348KiB/357973msec); 0 zone resets clat (msec): min=32, max=932, avg=180.34, stdev=87.78 lat (msec): min=32, max=932, avg=180.35, stdev=87.78 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 79], 10.00th=[ 92], 20.00th=[ 108], | 30.00th=[ 126], 40.00th=[ 142], 50.00th=[ 161], 60.00th=[ 184], | 70.00th=[ 209], 80.00th=[ 241], 90.00th=[ 296], 95.00th=[ 342], | 99.00th=[ 468], 99.50th=[ 550], 99.90th=[ 718], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 47, per=28.12%, avg=17.72, stdev= 8.26, samples=684 iops : min= 1, max= 11, avg= 3.81, stdev= 2.14, samples=684 lat (msec) : 10=1.79%, 20=12.24%, 50=21.09%, 100=16.08%, 250=38.87% lat (msec) : 500=9.47%, 750=0.36%, 1000=0.07%, 2000=0.03% cpu : usr=0.03%, sys=0.93%, ctx=5355, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=143594: Thu Jul 30 03:05:24 2026 read: IOPS=3, BW=14.5KiB/s (14.9kB/s)(3672KiB/252375msec) clat (msec): min=5, max=632, avg=60.52, stdev=59.03 lat (msec): min=5, max=632, avg=60.52, stdev=59.03 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 67], 80.00th=[ 91], 90.00th=[ 125], 95.00th=[ 161], | 99.00th=[ 296], 99.50th=[ 368], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 95, per=29.80%, avg=17.88, stdev=12.36, samples=391 iops : min= 1, max= 23, avg= 3.83, stdev= 3.13, samples=391 write: IOPS=3, BW=15.1KiB/s (15.5kB/s)(3808KiB/252375msec); 0 zone resets clat (msec): min=42, max=1885, avg=206.59, stdev=109.32 lat (msec): min=42, max=1885, avg=206.59, stdev=109.32 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 87], 10.00th=[ 103], 20.00th=[ 125], | 30.00th=[ 146], 40.00th=[ 165], 50.00th=[ 188], 60.00th=[ 211], | 70.00th=[ 241], 80.00th=[ 271], 90.00th=[ 334], 95.00th=[ 397], | 99.00th=[ 527], 99.50th=[ 592], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 7, max= 40, per=24.46%, avg=15.41, stdev= 7.40, samples=467 iops : min= 1, max= 10, avg= 3.21, stdev= 1.91, samples=467 lat (msec) : 10=1.18%, 20=7.16%, 50=20.74%, 100=16.09%, 250=40.46% lat (msec) : 500=13.63%, 750=0.64%, 2000=0.05% cpu : usr=0.02%, sys=0.80%, ctx=2758, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=919,952,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143595: Thu Jul 30 03:05:24 2026 read: IOPS=4, BW=17.0KiB/s (17.5kB/s)(6052KiB/354975msec) clat (msec): min=4, max=595, avg=46.65, stdev=49.13 lat (msec): min=4, max=595, avg=46.65, stdev=49.13 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 68], 90.00th=[ 105], 95.00th=[ 142], | 99.00th=[ 245], 99.50th=[ 279], 99.90th=[ 414], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 111, per=34.68%, avg=20.81, stdev=14.91, samples=559 iops : min= 1, max= 27, avg= 4.60, stdev= 3.76, samples=559 write: IOPS=4, BW=17.6KiB/s (17.0kB/s)(6236KiB/354975msec); 0 zone resets clat (msec): min=35, max=1854, avg=182.30, stdev=97.86 lat (msec): min=35, max=1854, avg=182.31, stdev=97.87 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 75], 10.00th=[ 89], 20.00th=[ 110], | 30.00th=[ 128], 40.00th=[ 146], 50.00th=[ 163], 60.00th=[ 184], | 70.00th=[ 209], 80.00th=[ 243], 90.00th=[ 296], 95.00th=[ 351], | 99.00th=[ 481], 99.50th=[ 535], 99.90th=[ 961], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 7, max= 48, per=27.82%, avg=17.53, stdev= 8.37, samples=679 iops : min= 1, max= 12, avg= 3.77, stdev= 2.17, samples=679 lat (msec) : 10=2.12%, 20=13.35%, 50=20.41%, 100=15.79%, 250=38.57% lat (msec) : 500=9.44%, 750=0.26%, 1000=0.03%, 2000=0.03% cpu : usr=0.02%, sys=0.90%, ctx=5262, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=60.2KiB/s (61.7kB/s), 14.5KiB/s-17.0KiB/s (14.9kB/s-17.5kB/s), io=21.1MiB (22.2MB), run=252375-359614msec WRITE: bw=63.1KiB/s (64.6kB/s), 15.1KiB/s-17.7KiB/s (15.5kB/s-18.2kB/s), io=22.2MiB (23.2MB), run=252375-359614msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143671: Thu Jul 30 03:06:11 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5920KiB/35210msec) clat (usec): min=32, max=429605, avg=50496.71, stdev=45703.13 lat (usec): min=33, max=429607, avg=50498.81, stdev=45702.00 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 51], 10.00th=[ 56], 20.00th=[ 104], | 30.00th=[ 28705], 40.00th=[ 40109], 50.00th=[ 45876], 60.00th=[ 53216], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[120062], | 99.00th=[187696], 99.50th=[358613], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 31, max= 288, per=24.99%, avg=166.19, stdev=60.73, samples=69 iops : min= 1, max= 18, avg= 9.62, stdev= 3.87, samples=69 write: IOPS=11, BW=181KiB/s (185kB/s)(6368KiB/35210msec); 0 zone resets clat (usec): min=1412, max=248096, avg=40940.70, stdev=43199.45 lat (usec): min=1412, max=248098, avg=40943.71, stdev=43200.91 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1795], 10.00th=[ 3687], 20.00th=[ 6259], | 30.00th=[ 9634], 40.00th=[ 16450], 50.00th=[ 24249], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[129500], | 99.00th=[219153], 99.50th=[227541], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 413, per=26.08%, avg=182.53, stdev=83.34, samples=68 iops : min= 1, max= 25, avg=10.66, stdev= 5.26, samples=68 lat (usec) : 50=2.21%, 100=7.29%, 250=0.39%, 500=0.26%, 750=0.13% lat (msec) : 2=3.39%, 4=2.47%, 10=10.42%, 20=7.94%, 50=26.82% lat (msec) : 100=28.91%, 250=9.51%, 500=0.26% cpu : usr=0.05%, sys=3.75%, ctx=1350, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143672: Thu Jul 30 03:06:11 2026 read: IOPS=9, BW=160KiB/s (163kB/s)(5744KiB/35983msec) clat (usec): min=37, max=260947, avg=50660.05, stdev=40481.26 lat (usec): min=37, max=260948, avg=50661.02, stdev=40481.26 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 49], 10.00th=[ 59], 20.00th=[ 20317], | 30.00th=[ 31327], 40.00th=[ 39060], 50.00th=[ 46400], 60.00th=[ 55313], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 95945], 95.00th=[125305], | 99.00th=[196084], 99.50th=[229639], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 319, per=23.88%, avg=158.83, stdev=72.65, samples=70 iops : min= 1, max= 19, avg= 9.16, stdev= 4.50, samples=70 write: IOPS=11, BW=182KiB/s (186kB/s)(6544KiB/35983msec); 0 zone resets clat (usec): min=1339, max=442650, avg=43216.77, stdev=50585.62 lat (usec): min=1340, max=442652, avg=43219.98, stdev=50587.52 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1811], 10.00th=[ 3261], 20.00th=[ 6325], | 30.00th=[ 10028], 40.00th=[ 13960], 50.00th=[ 24773], 60.00th=[ 37487], | 70.00th=[ 55313], 80.00th=[ 74974], 90.00th=[110625], 95.00th=[135267], | 99.00th=[210764], 99.50th=[233833], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 31, max= 377, per=25.87%, avg=181.07, stdev=67.91, samples=70 iops : min= 1, max= 23, avg=10.56, stdev= 4.28, samples=70 lat (usec) : 50=2.34%, 100=5.73%, 250=0.13%, 500=0.26% lat (msec) : 2=3.39%, 4=3.52%, 10=9.24%, 20=9.77%, 50=26.69% lat (msec) : 100=28.91%, 250=9.64%, 500=0.39% cpu : usr=0.05%, sys=3.70%, ctx=1285, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143673: Thu Jul 30 03:06:11 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(6256KiB/35578msec) clat (usec): min=38, max=269220, avg=53631.49, stdev=42281.33 lat (usec): min=39, max=269221, avg=53632.70, stdev=42281.27 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 21103], | 30.00th=[ 32900], 40.00th=[ 42206], 50.00th=[ 47973], 60.00th=[ 56886], | 70.00th=[ 71828], 80.00th=[ 81265], 90.00th=[ 99091], 95.00th=[125305], | 99.00th=[212861], 99.50th=[258999], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 349, per=26.42%, avg=175.69, stdev=71.53, samples=70 iops : min= 1, max= 21, avg=10.23, stdev= 4.46, samples=70 write: IOPS=10, BW=170KiB/s (174kB/s)(6032KiB/35578msec); 0 zone resets clat (usec): min=1250, max=319485, avg=38168.47, stdev=42589.95 lat (usec): min=1252, max=319487, avg=38170.16, stdev=42589.96 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1745], 10.00th=[ 2802], 20.00th=[ 6259], | 30.00th=[ 8979], 40.00th=[ 13435], 50.00th=[ 26084], 60.00th=[ 36439], | 70.00th=[ 47973], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[107480], | 99.00th=[185598], 99.50th=[304088], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 347, per=24.12%, avg=168.84, stdev=80.93, samples=70 iops : min= 1, max= 21, avg= 9.79, stdev= 5.08, samples=70 lat (usec) : 50=1.30%, 100=7.29%, 250=0.39%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.43%, 4=1.43%, 10=10.94%, 20=7.29%, 50=28.52% lat (msec) : 100=29.82%, 250=7.55%, 500=0.65% cpu : usr=0.04%, sys=3.68%, ctx=1346, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143674: Thu Jul 30 03:06:11 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(6032KiB/34044msec) clat (usec): min=31, max=286068, avg=49738.39, stdev=40184.73 lat (usec): min=31, max=286068, avg=49739.36, stdev=40184.71 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 58], 20.00th=[ 186], | 30.00th=[ 30016], 40.00th=[ 39584], 50.00th=[ 46924], 60.00th=[ 56886], | 70.00th=[ 66323], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[115868], | 99.00th=[175113], 99.50th=[270533], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 381, per=26.55%, avg=176.57, stdev=75.67, samples=67 iops : min= 1, max= 23, avg=10.28, stdev= 4.75, samples=67 write: IOPS=11, BW=184KiB/s (188kB/s)(6256KiB/34044msec); 0 zone resets clat (usec): min=1343, max=481175, avg=38567.06, stdev=48725.57 lat (usec): min=1345, max=481177, avg=38572.45, stdev=48723.90 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 2802], 20.00th=[ 5538], | 30.00th=[ 7963], 40.00th=[ 12125], 50.00th=[ 20317], 60.00th=[ 33162], | 70.00th=[ 46924], 80.00th=[ 63701], 90.00th=[ 94897], 95.00th=[131597], | 99.00th=[198181], 99.50th=[304088], 99.90th=[480248], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 32, max= 411, per=26.19%, avg=183.30, stdev=76.05, samples=67 iops : min= 2, max= 25, avg=10.72, stdev= 4.77, samples=67 lat (usec) : 50=1.43%, 100=7.68%, 250=0.78%, 500=0.26%, 1000=0.13% lat (msec) : 2=4.69%, 4=2.73%, 10=11.07%, 20=8.07%, 50=26.04% lat (msec) : 100=27.86%, 250=8.72%, 500=0.52% cpu : usr=0.05%, sys=3.75%, ctx=1287, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=666KiB/s (682kB/s), 160KiB/s-177KiB/s (163kB/s-181kB/s), io=23.4MiB (24.5MB), run=34044-35983msec WRITE: bw=700KiB/s (717kB/s), 170KiB/s-184KiB/s (174kB/s-188kB/s), io=24.6MiB (25.8MB), run=34044-35983msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143676: Thu Jul 30 03:07:05 2026 read: IOPS=4, BW=67.0KiB/s (68.6kB/s)(5920KiB/88346msec) clat (msec): min=6, max=472, avg=48.94, stdev=51.95 lat (msec): min=6, max=472, avg=48.94, stdev=51.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 102], 95.00th=[ 138], | 99.00th=[ 279], 99.50th=[ 388], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 30, max= 281, per=30.09%, avg=80.35, stdev=47.32, samples=144 iops : min= 1, max= 17, avg= 4.26, stdev= 2.99, samples=144 write: IOPS=4, BW=72.1KiB/s (73.8kB/s)(6368KiB/88346msec); 0 zone resets clat (msec): min=43, max=604, avg=176.35, stdev=79.54 lat (msec): min=43, max=604, avg=176.35, stdev=79.54 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 81], 10.00th=[ 95], 20.00th=[ 113], | 30.00th=[ 129], 40.00th=[ 144], 50.00th=[ 159], 60.00th=[ 180], | 70.00th=[ 203], 80.00th=[ 232], 90.00th=[ 275], 95.00th=[ 334], | 99.00th=[ 435], 99.50th=[ 472], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 22, max= 160, per=26.32%, avg=73.96, stdev=30.58, samples=169 iops : min= 1, max= 10, avg= 3.85, stdev= 1.99, samples=169 lat (msec) : 10=1.43%, 20=9.38%, 50=23.44%, 100=15.49%, 250=41.54% lat (msec) : 500=8.59%, 750=0.13% cpu : usr=0.02%, sys=1.01%, ctx=1273, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143677: Thu Jul 30 03:07:05 2026 read: IOPS=4, BW=64.2KiB/s (65.8kB/s)(5744KiB/89426msec) clat (msec): min=6, max=414, avg=49.06, stdev=48.43 lat (msec): min=6, max=414, avg=49.06, stdev=48.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 96], 95.00th=[ 140], | 99.00th=[ 257], 99.50th=[ 309], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 21, max= 320, per=30.04%, avg=80.22, stdev=50.87, samples=141 iops : min= 1, max= 20, avg= 4.25, stdev= 3.24, samples=141 write: IOPS=4, BW=73.2KiB/s (74.9kB/s)(6544KiB/89426msec); 0 zone resets clat (msec): min=47, max=638, avg=175.38, stdev=74.79 lat (msec): min=47, max=638, avg=175.39, stdev=74.79 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 85], 10.00th=[ 94], 20.00th=[ 114], | 30.00th=[ 132], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 178], | 70.00th=[ 194], 80.00th=[ 230], 90.00th=[ 275], 95.00th=[ 313], | 99.00th=[ 405], 99.50th=[ 435], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 30, max= 159, per=26.45%, avg=74.33, stdev=30.06, samples=172 iops : min= 1, max= 9, avg= 3.87, stdev= 1.96, samples=172 lat (msec) : 10=0.91%, 20=7.81%, 50=25.65%, 100=14.06%, 250=42.58% lat (msec) : 500=8.72%, 750=0.26% cpu : usr=0.02%, sys=1.00%, ctx=1276, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143678: Thu Jul 30 03:07:05 2026 read: IOPS=4, BW=72.6KiB/s (74.4kB/s)(6256KiB/86139msec) clat (msec): min=8, max=389, avg=51.37, stdev=51.45 lat (msec): min=8, max=389, avg=51.37, stdev=51.45 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 71], 90.00th=[ 102], 95.00th=[ 176], | 99.00th=[ 284], 99.50th=[ 368], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 29, max= 319, per=33.20%, avg=88.64, stdev=59.58, samples=139 iops : min= 1, max= 19, avg= 4.76, stdev= 3.75, samples=139 write: IOPS=4, BW=70.0KiB/s (71.7kB/s)(6032KiB/86139msec); 0 zone resets clat (msec): min=45, max=537, avg=175.13, stdev=70.10 lat (msec): min=45, max=537, avg=175.13, stdev=70.10 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 83], 10.00th=[ 100], 20.00th=[ 120], | 30.00th=[ 134], 40.00th=[ 142], 50.00th=[ 161], 60.00th=[ 180], | 70.00th=[ 203], 80.00th=[ 228], 90.00th=[ 268], 95.00th=[ 309], | 99.00th=[ 384], 99.50th=[ 393], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 191, per=25.21%, avg=70.84, stdev=28.40, samples=166 iops : min= 1, max= 11, avg= 3.64, stdev= 1.86, samples=166 lat (msec) : 10=0.52%, 20=9.38%, 50=26.17%, 100=14.84%, 250=41.02% lat (msec) : 500=7.94%, 750=0.13% cpu : usr=0.03%, sys=1.02%, ctx=1387, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143679: Thu Jul 30 03:07:05 2026 read: IOPS=4, BW=67.7KiB/s (69.3kB/s)(6032KiB/89094msec) clat (msec): min=6, max=373, avg=50.14, stdev=55.39 lat (msec): min=6, max=373, avg=50.15, stdev=55.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 108], 95.00th=[ 155], | 99.00th=[ 321], 99.50th=[ 368], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 288, per=32.29%, avg=86.22, stdev=54.88, samples=136 iops : min= 1, max= 18, avg= 4.62, stdev= 3.50, samples=136 write: IOPS=4, BW=70.2KiB/s (71.9kB/s)(6256KiB/89094msec); 0 zone resets clat (msec): min=47, max=545, avg=179.43, stdev=83.07 lat (msec): min=47, max=545, avg=179.43, stdev=83.07 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 80], 10.00th=[ 90], 20.00th=[ 113], | 30.00th=[ 132], 40.00th=[ 150], 50.00th=[ 165], 60.00th=[ 184], | 70.00th=[ 205], 80.00th=[ 236], 90.00th=[ 284], 95.00th=[ 347], | 99.00th=[ 443], 99.50th=[ 542], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 23, max= 191, per=25.78%, avg=72.45, stdev=32.02, samples=169 iops : min= 1, max= 11, avg= 3.75, stdev= 2.04, samples=169 lat (msec) : 10=1.04%, 20=10.94%, 50=24.48%, 100=14.84%, 250=39.19% lat (msec) : 500=9.24%, 750=0.26% cpu : usr=0.01%, sys=1.02%, ctx=1346, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=268KiB/s (274kB/s), 64.2KiB/s-72.6KiB/s (65.8kB/s-74.4kB/s), io=23.4MiB (24.5MB), run=86139-89426msec WRITE: bw=282KiB/s (289kB/s), 70.0KiB/s-73.2KiB/s (71.7kB/s-74.9kB/s), io=24.6MiB (25.8MB), run=86139-89426msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143699: Thu Jul 30 03:07:31 2026 read: IOPS=0, BW=786KiB/s (805kB/s)(7168KiB/9122msec) clat (msec): min=110, max=1842, avg=481.04, stdev=623.77 lat (msec): min=110, max=1842, avg=481.05, stdev=623.77 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 128], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 222], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 609], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1954, max= 4511, per=100.00%, avg=3501.33, stdev=1360.65, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=561KiB/s (575kB/s)(5120KiB/9122msec); 0 zone resets clat (msec): min=375, max=3836, avg=1140.27, stdev=1510.25 lat (msec): min=375, max=3836, avg=1140.57, stdev=1510.12 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 1828, max= 2039, per=93.11%, avg=1965.60, stdev=83.38, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.43%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143700: Thu Jul 30 03:07:31 2026 read: IOPS=0, BW=154KiB/s (157kB/s)(2048KiB/13321msec) clat (msec): min=161, max=321, avg=241.53, stdev=113.39 lat (msec): min=161, max=321, avg=241.53, stdev=113.39 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1595, max= 1988, per=100.00%, avg=1791.50, stdev=277.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=769KiB/s (787kB/s)(10.0MiB/13321msec); 0 zone resets clat (msec): min=172, max=4717, avg=1268.56, stdev=1554.79 lat (msec): min=172, max=4717, avg=1268.72, stdev=1554.73 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 230], | 30.00th=[ 284], 40.00th=[ 347], 50.00th=[ 426], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 2668], 90.00th=[ 2735], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1988, max= 4063, per=100.00%, avg=2673.67, stdev=1028.62, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, >=2000=25.00% cpu : usr=0.00%, sys=1.19%, ctx=110, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143701: Thu Jul 30 03:07:31 2026 read: IOPS=0, BW=470KiB/s (482kB/s)(6144KiB/13062msec) clat (msec): min=124, max=760, avg=346.08, stdev=227.99 lat (msec): min=124, max=760, avg=346.08, stdev=227.99 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 321], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2023, max= 3976, per=100.00%, avg=3218.67, stdev=1047.69, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=470KiB/s (482kB/s)(6144KiB/13062msec); 0 zone resets clat (msec): min=352, max=5825, avg=1807.54, stdev=2151.57 lat (msec): min=352, max=5825, avg=1807.85, stdev=2151.42 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 852], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 5805], 95.00th=[ 5805], | 99.00th=[ 5805], 99.50th=[ 5805], 99.90th=[ 5805], 99.95th=[ 5805], | 99.99th=[ 5805] bw ( KiB/s): min= 1954, max= 2039, per=95.07%, avg=2007.00, stdev=29.81, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=16.67%, 500=41.67%, 750=8.33%, 1000=16.67%, >=2000=16.67% cpu : usr=0.01%, sys=1.27%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143703: Thu Jul 30 03:07:31 2026 read: IOPS=0, BW=377KiB/s (386kB/s)(5120KiB/13579msec) clat (msec): min=134, max=892, avg=561.03, stdev=361.26 lat (msec): min=134, max=892, avg=561.03, stdev=361.26 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1988, max= 4007, per=100.00%, avg=2672.67, stdev=1155.70, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=528KiB/s (541kB/s)(7168KiB/13579msec); 0 zone resets clat (msec): min=207, max=5741, avg=1502.98, stdev=2026.10 lat (msec): min=207, max=5742, avg=1503.23, stdev=2025.98 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 249], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 558], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 2500], 90.00th=[ 5738], 95.00th=[ 5738], | 99.00th=[ 5738], 99.50th=[ 5738], 99.90th=[ 5738], 99.95th=[ 5738], | 99.99th=[ 5738] bw ( KiB/s): min= 2035, max= 4079, per=100.00%, avg=2770.60, stdev=1012.84, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=33.33%, 750=33.33%, 1000=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=1.01%, ctx=91, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1508KiB/s (1544kB/s), 154KiB/s-786KiB/s (157kB/s-805kB/s), io=20.0MiB (20.0MB), run=9122-13579msec WRITE: bw=2111KiB/s (2162kB/s), 470KiB/s-769KiB/s (482kB/s-787kB/s), io=28.0MiB (29.4MB), run=9122-13579msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143702: Thu Jul 30 03:07:31 2026 read: IOPS=0, BW=580KiB/s (594kB/s)(7168KiB/12350msec) clat (usec): min=404, max=4757.7k, avg=1561141.04, stdev=1987203.64 lat (usec): min=405, max=4757.7k, avg=1561143.41, stdev=1987206.10 clat percentiles (usec): | 1.00th=[ 404], 5.00th=[ 404], 10.00th=[ 404], | 20.00th=[ 437], 30.00th=[ 4424], 40.00th=[ 4424], | 50.00th=[ 278922], 60.00th=[2332034], 70.00th=[2332034], | 80.00th=[3539993], 90.00th=[4731175], 95.00th=[4731175], | 99.00th=[4731175], 99.50th=[4731175], 99.90th=[4731175], | 99.95th=[4731175], 99.99th=[4731175] bw ( KiB/s): min= 1973, max= 4063, per=100.00%, avg=2414.80, stdev=921.76, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=415KiB/s (425kB/s)(5120KiB/12350msec); 0 zone resets clat (msec): min=100, max=274, avg=206.51, stdev=65.26 lat (msec): min=100, max=274, avg=206.55, stdev=65.25 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2023, max= 4071, per=100.00%, avg=2708.33, stdev=1180.11, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=16.67% lat (msec) : 10=8.33%, 250=33.33%, 500=16.67%, >=2000=25.00% cpu : usr=0.00%, sys=4.41%, ctx=985, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143704: Thu Jul 30 03:07:31 2026 read: IOPS=0, BW=152KiB/s (155kB/s)(2048KiB/13517msec) clat (usec): min=432, max=197267, avg=98849.89, stdev=139183.10 lat (usec): min=433, max=197269, avg=98851.82, stdev=139184.18 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 433], | 30.00th=[ 433], 40.00th=[ 433], 50.00th=[ 433], 60.00th=[198181], | 70.00th=[198181], 80.00th=[198181], 90.00th=[198181], 95.00th=[198181], | 99.00th=[198181], 99.50th=[198181], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 1519, max= 1988, per=100.00%, avg=1753.50, stdev=331.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=758KiB/s (776kB/s)(10.0MiB/13517msec); 0 zone resets clat (msec): min=188, max=4888, avg=1314.20, stdev=1615.94 lat (msec): min=188, max=4888, avg=1314.31, stdev=1615.95 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 203], | 30.00th=[ 305], 40.00th=[ 351], 50.00th=[ 384], 60.00th=[ 481], | 70.00th=[ 751], 80.00th=[ 2735], 90.00th=[ 2869], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 1988, max= 4063, per=100.00%, avg=2597.71, stdev=977.15, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (usec) : 500=8.33% lat (msec) : 250=25.00%, 500=33.33%, 1000=8.33%, >=2000=25.00% cpu : usr=0.01%, sys=3.54%, ctx=122, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143705: Thu Jul 30 03:07:31 2026 read: IOPS=0, BW=489KiB/s (501kB/s)(6144KiB/12557msec) clat (usec): min=452, max=450970, avg=222147.12, stdev=184990.82 lat (usec): min=453, max=450971, avg=222148.30, stdev=184990.63 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 2737], | 30.00th=[ 2737], 40.00th=[231736], 50.00th=[231736], 60.00th=[304088], | 70.00th=[341836], 80.00th=[341836], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 1950, max= 3976, per=100.00%, avg=2488.25, stdev=992.44, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=489KiB/s (501kB/s)(6144KiB/12557msec); 0 zone resets clat (msec): min=299, max=6372, avg=1773.41, stdev=2434.12 lat (msec): min=299, max=6372, avg=1773.46, stdev=2434.11 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 506], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 6342], 95.00th=[ 6342], | 99.00th=[ 6342], 99.50th=[ 6342], 99.90th=[ 6342], 99.95th=[ 6342], | 99.99th=[ 6342] bw ( KiB/s): min= 1950, max= 2043, per=94.47%, avg=2003.80, stdev=36.44, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=8.33%, 500=50.00%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=3.07%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143706: Thu Jul 30 03:07:31 2026 read: IOPS=0, BW=403KiB/s (413kB/s)(5120KiB/12702msec) clat (usec): min=485, max=539403, avg=254492.64, stdev=212414.20 lat (usec): min=486, max=539404, avg=254493.77, stdev=212414.26 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[133694], 40.00th=[133694], 50.00th=[210764], 60.00th=[210764], | 70.00th=[387974], 80.00th=[387974], 90.00th=[541066], 95.00th=[541066], | 99.00th=[541066], 99.50th=[541066], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 1992, max= 5965, per=100.00%, avg=3978.50, stdev=2809.34, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=564KiB/s (578kB/s)(7168KiB/12702msec); 0 zone resets clat (msec): min=289, max=6104, avg=1534.12, stdev=2207.08 lat (msec): min=289, max=6104, avg=1534.24, stdev=2207.04 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 313], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 380], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 2769], 90.00th=[ 6074], 95.00th=[ 6074], | 99.00th=[ 6074], 99.50th=[ 6074], 99.90th=[ 6074], 99.95th=[ 6074], | 99.99th=[ 6074] bw ( KiB/s): min= 1950, max= 4007, per=100.00%, avg=2508.75, stdev=999.72, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=4.24%, ctx=223, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1515KiB/s (1551kB/s), 152KiB/s-580KiB/s (155kB/s-594kB/s), io=20.0MiB (20.0MB), run=12350-13517msec WRITE: bw=2121KiB/s (2172kB/s), 415KiB/s-758KiB/s (425kB/s-776kB/s), io=28.0MiB (29.4MB), run=12350-13517msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143719: Thu Jul 30 03:07:57 2026 read: IOPS=0, BW=1104KiB/s (1130kB/s)(12.0MiB/11131msec) clat (msec): min=1955, max=6128, avg=3702.92, stdev=2167.50 lat (msec): min=1955, max=6128, avg=3702.92, stdev=2167.50 clat percentiles (msec): | 1.00th=[ 1955], 5.00th=[ 1955], 10.00th=[ 1955], 20.00th=[ 1955], | 30.00th=[ 1955], 40.00th=[ 3037], 50.00th=[ 3037], 60.00th=[ 3037], | 70.00th=[ 6141], 80.00th=[ 6141], 90.00th=[ 6141], 95.00th=[ 6141], | 99.00th=[ 6141], 99.50th=[ 6141], 99.90th=[ 6141], 99.95th=[ 6141], | 99.99th=[ 6141] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=0.77%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143720: Thu Jul 30 03:07:57 2026 read: IOPS=0, BW=567KiB/s (581kB/s)(4096KiB/7219msec) clat (nsec): min=993441k, max=993441k, avg=993441053.00, stdev= 0.00 lat (nsec): min=993444k, max=993444k, avg=993443510.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1135KiB/s (1162kB/s)(8192KiB/7219msec); 0 zone resets clat (msec): min=1245, max=4890, avg=3067.92, stdev=2577.49 lat (msec): min=1245, max=4890, avg=3068.05, stdev=2577.48 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 4866], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.30%, ctx=46, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143721: Thu Jul 30 03:07:57 2026 write: IOPS=0, BW=1120KiB/s (1147kB/s)(12.0MiB/10973msec); 0 zone resets clat (msec): min=2018, max=5845, avg=3642.05, stdev=1978.55 lat (msec): min=2018, max=5854, avg=3645.34, stdev=1983.01 clat percentiles (msec): | 1.00th=[ 2022], 5.00th=[ 2022], 10.00th=[ 2022], 20.00th=[ 2022], | 30.00th=[ 2022], 40.00th=[ 3071], 50.00th=[ 3071], 60.00th=[ 3071], | 70.00th=[ 5873], 80.00th=[ 5873], 90.00th=[ 5873], 95.00th=[ 5873], | 99.00th=[ 5873], 99.50th=[ 5873], 99.90th=[ 5873], 99.95th=[ 5873], | 99.99th=[ 5873] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : >=2000=100.00% cpu : usr=0.00%, sys=1.02%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143722: Thu Jul 30 03:07:57 2026 write: IOPS=0, BW=1112KiB/s (1138kB/s)(12.0MiB/11054msec); 0 zone resets clat (msec): min=1217, max=4909, avg=3654.92, stdev=2111.39 lat (msec): min=1217, max=4910, avg=3655.17, stdev=2111.46 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 4866], 50.00th=[ 4866], 60.00th=[ 4866], | 70.00th=[ 4933], 80.00th=[ 4933], 90.00th=[ 4933], 95.00th=[ 4933], | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], | 99.99th=[ 4933] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.19%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1472KiB/s (1507kB/s), 567KiB/s-1104KiB/s (581kB/s-1130kB/s), io=16.0MiB (16.8MB), run=7219-11131msec WRITE: bw=2964KiB/s (3036kB/s), 1112KiB/s-1135KiB/s (1138kB/s-1162kB/s), io=32.0MiB (33.6MB), run=7219-11054msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143715: Thu Jul 30 03:07:58 2026 read: IOPS=0, BW=1149KiB/s (1177kB/s)(12.0MiB/10692msec) clat (msec): min=822, max=4881, avg=3449.60, stdev=2278.53 lat (msec): min=822, max=4881, avg=3449.60, stdev=2278.53 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 4665], 50.00th=[ 4665], 60.00th=[ 4665], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=4.47%, ctx=908, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143716: Thu Jul 30 03:07:58 2026 read: IOPS=0, BW=588KiB/s (602kB/s)(4096KiB/6967msec) clat (nsec): min=848291k, max=848291k, avg=848290584.00, stdev= 0.00 lat (nsec): min=848292k, max=848292k, avg=848292463.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1176KiB/s (1204kB/s)(8192KiB/6967msec); 0 zone resets clat (msec): min=805, max=5064, avg=2935.32, stdev=3011.40 lat (msec): min=806, max=5069, avg=2937.89, stdev=3014.60 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 5067], | 70.00th=[ 5067], 80.00th=[ 5067], 90.00th=[ 5067], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.37%, ctx=159, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143717: Thu Jul 30 03:07:58 2026 write: IOPS=0, BW=1054KiB/s (1079kB/s)(12.0MiB/11661msec); 0 zone resets clat (msec): min=2175, max=5401, avg=3820.93, stdev=1614.06 lat (msec): min=2175, max=5401, avg=3821.33, stdev=1614.18 clat percentiles (msec): | 1.00th=[ 2165], 5.00th=[ 2165], 10.00th=[ 2165], 20.00th=[ 2165], | 30.00th=[ 2165], 40.00th=[ 3876], 50.00th=[ 3876], 60.00th=[ 3876], | 70.00th=[ 5403], 80.00th=[ 5403], 90.00th=[ 5403], 95.00th=[ 5403], | 99.00th=[ 5403], 99.50th=[ 5403], 99.90th=[ 5403], 99.95th=[ 5403], | 99.99th=[ 5403] bw ( KiB/s): min= 7984, max= 8031, per=100.00%, avg=8007.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : >=2000=100.00% cpu : usr=0.00%, sys=1.04%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143718: Thu Jul 30 03:07:58 2026 write: IOPS=0, BW=1135KiB/s (1162kB/s)(12.0MiB/10826msec); 0 zone resets clat (msec): min=790, max=5442, avg=3550.43, stdev=2444.21 lat (msec): min=791, max=5443, avg=3550.75, stdev=2444.14 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 4396], 50.00th=[ 4396], 60.00th=[ 4396], | 70.00th=[ 5470], 80.00th=[ 5470], 90.00th=[ 5470], 95.00th=[ 5470], | 99.00th=[ 5470], 99.50th=[ 5470], 99.90th=[ 5470], 99.95th=[ 5470], | 99.99th=[ 5470] bw ( KiB/s): min= 8031, max= 8047, per=100.00%, avg=8039.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=1.01%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1532KiB/s (1569kB/s), 588KiB/s-1149KiB/s (602kB/s-1177kB/s), io=16.0MiB (16.8MB), run=6967-10692msec WRITE: bw=2810KiB/s (2877kB/s), 1054KiB/s-1176KiB/s (1079kB/s-1204kB/s), io=32.0MiB (33.6MB), run=6967-11661msec