== sanity test 398b: DIO and buffer IO race ============== 10:00:23 (1788530423) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.25013 s, 6.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177872: Fri Sep 4 10:03:23 2026 read: IOPS=9, BW=38.8KiB/s (39.8kB/s)(5992KiB/154268msec) clat (usec): min=50, max=361038, avg=56422.64, stdev=35422.18 lat (usec): min=51, max=361040, avg=56428.87, stdev=35422.65 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 13829], 10.00th=[ 21365], 20.00th=[ 29230], | 30.00th=[ 35390], 40.00th=[ 42206], 50.00th=[ 50070], 60.00th=[ 57934], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[102237], 95.00th=[119014], | 99.00th=[168821], 99.50th=[191890], 99.90th=[291505], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 79, per=25.47%, avg=38.71, stdev=14.91, samples=301 iops : min= 1, max= 19, avg= 9.02, stdev= 3.76, samples=301 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6296KiB/154268msec); 0 zone resets clat (usec): min=1101, max=1343.3k, avg=43846.77, stdev=53828.79 lat (usec): min=1103, max=1343.3k, avg=43857.54, stdev=53831.63 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1500], 10.00th=[ 2573], | 20.00th=[ 5997], 30.00th=[ 11863], 40.00th=[ 21103], | 50.00th=[ 31589], 60.00th=[ 41681], 70.00th=[ 54264], | 80.00th=[ 73925], 90.00th=[ 104334], 95.00th=[ 127402], | 99.00th=[ 189793], 99.50th=[ 208667], 99.90th=[ 295699], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 6, max= 108, per=25.47%, avg=40.50, stdev=18.05, samples=302 iops : min= 1, max= 27, avg= 9.47, stdev= 4.54, samples=302 lat (usec) : 100=1.66%, 250=0.10%, 500=0.03% lat (msec) : 2=4.36%, 4=3.26%, 10=7.00%, 20=7.65%, 50=34.47% lat (msec) : 100=30.47%, 250=10.81%, 500=0.16%, 2000=0.03% cpu : usr=0.09%, sys=4.82%, ctx=6790, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177873: Fri Sep 4 10:03:23 2026 read: IOPS=9, BW=38.6KiB/s (39.6kB/s)(5940KiB/153736msec) clat (usec): min=37, max=1378.2k, avg=57361.53, stdev=50143.02 lat (usec): min=38, max=1378.2k, avg=57365.79, stdev=50142.94 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 15008], 10.00th=[ 21890], | 20.00th=[ 29230], 30.00th=[ 35390], 40.00th=[ 41681], | 50.00th=[ 49021], 60.00th=[ 56886], 70.00th=[ 66847], | 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[ 124257], | 99.00th=[ 198181], 99.50th=[ 231736], 99.90th=[ 267387], | 99.95th=[1384121], 99.99th=[1384121] bw ( KiB/s): min= 7, max= 95, per=25.15%, avg=38.23, stdev=16.18, samples=300 iops : min= 1, max= 23, avg= 8.90, stdev= 4.08, samples=300 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6348KiB/153736msec); 0 zone resets clat (usec): min=943, max=375235, avg=42774.55, stdev=43700.31 lat (usec): min=944, max=375236, avg=42778.24, stdev=43700.48 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1516], 10.00th=[ 2040], 20.00th=[ 5473], | 30.00th=[ 10814], 40.00th=[ 21103], 50.00th=[ 30016], 60.00th=[ 42206], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[104334], 95.00th=[126354], | 99.00th=[193987], 99.50th=[217056], 99.90th=[316670], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 103, per=25.91%, avg=41.19, stdev=19.66, samples=297 iops : min= 1, max= 25, avg= 9.65, stdev= 4.96, samples=297 lat (usec) : 50=0.07%, 100=1.33%, 250=0.03%, 500=0.03%, 1000=0.07% lat (msec) : 2=5.14%, 4=3.32%, 10=6.54%, 20=7.16%, 50=35.58% lat (msec) : 100=30.53%, 250=9.93%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=4.86%, ctx=6648, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177874: Fri Sep 4 10:03:23 2026 read: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6028KiB/151217msec) clat (usec): min=36, max=276292, avg=56024.80, stdev=35755.51 lat (usec): min=37, max=276293, avg=56031.71, stdev=35755.75 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 14484], 10.00th=[ 21627], 20.00th=[ 28705], | 30.00th=[ 35914], 40.00th=[ 42206], 50.00th=[ 49546], 60.00th=[ 55313], | 70.00th=[ 65274], 80.00th=[ 78119], 90.00th=[100140], 95.00th=[122160], | 99.00th=[189793], 99.50th=[200279], 99.90th=[231736], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 87, per=26.33%, avg=40.02, stdev=15.59, samples=292 iops : min= 1, max= 21, avg= 9.35, stdev= 3.95, samples=292 write: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6260KiB/151217msec); 0 zone resets clat (usec): min=1169, max=1293.2k, avg=42275.35, stdev=52385.12 lat (usec): min=1170, max=1293.2k, avg=42284.01, stdev=52382.63 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1467], 10.00th=[ 2212], | 20.00th=[ 5473], 30.00th=[ 10028], 40.00th=[ 19006], | 50.00th=[ 29230], 60.00th=[ 41157], 70.00th=[ 54264], | 80.00th=[ 71828], 90.00th=[ 100140], 95.00th=[ 126354], | 99.00th=[ 177210], 99.50th=[ 214959], 99.90th=[ 261096], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 7, max= 102, per=25.97%, avg=41.29, stdev=19.27, samples=294 iops : min= 1, max= 25, avg= 9.67, stdev= 4.85, samples=294 lat (usec) : 50=0.10%, 100=1.43%, 250=0.16%, 500=0.03% lat (msec) : 2=4.75%, 4=3.12%, 10=7.58%, 20=7.78%, 50=34.02% lat (msec) : 100=31.02%, 250=9.86%, 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=4.92%, ctx=6788, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177875: Fri Sep 4 10:03:23 2026 read: IOPS=9, BW=38.4KiB/s (39.4kB/s)(6052KiB/157461msec) clat (usec): min=39, max=309913, avg=57748.59, stdev=37103.79 lat (usec): min=39, max=309915, avg=57750.67, stdev=37104.30 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 15533], 10.00th=[ 20841], 20.00th=[ 28967], | 30.00th=[ 35390], 40.00th=[ 42206], 50.00th=[ 50070], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[104334], 95.00th=[125305], | 99.00th=[177210], 99.50th=[206570], 99.90th=[278922], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 95, per=25.37%, avg=38.56, stdev=15.73, samples=305 iops : min= 1, max= 23, avg= 8.98, stdev= 3.96, samples=305 write: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6236KiB/157461msec); 0 zone resets clat (usec): min=921, max=1016.1k, avg=44558.29, stdev=50130.61 lat (usec): min=923, max=1016.1k, avg=44563.24, stdev=50131.61 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1467], 10.00th=[ 2147], | 20.00th=[ 6194], 30.00th=[ 11863], 40.00th=[ 21890], | 50.00th=[ 31327], 60.00th=[ 41681], 70.00th=[ 55313], | 80.00th=[ 76022], 90.00th=[ 106431], 95.00th=[ 133694], | 99.00th=[ 187696], 99.50th=[ 219153], 99.90th=[ 287310], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 95, per=24.76%, avg=39.36, stdev=17.96, samples=307 iops : min= 1, max= 23, avg= 9.19, stdev= 4.51, samples=307 lat (usec) : 50=0.03%, 100=1.24%, 250=0.16%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.69%, 4=2.70%, 10=6.54%, 20=8.17%, 50=34.47% lat (msec) : 100=30.37%, 250=11.30%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=4.79%, ctx=6953, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=152KiB/s (156kB/s), 38.4KiB/s-39.9KiB/s (39.4kB/s-40.8kB/s), io=23.4MiB (24.6MB), run=151217-157461msec WRITE: bw=160KiB/s (163kB/s), 39.6KiB/s-41.4KiB/s (40.6kB/s-42.4kB/s), io=24.6MiB (25.7MB), run=151217-157461msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177877: Fri Sep 4 10:04:11 2026 read: IOPS=7, BW=29.3KiB/s (30.0kB/s)(5992KiB/204407msec) clat (msec): min=6, max=1437, avg=53.83, stdev=56.75 lat (msec): min=6, max=1437, avg=53.83, stdev=56.75 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 78], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 232], 99.50th=[ 251], 99.90th=[ 363], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 135, per=26.12%, avg=30.30, stdev=20.14, samples=382 iops : min= 1, max= 33, avg= 6.90, stdev= 5.07, samples=382 write: IOPS=7, BW=30.8KiB/s (31.5kB/s)(6296KiB/204407msec); 0 zone resets clat (msec): min=10, max=462, avg=78.50, stdev=55.72 lat (msec): min=10, max=462, avg=78.50, stdev=55.73 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 77], | 70.00th=[ 93], 80.00th=[ 115], 90.00th=[ 148], 95.00th=[ 186], | 99.00th=[ 275], 99.50th=[ 347], 99.90th=[ 414], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 101, per=25.11%, avg=30.64, stdev=18.06, samples=397 iops : min= 1, max= 25, avg= 6.98, stdev= 4.56, samples=397 lat (msec) : 10=0.88%, 20=8.72%, 50=40.85%, 100=29.75%, 250=18.85% lat (msec) : 500=0.91%, 2000=0.03% cpu : usr=0.05%, sys=1.92%, ctx=5113, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177878: Fri Sep 4 10:04:11 2026 read: IOPS=7, BW=28.9KiB/s (29.6kB/s)(5940KiB/205553msec) clat (msec): min=6, max=1128, avg=56.14, stdev=55.41 lat (msec): min=6, max=1128, avg=56.14, stdev=55.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 60], 80.00th=[ 81], 90.00th=[ 124], 95.00th=[ 157], | 99.00th=[ 228], 99.50th=[ 271], 99.90th=[ 477], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 119, per=25.77%, avg=29.89, stdev=20.41, samples=384 iops : min= 1, max= 29, avg= 6.79, stdev= 5.14, samples=384 write: IOPS=7, BW=30.9KiB/s (31.6kB/s)(6348KiB/205553msec); 0 zone resets clat (msec): min=9, max=473, avg=76.84, stdev=55.52 lat (msec): min=9, max=473, avg=76.85, stdev=55.54 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 110], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 393], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 102, per=25.38%, avg=30.97, stdev=18.93, samples=395 iops : min= 1, max= 25, avg= 7.06, stdev= 4.78, samples=395 lat (msec) : 10=1.01%, 20=8.92%, 50=40.27%, 100=30.34%, 250=18.29% lat (msec) : 500=1.14%, 2000=0.03% cpu : usr=0.05%, sys=1.95%, ctx=5229, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177879: Fri Sep 4 10:04:11 2026 read: IOPS=7, BW=29.8KiB/s (30.5kB/s)(6028KiB/202477msec) clat (msec): min=5, max=478, avg=52.33, stdev=45.21 lat (msec): min=5, max=478, avg=52.33, stdev=45.21 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 78], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 211], 99.50th=[ 264], 99.90th=[ 376], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 126, per=26.39%, avg=30.61, stdev=20.40, samples=380 iops : min= 1, max= 31, avg= 6.98, stdev= 5.15, samples=380 write: IOPS=7, BW=30.9KiB/s (31.7kB/s)(6260KiB/202477msec); 0 zone resets clat (msec): min=11, max=1130, avg=78.86, stdev=61.21 lat (msec): min=11, max=1130, avg=78.87, stdev=61.21 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 74], | 70.00th=[ 93], 80.00th=[ 116], 90.00th=[ 153], 95.00th=[ 190], | 99.00th=[ 259], 99.50th=[ 309], 99.90th=[ 464], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 103, per=25.26%, avg=30.82, stdev=19.13, samples=392 iops : min= 1, max= 25, avg= 7.03, stdev= 4.83, samples=392 lat (msec) : 10=0.85%, 20=9.47%, 50=41.70%, 100=28.13%, 250=18.91% lat (msec) : 500=0.91%, 2000=0.03% cpu : usr=0.05%, sys=1.94%, ctx=5154, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177880: Fri Sep 4 10:04:11 2026 read: IOPS=7, BW=29.5KiB/s (30.2kB/s)(6052KiB/205267msec) clat (msec): min=6, max=349, avg=54.77, stdev=46.67 lat (msec): min=6, max=349, avg=54.77, stdev=46.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 49], | 70.00th=[ 61], 80.00th=[ 80], 90.00th=[ 117], 95.00th=[ 155], | 99.00th=[ 241], 99.50th=[ 264], 99.90th=[ 338], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 109, per=26.39%, avg=30.61, stdev=20.19, samples=383 iops : min= 1, max= 27, avg= 6.97, stdev= 5.09, samples=383 write: IOPS=7, BW=30.4KiB/s (31.1kB/s)(6236KiB/205267msec); 0 zone resets clat (msec): min=11, max=1155, avg=78.38, stdev=62.13 lat (msec): min=11, max=1155, avg=78.39, stdev=62.13 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 74], | 70.00th=[ 90], 80.00th=[ 117], 90.00th=[ 153], 95.00th=[ 190], | 99.00th=[ 275], 99.50th=[ 330], 99.90th=[ 401], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 110, per=24.93%, avg=30.41, stdev=19.32, samples=397 iops : min= 1, max= 27, avg= 6.92, stdev= 4.87, samples=397 lat (msec) : 10=1.14%, 20=9.11%, 50=40.62%, 100=29.56%, 250=18.29% lat (msec) : 500=1.24%, 2000=0.03% cpu : usr=0.06%, sys=2.00%, ctx=5326, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=117KiB/s (120kB/s), 28.9KiB/s-29.8KiB/s (29.6kB/s-30.5kB/s), io=23.4MiB (24.6MB), run=202477-205553msec WRITE: bw=122KiB/s (125kB/s), 30.4KiB/s-30.9KiB/s (31.1kB/s-31.7kB/s), io=24.6MiB (25.7MB), run=202477-205553msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177936: Fri Sep 4 10:04:56 2026 read: IOPS=11, BW=177KiB/s (182kB/s)(5920KiB/33364msec) clat (usec): min=37, max=283256, avg=47788.32, stdev=33511.88 lat (usec): min=38, max=283258, avg=47809.07, stdev=33499.65 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 129], 20.00th=[ 25297], | 30.00th=[ 31327], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[164627], 99.50th=[191890], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 62, max= 349, per=25.12%, avg=176.82, stdev=61.47, samples=65 iops : min= 3, max= 21, avg=10.26, stdev= 3.89, samples=65 write: IOPS=11, BW=191KiB/s (195kB/s)(6368KiB/33364msec); 0 zone resets clat (usec): min=1873, max=220267, avg=39086.73, stdev=38103.10 lat (usec): min=1875, max=220269, avg=39095.08, stdev=38104.63 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 2868], 10.00th=[ 4555], 20.00th=[ 6915], | 30.00th=[ 12387], 40.00th=[ 19006], 50.00th=[ 28181], 60.00th=[ 38536], | 70.00th=[ 48497], 80.00th=[ 63177], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[191890], 99.50th=[202376], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 407, per=25.80%, avg=190.91, stdev=81.29, samples=65 iops : min= 1, max= 25, avg=11.15, stdev= 5.15, samples=65 lat (usec) : 50=0.26%, 100=4.17%, 250=0.39%, 500=0.13% lat (msec) : 2=0.52%, 4=4.04%, 10=8.59%, 20=9.77%, 50=39.19% lat (msec) : 100=25.65%, 250=7.16%, 500=0.13% cpu : usr=0.08%, sys=6.15%, ctx=1750, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177937: Fri Sep 4 10:04:56 2026 read: IOPS=10, BW=173KiB/s (178kB/s)(5744KiB/33115msec) clat (usec): min=54, max=181527, avg=51687.45, stdev=29771.08 lat (usec): min=55, max=181528, avg=51694.65, stdev=29774.51 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 137], 10.00th=[ 22938], 20.00th=[ 28967], | 30.00th=[ 35390], 40.00th=[ 40633], 50.00th=[ 47973], 60.00th=[ 53740], | 70.00th=[ 62653], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[109577], | 99.00th=[141558], 99.50th=[179307], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 62, max= 319, per=24.50%, avg=172.46, stdev=62.27, samples=65 iops : min= 3, max= 19, avg= 9.98, stdev= 3.89, samples=65 write: IOPS=12, BW=198KiB/s (202kB/s)(6544KiB/33115msec); 0 zone resets clat (usec): min=1736, max=276033, avg=35390.84, stdev=36542.33 lat (usec): min=1738, max=276035, avg=35396.83, stdev=36544.04 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2474], 10.00th=[ 4080], 20.00th=[ 7046], | 30.00th=[ 11731], 40.00th=[ 17171], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 41681], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[104334], | 99.00th=[160433], 99.50th=[175113], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 439, per=26.69%, avg=197.51, stdev=90.78, samples=65 iops : min= 1, max= 27, avg=11.57, stdev= 5.77, samples=65 lat (usec) : 100=1.95%, 250=0.65%, 500=0.13% lat (msec) : 2=0.91%, 4=4.17%, 10=9.77%, 20=10.94%, 50=37.37% lat (msec) : 100=27.34%, 250=6.64%, 500=0.13% cpu : usr=0.07%, sys=6.28%, ctx=1751, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177938: Fri Sep 4 10:04:56 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(6256KiB/34017msec) clat (usec): min=33, max=257299, avg=49239.30, stdev=32161.00 lat (usec): min=33, max=257301, avg=49241.08, stdev=32160.87 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 102], 10.00th=[ 20579], 20.00th=[ 27395], | 30.00th=[ 33424], 40.00th=[ 38011], 50.00th=[ 43254], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[110625], | 99.00th=[179307], 99.50th=[252707], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 318, per=26.13%, avg=183.94, stdev=67.08, samples=67 iops : min= 1, max= 19, avg=10.70, stdev= 4.27, samples=67 write: IOPS=11, BW=177KiB/s (182kB/s)(6032KiB/34017msec); 0 zone resets clat (usec): min=1885, max=204822, avg=38864.53, stdev=36454.97 lat (usec): min=1886, max=204824, avg=38875.52, stdev=36461.71 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2245], 10.00th=[ 4178], 20.00th=[ 8717], | 30.00th=[ 14484], 40.00th=[ 21627], 50.00th=[ 28443], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 62129], 90.00th=[ 84411], 95.00th=[111674], | 99.00th=[183501], 99.50th=[198181], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 320, per=23.71%, avg=175.43, stdev=77.92, samples=67 iops : min= 1, max= 20, avg=10.16, stdev= 4.92, samples=67 lat (usec) : 50=0.13%, 100=2.34%, 250=0.39%, 500=0.13% lat (msec) : 2=0.65%, 4=4.04%, 10=6.25%, 20=9.90%, 50=41.80% lat (msec) : 100=27.47%, 250=6.64%, 500=0.26% cpu : usr=0.09%, sys=5.88%, ctx=1825, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177939: Fri Sep 4 10:04:56 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(6032KiB/32116msec) clat (usec): min=36, max=179736, avg=46633.48, stdev=30456.00 lat (usec): min=37, max=179738, avg=46635.17, stdev=30456.16 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 963], 20.00th=[ 23725], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 49546], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[143655], 99.50th=[166724], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 62, max= 350, per=26.43%, avg=186.08, stdev=67.96, samples=63 iops : min= 3, max= 21, avg=10.84, stdev= 4.30, samples=63 write: IOPS=12, BW=195KiB/s (199kB/s)(6256KiB/32116msec); 0 zone resets clat (usec): min=1480, max=191628, avg=36885.80, stdev=35988.32 lat (usec): min=1481, max=191629, avg=36899.04, stdev=35978.64 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2245], 10.00th=[ 3523], 20.00th=[ 6194], | 30.00th=[ 10814], 40.00th=[ 17433], 50.00th=[ 26608], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 62129], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[152044], 99.50th=[183501], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 62, max= 415, per=26.65%, avg=197.23, stdev=77.40, samples=62 iops : min= 3, max= 25, avg=11.55, stdev= 4.93, samples=62 lat (usec) : 50=0.26%, 100=3.65%, 250=0.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.04%, 4=5.34%, 10=7.81%, 20=10.16%, 50=37.63% lat (msec) : 100=26.43%, 250=6.64% cpu : usr=0.09%, sys=6.07%, ctx=1755, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=704KiB/s (721kB/s), 173KiB/s-188KiB/s (178kB/s-192kB/s), io=23.4MiB (24.5MB), run=32116-34017msec WRITE: bw=741KiB/s (759kB/s), 177KiB/s-198KiB/s (182kB/s-202kB/s), io=24.6MiB (25.8MB), run=32116-34017msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177942: Fri Sep 4 10:05:08 2026 read: IOPS=8, BW=131KiB/s (135kB/s)(5920KiB/45030msec) clat (msec): min=9, max=246, avg=47.37, stdev=40.34 lat (msec): min=9, max=246, avg=47.37, stdev=40.34 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 103], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 351, per=25.21%, avg=132.58, stdev=79.90, samples=88 iops : min= 1, max= 21, avg= 7.49, stdev= 5.02, samples=88 write: IOPS=8, BW=141KiB/s (145kB/s)(6368KiB/45030msec); 0 zone resets clat (msec): min=18, max=290, avg=68.76, stdev=43.64 lat (msec): min=18, max=290, avg=68.77, stdev=43.64 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 64], | 70.00th=[ 78], 80.00th=[ 97], 90.00th=[ 129], 95.00th=[ 159], | 99.00th=[ 224], 99.50th=[ 271], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 383, per=25.49%, avg=140.96, stdev=76.84, samples=89 iops : min= 1, max= 23, avg= 8.02, stdev= 4.86, samples=89 lat (msec) : 10=0.13%, 20=9.51%, 50=46.61%, 100=29.04%, 250=14.32% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=2.19%, ctx=1262, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177943: Fri Sep 4 10:05:08 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5744KiB/45510msec) clat (msec): min=9, max=269, avg=47.06, stdev=40.11 lat (msec): min=9, max=269, avg=47.06, stdev=40.11 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 99], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 218], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 30, max= 475, per=24.51%, avg=128.90, stdev=86.52, samples=88 iops : min= 1, max= 29, avg= 7.25, stdev= 5.48, samples=88 write: IOPS=8, BW=144KiB/s (147kB/s)(6544KiB/45510msec); 0 zone resets clat (msec): min=15, max=336, avg=69.66, stdev=44.89 lat (msec): min=15, max=336, avg=69.66, stdev=44.89 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 82], 80.00th=[ 106], 90.00th=[ 131], 95.00th=[ 155], | 99.00th=[ 209], 99.50th=[ 234], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 447, per=25.92%, avg=143.31, stdev=80.43, samples=90 iops : min= 1, max= 27, avg= 8.17, stdev= 5.06, samples=90 lat (msec) : 10=0.39%, 20=9.11%, 50=48.05%, 100=26.56%, 250=15.49% lat (msec) : 500=0.39% cpu : usr=0.08%, sys=2.33%, ctx=1269, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177944: Fri Sep 4 10:05:08 2026 read: IOPS=8, BW=138KiB/s (142kB/s)(6256KiB/45242msec) clat (msec): min=7, max=256, avg=49.04, stdev=40.10 lat (msec): min=7, max=256, avg=49.04, stdev=40.10 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 71], 90.00th=[ 104], 95.00th=[ 130], | 99.00th=[ 207], 99.50th=[ 236], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 413, per=26.87%, avg=141.34, stdev=87.49, samples=87 iops : min= 1, max= 25, avg= 8.05, stdev= 5.52, samples=87 write: IOPS=8, BW=133KiB/s (137kB/s)(6032KiB/45242msec); 0 zone resets clat (msec): min=16, max=291, avg=68.85, stdev=46.61 lat (msec): min=16, max=291, avg=68.87, stdev=46.60 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 56], 60.00th=[ 63], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 127], 95.00th=[ 157], | 99.00th=[ 268], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 348, per=23.96%, avg=132.48, stdev=72.64, samples=88 iops : min= 1, max= 21, avg= 7.49, stdev= 4.56, samples=88 lat (msec) : 10=0.39%, 20=10.29%, 50=44.14%, 100=30.34%, 250=14.06% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=2.46%, ctx=1281, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177945: Fri Sep 4 10:05:08 2026 read: IOPS=8, BW=134KiB/s (138kB/s)(6032KiB/44907msec) clat (msec): min=5, max=300, avg=47.18, stdev=40.17 lat (msec): min=5, max=300, avg=47.19, stdev=40.17 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 107], 95.00th=[ 133], | 99.00th=[ 199], 99.50th=[ 251], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 415, per=25.77%, avg=135.53, stdev=82.32, samples=86 iops : min= 1, max= 25, avg= 7.69, stdev= 5.20, samples=86 write: IOPS=8, BW=139KiB/s (143kB/s)(6256KiB/44907msec); 0 zone resets clat (msec): min=16, max=340, avg=68.96, stdev=46.14 lat (msec): min=16, max=340, avg=68.97, stdev=46.14 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 101], 90.00th=[ 130], 95.00th=[ 167], | 99.00th=[ 239], 99.50th=[ 249], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 351, per=25.25%, avg=139.62, stdev=77.26, samples=87 iops : min= 1, max= 21, avg= 7.93, stdev= 4.86, samples=87 lat (msec) : 10=0.39%, 20=9.77%, 50=47.92%, 100=26.56%, 250=14.97% lat (msec) : 500=0.39% cpu : usr=0.08%, sys=2.28%, ctx=1319, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=526KiB/s (539kB/s), 126KiB/s-138KiB/s (129kB/s-142kB/s), io=23.4MiB (24.5MB), run=44907-45510msec WRITE: bw=554KiB/s (567kB/s), 133KiB/s-144KiB/s (137kB/s-147kB/s), io=24.6MiB (25.8MB), run=44907-45510msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177957: Fri Sep 4 10:05:27 2026 read: IOPS=0, BW=917KiB/s (939kB/s)(7168KiB/7818msec) clat (msec): min=64, max=3320, avg=653.92, stdev=1190.10 lat (msec): min=64, max=3320, avg=653.92, stdev=1190.10 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 90], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 124], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 584], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 1815, max= 2809, per=82.12%, avg=2150.80, stdev=381.01, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=0, BW=655KiB/s (671kB/s)(5120KiB/7818msec); 0 zone resets clat (msec): min=381, max=985, avg=600.61, stdev=245.37 lat (msec): min=381, max=985, avg=600.75, stdev=245.44 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 2003, max= 2043, per=55.14%, avg=2022.00, stdev=22.00, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=25.00%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.84%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177958: Fri Sep 4 10:05:27 2026 read: IOPS=0, BW=271KiB/s (277kB/s)(2048KiB/7564msec) clat (msec): min=100, max=316, avg=208.15, stdev=152.72 lat (msec): min=100, max=316, avg=208.19, stdev=152.77 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1391, max= 2048, per=65.65%, avg=1719.50, stdev=464.57, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1354KiB/s (1386kB/s)(10.0MiB/7564msec); 0 zone resets clat (msec): min=115, max=3779, avg=695.19, stdev=1109.34 lat (msec): min=116, max=3779, avg=695.37, stdev=1109.36 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 148], | 30.00th=[ 169], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 351], | 70.00th=[ 456], 80.00th=[ 550], 90.00th=[ 902], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 1815, max= 4173, per=62.82%, avg=2303.43, stdev=828.39, samples=7 iops : min= 1, max= 4, avg= 1.57, stdev= 1.13, samples=7 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=3.09%, ctx=97, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177959: Fri Sep 4 10:05:27 2026 read: IOPS=0, BW=908KiB/s (930kB/s)(6144KiB/6768msec) clat (msec): min=134, max=500, avg=319.12, stdev=150.50 lat (msec): min=134, max=500, avg=319.12, stdev=150.50 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 393], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1756, max= 4096, per=94.34%, avg=2470.75, stdev=1090.46, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=908KiB/s (930kB/s)(6144KiB/6768msec); 0 zone resets clat (msec): min=122, max=3084, avg=802.21, stdev=1152.41 lat (msec): min=122, max=3084, avg=802.61, stdev=1152.23 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 284], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1756, max= 4047, per=63.41%, avg=2325.20, stdev=971.84, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.33%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177960: Fri Sep 4 10:05:27 2026 read: IOPS=0, BW=739KiB/s (757kB/s)(5120KiB/6929msec) clat (msec): min=162, max=2919, avg=937.05, stdev=1136.78 lat (msec): min=162, max=2919, avg=937.05, stdev=1136.78 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1815, max= 2048, per=75.28%, avg=1971.50, stdev=108.83, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1034KiB/s (1059kB/s)(7168KiB/6929msec); 0 zone resets clat (msec): min=89, max=1211, avg=309.37, stdev=399.84 lat (msec): min=89, max=1211, avg=309.50, stdev=399.85 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 130], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 171], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 213], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1747, max= 5818, per=100.00%, avg=3782.50, stdev=2878.63, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=58.33%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=2.87%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2620KiB/s (2682kB/s), 271KiB/s-917KiB/s (277kB/s-939kB/s), io=20.0MiB (20.0MB), run=6768-7818msec WRITE: bw=3667KiB/s (3755kB/s), 655KiB/s-1354KiB/s (671kB/s-1386kB/s), io=28.0MiB (29.4MB), run=6768-7818msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177962: Fri Sep 4 10:05:27 2026 read: IOPS=1, BW=1242KiB/s (1272kB/s)(7168KiB/5770msec) clat (usec): min=576, max=2850.4k, avg=589557.07, stdev=1001866.22 lat (usec): min=579, max=2850.4k, avg=589559.22, stdev=1001866.00 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], | 20.00th=[ 221250], 30.00th=[ 231736], 40.00th=[ 231736], | 50.00th=[ 240124], 60.00th=[ 278922], 70.00th=[ 278922], | 80.00th=[ 304088], 90.00th=[2835350], 95.00th=[2835350], | 99.00th=[2835350], 99.50th=[2835350], 99.90th=[2835350], | 99.95th=[2835350], 99.99th=[2835350] bw ( KiB/s): min= 1732, max= 4071, per=83.35%, avg=2374.60, stdev=956.78, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=887KiB/s (909kB/s)(5120KiB/5770msec); 0 zone resets clat (msec): min=76, max=418, avg=315.03, stdev=138.30 lat (msec): min=76, max=418, avg=315.11, stdev=138.31 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2000, max= 4079, per=67.79%, avg=2703.33, stdev=1191.46, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=10.90%, ctx=659, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177963: Fri Sep 4 10:05:27 2026 read: IOPS=0, BW=285KiB/s (292kB/s)(2048KiB/7188msec) clat (msec): min=77, max=239, avg=158.27, stdev=114.72 lat (msec): min=77, max=239, avg=158.27, stdev=114.72 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 241], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 1641, max= 2039, per=64.58%, avg=1840.00, stdev=281.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1425KiB/s (1459kB/s)(10.0MiB/7188msec); 0 zone resets clat (msec): min=140, max=3492, avg=686.76, stdev=1017.87 lat (msec): min=140, max=3492, avg=686.84, stdev=1017.88 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 159], | 30.00th=[ 190], 40.00th=[ 255], 50.00th=[ 330], 60.00th=[ 368], | 70.00th=[ 460], 80.00th=[ 464], 90.00th=[ 1011], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 2023, max= 6131, per=76.71%, avg=3059.00, stdev=1712.54, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.18%, ctx=173, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177964: Fri Sep 4 10:05:27 2026 read: IOPS=0, BW=947KiB/s (970kB/s)(6144KiB/6487msec) clat (usec): min=524, max=387977, avg=167712.15, stdev=184393.98 lat (usec): min=526, max=387979, avg=167714.01, stdev=184394.13 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 1909], | 30.00th=[ 1909], 40.00th=[ 4359], 50.00th=[ 4359], 60.00th=[278922], | 70.00th=[329253], 80.00th=[329253], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 2035, max= 4079, per=100.00%, avg=3397.67, stdev=1180.10, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=947KiB/s (970kB/s)(6144KiB/6487msec); 0 zone resets clat (msec): min=255, max=3617, avg=907.85, stdev=1330.46 lat (msec): min=255, max=3624, avg=909.04, stdev=1333.11 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 426], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1723, max= 2039, per=49.44%, avg=1971.80, stdev=139.12, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=8.33%, 500=66.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.06%, ctx=162, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177965: Fri Sep 4 10:05:27 2026 read: IOPS=0, BW=717KiB/s (734kB/s)(5120KiB/7144msec) clat (usec): min=468, max=421462, avg=149651.01, stdev=206860.29 lat (usec): min=469, max=421464, avg=149652.44, stdev=206860.79 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 469], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 824], 60.00th=[ 824], | 70.00th=[325059], 80.00th=[325059], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1003KiB/s (1027kB/s)(7168KiB/7144msec); 0 zone resets clat (msec): min=201, max=3238, avg=913.36, stdev=1045.70 lat (msec): min=201, max=3238, avg=913.44, stdev=1045.70 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 418], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 523], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 852], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1575, max= 2039, per=48.72%, avg=1943.00, stdev=205.74, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 250=8.33%, 500=33.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.59%, ctx=114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2849KiB/s (2918kB/s), 285KiB/s-1242KiB/s (292kB/s-1272kB/s), io=20.0MiB (20.0MB), run=5770-7188msec WRITE: bw=3989KiB/s (4085kB/s), 887KiB/s-1425KiB/s (909kB/s-1459kB/s), io=28.0MiB (29.4MB), run=5770-7188msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177973: Fri Sep 4 10:05:44 2026 read: IOPS=0, BW=3227KiB/s (3304kB/s)(12.0MiB/3808msec) clat (msec): min=524, max=1604, avg=1182.55, stdev=577.40 lat (msec): min=524, max=1604, avg=1182.55, stdev=577.40 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7585, max= 8015, per=100.00%, avg=7800.00, stdev=304.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.11%, sys=3.36%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177974: Fri Sep 4 10:05:44 2026 read: IOPS=0, BW=1001KiB/s (1026kB/s)(4096KiB/4090msec) clat (nsec): min=1271.9M, max=1271.9M, avg=1271895899.00, stdev= 0.00 lat (nsec): min=1271.9M, max=1271.9M, avg=1271897087.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2003KiB/s (2051kB/s)(8192KiB/4090msec); 0 zone resets clat (msec): min=1255, max=1399, avg=1327.91, stdev=101.93 lat (msec): min=1256, max=1400, avg=1328.52, stdev=101.78 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7393, max= 7393, per=92.29%, avg=7393.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.22%, sys=3.30%, ctx=54, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177976: Fri Sep 4 10:05:44 2026 write: IOPS=0, BW=3081KiB/s (3155kB/s)(12.0MiB/3988msec); 0 zone resets clat (msec): min=553, max=2306, avg=1240.14, stdev=936.04 lat (msec): min=558, max=2308, avg=1242.57, stdev=935.15 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7366, max= 8110, per=96.59%, avg=7738.00, stdev=526.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.13%, sys=4.06%, ctx=104, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177978: Fri Sep 4 10:05:44 2026 write: IOPS=0, BW=3256KiB/s (3334kB/s)(12.0MiB/3774msec); 0 zone resets clat (msec): min=180, max=2609, avg=1240.69, stdev=1243.33 lat (msec): min=180, max=2612, avg=1242.23, stdev=1244.95 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 7772, max= 7772, per=97.02%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.19%, sys=4.82%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4006KiB/s (4102kB/s), 1001KiB/s-3227KiB/s (1026kB/s-3304kB/s), io=16.0MiB (16.8MB), run=3808-4090msec WRITE: bw=8012KiB/s (8204kB/s), 2003KiB/s-3256KiB/s (2051kB/s-3334kB/s), io=32.0MiB (33.6MB), run=3774-4090msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177975: Fri Sep 4 10:05:45 2026 read: IOPS=0, BW=3716KiB/s (3805kB/s)(12.0MiB/3307msec) clat (msec): min=1052, max=1102, avg=1076.16, stdev=25.29 lat (msec): min=1052, max=1102, avg=1076.16, stdev=25.29 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=10.86%, ctx=474, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177977: Fri Sep 4 10:05:45 2026 read: IOPS=0, BW=1002KiB/s (1026kB/s)(4096KiB/4087msec) clat (nsec): min=1071.2M, max=1071.2M, avg=1071186264.00, stdev= 0.00 lat (nsec): min=1071.2M, max=1071.2M, avg=1071189644.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2004KiB/s (2053kB/s)(8192KiB/4087msec); 0 zone resets clat (msec): min=472, max=2465, avg=1469.00, stdev=1408.81 lat (msec): min=475, max=2465, avg=1470.74, stdev=1407.07 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 2467], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.10%, sys=5.85%, ctx=220, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177979: Fri Sep 4 10:05:45 2026 write: IOPS=0, BW=2698KiB/s (2763kB/s)(12.0MiB/4554msec); 0 zone resets clat (msec): min=244, max=2448, avg=1465.59, stdev=1121.31 lat (msec): min=244, max=2448, avg=1466.27, stdev=1121.27 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.11%, sys=2.61%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177980: Fri Sep 4 10:05:45 2026 write: IOPS=0, BW=3314KiB/s (3393kB/s)(12.0MiB/3708msec); 0 zone resets clat (msec): min=401, max=2613, avg=1173.53, stdev=1247.70 lat (msec): min=402, max=2613, avg=1174.09, stdev=1247.75 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min=15663, max=15663, per=100.00%, avg=15663.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=4.05%, ctx=99, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4009KiB/s (4105kB/s), 1002KiB/s-3716KiB/s (1026kB/s-3805kB/s), io=16.0MiB (16.8MB), run=3307-4087msec WRITE: bw=7195KiB/s (7368kB/s), 2004KiB/s-3314KiB/s (2053kB/s-3393kB/s), io=32.0MiB (33.6MB), run=3708-4554msec