== sanity test 398b: DIO and buffer IO race ============== 20:58:00 (1786755480) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.01762 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145239: Fri Aug 14 21:00:23 2026 read: IOPS=12, BW=48.3KiB/s (49.5kB/s)(5992KiB/123954msec) clat (usec): min=34, max=1051.0k, avg=41160.17, stdev=40259.94 lat (usec): min=34, max=1051.0k, avg=41161.60, stdev=40260.09 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 10683], | 20.00th=[ 19268], 30.00th=[ 24511], 40.00th=[ 29230], | 50.00th=[ 35914], 60.00th=[ 41681], 70.00th=[ 49546], | 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[ 139461], 99.50th=[ 168821], 99.90th=[ 459277], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 6, max= 111, per=24.85%, avg=47.97, stdev=20.64, samples=243 iops : min= 1, max= 27, avg=11.34, stdev= 5.17, samples=243 write: IOPS=12, BW=50.8KiB/s (52.0kB/s)(6296KiB/123954msec); 0 zone resets clat (usec): min=1005, max=357466, avg=39454.51, stdev=40247.31 lat (usec): min=1006, max=357468, avg=39458.09, stdev=40245.83 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1942], 20.00th=[ 4555], | 30.00th=[ 8979], 40.00th=[ 18482], 50.00th=[ 29492], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[173016], 99.50th=[204473], 99.90th=[291505], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 126, per=25.09%, avg=50.69, stdev=20.09, samples=242 iops : min= 1, max= 31, avg=12.03, stdev= 5.07, samples=242 lat (usec) : 50=0.68%, 100=3.29%, 250=0.26%, 500=0.03% lat (msec) : 2=5.31%, 4=4.20%, 10=7.29%, 20=10.22%, 50=38.15% lat (msec) : 100=24.80%, 250=5.57%, 500=0.16%, 2000=0.03% cpu : usr=0.05%, sys=4.93%, ctx=6648, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145240: Fri Aug 14 21:00:23 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(5940KiB/123877msec) clat (usec): min=36, max=290953, avg=42304.89, stdev=31687.28 lat (usec): min=36, max=290954, avg=42306.33, stdev=31687.49 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 13173], 20.00th=[ 20841], | 30.00th=[ 25035], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[164627], 99.50th=[177210], 99.90th=[261096], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 6, max= 111, per=24.83%, avg=47.93, stdev=19.56, samples=242 iops : min= 1, max= 27, avg=11.33, stdev= 4.93, samples=242 write: IOPS=12, BW=51.2KiB/s (52.5kB/s)(6348KiB/123877msec); 0 zone resets clat (usec): min=1133, max=992535, avg=38339.81, stdev=45778.35 lat (usec): min=1133, max=992536, avg=38341.44, stdev=45778.67 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 2212], 20.00th=[ 4686], | 30.00th=[ 8979], 40.00th=[ 16909], 50.00th=[ 27132], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 64226], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[181404], 99.50th=[206570], 99.90th=[270533], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 126, per=25.09%, avg=50.68, stdev=22.55, samples=244 iops : min= 1, max= 31, avg=12.03, stdev= 5.66, samples=244 lat (usec) : 50=0.55%, 100=2.93%, 250=0.20%, 750=0.07%, 1000=0.03% lat (msec) : 2=4.49%, 4=4.36%, 10=7.91%, 20=10.51%, 50=39.45% lat (msec) : 100=23.50%, 250=5.73%, 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=4.92%, ctx=6586, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145241: Fri Aug 14 21:00:23 2026 read: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6028KiB/123554msec) clat (usec): min=27, max=1053.5k, avg=40292.26, stdev=39607.83 lat (usec): min=27, max=1053.5k, avg=40297.80, stdev=39607.11 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 11207], | 20.00th=[ 19006], 30.00th=[ 23725], 40.00th=[ 28705], | 50.00th=[ 33817], 60.00th=[ 40109], 70.00th=[ 48497], | 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[ 127402], 99.50th=[ 158335], 99.90th=[ 471860], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 6, max= 119, per=25.17%, avg=48.57, stdev=22.15, samples=243 iops : min= 1, max= 29, avg=11.50, stdev= 5.58, samples=243 write: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6260KiB/123554msec); 0 zone resets clat (usec): min=1079, max=426847, avg=40025.25, stdev=40109.10 lat (usec): min=1080, max=426848, avg=40028.28, stdev=40107.94 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1385], 10.00th=[ 2474], 20.00th=[ 5407], | 30.00th=[ 11207], 40.00th=[ 20841], 50.00th=[ 30278], 60.00th=[ 41157], | 70.00th=[ 52691], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[173016], 99.50th=[214959], 99.90th=[337642], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 104, per=24.94%, avg=50.38, stdev=18.68, samples=243 iops : min= 1, max= 26, avg=11.95, stdev= 4.68, samples=243 lat (usec) : 50=0.78%, 100=3.29%, 250=0.23%, 500=0.10%, 750=0.13% lat (msec) : 2=4.26%, 4=3.65%, 10=6.80%, 20=11.07%, 50=39.13% lat (msec) : 100=25.72%, 250=4.65%, 500=0.16%, 2000=0.03% cpu : usr=0.06%, sys=4.78%, ctx=6587, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145242: Fri Aug 14 21:00:23 2026 read: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6052KiB/123971msec) clat (usec): min=34, max=954548, avg=41848.27, stdev=40733.92 lat (usec): min=34, max=954549, avg=41851.70, stdev=40732.74 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 3392], 20.00th=[ 19530], | 30.00th=[ 24511], 40.00th=[ 29492], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[156238], 99.50th=[193987], 99.90th=[574620], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 110, per=25.13%, avg=48.50, stdev=19.54, samples=242 iops : min= 1, max= 27, avg=11.48, stdev= 4.93, samples=242 write: IOPS=12, BW=50.3KiB/s (51.5kB/s)(6236KiB/123971msec); 0 zone resets clat (usec): min=1141, max=269269, avg=38829.10, stdev=38458.39 lat (usec): min=1142, max=269270, avg=38832.23, stdev=38457.55 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1352], 10.00th=[ 1958], 20.00th=[ 4752], | 30.00th=[ 9241], 40.00th=[ 19530], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 51643], 80.00th=[ 66847], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[170918], 99.50th=[189793], 99.90th=[254804], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 127, per=24.69%, avg=49.87, stdev=21.68, samples=243 iops : min= 1, max= 31, avg=11.82, stdev= 5.44, samples=243 lat (usec) : 50=0.85%, 100=3.39%, 250=0.36%, 500=0.10%, 750=0.10% lat (msec) : 2=5.14%, 4=4.10%, 10=7.13%, 20=9.57%, 50=38.41% lat (msec) : 100=25.39%, 250=5.24%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.82%, ctx=6647, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=194KiB/s (198kB/s), 47.0KiB/s-48.8KiB/s (49.1kB/s-49.0kB/s), io=23.4MiB (24.6MB), run=123554-123971msec WRITE: bw=203KiB/s (208kB/s), 50.3KiB/s-51.2KiB/s (51.5kB/s-52.5kB/s), io=24.6MiB (25.7MB), run=123554-123971msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145234: Fri Aug 14 21:02:32 2026 read: IOPS=5, BW=23.6KiB/s (24.2kB/s)(5992KiB/253472msec) clat (msec): min=5, max=1052, avg=34.84, stdev=45.93 lat (msec): min=5, max=1052, avg=34.84, stdev=45.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 103], | 99.00th=[ 197], 99.50th=[ 279], 99.90th=[ 405], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 88, per=28.17%, avg=26.48, stdev=17.94, samples=438 iops : min= 1, max= 22, avg= 5.99, stdev= 4.54, samples=438 write: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6296KiB/253472msec); 0 zone resets clat (msec): min=31, max=473, avg=127.62, stdev=57.92 lat (msec): min=31, max=473, avg=127.62, stdev=57.92 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 113], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 245], | 99.00th=[ 321], 99.50th=[ 359], 99.90th=[ 430], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 55, per=24.90%, avg=24.65, stdev=10.81, samples=493 iops : min= 1, max= 13, avg= 5.54, stdev= 2.77, samples=493 lat (msec) : 10=3.91%, 20=19.34%, 50=17.25%, 100=24.90%, 250=32.03% lat (msec) : 500=2.54%, 2000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5151, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145235: Fri Aug 14 21:02:32 2026 read: IOPS=5, BW=23.5KiB/s (24.0kB/s)(5940KiB/252969msec) clat (msec): min=5, max=1010, avg=34.54, stdev=45.29 lat (msec): min=5, max=1010, avg=34.54, stdev=45.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 75], 95.00th=[ 99], | 99.00th=[ 190], 99.50th=[ 253], 99.90th=[ 542], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 111, per=27.86%, avg=26.19, stdev=17.64, samples=439 iops : min= 1, max= 27, avg= 5.93, stdev= 4.43, samples=439 write: IOPS=6, BW=25.1KiB/s (25.7kB/s)(6348KiB/252969msec); 0 zone resets clat (msec): min=29, max=585, avg=126.81, stdev=58.66 lat (msec): min=29, max=585, avg=126.81, stdev=58.66 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 207], 95.00th=[ 241], | 99.00th=[ 317], 99.50th=[ 359], 99.90th=[ 430], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 56, per=25.18%, avg=24.93, stdev=10.82, samples=492 iops : min= 1, max= 14, avg= 5.60, stdev= 2.77, samples=492 lat (msec) : 10=4.07%, 20=17.94%, 50=18.49%, 100=26.01%, 250=31.35% lat (msec) : 500=2.05%, 750=0.07%, 2000=0.03% cpu : usr=0.03%, sys=1.23%, ctx=5117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145236: Fri Aug 14 21:02:32 2026 read: IOPS=5, BW=23.0KiB/s (24.5kB/s)(6028KiB/251581msec) clat (msec): min=5, max=448, avg=34.54, stdev=36.30 lat (msec): min=5, max=448, avg=34.55, stdev=36.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 50], 90.00th=[ 75], 95.00th=[ 102], | 99.00th=[ 174], 99.50th=[ 207], 99.90th=[ 409], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 120, per=27.25%, avg=25.61, stdev=17.23, samples=455 iops : min= 1, max= 30, avg= 5.78, stdev= 4.37, samples=455 write: IOPS=6, BW=24.9KiB/s (25.5kB/s)(6260KiB/251581msec); 0 zone resets clat (msec): min=32, max=1157, avg=127.22, stdev=64.03 lat (msec): min=32, max=1157, avg=127.22, stdev=64.03 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 239], | 99.00th=[ 334], 99.50th=[ 393], 99.90th=[ 443], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 55, per=24.80%, avg=24.55, stdev=10.97, samples=492 iops : min= 1, max= 13, avg= 5.51, stdev= 2.81, samples=492 lat (msec) : 10=4.26%, 20=17.35%, 50=18.59%, 100=26.17%, 250=31.32% lat (msec) : 500=2.28%, 2000=0.03% cpu : usr=0.03%, sys=1.32%, ctx=5085, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145237: Fri Aug 14 21:02:32 2026 read: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6052KiB/252267msec) clat (msec): min=5, max=523, avg=33.49, stdev=36.73 lat (msec): min=5, max=523, avg=33.49, stdev=36.73 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 74], 95.00th=[ 111], | 99.00th=[ 165], 99.50th=[ 199], 99.90th=[ 388], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 127, per=28.29%, avg=26.59, stdev=19.08, samples=440 iops : min= 1, max= 31, avg= 6.02, stdev= 4.79, samples=440 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6236KiB/252267msec); 0 zone resets clat (msec): min=31, max=1164, avg=129.05, stdev=64.62 lat (msec): min=31, max=1164, avg=129.05, stdev=64.61 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 205], 95.00th=[ 239], | 99.00th=[ 342], 99.50th=[ 401], 99.90th=[ 584], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 55, per=24.67%, avg=24.42, stdev=10.95, samples=492 iops : min= 1, max= 13, avg= 5.48, stdev= 2.81, samples=492 lat (msec) : 10=4.62%, 20=18.85%, 50=18.00%, 100=22.79%, 250=33.46% lat (msec) : 500=2.18%, 750=0.07%, 2000=0.03% cpu : usr=0.03%, sys=1.30%, ctx=5041, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=94.7KiB/s (97.0kB/s), 23.5KiB/s-23.0KiB/s (24.0kB/s-24.6kB/s), io=23.4MiB (24.6MB), run=251581-253472msec WRITE: bw=99.2KiB/s (102kB/s), 24.7KiB/s-25.1KiB/s (25.3kB/s-25.7kB/s), io=24.6MiB (25.7MB), run=251581-253472msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145311: Fri Aug 14 21:03:13 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(5920KiB/28105msec) clat (usec): min=40, max=274886, avg=40093.76, stdev=30648.92 lat (usec): min=40, max=274888, avg=40098.25, stdev=30644.58 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 14484], | 30.00th=[ 25560], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 60556], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[160433], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 94, max= 383, per=25.93%, avg=210.53, stdev=68.86, samples=55 iops : min= 5, max= 23, avg=12.40, stdev= 4.40, samples=55 write: IOPS=14, BW=227KiB/s (232kB/s)(6368KiB/28105msec); 0 zone resets clat (usec): min=1627, max=152004, avg=33114.21, stdev=31666.65 lat (usec): min=1629, max=152006, avg=33130.64, stdev=31677.44 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2089], 10.00th=[ 3523], 20.00th=[ 5669], | 30.00th=[ 9634], 40.00th=[ 13960], 50.00th=[ 24249], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 57934], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[133694], 99.50th=[145753], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 32, max= 478, per=26.59%, avg=227.04, stdev=81.80, samples=55 iops : min= 2, max= 29, avg=13.45, stdev= 5.12, samples=55 lat (usec) : 50=0.26%, 100=6.64%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=2.47%, 4=4.82%, 10=9.64%, 20=10.16%, 50=35.03% lat (msec) : 100=25.65%, 250=4.04%, 500=0.13% cpu : usr=0.07%, sys=5.89%, ctx=1608, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145312: Fri Aug 14 21:03:13 2026 read: IOPS=12, BW=198KiB/s (202kB/s)(5744KiB/29064msec) clat (usec): min=38, max=175575, avg=40458.70, stdev=28433.01 lat (usec): min=38, max=175576, avg=40462.94, stdev=28433.65 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 19268], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 44827], | 70.00th=[ 51643], 80.00th=[ 61604], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[143655], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 21, max= 352, per=24.47%, avg=198.68, stdev=87.60, samples=57 iops : min= 1, max= 22, avg=11.67, stdev= 5.53, samples=57 write: IOPS=14, BW=225KiB/s (231kB/s)(6544KiB/29064msec); 0 zone resets clat (usec): min=1500, max=317873, avg=34957.88, stdev=38438.32 lat (usec): min=1502, max=317875, avg=34969.96, stdev=38437.88 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2311], 10.00th=[ 3720], 20.00th=[ 5866], | 30.00th=[ 8848], 40.00th=[ 13042], 50.00th=[ 22676], 60.00th=[ 31851], | 70.00th=[ 44303], 80.00th=[ 62129], 90.00th=[ 83362], 95.00th=[109577], | 99.00th=[162530], 99.50th=[173016], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 62, max= 474, per=26.42%, avg=225.65, stdev=93.82, samples=57 iops : min= 3, max= 29, avg=13.37, stdev= 5.88, samples=57 lat (usec) : 50=0.78%, 100=6.12%, 250=0.91%, 500=0.26% lat (msec) : 2=1.82%, 4=5.08%, 10=10.81%, 20=9.64%, 50=35.81% lat (msec) : 100=23.70%, 250=4.95%, 500=0.13% cpu : usr=0.07%, sys=6.04%, ctx=1677, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145313: Fri Aug 14 21:03:13 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29474msec) clat (usec): min=31, max=174597, avg=37579.35, stdev=29836.86 lat (usec): min=32, max=174599, avg=37580.67, stdev=29836.82 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 725], | 30.00th=[ 20579], 40.00th=[ 28443], 50.00th=[ 34866], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[125305], 99.50th=[160433], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 382, per=26.68%, avg=216.63, stdev=73.89, samples=56 iops : min= 1, max= 23, avg=12.79, stdev= 4.69, samples=56 write: IOPS=12, BW=205KiB/s (210kB/s)(6032KiB/29474msec); 0 zone resets clat (usec): min=1530, max=357226, avg=38524.67, stdev=43592.72 lat (usec): min=1532, max=357228, avg=38534.04, stdev=43587.56 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2376], 10.00th=[ 3359], 20.00th=[ 5669], | 30.00th=[ 10945], 40.00th=[ 18744], 50.00th=[ 25560], 60.00th=[ 35390], | 70.00th=[ 44827], 80.00th=[ 62129], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[223347], 99.50th=[270533], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 42, max= 380, per=23.63%, avg=201.84, stdev=94.07, samples=57 iops : min= 2, max= 23, avg=11.86, stdev= 5.94, samples=57 lat (usec) : 50=0.65%, 100=8.20%, 250=1.04%, 750=0.39%, 1000=0.26% lat (msec) : 2=1.95%, 4=4.56%, 10=8.20%, 20=9.90%, 50=35.68% lat (msec) : 100=23.83%, 250=4.95%, 500=0.39% cpu : usr=0.06%, sys=5.83%, ctx=1693, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145314: Fri Aug 14 21:03:13 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28225msec) clat (usec): min=38, max=256971, avg=38082.03, stdev=33354.59 lat (usec): min=38, max=256972, avg=38085.76, stdev=33354.70 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 60], 20.00th=[ 82], | 30.00th=[ 22938], 40.00th=[ 29754], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 47973], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[126354], 99.50th=[242222], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 444, per=26.75%, avg=217.19, stdev=97.08, samples=54 iops : min= 1, max= 27, avg=12.81, stdev= 6.14, samples=54 write: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28225msec); 0 zone resets clat (usec): min=1531, max=303196, avg=34559.38, stdev=37385.65 lat (usec): min=1533, max=303199, avg=34564.68, stdev=37385.21 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1958], 10.00th=[ 2900], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[ 13435], 50.00th=[ 23725], 60.00th=[ 31851], | 70.00th=[ 42730], 80.00th=[ 59507], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[166724], 99.50th=[223347], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 416, per=26.02%, avg=222.22, stdev=88.11, samples=55 iops : min= 1, max= 26, avg=13.15, stdev= 5.57, samples=55 lat (usec) : 50=1.56%, 100=8.59%, 250=0.78%, 750=0.13% lat (msec) : 2=2.99%, 4=4.56%, 10=9.90%, 20=9.11%, 50=35.68% lat (msec) : 100=22.27%, 250=4.17%, 500=0.26% cpu : usr=0.06%, sys=5.74%, ctx=1596, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=813KiB/s (832kB/s), 198KiB/s-214KiB/s (202kB/s-219kB/s), io=23.4MiB (24.5MB), run=28105-29474msec WRITE: bw=855KiB/s (876kB/s), 205KiB/s-227KiB/s (210kB/s-232kB/s), io=24.6MiB (25.8MB), run=28105-29474msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145307: Fri Aug 14 21:03:46 2026 read: IOPS=5, BW=95.8KiB/s (98.1kB/s)(5920KiB/61791msec) clat (msec): min=6, max=264, avg=34.94, stdev=34.07 lat (msec): min=6, max=264, avg=34.94, stdev=34.07 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 70], 95.00th=[ 99], | 99.00th=[ 192], 99.50th=[ 236], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 256, per=26.86%, avg=103.15, stdev=58.52, samples=113 iops : min= 1, max= 16, avg= 5.70, stdev= 3.74, samples=113 write: IOPS=6, BW=103KiB/s (106kB/s)(6368KiB/61791msec); 0 zone resets clat (msec): min=38, max=463, avg=122.41, stdev=56.69 lat (msec): min=38, max=463, avg=122.41, stdev=56.69 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 159], 90.00th=[ 201], 95.00th=[ 236], | 99.00th=[ 326], 99.50th=[ 372], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 192, per=25.45%, avg=102.81, stdev=44.86, samples=122 iops : min= 1, max= 12, avg= 5.67, stdev= 2.93, samples=122 lat (msec) : 10=2.47%, 20=16.67%, 50=20.57%, 100=27.86%, 250=30.60% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.49%, ctx=1299, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145308: Fri Aug 14 21:03:46 2026 read: IOPS=5, BW=92.1KiB/s (94.3kB/s)(5744KiB/62342msec) clat (msec): min=7, max=258, avg=38.96, stdev=44.52 lat (msec): min=7, max=258, avg=38.96, stdev=44.52 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 85], 95.00th=[ 148], | 99.00th=[ 236], 99.50th=[ 255], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 21, max= 382, per=27.11%, avg=104.12, stdev=69.26, samples=109 iops : min= 1, max= 23, avg= 5.75, stdev= 4.38, samples=109 write: IOPS=6, BW=105KiB/s (107kB/s)(6544KiB/62342msec); 0 zone resets clat (msec): min=35, max=336, avg=117.85, stdev=53.64 lat (msec): min=35, max=336, avg=117.85, stdev=53.64 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 116], | 70.00th=[ 131], 80.00th=[ 157], 90.00th=[ 199], 95.00th=[ 230], | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 254, per=26.51%, avg=107.09, stdev=46.25, samples=120 iops : min= 1, max= 15, avg= 5.95, stdev= 3.00, samples=120 lat (msec) : 10=2.99%, 20=16.02%, 50=20.44%, 100=27.60%, 250=31.25% lat (msec) : 500=1.69% cpu : usr=0.04%, sys=1.51%, ctx=1352, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145309: Fri Aug 14 21:03:46 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59604msec) clat (msec): min=6, max=413, avg=34.39, stdev=35.18 lat (msec): min=6, max=413, avg=34.39, stdev=35.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 69], 95.00th=[ 93], | 99.00th=[ 190], 99.50th=[ 230], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 30, max= 351, per=29.23%, avg=112.25, stdev=74.60, samples=110 iops : min= 1, max= 21, avg= 6.26, stdev= 4.73, samples=110 write: IOPS=6, BW=101KiB/s (104kB/s)(6032KiB/59604msec); 0 zone resets clat (msec): min=41, max=366, avg=121.66, stdev=58.33 lat (msec): min=41, max=366, avg=121.66, stdev=58.33 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 56], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 87], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 117], | 70.00th=[ 131], 80.00th=[ 157], 90.00th=[ 209], 95.00th=[ 241], | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 223, per=25.27%, avg=102.10, stdev=45.48, samples=115 iops : min= 1, max= 13, avg= 5.63, stdev= 2.95, samples=115 lat (msec) : 10=1.82%, 20=17.32%, 50=23.57%, 100=29.04%, 250=25.91% lat (msec) : 500=2.34% cpu : usr=0.03%, sys=1.48%, ctx=1295, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145310: Fri Aug 14 21:03:46 2026 read: IOPS=6, BW=97.3KiB/s (99.7kB/s)(6032KiB/61977msec) clat (msec): min=7, max=406, avg=36.66, stdev=42.36 lat (msec): min=7, max=406, avg=36.66, stdev=42.36 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 80], 95.00th=[ 111], | 99.00th=[ 236], 99.50th=[ 262], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 30, max= 307, per=27.19%, avg=104.41, stdev=65.10, samples=113 iops : min= 1, max= 19, avg= 5.78, stdev= 4.16, samples=113 write: IOPS=6, BW=101KiB/s (103kB/s)(6256KiB/61977msec); 0 zone resets clat (msec): min=42, max=414, avg=123.02, stdev=54.60 lat (msec): min=42, max=414, avg=123.02, stdev=54.61 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 101], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 197], 95.00th=[ 232], | 99.00th=[ 330], 99.50th=[ 355], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 30, max= 192, per=25.54%, avg=103.19, stdev=42.61, samples=119 iops : min= 1, max= 12, avg= 5.71, stdev= 2.77, samples=119 lat (msec) : 10=2.47%, 20=18.62%, 50=19.53%, 100=26.04%, 250=31.51% lat (msec) : 500=1.82% cpu : usr=0.03%, sys=1.53%, ctx=1311, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=384KiB/s (393kB/s), 92.1KiB/s-105KiB/s (94.3kB/s-107kB/s), io=23.4MiB (24.5MB), run=59604-62342msec WRITE: bw=404KiB/s (414kB/s), 101KiB/s-105KiB/s (103kB/s-107kB/s), io=24.6MiB (25.8MB), run=59604-62342msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145336: Fri Aug 14 21:03:59 2026 read: IOPS=1, BW=1647KiB/s (1686kB/s)(7168KiB/4353msec) clat (usec): min=444, max=2136.2k, avg=401071.19, stdev=776266.72 lat (usec): min=444, max=2136.2k, avg=401072.19, stdev=776266.75 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], | 20.00th=[ 603], 30.00th=[ 3490], 40.00th=[ 3490], | 50.00th=[ 141558], 60.00th=[ 162530], 70.00th=[ 162530], | 80.00th=[ 362808], 90.00th=[2139096], 95.00th=[2139096], | 99.00th=[2139096], 99.50th=[2139096], 99.90th=[2139096], | 99.95th=[2139096], 99.99th=[2139096] bw ( KiB/s): min= 2043, max= 6107, per=81.65%, avg=3841.00, stdev=2072.03, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1176KiB/s (1204kB/s)(5120KiB/4353msec); 0 zone resets clat (msec): min=132, max=713, avg=308.50, stdev=253.25 lat (msec): min=132, max=713, avg=308.83, stdev=253.02 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2035, max= 6131, per=62.00%, avg=4083.00, stdev=2896.31, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=11.79%, ctx=208, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145337: Fri Aug 14 21:03:59 2026 read: IOPS=0, BW=475KiB/s (486kB/s)(2048KiB/4316msec) clat (usec): min=609, max=142293, avg=71451.23, stdev=100186.02 lat (usec): min=610, max=142294, avg=71452.53, stdev=100186.20 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 611], 50.00th=[ 611], 60.00th=[141558], | 70.00th=[141558], 80.00th=[141558], 90.00th=[141558], 95.00th=[141558], | 99.00th=[141558], 99.50th=[141558], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 1625, max= 2043, per=38.99%, avg=1834.00, stdev=295.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2373KiB/s (2430kB/s)(10.0MiB/4316msec); 0 zone resets clat (msec): min=85, max=854, avg=416.83, stdev=220.89 lat (msec): min=85, max=854, avg=416.90, stdev=220.89 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 284], | 30.00th=[ 288], 40.00th=[ 292], 50.00th=[ 326], 60.00th=[ 359], | 70.00th=[ 506], 80.00th=[ 523], 90.00th=[ 651], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1625, max= 4087, per=38.87%, avg=2560.00, stdev=1038.09, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=15.39%, ctx=126, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145338: Fri Aug 14 21:03:59 2026 read: IOPS=1, BW=1541KiB/s (1578kB/s)(6144KiB/3987msec) clat (msec): min=3, max=204, avg=139.46, stdev=77.13 lat (msec): min=3, max=204, avg=139.46, stdev=77.13 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 186], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 205], 95.00th=[ 205], | 99.00th=[ 205], 99.50th=[ 205], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 2039, max= 4071, per=57.77%, avg=2717.67, stdev=1172.02, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1541KiB/s (1578kB/s)(6144KiB/3987msec); 0 zone resets clat (msec): min=173, max=1196, avg=524.26, stdev=371.98 lat (msec): min=173, max=1196, avg=524.33, stdev=371.98 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 498], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1681, max= 2043, per=29.84%, avg=1965.00, stdev=159.07, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 4=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.12%, ctx=182, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145339: Fri Aug 14 21:03:59 2026 read: IOPS=1, BW=1397KiB/s (1430kB/s)(5120KiB/3666msec) clat (msec): min=16, max=245, avg=162.58, stdev=94.27 lat (msec): min=16, max=245, avg=162.58, stdev=94.27 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 17], 10.00th=[ 17], 20.00th=[ 17], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1955KiB/s (2002kB/s)(7168KiB/3666msec); 0 zone resets clat (msec): min=183, max=950, avg=405.96, stdev=315.97 lat (msec): min=183, max=950, avg=406.26, stdev=316.24 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 188], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 194], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 743], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1648, max= 4096, per=42.17%, avg=2777.00, stdev=1209.92, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 20=8.33%, 250=66.67%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=14.54%, ctx=148, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4705KiB/s (4818kB/s), 475KiB/s-1647KiB/s (486kB/s-1686kB/s), io=20.0MiB (20.0MB), run=3666-4353msec WRITE: bw=6587KiB/s (6745kB/s), 1176KiB/s-2373KiB/s (1204kB/s-2430kB/s), io=28.0MiB (29.4MB), run=3666-4353msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145331: Fri Aug 14 21:03:59 2026 read: IOPS=2, BW=2728KiB/s (2793kB/s)(7168KiB/2628msec) clat (msec): min=64, max=262, avg=140.75, stdev=67.66 lat (msec): min=64, max=262, avg=140.75, stdev=67.66 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 68], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 178], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 2043, max= 6059, per=93.23%, avg=4063.00, stdev=2008.11, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1948KiB/s (1995kB/s)(5120KiB/2628msec); 0 zone resets clat (msec): min=218, max=517, avg=316.46, stdev=119.09 lat (msec): min=218, max=517, avg=316.75, stdev=119.09 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1946, max= 4087, per=41.40%, avg=2525.75, stdev=1041.70, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=7.16%, ctx=101, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145332: Fri Aug 14 21:03:59 2026 read: IOPS=0, BW=459KiB/s (470kB/s)(2048KiB/4461msec) clat (msec): min=92, max=145, avg=118.62, stdev=37.43 lat (msec): min=92, max=145, avg=118.63, stdev=37.43 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 1965, max= 2015, per=45.66%, avg=1990.00, stdev=35.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2295KiB/s (2351kB/s)(10.0MiB/4461msec); 0 zone resets clat (msec): min=168, max=1133, avg=418.95, stdev=284.68 lat (msec): min=168, max=1133, avg=419.10, stdev=284.61 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 180], | 30.00th=[ 209], 40.00th=[ 247], 50.00th=[ 355], 60.00th=[ 439], | 70.00th=[ 447], 80.00th=[ 464], 90.00th=[ 550], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1965, max= 6023, per=49.50%, avg=3020.00, stdev=1683.38, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.20%, ctx=66, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145333: Fri Aug 14 21:03:59 2026 read: IOPS=1, BW=1308KiB/s (1339kB/s)(6144KiB/4699msec) clat (msec): min=116, max=376, avg=219.96, stdev=110.69 lat (msec): min=116, max=376, avg=219.96, stdev=110.69 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 197], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1946, max= 4087, per=57.68%, avg=2513.75, stdev=1049.29, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1308KiB/s (1339kB/s)(6144KiB/4699msec); 0 zone resets clat (msec): min=192, max=1054, avg=552.91, stdev=344.50 lat (msec): min=192, max=1054, avg=553.08, stdev=344.45 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 542], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1946, max= 2043, per=33.04%, avg=2015.60, stdev=41.73, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.24%, ctx=70, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145334: Fri Aug 14 21:03:59 2026 read: IOPS=1, BW=1320KiB/s (1351kB/s)(5120KiB/3880msec) clat (msec): min=93, max=328, avg=202.95, stdev=104.29 lat (msec): min=93, max=328, avg=202.95, stdev=104.29 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 2027, max= 5840, per=90.26%, avg=3933.50, stdev=2696.20, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1847KiB/s (1892kB/s)(7168KiB/3880msec); 0 zone resets clat (msec): min=137, max=1180, avg=398.99, stdev=361.67 lat (msec): min=137, max=1181, avg=399.15, stdev=361.68 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 192], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 251], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 485], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1957, max= 4087, per=49.62%, avg=3027.50, stdev=1196.19, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 2000=8.33% cpu : usr=0.08%, sys=4.07%, ctx=62, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4358KiB/s (4463kB/s), 459KiB/s-2728KiB/s (470kB/s-2793kB/s), io=20.0MiB (20.0MB), run=2628-4699msec WRITE: bw=6102KiB/s (6248kB/s), 1308KiB/s-2295KiB/s (1339kB/s-2351kB/s), io=28.0MiB (29.4MB), run=2628-4699msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145347: Fri Aug 14 21:04:13 2026 read: IOPS=1, BW=5681KiB/s (5817kB/s)(12.0MiB/2163msec) clat (msec): min=628, max=845, avg=702.77, stdev=123.32 lat (msec): min=628, max=845, avg=702.77, stdev=123.32 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 5843, max= 8143, per=100.00%, avg=6993.00, stdev=1626.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.75%, ctx=235, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145349: Fri Aug 14 21:04:13 2026 read: IOPS=0, BW=1446KiB/s (1481kB/s)(4096KiB/2832msec) clat (nsec): min=725566k, max=725566k, avg=725565890.00, stdev= 0.00 lat (nsec): min=725568k, max=725568k, avg=725568233.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2893KiB/s (2962kB/s)(8192KiB/2832msec); 0 zone resets clat (msec): min=920, max=978, avg=949.64, stdev=40.78 lat (msec): min=921, max=978, avg=949.97, stdev=40.71 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8126, max= 8126, per=79.11%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=8.87%, ctx=150, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145351: Fri Aug 14 21:04:13 2026 write: IOPS=0, BW=3852KiB/s (3944kB/s)(12.0MiB/3190msec); 0 zone resets clat (msec): min=227, max=2124, avg=1023.50, stdev=984.57 lat (msec): min=228, max=2125, avg=1024.32, stdev=984.67 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8126, max= 8175, per=79.35%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.86%, ctx=75, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145353: Fri Aug 14 21:04:13 2026 write: IOPS=1, BW=6295KiB/s (6446kB/s)(12.0MiB/1952msec); 0 zone resets clat (msec): min=337, max=908, avg=572.76, stdev=298.56 lat (msec): min=337, max=909, avg=573.67, stdev=298.69 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 5665, max= 8159, per=67.29%, avg=6912.00, stdev=1763.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.43%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5785KiB/s (5924kB/s), 1446KiB/s-5681KiB/s (1481kB/s-5817kB/s), io=16.0MiB (16.8MB), run=2163-2832msec WRITE: bw=10.0MiB/s (10.5MB/s), 2893KiB/s-6295KiB/s (2962kB/s-6446kB/s), io=32.0MiB (33.6MB), run=1952-3190msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145348: Fri Aug 14 21:04:13 2026 read: IOPS=2, BW=8834KiB/s (9046kB/s)(12.0MiB/1391msec) clat (msec): min=199, max=840, avg=441.88, stdev=347.60 lat (msec): min=199, max=840, avg=441.88, stdev=347.60 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min=13721, max=13721, per=100.00%, avg=13721.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.40%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145350: Fri Aug 14 21:04:13 2026 read: IOPS=0, BW=1363KiB/s (1395kB/s)(4096KiB/3006msec) clat (nsec): min=1258.9M, max=1258.9M, avg=1258898760.00, stdev= 0.00 lat (nsec): min=1258.9M, max=1258.9M, avg=1258900758.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2725KiB/s (2791kB/s)(8192KiB/3006msec); 0 zone resets clat (msec): min=603, max=1109, avg=856.57, stdev=358.11 lat (msec): min=603, max=1111, avg=857.44, stdev=358.86 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8143, max= 8143, per=74.71%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.73%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145352: Fri Aug 14 21:04:13 2026 write: IOPS=1, BW=4344KiB/s (4448kB/s)(12.0MiB/2829msec); 0 zone resets clat (msec): min=536, max=1138, avg=930.65, stdev=341.91 lat (msec): min=536, max=1139, avg=931.55, stdev=342.41 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8143, max= 8192, per=74.93%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.78%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145354: Fri Aug 14 21:04:13 2026 write: IOPS=1, BW=5380KiB/s (5509kB/s)(12.0MiB/2284msec); 0 zone resets clat (msec): min=623, max=960, avg=739.16, stdev=191.82 lat (msec): min=623, max=960, avg=739.48, stdev=191.86 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8192, max= 8192, per=75.16%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.62%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5450KiB/s (5581kB/s), 1363KiB/s-8834KiB/s (1395kB/s-9046kB/s), io=16.0MiB (16.8MB), run=1391-3006msec WRITE: bw=10.6MiB/s (11.2MB/s), 2725KiB/s-5380KiB/s (2791kB/s-5509kB/s), io=32.0MiB (33.6MB), run=2284-3006msec