== sanity test 398b: DIO and buffer IO race ============== 00:39:58 (1788669598) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.22943 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144903: Sun Sep 6 00:42:34 2026 read: IOPS=11, BW=44.3KiB/s (45.4kB/s)(5992KiB/135123msec) clat (usec): min=34, max=1050.9k, avg=43704.72, stdev=40203.20 lat (usec): min=35, max=1050.9k, avg=43713.59, stdev=40206.92 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 5735], | 20.00th=[ 20055], 30.00th=[ 25822], 40.00th=[ 31851], | 50.00th=[ 37487], 60.00th=[ 44303], 70.00th=[ 53216], | 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[ 137364], 99.50th=[ 162530], 99.90th=[ 274727], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 125, per=25.24%, avg=44.17, stdev=20.44, samples=264 iops : min= 1, max= 31, avg=10.40, stdev= 5.17, samples=264 write: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6296KiB/135123msec); 0 zone resets clat (usec): min=846, max=484596, avg=43947.38, stdev=47273.35 lat (usec): min=847, max=484598, avg=43951.07, stdev=47273.19 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 1598], 20.00th=[ 5080], | 30.00th=[ 11076], 40.00th=[ 21627], 50.00th=[ 32113], 60.00th=[ 42206], | 70.00th=[ 56886], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[127402], | 99.00th=[217056], 99.50th=[258999], 99.90th=[455082], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 7, max= 111, per=25.28%, avg=46.52, stdev=20.03, samples=263 iops : min= 1, max= 27, avg=11.00, stdev= 5.05, samples=263 lat (usec) : 50=0.23%, 100=3.84%, 250=0.42%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.99%, 4=3.22%, 10=5.83%, 20=9.57%, 50=37.27% lat (msec) : 100=25.75%, 250=7.29%, 500=0.33%, 2000=0.03% cpu : usr=0.09%, sys=5.25%, ctx=6531, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144904: Sun Sep 6 00:42:34 2026 read: IOPS=11, BW=44.3KiB/s (45.3kB/s)(5940KiB/134140msec) clat (usec): min=32, max=266423, avg=42834.26, stdev=30724.85 lat (usec): min=32, max=266426, avg=42837.41, stdev=30724.29 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 6456], 20.00th=[ 19792], | 30.00th=[ 25560], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[139461], 99.50th=[175113], 99.90th=[223347], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 103, per=25.40%, avg=44.45, stdev=18.67, samples=260 iops : min= 1, max= 25, avg=10.48, stdev= 4.72, samples=260 write: IOPS=11, BW=47.3KiB/s (48.5kB/s)(6348KiB/134140msec); 0 zone resets clat (usec): min=909, max=1012.0k, avg=44141.03, stdev=50919.92 lat (usec): min=911, max=1012.0k, avg=44146.98, stdev=50921.07 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 1614], | 20.00th=[ 4113], 30.00th=[ 9765], 40.00th=[ 21365], | 50.00th=[ 32113], 60.00th=[ 43779], 70.00th=[ 57934], | 80.00th=[ 74974], 90.00th=[ 102237], 95.00th=[ 127402], | 99.00th=[ 212861], 99.50th=[ 242222], 99.90th=[ 333448], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 127, per=25.56%, avg=47.04, stdev=20.83, samples=262 iops : min= 1, max= 31, avg=11.13, stdev= 5.24, samples=262 lat (usec) : 50=0.46%, 100=3.74%, 250=0.29%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=6.09%, 4=4.20%, 10=5.53%, 20=9.21%, 50=36.30% lat (msec) : 100=26.37%, 250=7.29%, 500=0.20%, 2000=0.03% cpu : usr=0.09%, sys=5.27%, ctx=6457, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144905: Sun Sep 6 00:42:34 2026 read: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6028KiB/136606msec) clat (usec): min=29, max=334143, avg=42790.62, stdev=32742.56 lat (usec): min=30, max=334147, avg=42794.57, stdev=32742.34 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 165], 20.00th=[ 18482], | 30.00th=[ 24773], 40.00th=[ 30016], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[141558], 99.50th=[175113], 99.90th=[278922], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 110, per=25.38%, avg=44.41, stdev=21.19, samples=263 iops : min= 1, max= 27, avg=10.47, stdev= 5.35, samples=263 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6260KiB/136606msec); 0 zone resets clat (usec): min=860, max=1008.1k, avg=45760.24, stdev=54347.94 lat (usec): min=862, max=1008.1k, avg=45762.53, stdev=54347.92 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1270], 10.00th=[ 1647], | 20.00th=[ 5211], 30.00th=[ 11469], 40.00th=[ 22676], | 50.00th=[ 33162], 60.00th=[ 45351], 70.00th=[ 57934], | 80.00th=[ 77071], 90.00th=[ 102237], 95.00th=[ 130548], | 99.00th=[ 202376], 99.50th=[ 267387], 99.90th=[ 734004], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 134, per=24.69%, avg=45.42, stdev=20.94, samples=267 iops : min= 1, max= 33, avg=10.72, stdev= 5.29, samples=267 lat (usec) : 50=0.65%, 100=3.87%, 250=0.49%, 1000=0.20% lat (msec) : 2=5.70%, 4=3.09%, 10=5.86%, 20=10.25%, 50=36.04% lat (msec) : 100=25.59%, 250=7.94%, 500=0.26%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.25%, ctx=6570, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144906: Sun Sep 6 00:42:34 2026 read: IOPS=11, BW=44.6KiB/s (45.6kB/s)(6052KiB/135812msec) clat (usec): min=34, max=803413, avg=43224.60, stdev=36742.40 lat (usec): min=34, max=803414, avg=43245.84, stdev=36754.91 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 11207], 20.00th=[ 19530], | 30.00th=[ 25560], 40.00th=[ 30802], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[102237], | 99.00th=[149947], 99.50th=[173016], 99.90th=[295699], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 127, per=25.78%, avg=45.11, stdev=19.71, samples=262 iops : min= 1, max= 31, avg=10.63, stdev= 4.98, samples=262 write: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6236KiB/135812msec); 0 zone resets clat (usec): min=899, max=1012.2k, avg=44822.02, stdev=52126.29 lat (usec): min=901, max=1012.2k, avg=44829.60, stdev=52130.08 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1696], | 20.00th=[ 4686], 30.00th=[ 10421], 40.00th=[ 22152], | 50.00th=[ 32375], 60.00th=[ 44303], 70.00th=[ 58983], | 80.00th=[ 73925], 90.00th=[ 103285], 95.00th=[ 129500], | 99.00th=[ 219153], 99.50th=[ 274727], 99.90th=[ 329253], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 149, per=24.96%, avg=45.93, stdev=20.62, samples=265 iops : min= 1, max= 37, avg=10.85, stdev= 5.21, samples=265 lat (usec) : 50=0.39%, 100=3.35%, 250=0.26%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.99%, 4=3.26%, 10=6.32%, 20=9.70%, 50=36.10% lat (msec) : 100=26.53%, 250=7.45%, 500=0.33%, 1000=0.03%, 2000=0.03% cpu : usr=0.11%, sys=5.05%, ctx=6449, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=176KiB/s (180kB/s), 44.1KiB/s-44.6KiB/s (45.2kB/s-45.6kB/s), io=23.4MiB (24.6MB), run=134140-136606msec WRITE: bw=184KiB/s (188kB/s), 45.8KiB/s-47.3KiB/s (46.9kB/s-48.5kB/s), io=24.6MiB (25.7MB), run=134140-136606msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144899: Sun Sep 6 00:44:51 2026 read: IOPS=5, BW=22.1KiB/s (22.6kB/s)(5992KiB/271064msec) clat (msec): min=5, max=1040, avg=36.11, stdev=50.82 lat (msec): min=5, max=1040, avg=36.11, stdev=50.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 75], 95.00th=[ 106], | 99.00th=[ 199], 99.50th=[ 292], 99.90th=[ 625], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 87, per=28.82%, avg=25.08, stdev=17.00, samples=462 iops : min= 1, max= 21, avg= 5.64, stdev= 4.32, samples=462 write: IOPS=5, BW=23.2KiB/s (23.8kB/s)(6296KiB/271064msec); 0 zone resets clat (msec): min=33, max=603, avg=137.56, stdev=71.61 lat (msec): min=33, max=603, avg=137.57, stdev=71.61 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 184], 90.00th=[ 230], 95.00th=[ 284], | 99.00th=[ 388], 99.50th=[ 447], 99.90th=[ 523], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 64, per=25.42%, avg=23.13, stdev=11.49, samples=524 iops : min= 1, max= 16, avg= 5.14, stdev= 2.94, samples=524 lat (msec) : 10=4.17%, 20=17.32%, 50=19.60%, 100=23.31%, 250=31.58% lat (msec) : 500=3.87%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5245, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144900: Sun Sep 6 00:44:51 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5940KiB/273508msec) clat (msec): min=4, max=963, avg=35.71, stdev=46.21 lat (msec): min=4, max=963, avg=35.71, stdev=46.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 48], 90.00th=[ 80], 95.00th=[ 113], | 99.00th=[ 186], 99.50th=[ 213], 99.90th=[ 642], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 101, per=28.82%, avg=25.07, stdev=16.94, samples=458 iops : min= 1, max= 25, avg= 5.64, stdev= 4.29, samples=458 write: IOPS=5, BW=23.2KiB/s (23.8kB/s)(6348KiB/273508msec); 0 zone resets clat (msec): min=29, max=836, avg=138.67, stdev=71.31 lat (msec): min=29, max=836, avg=138.67, stdev=71.31 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 236], 95.00th=[ 275], | 99.00th=[ 368], 99.50th=[ 409], 99.90th=[ 609], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 64, per=25.30%, avg=23.02, stdev=11.43, samples=531 iops : min= 1, max= 16, avg= 5.12, stdev= 2.94, samples=531 lat (msec) : 10=4.39%, 20=18.23%, 50=17.25%, 100=22.92%, 250=33.01% lat (msec) : 500=4.07%, 750=0.07%, 1000=0.07% cpu : usr=0.05%, sys=1.18%, ctx=5181, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144901: Sun Sep 6 00:44:51 2026 read: IOPS=5, BW=22.2KiB/s (22.8kB/s)(6028KiB/271105msec) clat (msec): min=5, max=592, avg=35.60, stdev=38.99 lat (msec): min=5, max=592, avg=35.61, stdev=38.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 110], | 99.00th=[ 180], 99.50th=[ 245], 99.90th=[ 309], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 110, per=28.29%, avg=24.61, stdev=17.17, samples=472 iops : min= 1, max= 27, avg= 5.52, stdev= 4.34, samples=472 write: IOPS=5, BW=23.1KiB/s (23.6kB/s)(6260KiB/271105msec); 0 zone resets clat (msec): min=29, max=966, avg=138.68, stdev=72.08 lat (msec): min=29, max=966, avg=138.68, stdev=72.08 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 120], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 363], 99.50th=[ 405], 99.90th=[ 523], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 71, per=25.01%, avg=22.76, stdev=11.25, samples=529 iops : min= 1, max= 17, avg= 5.05, stdev= 2.90, samples=529 lat (msec) : 10=3.87%, 20=17.58%, 50=19.14%, 100=23.47%, 250=31.71% lat (msec) : 500=4.13%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.15%, ctx=4950, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144902: Sun Sep 6 00:44:51 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6052KiB/271872msec) clat (msec): min=5, max=485, avg=34.92, stdev=38.91 lat (msec): min=5, max=485, avg=34.92, stdev=38.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 74], 95.00th=[ 115], | 99.00th=[ 174], 99.50th=[ 236], 99.90th=[ 414], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 100, per=29.34%, avg=25.53, stdev=18.03, samples=457 iops : min= 1, max= 25, avg= 5.75, stdev= 4.57, samples=457 write: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6236KiB/271872msec); 0 zone resets clat (msec): min=35, max=967, avg=140.23, stdev=76.70 lat (msec): min=35, max=967, avg=140.23, stdev=76.70 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 232], 95.00th=[ 284], | 99.00th=[ 397], 99.50th=[ 439], 99.90th=[ 844], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 56, per=24.93%, avg=22.69, stdev=11.17, samples=527 iops : min= 1, max= 14, avg= 5.03, stdev= 2.85, samples=527 lat (msec) : 10=4.46%, 20=17.38%, 50=19.79%, 100=22.66%, 250=31.38% lat (msec) : 500=4.23%, 750=0.03%, 1000=0.07% cpu : usr=0.05%, sys=1.18%, ctx=5192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=87.8KiB/s (89.9kB/s), 21.7KiB/s-22.3KiB/s (22.2kB/s-22.8kB/s), io=23.4MiB (24.6MB), run=271064-273508msec WRITE: bw=91.9KiB/s (94.1kB/s), 22.9KiB/s-23.2KiB/s (23.5kB/s-23.8kB/s), io=24.6MiB (25.7MB), run=271064-273508msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144964: Sun Sep 6 00:45:33 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(5920KiB/28211msec) clat (usec): min=34, max=279127, avg=36831.77, stdev=34335.98 lat (usec): min=34, max=279131, avg=36833.05, stdev=34336.40 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 87], | 30.00th=[ 20055], 40.00th=[ 25297], 50.00th=[ 30278], 60.00th=[ 36439], | 70.00th=[ 45876], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[149947], 99.50th=[183501], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 566, per=25.96%, avg=214.98, stdev=107.57, samples=54 iops : min= 1, max= 35, avg=12.70, stdev= 6.79, samples=54 write: IOPS=14, BW=226KiB/s (231kB/s)(6368KiB/28211msec); 0 zone resets clat (usec): min=1209, max=577106, avg=36187.14, stdev=49298.90 lat (usec): min=1210, max=577109, avg=36201.57, stdev=49292.86 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1647], 10.00th=[ 1893], 20.00th=[ 4490], | 30.00th=[ 7963], 40.00th=[ 12387], 50.00th=[ 20579], 60.00th=[ 30540], | 70.00th=[ 43254], 80.00th=[ 62129], 90.00th=[ 83362], 95.00th=[121111], | 99.00th=[202376], 99.50th=[396362], 99.90th=[574620], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 60, max= 570, per=26.51%, avg=230.89, stdev=100.04, samples=54 iops : min= 3, max= 35, avg=13.72, stdev= 6.28, samples=54 lat (usec) : 50=1.43%, 100=8.46%, 250=0.26%, 500=0.52% lat (msec) : 2=5.34%, 4=3.65%, 10=9.24%, 20=10.94%, 50=34.51% lat (msec) : 100=19.79%, 250=5.47%, 500=0.26%, 750=0.13% cpu : usr=0.05%, sys=6.00%, ctx=1403, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144966: Sun Sep 6 00:45:33 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(5744KiB/28326msec) clat (usec): min=36, max=593228, avg=40569.05, stdev=44064.28 lat (usec): min=36, max=593230, avg=40570.20, stdev=44064.33 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 15270], | 30.00th=[ 23462], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 46400], 80.00th=[ 54264], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[156238], 99.50th=[316670], 99.90th=[591397], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 31, max= 416, per=24.91%, avg=206.26, stdev=94.01, samples=54 iops : min= 1, max= 26, avg=12.17, stdev= 5.92, samples=54 write: IOPS=14, BW=231KiB/s (237kB/s)(6544KiB/28326msec); 0 zone resets clat (usec): min=1325, max=202235, avg=33096.92, stdev=34611.83 lat (usec): min=1327, max=202237, avg=33100.02, stdev=34611.57 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1696], 10.00th=[ 2147], 20.00th=[ 5014], | 30.00th=[ 7963], 40.00th=[ 14091], 50.00th=[ 22676], 60.00th=[ 31065], | 70.00th=[ 40633], 80.00th=[ 57410], 90.00th=[ 76022], 95.00th=[104334], | 99.00th=[154141], 99.50th=[185598], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 60, max= 508, per=27.03%, avg=235.43, stdev=106.56, samples=54 iops : min= 3, max= 31, avg=14.00, stdev= 6.65, samples=54 lat (usec) : 50=1.30%, 100=6.51%, 250=0.13%, 750=0.13% lat (msec) : 2=4.69%, 4=3.78%, 10=10.29%, 20=10.03%, 50=38.28% lat (msec) : 100=19.79%, 250=4.82%, 500=0.13%, 750=0.13% cpu : usr=0.06%, sys=5.98%, ctx=1433, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144967: Sun Sep 6 00:45:33 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6256KiB/28923msec) clat (usec): min=35, max=445284, avg=38949.64, stdev=39682.33 lat (usec): min=35, max=445286, avg=38950.76, stdev=39682.38 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 62], 20.00th=[ 3359], | 30.00th=[ 21365], 40.00th=[ 27132], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 56886], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[193987], 99.50th=[274727], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 32, max= 384, per=26.62%, avg=220.41, stdev=95.38, samples=56 iops : min= 2, max= 24, avg=13.07, stdev= 6.02, samples=56 write: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28923msec); 0 zone resets clat (usec): min=1032, max=529960, avg=35664.38, stdev=47591.50 lat (usec): min=1034, max=529962, avg=35666.39, stdev=47591.55 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1500], 10.00th=[ 1729], 20.00th=[ 3228], | 30.00th=[ 6259], 40.00th=[ 10290], 50.00th=[ 17433], 60.00th=[ 30802], | 70.00th=[ 44303], 80.00th=[ 63177], 90.00th=[ 86508], 95.00th=[115868], | 99.00th=[219153], 99.50th=[246416], 99.90th=[530580], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 31, max= 416, per=23.71%, avg=206.53, stdev=96.24, samples=57 iops : min= 1, max= 26, avg=12.19, stdev= 6.07, samples=57 lat (usec) : 50=1.56%, 100=7.55%, 250=0.65%, 500=0.13% lat (msec) : 2=7.29%, 4=4.69%, 10=8.07%, 20=10.29%, 50=31.77% lat (msec) : 100=22.14%, 250=5.47%, 500=0.26%, 750=0.13% cpu : usr=0.11%, sys=5.73%, ctx=1413, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144969: Sun Sep 6 00:45:33 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26954msec) clat (usec): min=36, max=562128, avg=37798.75, stdev=40807.62 lat (usec): min=36, max=562129, avg=37812.52, stdev=40803.75 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 139], | 30.00th=[ 19792], 40.00th=[ 26870], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 47973], 80.00th=[ 56886], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[135267], 99.50th=[217056], 99.90th=[566232], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 63, max= 416, per=27.84%, avg=230.49, stdev=93.49, samples=51 iops : min= 3, max= 26, avg=13.69, stdev= 5.90, samples=51 write: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26954msec); 0 zone resets clat (usec): min=1355, max=239796, avg=31774.98, stdev=37128.44 lat (usec): min=1356, max=239798, avg=31787.60, stdev=37120.44 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1663], 10.00th=[ 1827], 20.00th=[ 3720], | 30.00th=[ 5473], 40.00th=[ 9765], 50.00th=[ 18482], 60.00th=[ 27919], | 70.00th=[ 36963], 80.00th=[ 53740], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[168821], 99.50th=[189793], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 62, max= 540, per=27.16%, avg=236.54, stdev=116.90, samples=52 iops : min= 3, max= 33, avg=14.06, stdev= 7.37, samples=52 lat (usec) : 50=1.56%, 100=7.94%, 250=0.52%, 500=0.26%, 750=0.26% lat (msec) : 2=6.25%, 4=5.21%, 10=9.38%, 20=9.38%, 50=34.77% lat (msec) : 100=19.66%, 250=4.69%, 750=0.13% cpu : usr=0.07%, sys=6.04%, ctx=1399, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=828KiB/s (848kB/s), 203KiB/s-224KiB/s (208kB/s-229kB/s), io=23.4MiB (24.5MB), run=26954-28923msec WRITE: bw=871KiB/s (892kB/s), 209KiB/s-232KiB/s (214kB/s-238kB/s), io=24.6MiB (25.8MB), run=26954-28923msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144963: Sun Sep 6 00:46:09 2026 read: IOPS=5, BW=91.4KiB/s (93.6kB/s)(5920KiB/64756msec) clat (msec): min=5, max=362, avg=36.52, stdev=41.10 lat (msec): min=5, max=362, avg=36.52, stdev=41.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 72], 95.00th=[ 115], | 99.00th=[ 224], 99.50th=[ 300], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 317, per=27.32%, avg=100.25, stdev=64.75, samples=116 iops : min= 1, max= 19, avg= 5.50, stdev= 4.14, samples=116 write: IOPS=6, BW=98.3KiB/s (101kB/s)(6368KiB/64756msec); 0 zone resets clat (msec): min=37, max=539, avg=128.10, stdev=68.94 lat (msec): min=37, max=539, avg=128.10, stdev=68.93 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 87], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 124], | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 215], 95.00th=[ 271], | 99.00th=[ 363], 99.50th=[ 481], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 29, max= 223, per=25.68%, avg=99.40, stdev=48.15, samples=126 iops : min= 1, max= 13, avg= 5.44, stdev= 3.12, samples=126 lat (msec) : 10=3.12%, 20=16.54%, 50=21.74%, 100=25.78%, 250=28.91% lat (msec) : 500=3.78%, 750=0.13% cpu : usr=0.06%, sys=1.29%, ctx=1337, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144965: Sun Sep 6 00:46:09 2026 read: IOPS=5, BW=88.2KiB/s (90.3kB/s)(5744KiB/65115msec) clat (msec): min=5, max=297, avg=37.91, stdev=41.64 lat (msec): min=5, max=297, avg=37.91, stdev=41.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 52], 90.00th=[ 96], 95.00th=[ 126], | 99.00th=[ 213], 99.50th=[ 232], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 416, per=27.54%, avg=101.07, stdev=73.88, samples=110 iops : min= 1, max= 26, avg= 5.57, stdev= 4.74, samples=110 write: IOPS=6, BW=100KiB/s (103kB/s)(6544KiB/65115msec); 0 zone resets clat (msec): min=39, max=487, avg=125.40, stdev=69.13 lat (msec): min=39, max=487, avg=125.40, stdev=69.13 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 107], 60.00th=[ 120], | 70.00th=[ 138], 80.00th=[ 165], 90.00th=[ 222], 95.00th=[ 262], | 99.00th=[ 368], 99.50th=[ 409], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 30, max= 192, per=25.73%, avg=99.58, stdev=48.18, samples=127 iops : min= 1, max= 12, avg= 5.45, stdev= 3.14, samples=127 lat (msec) : 10=2.99%, 20=17.84%, 50=18.36%, 100=27.34%, 250=30.21% lat (msec) : 500=3.26% cpu : usr=0.05%, sys=1.21%, ctx=1330, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144968: Sun Sep 6 00:46:09 2026 read: IOPS=6, BW=100KiB/s (102kB/s)(6256KiB/62523msec) clat (msec): min=6, max=263, avg=34.41, stdev=35.81 lat (msec): min=6, max=263, avg=34.42, stdev=35.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 66], 95.00th=[ 111], | 99.00th=[ 192], 99.50th=[ 241], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 383, per=30.28%, avg=111.12, stdev=74.21, samples=111 iops : min= 1, max= 23, avg= 6.17, stdev= 4.72, samples=111 write: IOPS=6, BW=96.5KiB/s (98.8kB/s)(6032KiB/62523msec); 0 zone resets clat (msec): min=46, max=538, avg=129.99, stdev=69.13 lat (msec): min=46, max=538, avg=130.00, stdev=69.13 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 97], 50.00th=[ 110], 60.00th=[ 126], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 222], 95.00th=[ 262], | 99.00th=[ 376], 99.50th=[ 481], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 31, max= 192, per=25.38%, avg=98.22, stdev=43.87, samples=120 iops : min= 1, max= 12, avg= 5.36, stdev= 2.85, samples=120 lat (msec) : 10=3.52%, 20=18.23%, 50=20.96%, 100=26.43%, 250=27.86% lat (msec) : 500=2.86%, 750=0.13% cpu : usr=0.06%, sys=1.34%, ctx=1373, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144970: Sun Sep 6 00:46:09 2026 read: IOPS=5, BW=93.3KiB/s (95.6kB/s)(6032KiB/64636msec) clat (msec): min=5, max=241, avg=35.33, stdev=34.26 lat (msec): min=5, max=241, avg=35.33, stdev=34.26 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 75], 95.00th=[ 115], | 99.00th=[ 182], 99.50th=[ 194], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 318, per=29.20%, avg=107.16, stdev=67.28, samples=111 iops : min= 1, max= 19, avg= 5.92, stdev= 4.30, samples=111 write: IOPS=6, BW=96.8KiB/s (99.1kB/s)(6256KiB/64636msec); 0 zone resets clat (msec): min=30, max=548, avg=130.77, stdev=72.04 lat (msec): min=30, max=548, avg=130.77, stdev=72.05 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 77], | 30.00th=[ 90], 40.00th=[ 103], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 228], 95.00th=[ 257], | 99.00th=[ 418], 99.50th=[ 535], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 223, per=25.14%, avg=97.30, stdev=47.97, samples=127 iops : min= 1, max= 13, avg= 5.31, stdev= 3.12, samples=127 lat (msec) : 10=1.95%, 20=17.97%, 50=21.09%, 100=24.48%, 250=31.77% lat (msec) : 500=2.47%, 750=0.26% cpu : usr=0.04%, sys=1.18%, ctx=1291, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=368KiB/s (377kB/s), 88.2KiB/s-100KiB/s (90.3kB/s-102kB/s), io=23.4MiB (24.5MB), run=62523-65115msec WRITE: bw=387KiB/s (396kB/s), 96.5KiB/s-100KiB/s (98.8kB/s-103kB/s), io=24.6MiB (25.8MB), run=62523-65115msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144990: Sun Sep 6 00:46:23 2026 read: IOPS=2, BW=2116KiB/s (2166kB/s)(7168KiB/3388msec) clat (usec): min=634, max=488823, avg=221354.60, stdev=154021.31 lat (usec): min=636, max=488824, avg=221356.37, stdev=154021.31 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 93848], | 30.00th=[200279], 40.00th=[200279], 50.00th=[221250], 60.00th=[261096], | 70.00th=[261096], 80.00th=[283116], 90.00th=[488637], 95.00th=[488637], | 99.00th=[488637], 99.50th=[488637], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 1759, max= 4031, per=59.44%, avg=2957.00, stdev=1235.64, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1511KiB/s (1547kB/s)(5120KiB/3388msec); 0 zone resets clat (msec): min=148, max=1024, avg=366.96, stdev=369.12 lat (msec): min=148, max=1024, avg=367.07, stdev=369.11 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 2015, max= 6011, per=57.62%, avg=4013.00, stdev=2825.60, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=11.49%, ctx=168, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144991: Sun Sep 6 00:46:23 2026 read: IOPS=0, BW=498KiB/s (510kB/s)(2048KiB/4116msec) clat (msec): min=276, max=374, avg=325.55, stdev=69.36 lat (msec): min=276, max=374, avg=325.55, stdev=69.36 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1648, max= 2023, per=36.89%, avg=1835.50, stdev=265.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2488KiB/s (2548kB/s)(10.0MiB/4116msec); 0 zone resets clat (msec): min=100, max=731, avg=346.24, stdev=194.91 lat (msec): min=100, max=731, avg=346.34, stdev=194.90 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 153], | 30.00th=[ 205], 40.00th=[ 228], 50.00th=[ 313], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 443], 90.00th=[ 567], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2011, max= 6023, per=40.52%, avg=2822.20, stdev=1789.33, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=12.35%, ctx=98, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144992: Sun Sep 6 00:46:23 2026 read: IOPS=1, BW=1773KiB/s (1816kB/s)(6144KiB/3465msec) clat (msec): min=2, max=417, avg=212.88, stdev=137.45 lat (msec): min=2, max=417, avg=212.88, stdev=137.45 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 243], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2003, max= 4079, per=50.85%, avg=2530.00, stdev=1032.70, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1773KiB/s (1816kB/s)(6144KiB/3465msec); 0 zone resets clat (msec): min=81, max=957, avg=364.37, stdev=327.65 lat (msec): min=81, max=957, avg=364.45, stdev=327.65 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 363], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 2015, max= 3723, per=35.18%, avg=2450.00, stdev=848.73, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 4=8.33%, 100=8.33%, 250=41.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=10.77%, ctx=211, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144993: Sun Sep 6 00:46:23 2026 read: IOPS=1, BW=1577KiB/s (1615kB/s)(5120KiB/3247msec) clat (usec): min=402, max=239821, avg=87623.14, stdev=119487.93 lat (usec): min=404, max=239823, avg=87624.58, stdev=119488.20 clat percentiles (usec): | 1.00th=[ 404], 5.00th=[ 404], 10.00th=[ 404], 20.00th=[ 404], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 2409], 60.00th=[ 2409], | 70.00th=[193987], 80.00th=[193987], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 2003, max= 6071, per=81.15%, avg=4037.00, stdev=2876.51, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2208KiB/s (2261kB/s)(7168KiB/3247msec); 0 zone resets clat (msec): min=157, max=943, avg=399.92, stdev=289.36 lat (msec): min=157, max=943, avg=400.20, stdev=289.45 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 236], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 550], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1744, max= 4007, per=33.96%, avg=2365.60, stdev=925.68, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 250=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=10.51%, ctx=73, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4976KiB/s (5095kB/s), 498KiB/s-2116KiB/s (510kB/s-2166kB/s), io=20.0MiB (20.0MB), run=3247-4116msec WRITE: bw=6966KiB/s (7133kB/s), 1511KiB/s-2488KiB/s (1547kB/s-2548kB/s), io=28.0MiB (29.4MB), run=3247-4116msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144985: Sun Sep 6 00:46:23 2026 read: IOPS=2, BW=2089KiB/s (2139kB/s)(7168KiB/3431msec) clat (msec): min=84, max=279, avg=160.24, stdev=72.01 lat (msec): min=84, max=279, avg=160.25, stdev=72.00 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 114], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 138], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 241], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1924, max= 4394, per=75.62%, avg=3439.33, stdev=1327.02, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1492KiB/s (1528kB/s)(5120KiB/3431msec); 0 zone resets clat (msec): min=192, max=634, avg=434.13, stdev=193.97 lat (msec): min=193, max=634, avg=434.23, stdev=193.93 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1924, max= 4079, per=39.57%, avg=2519.50, stdev=1041.08, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=3.56%, ctx=67, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144986: Sun Sep 6 00:46:23 2026 read: IOPS=0, BW=455KiB/s (466kB/s)(2048KiB/4503msec) clat (msec): min=74, max=440, avg=257.61, stdev=258.61 lat (msec): min=74, max=440, avg=257.62, stdev=258.61 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1523, max= 2027, per=39.03%, avg=1775.00, stdev=356.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2274KiB/s (2329kB/s)(10.0MiB/4503msec); 0 zone resets clat (msec): min=133, max=1042, avg=395.58, stdev=302.67 lat (msec): min=133, max=1042, avg=395.68, stdev=302.67 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 199], | 30.00th=[ 230], 40.00th=[ 232], 50.00th=[ 236], 60.00th=[ 321], | 70.00th=[ 326], 80.00th=[ 388], 90.00th=[ 852], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1924, max= 4031, per=53.48%, avg=3405.00, stdev=928.62, samples=5 iops : min= 1, max= 3, avg= 2.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.91%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144987: Sun Sep 6 00:46:23 2026 read: IOPS=1, BW=1371KiB/s (1404kB/s)(6144KiB/4481msec) clat (msec): min=66, max=734, avg=325.23, stdev=263.03 lat (msec): min=66, max=734, avg=325.23, stdev=263.03 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 209], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1924, max= 2039, per=43.93%, avg=1997.80, stdev=43.64, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1371KiB/s (1404kB/s)(6144KiB/4481msec); 0 zone resets clat (msec): min=116, max=654, avg=392.10, stdev=187.15 lat (msec): min=121, max=654, avg=393.15, stdev=185.47 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 414], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1924, max= 2909, per=34.91%, avg=2223.00, stdev=460.28, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=2.88%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144988: Sun Sep 6 00:46:23 2026 read: IOPS=1, BW=1486KiB/s (1521kB/s)(5120KiB/3446msec) clat (msec): min=96, max=228, avg=146.35, stdev=50.10 lat (msec): min=96, max=228, avg=146.35, stdev=50.10 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 2000, max= 6119, per=89.26%, avg=4059.50, stdev=2912.57, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2080KiB/s (2130kB/s)(7168KiB/3446msec); 0 zone resets clat (msec): min=163, max=813, avg=366.83, stdev=258.56 lat (msec): min=164, max=813, avg=366.93, stdev=258.57 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 176], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 251], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 642], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1924, max= 4000, per=43.38%, avg=2762.25, stdev=981.16, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.74%, ctx=69, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4548KiB/s (4657kB/s), 455KiB/s-2089KiB/s (466kB/s-2139kB/s), io=20.0MiB (20.0MB), run=3431-4503msec WRITE: bw=6367KiB/s (6520kB/s), 1371KiB/s-2274KiB/s (1404kB/s-2329kB/s), io=28.0MiB (29.4MB), run=3431-4503msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144999: Sun Sep 6 00:46:35 2026 read: IOPS=1, BW=5218KiB/s (5343kB/s)(12.0MiB/2355msec) clat (msec): min=697, max=812, avg=748.02, stdev=58.58 lat (msec): min=697, max=812, avg=748.02, stdev=58.58 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7876, max= 8031, per=100.00%, avg=7953.50, stdev=109.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=12.96%, ctx=189, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145000: Sun Sep 6 00:46:35 2026 read: IOPS=0, BW=1444KiB/s (1479kB/s)(4096KiB/2836msec) clat (nsec): min=739087k, max=739087k, avg=739086697.00, stdev= 0.00 lat (nsec): min=739090k, max=739090k, avg=739089952.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2889KiB/s (2958kB/s)(8192KiB/2836msec); 0 zone resets clat (msec): min=350, max=1531, avg=940.99, stdev=835.72 lat (msec): min=350, max=1532, avg=941.24, stdev=835.67 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7892, max= 7892, per=75.38%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.82%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145002: Sun Sep 6 00:46:35 2026 write: IOPS=0, BW=3926KiB/s (4020kB/s)(12.0MiB/3130msec); 0 zone resets clat (msec): min=792, max=1132, avg=999.07, stdev=181.79 lat (msec): min=792, max=1133, avg=999.51, stdev=181.63 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7742, max= 7892, per=74.67%, avg=7817.00, stdev=106.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.18%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145003: Sun Sep 6 00:46:35 2026 write: IOPS=1, BW=4999KiB/s (5119kB/s)(12.0MiB/2458msec); 0 zone resets clat (msec): min=316, max=1559, avg=781.93, stdev=677.35 lat (msec): min=317, max=1559, avg=782.40, stdev=677.30 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 6907, max= 7876, per=70.60%, avg=7391.50, stdev=685.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.70%, ctx=67, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5777KiB/s (5916kB/s), 1444KiB/s-5218KiB/s (1479kB/s-5343kB/s), io=16.0MiB (16.8MB), run=2355-2836msec WRITE: bw=10.2MiB/s (10.7MB/s), 2889KiB/s-4999KiB/s (2958kB/s-5119kB/s), io=32.0MiB (33.6MB), run=2458-3130msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145004: Sun Sep 6 00:46:36 2026 read: IOPS=1, BW=4224KiB/s (4326kB/s)(12.0MiB/2909msec) clat (msec): min=374, max=1650, avg=969.29, stdev=642.44 lat (msec): min=374, max=1650, avg=969.29, stdev=642.43 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7937, max= 8031, per=100.00%, avg=7984.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=2.99%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145005: Sun Sep 6 00:46:36 2026 read: IOPS=0, BW=1377KiB/s (1410kB/s)(4096KiB/2974msec) clat (nsec): min=1431.4M, max=1431.4M, avg=1431388572.00, stdev= 0.00 lat (nsec): min=1431.4M, max=1431.4M, avg=1431391026.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2755KiB/s (2821kB/s)(8192KiB/2974msec); 0 zone resets clat (msec): min=728, max=799, avg=763.74, stdev=50.12 lat (msec): min=728, max=799, avg=764.17, stdev=50.19 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8031, max= 8031, per=75.71%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.88%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145006: Sun Sep 6 00:46:36 2026 write: IOPS=0, BW=3978KiB/s (4073kB/s)(12.0MiB/3089msec); 0 zone resets clat (msec): min=327, max=1491, avg=1003.10, stdev=603.88 lat (msec): min=332, max=1491, avg=1005.79, stdev=601.94 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8175, max= 8175, per=77.07%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.53%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145007: Sun Sep 6 00:46:36 2026 write: IOPS=1, BW=5051KiB/s (5172kB/s)(12.0MiB/2433msec); 0 zone resets clat (msec): min=445, max=986, avg=773.95, stdev=288.42 lat (msec): min=446, max=987, avg=774.43, stdev=288.38 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 5505, max= 8175, per=64.49%, avg=6840.00, stdev=1887.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.66%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5509KiB/s (5641kB/s), 1377KiB/s-4224KiB/s (1410kB/s-4326kB/s), io=16.0MiB (16.8MB), run=2909-2974msec WRITE: bw=10.4MiB/s (10.9MB/s), 2755KiB/s-5051KiB/s (2821kB/s-5172kB/s), io=32.0MiB (33.6MB), run=2433-3089msec