== sanity test 398b: DIO and buffer IO race ============== 08:45:21 (1785415521) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 9.50172 s, 5.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143695: Thu Jul 30 08:48:39 2026 read: IOPS=8, BW=35.3KiB/s (36.1kB/s)(5992KiB/169841msec) clat (usec): min=28, max=1307.8k, avg=53238.99, stdev=54106.31 lat (usec): min=28, max=1307.8k, avg=53240.11, stdev=54106.30 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 51], 10.00th=[ 64], | 20.00th=[ 21365], 30.00th=[ 29492], 40.00th=[ 36439], | 50.00th=[ 43254], 60.00th=[ 52691], 70.00th=[ 66323], | 80.00th=[ 80217], 90.00th=[ 104334], 95.00th=[ 132645], | 99.00th=[ 189793], 99.50th=[ 248513], 99.90th=[ 459277], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 7, max= 94, per=25.35%, avg=35.49, stdev=17.98, samples=327 iops : min= 1, max= 23, avg= 8.21, stdev= 4.52, samples=327 write: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6296KiB/169841msec); 0 zone resets clat (usec): min=913, max=475708, avg=56951.24, stdev=60934.93 lat (usec): min=914, max=475709, avg=56955.04, stdev=60937.95 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1336], 20.00th=[ 4883], | 30.00th=[ 10290], 40.00th=[ 24773], 50.00th=[ 40633], 60.00th=[ 55837], | 70.00th=[ 76022], 80.00th=[ 96994], 90.00th=[137364], 95.00th=[179307], | 99.00th=[263193], 99.50th=[299893], 99.90th=[379585], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 95, per=25.46%, avg=37.42, stdev=18.75, samples=326 iops : min= 1, max= 23, avg= 8.70, stdev= 4.71, samples=326 lat (usec) : 50=2.25%, 100=3.91%, 250=0.26%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=7.16%, 4=2.15%, 10=6.15%, 20=6.38%, 50=28.35% lat (msec) : 100=27.41%, 250=14.88%, 500=0.85%, 2000=0.03% cpu : usr=0.04%, sys=4.12%, ctx=6079, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143698: Thu Jul 30 08:48:39 2026 read: IOPS=8, BW=35.6KiB/s (36.4kB/s)(5940KiB/166981msec) clat (usec): min=32, max=473461, avg=53000.65, stdev=43511.49 lat (usec): min=33, max=473462, avg=53001.83, stdev=43511.50 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 60], 20.00th=[ 20841], | 30.00th=[ 29492], 40.00th=[ 38536], 50.00th=[ 45876], 60.00th=[ 54789], | 70.00th=[ 65799], 80.00th=[ 81265], 90.00th=[106431], 95.00th=[128451], | 99.00th=[191890], 99.50th=[212861], 99.90th=[362808], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 5, max= 95, per=25.50%, avg=35.70, stdev=17.88, samples=322 iops : min= 1, max= 23, avg= 8.28, stdev= 4.50, samples=322 write: IOPS=9, BW=38.0KiB/s (38.9kB/s)(6348KiB/166981msec); 0 zone resets clat (usec): min=942, max=1258.2k, avg=55356.87, stdev=65308.41 lat (usec): min=943, max=1258.2k, avg=55362.64, stdev=65305.18 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1352], | 20.00th=[ 5145], 30.00th=[ 9896], 40.00th=[ 21627], | 50.00th=[ 39584], 60.00th=[ 54789], 70.00th=[ 73925], | 80.00th=[ 96994], 90.00th=[ 132645], 95.00th=[ 164627], | 99.00th=[ 258999], 99.50th=[ 312476], 99.90th=[ 434111], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 119, per=25.66%, avg=37.73, stdev=19.29, samples=326 iops : min= 1, max= 29, avg= 8.78, stdev= 4.87, samples=326 lat (usec) : 50=2.18%, 100=4.39%, 250=0.33%, 750=0.13%, 1000=0.13% lat (msec) : 2=6.93%, 4=2.15%, 10=6.74%, 20=6.28%, 50=26.50% lat (msec) : 100=28.65%, 250=14.88%, 500=0.68%, 2000=0.03% cpu : usr=0.05%, sys=4.10%, ctx=5963, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143700: Thu Jul 30 08:48:39 2026 read: IOPS=8, BW=35.3KiB/s (36.1kB/s)(6028KiB/170878msec) clat (usec): min=30, max=1259.0k, avg=53254.75, stdev=55332.62 lat (usec): min=30, max=1259.0k, avg=53258.07, stdev=55331.73 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 58], | 20.00th=[ 18220], 30.00th=[ 27919], 40.00th=[ 34866], | 50.00th=[ 43254], 60.00th=[ 53740], 70.00th=[ 66847], | 80.00th=[ 82314], 90.00th=[ 107480], 95.00th=[ 135267], | 99.00th=[ 206570], 99.50th=[ 254804], 99.90th=[ 583009], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 5, max= 95, per=25.44%, avg=35.62, stdev=18.71, samples=328 iops : min= 1, max= 23, avg= 8.25, stdev= 4.72, samples=328 write: IOPS=9, BW=36.6KiB/s (37.5kB/s)(6260KiB/170878msec); 0 zone resets clat (usec): min=986, max=347282, avg=57636.97, stdev=58272.14 lat (usec): min=988, max=347282, avg=57641.21, stdev=58270.60 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1483], 20.00th=[ 5735], | 30.00th=[ 11731], 40.00th=[ 25035], 50.00th=[ 42730], 60.00th=[ 58983], | 70.00th=[ 77071], 80.00th=[103285], 90.00th=[137364], 95.00th=[173016], | 99.00th=[240124], 99.50th=[270533], 99.90th=[308282], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 117, per=24.81%, avg=36.48, stdev=17.11, samples=332 iops : min= 1, max= 29, avg= 8.47, stdev= 4.30, samples=332 lat (usec) : 50=2.57%, 100=4.75%, 250=0.23%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.89%, 4=2.25%, 10=6.77%, 20=6.54%, 50=26.76% lat (msec) : 100=27.31%, 250=16.11%, 500=0.59%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=4.14%, ctx=6047, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143702: Thu Jul 30 08:48:39 2026 read: IOPS=8, BW=35.7KiB/s (36.6kB/s)(6052KiB/169386msec) clat (usec): min=26, max=599409, avg=50190.58, stdev=42403.02 lat (usec): min=26, max=599411, avg=50191.71, stdev=42403.04 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 17695], | 30.00th=[ 28443], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 62653], 80.00th=[ 81265], 90.00th=[103285], 95.00th=[120062], | 99.00th=[175113], 99.50th=[196084], 99.90th=[283116], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 87, per=25.94%, avg=36.32, stdev=17.26, samples=323 iops : min= 1, max= 21, avg= 8.42, stdev= 4.35, samples=323 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6236KiB/169386msec); 0 zone resets clat (usec): min=921, max=1598.0k, avg=59641.59, stdev=74736.73 lat (usec): min=921, max=1598.0k, avg=59646.87, stdev=74736.96 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1450], | 20.00th=[ 5866], 30.00th=[ 11863], 40.00th=[ 24511], | 50.00th=[ 42206], 60.00th=[ 58983], 70.00th=[ 77071], | 80.00th=[ 101188], 90.00th=[ 137364], 95.00th=[ 173016], | 99.00th=[ 278922], 99.50th=[ 346031], 99.90th=[ 591397], | 99.95th=[1602225], 99.99th=[1602225] bw ( KiB/s): min= 7, max= 94, per=25.13%, avg=36.95, stdev=16.54, samples=327 iops : min= 1, max= 23, avg= 8.58, stdev= 4.17, samples=327 lat (usec) : 50=2.93%, 100=4.95%, 250=0.42%, 750=0.07%, 1000=0.13% lat (msec) : 2=5.73%, 4=2.57%, 10=5.96%, 20=6.80%, 50=26.89% lat (msec) : 100=27.54%, 250=15.10%, 500=0.78%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=4.11%, ctx=5865, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=141KiB/s (144kB/s), 35.3KiB/s-35.7KiB/s (36.1kB/s-36.6kB/s), io=23.4MiB (24.6MB), run=166981-170878msec WRITE: bw=147KiB/s (151kB/s), 36.6KiB/s-38.0KiB/s (37.5kB/s-38.9kB/s), io=24.6MiB (25.7MB), run=166981-170878msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143696: Thu Jul 30 08:52:16 2026 read: IOPS=3, BW=15.5KiB/s (15.8kB/s)(5992KiB/387630msec) clat (msec): min=6, max=1282, avg=47.06, stdev=57.29 lat (msec): min=6, max=1282, avg=47.07, stdev=57.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 105], 95.00th=[ 144], | 99.00th=[ 224], 99.50th=[ 251], 99.90th=[ 735], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 87, per=31.63%, avg=19.29, stdev=13.22, samples=594 iops : min= 1, max= 21, avg= 4.19, stdev= 3.33, samples=594 write: IOPS=4, BW=16.2KiB/s (16.6kB/s)(6296KiB/387630msec); 0 zone resets clat (msec): min=39, max=721, avg=201.22, stdev=96.27 lat (msec): min=39, max=721, avg=201.22, stdev=96.27 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 88], 10.00th=[ 100], 20.00th=[ 122], | 30.00th=[ 144], 40.00th=[ 163], 50.00th=[ 182], 60.00th=[ 205], | 70.00th=[ 234], 80.00th=[ 262], 90.00th=[ 326], 95.00th=[ 393], | 99.00th=[ 542], 99.50th=[ 609], 99.90th=[ 709], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 47, per=25.33%, avg=16.21, stdev= 7.63, samples=737 iops : min= 1, max= 11, avg= 3.41, stdev= 1.97, samples=737 lat (msec) : 10=1.60%, 20=11.00%, 50=23.60%, 100=12.50%, 250=39.00% lat (msec) : 500=11.65%, 750=0.62%, 2000=0.03% cpu : usr=0.03%, sys=0.97%, ctx=5195, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143697: Thu Jul 30 08:52:16 2026 read: IOPS=3, BW=15.4KiB/s (15.7kB/s)(5940KiB/386337msec) clat (msec): min=5, max=1315, avg=47.44, stdev=60.31 lat (msec): min=5, max=1315, avg=47.44, stdev=60.31 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 103], 95.00th=[ 140], | 99.00th=[ 275], 99.50th=[ 321], 99.90th=[ 726], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 80, per=32.23%, avg=19.66, stdev=13.56, samples=578 iops : min= 1, max= 20, avg= 4.28, stdev= 3.44, samples=578 write: IOPS=4, BW=16.4KiB/s (16.8kB/s)(6348KiB/386337msec); 0 zone resets clat (msec): min=41, max=765, avg=198.78, stdev=90.97 lat (msec): min=41, max=765, avg=198.78, stdev=90.97 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 86], 10.00th=[ 100], 20.00th=[ 122], | 30.00th=[ 144], 40.00th=[ 165], 50.00th=[ 182], 60.00th=[ 205], | 70.00th=[ 230], 80.00th=[ 262], 90.00th=[ 321], 95.00th=[ 380], | 99.00th=[ 472], 99.50th=[ 550], 99.90th=[ 718], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 48, per=25.78%, avg=16.50, stdev= 7.76, samples=730 iops : min= 1, max= 12, avg= 3.48, stdev= 2.00, samples=730 lat (msec) : 10=1.40%, 20=11.78%, 50=22.62%, 100=12.79%, 250=38.67% lat (msec) : 500=12.21%, 750=0.46%, 1000=0.03%, 2000=0.03% cpu : usr=0.03%, sys=0.92%, ctx=5072, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143699: Thu Jul 30 08:52:16 2026 read: IOPS=3, BW=15.6KiB/s (15.0kB/s)(6028KiB/386053msec) clat (msec): min=5, max=469, avg=48.54, stdev=46.53 lat (msec): min=5, max=469, avg=48.54, stdev=46.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 107], 95.00th=[ 142], | 99.00th=[ 228], 99.50th=[ 266], 99.90th=[ 388], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 94, per=31.26%, avg=19.07, stdev=13.17, samples=603 iops : min= 1, max= 23, avg= 4.13, stdev= 3.32, samples=603 write: IOPS=4, BW=16.2KiB/s (16.6kB/s)(6260KiB/386053msec); 0 zone resets clat (msec): min=35, max=1412, avg=199.62, stdev=97.99 lat (msec): min=35, max=1412, avg=199.63, stdev=98.02 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 87], 10.00th=[ 101], 20.00th=[ 123], | 30.00th=[ 140], 40.00th=[ 161], 50.00th=[ 184], 60.00th=[ 205], | 70.00th=[ 230], 80.00th=[ 262], 90.00th=[ 317], 95.00th=[ 384], | 99.00th=[ 510], 99.50th=[ 592], 99.90th=[ 785], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 40, per=25.46%, avg=16.29, stdev= 7.75, samples=728 iops : min= 1, max= 10, avg= 3.43, stdev= 1.99, samples=728 lat (msec) : 10=1.30%, 20=11.33%, 50=21.94%, 100=14.03%, 250=39.13% lat (msec) : 500=11.69%, 750=0.49%, 1000=0.07%, 2000=0.03% cpu : usr=0.03%, sys=0.92%, ctx=5015, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143701: Thu Jul 30 08:52:16 2026 read: IOPS=3, BW=15.6KiB/s (16.0kB/s)(6052KiB/387174msec) clat (msec): min=5, max=662, avg=47.36, stdev=49.81 lat (msec): min=5, max=662, avg=47.36, stdev=49.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 67], 90.00th=[ 103], 95.00th=[ 148], | 99.00th=[ 243], 99.50th=[ 275], 99.90th=[ 472], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 95, per=32.08%, avg=19.57, stdev=14.20, samples=592 iops : min= 1, max= 23, avg= 4.25, stdev= 3.60, samples=592 write: IOPS=4, BW=16.1KiB/s (16.5kB/s)(6236KiB/387174msec); 0 zone resets clat (msec): min=37, max=1565, avg=202.11, stdev=101.64 lat (msec): min=37, max=1565, avg=202.11, stdev=101.64 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 87], 10.00th=[ 102], 20.00th=[ 123], | 30.00th=[ 144], 40.00th=[ 163], 50.00th=[ 184], 60.00th=[ 205], | 70.00th=[ 230], 80.00th=[ 264], 90.00th=[ 330], 95.00th=[ 388], | 99.00th=[ 535], 99.50th=[ 584], 99.90th=[ 709], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 40, per=25.03%, avg=16.02, stdev= 7.72, samples=738 iops : min= 1, max= 10, avg= 3.36, stdev= 1.98, samples=738 lat (msec) : 10=1.50%, 20=11.56%, 50=23.08%, 100=12.79%, 250=38.70% lat (msec) : 500=11.69%, 750=0.65%, 2000=0.03% cpu : usr=0.03%, sys=0.93%, ctx=5009, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=61.9KiB/s (63.4kB/s), 15.4KiB/s-15.6KiB/s (15.7kB/s-16.0kB/s), io=23.4MiB (24.6MB), run=386053-387630msec WRITE: bw=64.9KiB/s (66.4kB/s), 16.1KiB/s-16.4KiB/s (16.5kB/s-16.8kB/s), io=24.6MiB (25.7MB), run=386053-387630msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143779: Thu Jul 30 08:53:08 2026 read: IOPS=9, BW=160KiB/s (163kB/s)(5920KiB/37109msec) clat (usec): min=31, max=381160, avg=48991.69, stdev=40742.08 lat (usec): min=31, max=381162, avg=48992.90, stdev=40742.10 clat percentiles (usec): | 1.00th=[ 35], 5.00th=[ 47], 10.00th=[ 53], 20.00th=[ 65], | 30.00th=[ 31851], 40.00th=[ 41157], 50.00th=[ 49021], 60.00th=[ 55837], | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[ 93848], 95.00th=[108528], | 99.00th=[145753], 99.50th=[238027], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 370, per=25.78%, avg=157.79, stdev=69.03, samples=72 iops : min= 1, max= 23, avg= 9.15, stdev= 4.39, samples=72 write: IOPS=10, BW=172KiB/s (176kB/s)(6368KiB/37109msec); 0 zone resets clat (usec): min=1336, max=321646, avg=46927.98, stdev=49591.92 lat (usec): min=1337, max=321648, avg=46929.79, stdev=49591.96 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1631], 10.00th=[ 2212], 20.00th=[ 7635], | 30.00th=[ 11994], 40.00th=[ 18744], 50.00th=[ 28443], 60.00th=[ 43254], | 70.00th=[ 62129], 80.00th=[ 82314], 90.00th=[109577], 95.00th=[141558], | 99.00th=[210764], 99.50th=[278922], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 23, max= 410, per=26.61%, avg=171.36, stdev=83.17, samples=72 iops : min= 1, max= 25, avg=10.01, stdev= 5.23, samples=72 lat (usec) : 50=3.52%, 100=7.81%, 250=0.13%, 500=0.13% lat (msec) : 2=4.82%, 4=1.30%, 10=6.90%, 20=8.85%, 50=24.61% lat (msec) : 100=32.42%, 250=8.98%, 500=0.52% cpu : usr=0.06%, sys=4.63%, ctx=1342, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143782: Thu Jul 30 08:53:08 2026 read: IOPS=9, BW=147KiB/s (150kB/s)(5744KiB/39107msec) clat (usec): min=35, max=381164, avg=53049.12, stdev=44698.46 lat (usec): min=35, max=381167, avg=53050.36, stdev=44698.51 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 83], | 30.00th=[ 33817], 40.00th=[ 42730], 50.00th=[ 51119], 60.00th=[ 58983], | 70.00th=[ 67634], 80.00th=[ 83362], 90.00th=[101188], 95.00th=[123208], | 99.00th=[189793], 99.50th=[283116], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 23, max= 617, per=25.36%, avg=155.22, stdev=88.01, samples=72 iops : min= 1, max= 38, avg= 8.99, stdev= 5.54, samples=72 write: IOPS=10, BW=167KiB/s (171kB/s)(6544KiB/39107msec); 0 zone resets clat (usec): min=1277, max=491020, avg=47951.65, stdev=61886.46 lat (usec): min=1280, max=491021, avg=47954.12, stdev=61886.53 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1598], 10.00th=[ 1811], 20.00th=[ 5800], | 30.00th=[ 9372], 40.00th=[ 15008], 50.00th=[ 26084], 60.00th=[ 39060], | 70.00th=[ 54789], 80.00th=[ 85459], 90.00th=[116917], 95.00th=[158335], | 99.00th=[316670], 99.50th=[354419], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 23, max= 525, per=26.41%, avg=170.09, stdev=94.91, samples=75 iops : min= 1, max= 32, avg= 9.95, stdev= 5.99, samples=75 lat (usec) : 50=2.34%, 100=7.29%, 250=0.26%, 500=0.13% lat (msec) : 2=6.77%, 4=2.34%, 10=7.94%, 20=8.59%, 50=22.53% lat (msec) : 100=29.04%, 250=11.59%, 500=1.17% cpu : usr=0.06%, sys=4.22%, ctx=1327, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143783: Thu Jul 30 08:53:08 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37500msec) clat (usec): min=31, max=230264, avg=53685.44, stdev=41436.47 lat (usec): min=32, max=230266, avg=53688.76, stdev=41436.16 clat percentiles (usec): | 1.00th=[ 36], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 133], | 30.00th=[ 33817], 40.00th=[ 43254], 50.00th=[ 50070], 60.00th=[ 58983], | 70.00th=[ 72877], 80.00th=[ 86508], 90.00th=[102237], 95.00th=[120062], | 99.00th=[204473], 99.50th=[217056], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 60, max= 315, per=27.78%, avg=170.04, stdev=69.40, samples=72 iops : min= 3, max= 19, avg= 9.92, stdev= 4.40, samples=72 write: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37500msec); 0 zone resets clat (usec): min=1366, max=399751, avg=42751.02, stdev=49406.63 lat (usec): min=1368, max=399753, avg=42753.07, stdev=49406.52 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1614], 10.00th=[ 1811], 20.00th=[ 6652], | 30.00th=[ 10028], 40.00th=[ 14484], 50.00th=[ 23462], 60.00th=[ 38536], | 70.00th=[ 53740], 80.00th=[ 72877], 90.00th=[105382], 95.00th=[137364], | 99.00th=[217056], 99.50th=[283116], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 30, max= 378, per=25.25%, avg=162.64, stdev=71.09, samples=72 iops : min= 1, max= 23, avg= 9.44, stdev= 4.47, samples=72 lat (usec) : 50=2.86%, 100=6.90%, 250=0.78%, 500=0.13% lat (msec) : 2=5.47%, 4=1.56%, 10=7.68%, 20=8.98%, 50=24.35% lat (msec) : 100=29.43%, 250=11.46%, 500=0.39% cpu : usr=0.05%, sys=4.22%, ctx=1342, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143784: Thu Jul 30 08:53:08 2026 read: IOPS=10, BW=162KiB/s (165kB/s)(6032KiB/37345msec) clat (usec): min=30, max=372661, avg=57340.00, stdev=50845.50 lat (usec): min=30, max=372663, avg=57341.22, stdev=50845.47 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 20055], | 30.00th=[ 35390], 40.00th=[ 42730], 50.00th=[ 50070], 60.00th=[ 60556], | 70.00th=[ 70779], 80.00th=[ 84411], 90.00th=[111674], 95.00th=[131597], | 99.00th=[278922], 99.50th=[358613], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 31, max= 284, per=26.33%, avg=161.14, stdev=61.66, samples=72 iops : min= 1, max= 17, avg= 9.36, stdev= 3.87, samples=72 write: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37345msec); 0 zone resets clat (usec): min=1243, max=302166, avg=39803.18, stdev=41537.66 lat (usec): min=1244, max=302167, avg=39811.03, stdev=41536.68 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1663], 10.00th=[ 1844], 20.00th=[ 6259], | 30.00th=[ 10552], 40.00th=[ 16909], 50.00th=[ 25560], 60.00th=[ 37487], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[102237], 95.00th=[122160], | 99.00th=[166724], 99.50th=[204473], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 378, per=26.04%, avg=167.72, stdev=75.37, samples=72 iops : min= 1, max= 23, avg= 9.79, stdev= 4.79, samples=72 lat (usec) : 50=2.21%, 100=6.64%, 250=0.65% lat (msec) : 2=5.86%, 4=1.56%, 10=7.29%, 20=8.59%, 50=26.95% lat (msec) : 100=27.86%, 250=11.59%, 500=0.78% cpu : usr=0.04%, sys=4.62%, ctx=1382, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=612KiB/s (627kB/s), 147KiB/s-167KiB/s (150kB/s-171kB/s), io=23.4MiB (24.5MB), run=37109-39107msec WRITE: bw=644KiB/s (660kB/s), 161KiB/s-172KiB/s (165kB/s-176kB/s), io=24.6MiB (25.8MB), run=37109-39107msec fio: pid=143777, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=143777: Thu Jul 30 08:54:05 2026 read: IOPS=3, BW=57.9KiB/s (59.3kB/s)(4608KiB/79549msec) clat (msec): min=7, max=330, avg=60.92, stdev=52.93 lat (msec): min=7, max=330, avg=60.92, stdev=52.93 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 85], 90.00th=[ 132], 95.00th=[ 171], | 99.00th=[ 296], 99.50th=[ 326], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 243, per=28.75%, avg=68.13, stdev=41.58, samples=132 iops : min= 1, max= 15, avg= 3.53, stdev= 2.69, samples=132 write: IOPS=3, BW=63.4KiB/s (64.9kB/s)(5040KiB/79549msec); 0 zone resets clat (msec): min=55, max=480, avg=196.12, stdev=86.26 lat (msec): min=55, max=480, avg=196.13, stdev=86.27 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 86], 10.00th=[ 100], 20.00th=[ 123], | 30.00th=[ 142], 40.00th=[ 159], 50.00th=[ 178], 60.00th=[ 199], | 70.00th=[ 230], 80.00th=[ 262], 90.00th=[ 330], 95.00th=[ 380], | 99.00th=[ 435], 99.50th=[ 443], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 21, max= 128, per=26.11%, avg=65.28, stdev=28.33, samples=150 iops : min= 1, max= 8, avg= 3.32, stdev= 1.85, samples=150 lat (msec) : 10=0.17%, 20=5.30%, 50=22.02%, 100=18.71%, 250=40.40% lat (msec) : 500=13.25% cpu : usr=0.04%, sys=1.14%, ctx=1086, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=289,315,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143778: Thu Jul 30 08:54:05 2026 read: IOPS=3, BW=60.3KiB/s (61.7kB/s)(5744KiB/95310msec) clat (msec): min=7, max=365, avg=53.61, stdev=48.17 lat (msec): min=7, max=365, avg=53.61, stdev=48.17 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 71], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 268], 99.50th=[ 284], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 21, max= 352, per=31.60%, avg=74.89, stdev=51.94, samples=149 iops : min= 1, max= 22, avg= 3.93, stdev= 3.35, samples=149 write: IOPS=4, BW=68.7KiB/s (70.3kB/s)(6544KiB/95310msec); 0 zone resets clat (msec): min=61, max=585, avg=185.03, stdev=87.96 lat (msec): min=61, max=585, avg=185.04, stdev=87.96 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 83], 10.00th=[ 93], 20.00th=[ 115], | 30.00th=[ 134], 40.00th=[ 150], 50.00th=[ 167], 60.00th=[ 186], | 70.00th=[ 211], 80.00th=[ 247], 90.00th=[ 296], 95.00th=[ 359], | 99.00th=[ 493], 99.50th=[ 506], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 21, max= 159, per=28.66%, avg=71.65, stdev=30.61, samples=178 iops : min= 1, max= 9, avg= 3.72, stdev= 1.95, samples=178 lat (msec) : 10=0.78%, 20=6.64%, 50=22.27%, 100=18.36%, 250=41.15% lat (msec) : 500=10.42%, 750=0.39% cpu : usr=0.03%, sys=1.15%, ctx=1495, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143780: Thu Jul 30 08:54:05 2026 read: IOPS=4, BW=68.1KiB/s (69.7kB/s)(6256KiB/91850msec) clat (msec): min=5, max=545, avg=51.05, stdev=48.01 lat (msec): min=5, max=545, avg=51.05, stdev=48.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 126], | 99.00th=[ 257], 99.50th=[ 321], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 21, max= 288, per=34.35%, avg=81.41, stdev=55.69, samples=151 iops : min= 1, max= 18, avg= 4.34, stdev= 3.59, samples=151 write: IOPS=4, BW=65.7KiB/s (67.2kB/s)(6032KiB/91850msec); 0 zone resets clat (msec): min=54, max=582, avg=190.48, stdev=86.95 lat (msec): min=54, max=582, avg=190.49, stdev=86.96 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 84], 10.00th=[ 97], 20.00th=[ 122], | 30.00th=[ 138], 40.00th=[ 153], 50.00th=[ 171], 60.00th=[ 192], | 70.00th=[ 220], 80.00th=[ 253], 90.00th=[ 300], 95.00th=[ 372], | 99.00th=[ 468], 99.50th=[ 506], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 29, max= 128, per=26.58%, avg=66.46, stdev=27.71, samples=176 iops : min= 1, max= 8, avg= 3.39, stdev= 1.84, samples=176 lat (msec) : 10=0.78%, 20=6.64%, 50=26.56%, 100=17.58%, 250=37.76% lat (msec) : 500=10.29%, 750=0.39% cpu : usr=0.03%, sys=1.29%, ctx=1539, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143781: Thu Jul 30 08:54:05 2026 read: IOPS=4, BW=64.3KiB/s (65.8kB/s)(6032KiB/93806msec) clat (msec): min=8, max=542, avg=51.77, stdev=47.33 lat (msec): min=8, max=542, avg=51.78, stdev=47.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 67], 90.00th=[ 104], 95.00th=[ 134], | 99.00th=[ 222], 99.50th=[ 271], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 29, max= 252, per=34.37%, avg=81.47, stdev=49.64, samples=144 iops : min= 1, max= 15, avg= 4.35, stdev= 3.17, samples=144 write: IOPS=4, BW=66.7KiB/s (68.3kB/s)(6256KiB/93806msec); 0 zone resets clat (msec): min=51, max=581, avg=189.20, stdev=85.32 lat (msec): min=51, max=581, avg=189.20, stdev=85.32 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 87], 10.00th=[ 100], 20.00th=[ 118], | 30.00th=[ 136], 40.00th=[ 155], 50.00th=[ 174], 60.00th=[ 192], | 70.00th=[ 215], 80.00th=[ 249], 90.00th=[ 317], 95.00th=[ 359], | 99.00th=[ 447], 99.50th=[ 510], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 21, max= 152, per=27.15%, avg=67.87, stdev=28.98, samples=180 iops : min= 1, max= 9, avg= 3.48, stdev= 1.91, samples=180 lat (msec) : 10=0.52%, 20=4.82%, 50=27.60%, 100=16.41%, 250=40.23% lat (msec) : 500=10.03%, 750=0.39% cpu : usr=0.05%, sys=1.22%, ctx=1486, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=238KiB/s (243kB/s), 57.9KiB/s-68.1KiB/s (59.3kB/s-69.7kB/s), io=22.1MiB (23.2MB), run=79549-95310msec WRITE: bw=250KiB/s (256kB/s), 63.4KiB/s-68.7KiB/s (64.9kB/s-70.3kB/s), io=23.3MiB (24.4MB), run=79549-95310msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143810: Thu Jul 30 08:54:24 2026 read: IOPS=1, BW=1315KiB/s (1347kB/s)(7168KiB/5450msec) clat (usec): min=535, max=307256, avg=212261.06, stdev=98270.12 lat (usec): min=535, max=307258, avg=212262.51, stdev=98270.30 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[208667], | 30.00th=[231736], 40.00th=[231736], 50.00th=[240124], 60.00th=[240124], | 70.00th=[240124], 80.00th=[258999], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 1551, max= 4079, per=78.58%, avg=2908.25, stdev=1319.62, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=939KiB/s (962kB/s)(5120KiB/5450msec); 0 zone resets clat (msec): min=513, max=990, avg=722.57, stdev=178.59 lat (msec): min=513, max=990, avg=722.62, stdev=178.58 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1875, max= 2019, per=38.15%, avg=1976.80, stdev=59.16, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=16.67%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=7.23%, ctx=211, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143811: Thu Jul 30 08:54:24 2026 read: IOPS=0, BW=370KiB/s (379kB/s)(2048KiB/5533msec) clat (usec): min=445, max=287341, avg=143893.29, stdev=202866.37 lat (usec): min=446, max=287343, avg=143894.80, stdev=202867.19 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 445], | 30.00th=[ 445], 40.00th=[ 445], 50.00th=[ 445], 60.00th=[287310], | 70.00th=[287310], 80.00th=[287310], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 1426, max= 1875, per=44.60%, avg=1650.50, stdev=317.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1851KiB/s (1895kB/s)(10.0MiB/5533msec); 0 zone resets clat (msec): min=102, max=1284, avg=515.11, stdev=343.53 lat (msec): min=102, max=1284, avg=515.17, stdev=343.53 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 128], | 30.00th=[ 313], 40.00th=[ 380], 50.00th=[ 485], 60.00th=[ 510], | 70.00th=[ 558], 80.00th=[ 600], 90.00th=[ 802], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1976, max= 4039, per=49.12%, avg=2544.86, stdev=926.00, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 500=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.98%, ctx=140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143812: Thu Jul 30 08:54:24 2026 read: IOPS=1, BW=1447KiB/s (1482kB/s)(6144KiB/4245msec) clat (msec): min=11, max=622, avg=277.71, stdev=204.28 lat (msec): min=11, max=622, avg=277.71, stdev=204.28 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 12], 10.00th=[ 12], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 300], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2000, max= 3953, per=71.84%, avg=2658.67, stdev=1120.98, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1447KiB/s (1482kB/s)(6144KiB/4245msec); 0 zone resets clat (msec): min=203, max=723, avg=394.15, stdev=176.16 lat (msec): min=203, max=723, avg=394.20, stdev=176.16 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 397], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1460, max= 2039, per=36.14%, avg=1872.20, stdev=238.63, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 20=8.33%, 250=16.67%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=9.40%, ctx=184, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143813: Thu Jul 30 08:54:24 2026 read: IOPS=1, BW=1084KiB/s (1110kB/s)(5120KiB/4722msec) clat (usec): min=423, max=307263, avg=172818.05, stdev=157649.94 lat (usec): min=424, max=307264, avg=172819.03, stdev=157649.73 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 424], | 30.00th=[ 865], 40.00th=[ 865], 50.00th=[274727], 60.00th=[274727], | 70.00th=[283116], 80.00th=[283116], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 3750, max= 3953, per=100.00%, avg=3851.50, stdev=143.54, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1518KiB/s (1554kB/s)(7168KiB/4722msec); 0 zone resets clat (msec): min=206, max=807, avg=478.56, stdev=266.02 lat (msec): min=206, max=807, avg=478.62, stdev=266.03 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 213], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 506], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 793], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1875, max= 2039, per=38.40%, avg=1989.60, stdev=65.68, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=25.00%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=7.05%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3701KiB/s (3790kB/s), 370KiB/s-1447KiB/s (379kB/s-1482kB/s), io=20.0MiB (20.0MB), run=4245-5533msec WRITE: bw=5182KiB/s (5306kB/s), 939KiB/s-1851KiB/s (962kB/s-1895kB/s), io=28.0MiB (29.4MB), run=4245-5533msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143814: Thu Jul 30 08:54:25 2026 read: IOPS=1, BW=1359KiB/s (1392kB/s)(7168KiB/5274msec) clat (msec): min=134, max=526, avg=245.01, stdev=143.11 lat (msec): min=134, max=526, avg=245.01, stdev=143.11 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 144], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 176], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 326], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1875, max= 2925, per=71.37%, avg=2175.40, stdev=424.24, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=971KiB/s (994kB/s)(5120KiB/5274msec); 0 zone resets clat (msec): min=479, max=999, avg=682.12, stdev=231.19 lat (msec): min=479, max=1000, avg=682.32, stdev=231.44 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1875, max= 2043, per=46.73%, avg=1994.00, stdev=80.02, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=2.39%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143815: Thu Jul 30 08:54:25 2026 read: IOPS=0, BW=313KiB/s (320kB/s)(2048KiB/6545msec) clat (msec): min=157, max=644, avg=401.06, stdev=344.63 lat (msec): min=157, max=644, avg=401.06, stdev=344.63 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2023, max= 2043, per=66.70%, avg=2033.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1565KiB/s (1602kB/s)(10.0MiB/6545msec); 0 zone resets clat (msec): min=199, max=1336, avg=541.32, stdev=320.98 lat (msec): min=199, max=1336, avg=541.60, stdev=320.87 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 334], | 30.00th=[ 359], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 481], | 70.00th=[ 493], 80.00th=[ 575], 90.00th=[ 793], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1872, max= 2027, per=46.13%, avg=1968.25, stdev=65.95, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.42%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143816: Thu Jul 30 08:54:25 2026 read: IOPS=0, BW=938KiB/s (960kB/s)(6144KiB/6552msec) clat (msec): min=78, max=1306, avg=527.03, stdev=463.12 lat (msec): min=78, max=1306, avg=527.06, stdev=463.08 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 667], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1950, max= 2039, per=66.00%, avg=2011.60, stdev=35.24, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=938KiB/s (960kB/s)(6144KiB/6552msec); 0 zone resets clat (msec): min=211, max=890, avg=504.36, stdev=284.02 lat (msec): min=211, max=890, avg=504.41, stdev=284.03 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 617], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1957, max= 3900, per=55.82%, avg=2382.00, stdev=849.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=25.00%, 750=33.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.50%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143817: Thu Jul 30 08:54:25 2026 read: IOPS=0, BW=762KiB/s (780kB/s)(5120KiB/6718msec) clat (msec): min=82, max=823, avg=419.81, stdev=307.36 lat (msec): min=82, max=823, avg=419.81, stdev=307.36 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1872, max= 2027, per=63.95%, avg=1949.25, stdev=87.49, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1067KiB/s (1093kB/s)(7168KiB/6718msec); 0 zone resets clat (msec): min=146, max=1220, avg=593.95, stdev=344.58 lat (msec): min=146, max=1222, avg=594.32, stdev=345.21 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 351], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 558], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 743], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1957, max= 3900, per=55.82%, avg=2382.00, stdev=849.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=16.67%, 750=41.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.62%, ctx=92, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3049KiB/s (3122kB/s), 313KiB/s-1359KiB/s (320kB/s-1392kB/s), io=20.0MiB (20.0MB), run=5274-6718msec WRITE: bw=4268KiB/s (4370kB/s), 938KiB/s-1565KiB/s (960kB/s-1602kB/s), io=28.0MiB (29.4MB), run=5274-6718msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143827: Thu Jul 30 08:54:44 2026 read: IOPS=0, BW=3157KiB/s (3233kB/s)(12.0MiB/3892msec) clat (msec): min=1186, max=1433, avg=1274.26, stdev=138.51 lat (msec): min=1186, max=1433, avg=1274.26, stdev=138.51 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7641, max= 7892, per=100.00%, avg=7766.50, stdev=177.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=8.38%, ctx=297, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143829: Thu Jul 30 08:54:44 2026 read: IOPS=0, BW=791KiB/s (810kB/s)(4096KiB/5180msec) clat (nsec): min=1032.6M, max=1032.6M, avg=1032645512.00, stdev= 0.00 lat (nsec): min=1032.6M, max=1032.6M, avg=1032647443.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1581KiB/s (1619kB/s)(8192KiB/5180msec); 0 zone resets clat (msec): min=1273, max=2536, avg=1905.06, stdev=893.69 lat (msec): min=1273, max=2537, avg=1905.23, stdev=893.61 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 2534], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 7641, max= 7641, per=100.00%, avg=7641.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.19%, ctx=135, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143830: Thu Jul 30 08:54:44 2026 write: IOPS=0, BW=2346KiB/s (2402kB/s)(12.0MiB/5238msec); 0 zone resets clat (msec): min=430, max=2372, avg=1669.07, stdev=1076.25 lat (msec): min=430, max=2372, avg=1669.36, stdev=1076.23 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 2198], 50.00th=[ 2198], 60.00th=[ 2198], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 7641, max= 8047, per=100.00%, avg=7844.00, stdev=287.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=3.21%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143832: Thu Jul 30 08:54:44 2026 write: IOPS=0, BW=2556KiB/s (2618kB/s)(12.0MiB/4807msec); 0 zone resets clat (msec): min=576, max=2041, avg=1506.33, stdev=807.93 lat (msec): min=577, max=2042, avg=1507.00, stdev=808.34 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 1905], 50.00th=[ 1905], 60.00th=[ 1905], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 7816, max= 8078, per=100.00%, avg=7947.00, stdev=185.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.21%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3163KiB/s (3239kB/s), 791KiB/s-3157KiB/s (810kB/s-3233kB/s), io=16.0MiB (16.8MB), run=3892-5180msec WRITE: bw=6256KiB/s (6406kB/s), 1581KiB/s-2556KiB/s (1619kB/s-2618kB/s), io=32.0MiB (33.6MB), run=4807-5238msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143825: Thu Jul 30 08:54:44 2026 read: IOPS=0, BW=2554KiB/s (2615kB/s)(12.0MiB/4812msec) clat (msec): min=1005, max=1975, avg=1523.32, stdev=488.40 lat (msec): min=1005, max=1975, avg=1523.32, stdev=488.40 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 7968, max= 8126, per=100.00%, avg=8047.00, stdev=111.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.64%, ctx=65, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143826: Thu Jul 30 08:54:44 2026 read: IOPS=0, BW=749KiB/s (767kB/s)(4096KiB/5472msec) clat (nsec): min=2412.1M, max=2412.1M, avg=2412091528.00, stdev= 0.00 lat (nsec): min=2412.2M, max=2412.2M, avg=2412197790.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2400], 5.00th=[ 2400], 10.00th=[ 2400], 20.00th=[ 2400], | 30.00th=[ 2400], 40.00th=[ 2400], 50.00th=[ 2400], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1497KiB/s (1533kB/s)(8192KiB/5472msec); 0 zone resets clat (msec): min=1278, max=1541, avg=1409.86, stdev=185.75 lat (msec): min=1282, max=1541, avg=1411.76, stdev=183.45 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.01%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143828: Thu Jul 30 08:54:44 2026 write: IOPS=0, BW=3268KiB/s (3347kB/s)(12.0MiB/3760msec); 0 zone resets clat (msec): min=590, max=2149, avg=1225.95, stdev=818.34 lat (msec): min=590, max=2151, avg=1226.84, stdev=819.16 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7656, max= 8094, per=100.00%, avg=7875.00, stdev=309.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.45%, ctx=49, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143831: Thu Jul 30 08:54:44 2026 write: IOPS=0, BW=3592KiB/s (3678kB/s)(12.0MiB/3421msec); 0 zone resets clat (msec): min=426, max=1814, avg=1072.25, stdev=699.16 lat (msec): min=426, max=1815, avg=1072.53, stdev=699.18 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.82%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2994KiB/s (3066kB/s), 749KiB/s-2554KiB/s (767kB/s-2615kB/s), io=16.0MiB (16.8MB), run=4812-5472msec WRITE: bw=5988KiB/s (6132kB/s), 1497KiB/s-3592KiB/s (1533kB/s-3678kB/s), io=32.0MiB (33.6MB), run=3421-5472msec