== sanity test 398b: DIO and buffer IO race ============== 06:33:49 (1773657229) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 9.87996 s, 5.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147993: Mon Mar 16 06:36:34 2026 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(5992KiB/130007msec) clat (usec): min=33, max=370478, avg=42292.25, stdev=34041.27 lat (usec): min=33, max=370478, avg=42299.16, stdev=34040.27 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 351], 20.00th=[ 19268], | 30.00th=[ 24773], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[160433], 99.50th=[191890], 99.90th=[354419], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 103, per=25.19%, avg=45.59, stdev=19.77, samples=256 iops : min= 1, max= 25, avg=10.77, stdev= 4.99, samples=256 write: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6296KiB/130007msec); 0 zone resets clat (usec): min=746, max=255516, avg=42255.22, stdev=41850.36 lat (usec): min=747, max=255517, avg=42261.89, stdev=41845.93 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 1434], 20.00th=[ 4555], | 30.00th=[ 9634], 40.00th=[ 21365], 50.00th=[ 32375], 60.00th=[ 42730], | 70.00th=[ 56361], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[130548], | 99.00th=[170918], 99.50th=[198181], 99.90th=[238027], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 126, per=25.32%, avg=47.86, stdev=20.68, samples=256 iops : min= 1, max= 31, avg=11.35, stdev= 5.21, samples=256 lat (usec) : 50=1.30%, 100=3.32%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=6.58%, 4=2.99%, 10=6.09%, 20=9.34%, 50=36.72% lat (msec) : 100=26.14%, 250=6.74%, 500=0.20% cpu : usr=0.08%, sys=4.97%, ctx=6274, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147994: Mon Mar 16 06:36:34 2026 read: IOPS=11, BW=45.0KiB/s (46.1kB/s)(5940KiB/131886msec) clat (usec): min=28, max=317546, avg=41741.97, stdev=32025.07 lat (usec): min=29, max=317546, avg=41747.62, stdev=32026.95 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 90], 20.00th=[ 18744], | 30.00th=[ 24773], 40.00th=[ 30016], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[156238], 99.50th=[208667], 99.90th=[261096], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 102, per=25.01%, avg=45.26, stdev=19.60, samples=256 iops : min= 1, max= 25, avg=10.69, stdev= 4.94, samples=256 write: IOPS=12, BW=48.1KiB/s (49.3kB/s)(6348KiB/131886msec); 0 zone resets clat (usec): min=932, max=339541, avg=43932.92, stdev=46703.06 lat (usec): min=933, max=339542, avg=43935.44, stdev=46702.68 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1287], 10.00th=[ 1516], 20.00th=[ 4555], | 30.00th=[ 10159], 40.00th=[ 20841], 50.00th=[ 32900], 60.00th=[ 43254], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[130548], | 99.00th=[223347], 99.50th=[267387], 99.90th=[325059], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 143, per=25.30%, avg=47.81, stdev=21.38, samples=259 iops : min= 1, max= 35, avg=11.34, stdev= 5.38, samples=259 lat (usec) : 50=1.20%, 100=3.68%, 250=0.07%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=6.45%, 4=3.26%, 10=6.18%, 20=9.80%, 50=36.75% lat (msec) : 100=24.97%, 250=7.03%, 500=0.39% cpu : usr=0.07%, sys=4.91%, ctx=6302, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147995: Mon Mar 16 06:36:34 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6028KiB/129581msec) clat (usec): min=32, max=365550, avg=41366.41, stdev=32355.22 lat (usec): min=32, max=365551, avg=41370.29, stdev=32353.85 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 69], 20.00th=[ 19268], | 30.00th=[ 24511], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[147850], 99.50th=[181404], 99.90th=[283116], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 111, per=25.53%, avg=46.21, stdev=20.38, samples=254 iops : min= 1, max= 27, avg=10.94, stdev= 5.14, samples=254 write: IOPS=12, BW=48.3KiB/s (49.5kB/s)(6260KiB/129581msec); 0 zone resets clat (usec): min=837, max=433119, avg=42882.85, stdev=43567.24 lat (usec): min=838, max=433121, avg=42889.22, stdev=43566.78 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1598], 20.00th=[ 4752], | 30.00th=[ 9896], 40.00th=[ 20055], 50.00th=[ 31589], 60.00th=[ 43779], | 70.00th=[ 56886], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[125305], | 99.00th=[183501], 99.50th=[217056], 99.90th=[299893], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 135, per=25.31%, avg=47.83, stdev=17.43, samples=255 iops : min= 1, max= 33, avg=11.33, stdev= 4.36, samples=255 lat (usec) : 50=1.11%, 100=4.39%, 250=0.13%, 500=0.16%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=6.02%, 4=3.06%, 10=6.64%, 20=9.18%, 50=35.45% lat (msec) : 100=26.53%, 250=6.93%, 500=0.20% cpu : usr=0.06%, sys=5.11%, ctx=6338, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147996: Mon Mar 16 06:36:34 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6052KiB/132490msec) clat (usec): min=32, max=503989, avg=43042.55, stdev=34701.89 lat (usec): min=32, max=503990, avg=43043.85, stdev=34701.85 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 55], 10.00th=[ 87], 20.00th=[ 18744], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[147850], 99.50th=[187696], 99.90th=[358613], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 7, max= 121, per=25.14%, avg=45.50, stdev=20.80, samples=259 iops : min= 1, max= 30, avg=10.75, stdev= 5.26, samples=259 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6236KiB/132490msec); 0 zone resets clat (usec): min=915, max=344212, avg=43131.76, stdev=43804.30 lat (usec): min=916, max=344213, avg=43133.31, stdev=43804.34 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1303], 10.00th=[ 1483], 20.00th=[ 4047], | 30.00th=[ 9372], 40.00th=[ 20579], 50.00th=[ 31851], 60.00th=[ 43779], | 70.00th=[ 56361], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[131597], | 99.00th=[179307], 99.50th=[206570], 99.90th=[291505], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 119, per=24.68%, avg=46.64, stdev=18.59, samples=260 iops : min= 1, max= 29, avg=11.05, stdev= 4.70, samples=260 lat (usec) : 50=1.30%, 100=3.81%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.48%, 4=3.55%, 10=6.28%, 20=9.18%, 50=34.51% lat (msec) : 100=26.79%, 250=7.65%, 500=0.13%, 750=0.03% cpu : usr=0.06%, sys=4.89%, ctx=6362, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (186kB/s), 45.0KiB/s-46.5KiB/s (46.1kB/s-47.6kB/s), io=23.4MiB (24.6MB), run=129581-132490msec WRITE: bw=190KiB/s (194kB/s), 47.1KiB/s-48.4KiB/s (48.2kB/s-49.6kB/s), io=24.6MiB (25.7MB), run=129581-132490msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147988: Mon Mar 16 06:39:00 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5992KiB/276203msec) clat (msec): min=4, max=1065, avg=35.07, stdev=45.66 lat (msec): min=4, max=1065, avg=35.07, stdev=45.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 79], 95.00th=[ 104], | 99.00th=[ 215], 99.50th=[ 239], 99.90th=[ 342], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 6, max= 101, per=28.79%, avg=24.47, stdev=17.24, samples=473 iops : min= 1, max= 25, avg= 5.50, stdev= 4.36, samples=473 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6296KiB/276203msec); 0 zone resets clat (msec): min=30, max=2072, avg=141.85, stdev=85.15 lat (msec): min=30, max=2072, avg=141.85, stdev=85.15 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 414], 99.90th=[ 493], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 7, max= 63, per=25.47%, avg=22.67, stdev=10.69, samples=535 iops : min= 1, max= 15, avg= 5.04, stdev= 2.74, samples=535 lat (msec) : 10=4.26%, 20=18.07%, 50=18.39%, 100=22.49%, 250=32.36% lat (msec) : 500=4.36%, 2000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5207, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147989: Mon Mar 16 06:39:00 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(5940KiB/280342msec) clat (msec): min=4, max=903, avg=35.22, stdev=43.15 lat (msec): min=4, max=903, avg=35.22, stdev=43.15 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 107], | 99.00th=[ 201], 99.50th=[ 236], 99.90th=[ 393], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 95, per=28.93%, avg=24.59, stdev=17.17, samples=466 iops : min= 1, max= 23, avg= 5.53, stdev= 4.33, samples=466 write: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6348KiB/280342msec); 0 zone resets clat (msec): min=28, max=2287, avg=143.45, stdev=88.67 lat (msec): min=28, max=2287, avg=143.45, stdev=88.67 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 384], 99.50th=[ 430], 99.90th=[ 567], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7, max= 71, per=25.26%, avg=22.48, stdev=10.55, samples=543 iops : min= 1, max= 17, avg= 5.00, stdev= 2.71, samples=543 lat (msec) : 10=3.55%, 20=18.26%, 50=18.65%, 100=20.61%, 250=34.60% lat (msec) : 500=4.07%, 750=0.20%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5217, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147990: Mon Mar 16 06:39:00 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6028KiB/279099msec) clat (msec): min=5, max=386, avg=37.16, stdev=41.23 lat (msec): min=5, max=386, avg=37.16, stdev=41.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 116], | 99.00th=[ 207], 99.50th=[ 271], 99.90th=[ 363], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 6, max= 120, per=28.49%, avg=24.21, stdev=16.94, samples=480 iops : min= 1, max= 30, avg= 5.44, stdev= 4.29, samples=480 write: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6260KiB/279099msec); 0 zone resets clat (msec): min=31, max=2104, avg=142.29, stdev=90.47 lat (msec): min=31, max=2104, avg=142.29, stdev=90.47 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 122], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 186], 90.00th=[ 241], 95.00th=[ 279], | 99.00th=[ 409], 99.50th=[ 481], 99.90th=[ 995], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 7, max= 63, per=25.26%, avg=22.48, stdev=11.08, samples=535 iops : min= 1, max= 15, avg= 5.00, stdev= 2.83, samples=535 lat (msec) : 10=4.10%, 20=17.58%, 50=17.74%, 100=23.24%, 250=32.52% lat (msec) : 500=4.69%, 750=0.07%, 1000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=1.20%, ctx=5268, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147991: Mon Mar 16 06:39:00 2026 read: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6052KiB/276660msec) clat (msec): min=5, max=341, avg=35.19, stdev=36.01 lat (msec): min=5, max=341, avg=35.19, stdev=36.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 109], | 99.00th=[ 182], 99.50th=[ 205], 99.90th=[ 334], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 88, per=29.48%, avg=25.06, stdev=16.47, samples=467 iops : min= 1, max= 22, avg= 5.65, stdev= 4.17, samples=467 write: IOPS=5, BW=22.5KiB/s (23.1kB/s)(6236KiB/276660msec); 0 zone resets clat (msec): min=35, max=2192, avg=143.06, stdev=90.67 lat (msec): min=35, max=2192, avg=143.06, stdev=90.67 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 99], 40.00th=[ 112], 50.00th=[ 125], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 239], 95.00th=[ 275], | 99.00th=[ 380], 99.50th=[ 430], 99.90th=[ 1150], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 7, max= 56, per=25.32%, avg=22.53, stdev=10.49, samples=533 iops : min= 1, max= 14, avg= 5.01, stdev= 2.69, samples=533 lat (msec) : 10=4.20%, 20=17.35%, 50=19.17%, 100=21.61%, 250=33.63% lat (msec) : 500=3.87%, 750=0.10%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=1.25%, ctx=5081, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=85.7KiB/s (87.7kB/s), 21.2KiB/s-21.9KiB/s (21.7kB/s-22.4kB/s), io=23.4MiB (24.6MB), run=276203-280342msec WRITE: bw=89.7KiB/s (91.8kB/s), 22.4KiB/s-22.8KiB/s (22.0kB/s-23.3kB/s), io=24.6MiB (25.7MB), run=276203-280342msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148051: Mon Mar 16 06:39:42 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(5920KiB/28967msec) clat (usec): min=35, max=170510, avg=38937.83, stdev=33495.24 lat (usec): min=35, max=170511, avg=38939.19, stdev=33494.97 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 57], 20.00th=[ 67], | 30.00th=[ 19530], 40.00th=[ 28705], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[147850], 99.50th=[154141], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 544, per=25.18%, avg=204.25, stdev=86.48, samples=56 iops : min= 1, max= 34, avg=12.05, stdev= 5.55, samples=56 write: IOPS=13, BW=220KiB/s (225kB/s)(6368KiB/28967msec); 0 zone resets clat (usec): min=1306, max=274331, avg=36126.46, stdev=38342.04 lat (usec): min=1307, max=274333, avg=36130.00, stdev=38342.08 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1745], 10.00th=[ 2212], 20.00th=[ 5800], | 30.00th=[ 9503], 40.00th=[ 15795], 50.00th=[ 22152], 60.00th=[ 31851], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[175113], 99.50th=[187696], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 62, max= 472, per=25.94%, avg=221.29, stdev=94.93, samples=56 iops : min= 3, max= 29, avg=13.13, stdev= 6.01, samples=56 lat (usec) : 50=1.69%, 100=9.38%, 250=0.39%, 500=0.13%, 1000=0.39% lat (msec) : 2=4.69%, 4=4.69%, 10=7.29%, 20=10.42%, 50=31.25% lat (msec) : 100=23.44%, 250=6.12%, 500=0.13% cpu : usr=0.08%, sys=5.70%, ctx=1377, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148053: Mon Mar 16 06:39:42 2026 read: IOPS=12, BW=198KiB/s (202kB/s)(5744KiB/29077msec) clat (usec): min=36, max=441368, avg=41786.81, stdev=43752.16 lat (usec): min=36, max=441369, avg=41787.90, stdev=43752.15 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 76], | 30.00th=[ 19530], 40.00th=[ 29492], 50.00th=[ 35914], 60.00th=[ 43779], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[185598], 99.50th=[299893], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 24, max= 350, per=24.89%, avg=201.84, stdev=82.15, samples=55 iops : min= 1, max= 21, avg=11.89, stdev= 5.18, samples=55 write: IOPS=14, BW=225KiB/s (230kB/s)(6544KiB/29077msec); 0 zone resets clat (usec): min=1021, max=405692, avg=33724.91, stdev=43886.89 lat (usec): min=1021, max=405695, avg=33726.88, stdev=43886.86 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1778], 10.00th=[ 2311], 20.00th=[ 4424], | 30.00th=[ 7046], 40.00th=[ 11207], 50.00th=[ 18744], 60.00th=[ 28181], | 70.00th=[ 38536], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[108528], | 99.00th=[252707], 99.50th=[254804], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 49, max= 504, per=27.01%, avg=230.38, stdev=97.58, samples=55 iops : min= 3, max= 31, avg=13.71, stdev= 6.17, samples=55 lat (usec) : 50=1.95%, 100=8.20%, 250=0.65%, 500=0.39%, 750=0.39% lat (msec) : 2=4.56%, 4=5.73%, 10=9.77%, 20=9.90%, 50=30.08% lat (msec) : 100=22.92%, 250=4.56%, 500=0.91% cpu : usr=0.07%, sys=5.56%, ctx=1362, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148055: Mon Mar 16 06:39:42 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29516msec) clat (usec): min=30, max=250121, avg=40452.65, stdev=36220.87 lat (usec): min=31, max=250122, avg=40453.82, stdev=36220.86 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 19530], 40.00th=[ 28443], 50.00th=[ 35914], 60.00th=[ 44827], | 70.00th=[ 54264], 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[112722], | 99.00th=[154141], 99.50th=[156238], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 634, per=26.74%, avg=216.86, stdev=93.81, samples=56 iops : min= 1, max= 39, avg=12.84, stdev= 5.92, samples=56 write: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29516msec); 0 zone resets clat (usec): min=1144, max=382198, avg=35027.37, stdev=41619.26 lat (usec): min=1145, max=382199, avg=35029.77, stdev=41619.22 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1811], 10.00th=[ 2442], 20.00th=[ 5211], | 30.00th=[ 8848], 40.00th=[ 13566], 50.00th=[ 20579], 60.00th=[ 28443], | 70.00th=[ 43779], 80.00th=[ 60031], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[198181], 99.50th=[254804], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 93, max= 463, per=24.63%, avg=210.09, stdev=87.15, samples=55 iops : min= 5, max= 28, avg=12.38, stdev= 5.48, samples=55 lat (usec) : 50=1.69%, 100=9.51%, 250=0.65%, 500=0.52% lat (msec) : 2=4.04%, 4=4.17%, 10=8.59%, 20=10.42%, 50=30.08% lat (msec) : 100=24.22%, 250=5.73%, 500=0.39% cpu : usr=0.08%, sys=5.49%, ctx=1392, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148057: Mon Mar 16 06:39:42 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(6032KiB/28618msec) clat (usec): min=31, max=271450, avg=38997.73, stdev=34271.78 lat (usec): min=31, max=271451, avg=39026.63, stdev=34286.87 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 77], | 30.00th=[ 21627], 40.00th=[ 29754], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[162530], 99.50th=[200279], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 440, per=26.51%, avg=215.02, stdev=88.69, samples=55 iops : min= 1, max= 27, avg=12.73, stdev= 5.62, samples=55 write: IOPS=13, BW=219KiB/s (224kB/s)(6256KiB/28618msec); 0 zone resets clat (usec): min=1260, max=252189, avg=34311.93, stdev=40576.31 lat (usec): min=1263, max=252192, avg=34313.96, stdev=40576.24 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1729], 10.00th=[ 1975], 20.00th=[ 3720], | 30.00th=[ 6587], 40.00th=[ 11076], 50.00th=[ 19268], 60.00th=[ 31851], | 70.00th=[ 41157], 80.00th=[ 57934], 90.00th=[ 86508], 95.00th=[117965], | 99.00th=[187696], 99.50th=[238027], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 90, max= 474, per=26.24%, avg=223.84, stdev=99.14, samples=55 iops : min= 5, max= 29, avg=13.27, stdev= 6.25, samples=55 lat (usec) : 50=1.69%, 100=9.11%, 250=0.13%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.73%, 4=5.21%, 10=8.59%, 20=9.11%, 50=32.94% lat (msec) : 100=21.22%, 250=5.73%, 500=0.26% cpu : usr=0.10%, sys=5.36%, ctx=1274, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=811KiB/s (831kB/s), 198KiB/s-212KiB/s (202kB/s-217kB/s), io=23.4MiB (24.5MB), run=28618-29516msec WRITE: bw=854KiB/s (874kB/s), 204KiB/s-225KiB/s (209kB/s-230kB/s), io=24.6MiB (25.8MB), run=28618-29516msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148050: Mon Mar 16 06:40:28 2026 read: IOPS=4, BW=78.4KiB/s (80.3kB/s)(5920KiB/75499msec) clat (msec): min=6, max=307, avg=41.81, stdev=38.87 lat (msec): min=6, max=307, avg=41.81, stdev=38.87 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 92], 95.00th=[ 123], | 99.00th=[ 205], 99.50th=[ 296], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 320, per=29.52%, avg=93.29, stdev=60.88, samples=125 iops : min= 1, max= 20, avg= 5.06, stdev= 3.96, samples=125 write: IOPS=5, BW=84.3KiB/s (86.4kB/s)(6368KiB/75499msec); 0 zone resets clat (msec): min=44, max=457, avg=149.68, stdev=71.80 lat (msec): min=44, max=457, avg=149.68, stdev=71.80 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 108], 40.00th=[ 122], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 243], 95.00th=[ 309], | 99.00th=[ 393], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 30, max= 222, per=26.04%, avg=86.47, stdev=37.33, samples=145 iops : min= 1, max= 13, avg= 4.64, stdev= 2.42, samples=145 lat (msec) : 10=1.95%, 20=12.24%, 50=22.79%, 100=20.70%, 250=37.37% lat (msec) : 500=4.95% cpu : usr=0.04%, sys=1.46%, ctx=1382, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148052: Mon Mar 16 06:40:28 2026 read: IOPS=4, BW=75.9KiB/s (77.7kB/s)(5744KiB/75688msec) clat (msec): min=6, max=553, avg=44.52, stdev=52.87 lat (msec): min=6, max=553, avg=44.52, stdev=52.87 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 63], 90.00th=[ 85], 95.00th=[ 134], | 99.00th=[ 296], 99.50th=[ 359], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 23, max= 286, per=28.67%, avg=90.61, stdev=57.86, samples=125 iops : min= 1, max= 17, avg= 4.91, stdev= 3.65, samples=125 write: IOPS=5, BW=86.5KiB/s (88.5kB/s)(6544KiB/75688msec); 0 zone resets clat (msec): min=39, max=476, avg=145.80, stdev=67.50 lat (msec): min=39, max=476, avg=145.80, stdev=67.50 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 105], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 194], 90.00th=[ 239], 95.00th=[ 271], | 99.00th=[ 393], 99.50th=[ 409], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 191, per=26.64%, avg=88.44, stdev=38.12, samples=145 iops : min= 1, max= 11, avg= 4.77, stdev= 2.49, samples=145 lat (msec) : 10=1.30%, 20=10.94%, 50=22.79%, 100=21.61%, 250=38.67% lat (msec) : 500=4.56%, 750=0.13% cpu : usr=0.04%, sys=1.32%, ctx=1376, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148054: Mon Mar 16 06:40:28 2026 read: IOPS=5, BW=89.0KiB/s (91.2kB/s)(6256KiB/70267msec) clat (msec): min=6, max=552, avg=39.48, stdev=47.83 lat (msec): min=6, max=552, avg=39.48, stdev=47.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 108], | 99.00th=[ 247], 99.50th=[ 355], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 29, max= 410, per=32.05%, avg=101.27, stdev=73.96, samples=122 iops : min= 1, max= 25, avg= 5.57, stdev= 4.74, samples=122 write: IOPS=5, BW=85.8KiB/s (87.9kB/s)(6032KiB/70267msec); 0 zone resets clat (msec): min=42, max=440, avg=144.32, stdev=73.54 lat (msec): min=42, max=440, avg=144.32, stdev=73.54 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 194], 90.00th=[ 247], 95.00th=[ 305], | 99.00th=[ 401], 99.50th=[ 426], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 23, max= 191, per=26.19%, avg=86.95, stdev=40.83, samples=136 iops : min= 1, max= 11, avg= 4.66, stdev= 2.63, samples=136 lat (msec) : 10=1.43%, 20=17.32%, 50=22.40%, 100=21.48%, 250=32.29% lat (msec) : 500=4.95%, 750=0.13% cpu : usr=0.04%, sys=1.32%, ctx=1395, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148056: Mon Mar 16 06:40:28 2026 read: IOPS=5, BW=80.6KiB/s (82.6kB/s)(6032KiB/74792msec) clat (msec): min=5, max=218, avg=40.49, stdev=35.35 lat (msec): min=5, max=218, avg=40.49, stdev=35.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 59], 90.00th=[ 91], 95.00th=[ 121], | 99.00th=[ 167], 99.50th=[ 203], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 30, max= 350, per=29.36%, avg=92.78, stdev=63.71, samples=127 iops : min= 1, max= 21, avg= 5.05, stdev= 4.07, samples=127 write: IOPS=5, BW=83.6KiB/s (85.7kB/s)(6256KiB/74792msec); 0 zone resets clat (msec): min=47, max=617, avg=151.23, stdev=75.75 lat (msec): min=47, max=617, avg=151.23, stdev=75.75 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 93], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 134], 60.00th=[ 153], | 70.00th=[ 165], 80.00th=[ 194], 90.00th=[ 247], 95.00th=[ 300], | 99.00th=[ 456], 99.50th=[ 506], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 29, max= 160, per=25.74%, avg=85.47, stdev=36.93, samples=144 iops : min= 1, max= 10, avg= 4.58, stdev= 2.40, samples=144 lat (msec) : 10=1.69%, 20=13.41%, 50=22.27%, 100=21.22%, 250=36.46% lat (msec) : 500=4.69%, 750=0.26% cpu : usr=0.03%, sys=1.30%, ctx=1361, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=316KiB/s (324kB/s), 75.9KiB/s-89.0KiB/s (77.7kB/s-91.2kB/s), io=23.4MiB (24.5MB), run=70267-75688msec WRITE: bw=333KiB/s (341kB/s), 83.6KiB/s-86.5KiB/s (85.7kB/s-88.5kB/s), io=24.6MiB (25.8MB), run=70267-75688msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148077: Mon Mar 16 06:40:43 2026 read: IOPS=2, BW=2237KiB/s (2290kB/s)(7168KiB/3205msec) clat (usec): min=551, max=320219, avg=178587.17, stdev=132962.51 lat (usec): min=552, max=320220, avg=178588.58, stdev=132962.49 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 3556], | 30.00th=[152044], 40.00th=[152044], 50.00th=[208667], 60.00th=[263193], | 70.00th=[263193], 80.00th=[299893], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 2027, max= 4096, per=55.28%, avg=2969.67, stdev=1046.66, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1598KiB/s (1636kB/s)(5120KiB/3205msec); 0 zone resets clat (msec): min=126, max=909, avg=383.52, stdev=308.37 lat (msec): min=126, max=909, avg=383.60, stdev=308.38 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1946, max= 2027, per=26.41%, avg=1986.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=14.04%, ctx=128, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148078: Mon Mar 16 06:40:43 2026 read: IOPS=0, BW=537KiB/s (550kB/s)(2048KiB/3812msec) clat (usec): min=757, max=160144, avg=80451.32, stdev=112703.80 lat (usec): min=759, max=160147, avg=80453.17, stdev=112704.54 clat percentiles (usec): | 1.00th=[ 758], 5.00th=[ 758], 10.00th=[ 758], 20.00th=[ 758], | 30.00th=[ 758], 40.00th=[ 758], 50.00th=[ 758], 60.00th=[160433], | 70.00th=[160433], 80.00th=[160433], 90.00th=[160433], 95.00th=[160433], | 99.00th=[160433], 99.50th=[160433], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 1370, max= 1946, per=30.86%, avg=1658.00, stdev=407.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2686KiB/s (2751kB/s)(10.0MiB/3812msec); 0 zone resets clat (msec): min=70, max=1346, avg=352.22, stdev=405.74 lat (msec): min=71, max=1346, avg=352.29, stdev=405.73 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 81], | 30.00th=[ 94], 40.00th=[ 122], 50.00th=[ 127], 60.00th=[ 211], | 70.00th=[ 271], 80.00th=[ 510], 90.00th=[ 693], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 1735, max= 5840, per=51.73%, avg=3890.33, stdev=2060.21, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=25.00%, 250=33.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=12.51%, ctx=94, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148079: Mon Mar 16 06:40:43 2026 read: IOPS=1, BW=1944KiB/s (1990kB/s)(6144KiB/3161msec) clat (usec): min=534, max=361090, avg=112219.96, stdev=172664.49 lat (usec): min=535, max=361090, avg=112220.93, stdev=172664.25 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 783], 50.00th=[ 783], 60.00th=[ 3326], | 70.00th=[308282], 80.00th=[308282], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 2048, max= 4000, per=61.68%, avg=3313.67, stdev=1097.40, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1944KiB/s (1990kB/s)(6144KiB/3161msec); 0 zone resets clat (msec): min=138, max=697, avg=383.85, stdev=209.87 lat (msec): min=139, max=697, avg=384.65, stdev=209.53 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 472], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1387, max= 2048, per=25.02%, avg=1881.60, stdev=279.12, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=10.13%, ctx=71, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148080: Mon Mar 16 06:40:43 2026 read: IOPS=1, BW=1477KiB/s (1512kB/s)(5120KiB/3467msec) clat (usec): min=466, max=319957, avg=64914.89, stdev=142577.17 lat (usec): min=467, max=319958, avg=64915.65, stdev=142576.98 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 465], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 2966], 80.00th=[ 2966], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 2000, max= 5840, per=72.97%, avg=3920.00, stdev=2715.29, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2067KiB/s (2117kB/s)(7168KiB/3467msec); 0 zone resets clat (msec): min=114, max=659, avg=432.01, stdev=239.42 lat (msec): min=114, max=659, avg=432.07, stdev=239.41 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 186], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 575], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 642], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1450, max= 4096, per=30.85%, avg=2320.25, stdev=1204.95, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=8.33%, 750=33.33% cpu : usr=0.00%, sys=9.72%, ctx=126, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5373KiB/s (5501kB/s), 537KiB/s-2237KiB/s (550kB/s-2290kB/s), io=20.0MiB (20.0MB), run=3161-3812msec WRITE: bw=7522KiB/s (7702kB/s), 1598KiB/s-2686KiB/s (1636kB/s-2751kB/s), io=28.0MiB (29.4MB), run=3161-3812msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148082: Mon Mar 16 06:40:48 2026 read: IOPS=1, BW=1715KiB/s (1756kB/s)(7168KiB/4180msec) clat (msec): min=138, max=272, avg=214.09, stdev=48.09 lat (msec): min=138, max=272, avg=214.10, stdev=48.09 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 169], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 222], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 262], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1980, max= 6131, per=73.25%, avg=3042.25, stdev=2059.31, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1225KiB/s (1254kB/s)(5120KiB/4180msec); 0 zone resets clat (msec): min=345, max=602, avg=436.13, stdev=100.25 lat (msec): min=345, max=602, avg=436.19, stdev=100.24 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1946, max= 2039, per=34.35%, avg=1997.00, stdev=42.15, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=3.18%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148083: Mon Mar 16 06:40:48 2026 read: IOPS=0, BW=415KiB/s (425kB/s)(2048KiB/4931msec) clat (msec): min=230, max=300, avg=265.92, stdev=49.50 lat (msec): min=230, max=300, avg=265.92, stdev=49.50 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2023, max= 2043, per=48.95%, avg=2033.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2077KiB/s (2126kB/s)(10.0MiB/4931msec); 0 zone resets clat (msec): min=249, max=716, avg=393.74, stdev=138.38 lat (msec): min=249, max=717, avg=393.84, stdev=138.43 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 268], | 30.00th=[ 305], 40.00th=[ 330], 50.00th=[ 338], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 468], 90.00th=[ 498], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1946, max= 4079, per=51.98%, avg=3022.33, stdev=1131.74, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=16.67%, 500=75.00%, 750=8.33% cpu : usr=0.06%, sys=2.80%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148084: Mon Mar 16 06:40:48 2026 read: IOPS=1, BW=1496KiB/s (1532kB/s)(6144KiB/4106msec) clat (msec): min=132, max=348, avg=208.96, stdev=81.05 lat (msec): min=132, max=348, avg=208.96, stdev=81.05 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 209], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1946, max= 4047, per=60.50%, avg=2512.75, stdev=1023.61, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1496KiB/s (1532kB/s)(6144KiB/4106msec); 0 zone resets clat (msec): min=305, max=488, avg=398.27, stdev=62.08 lat (msec): min=305, max=489, avg=398.39, stdev=62.09 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 414], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1946, max= 2043, per=34.49%, avg=2005.40, stdev=41.54, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.02%, sys=3.34%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148085: Mon Mar 16 06:40:48 2026 read: IOPS=1, BW=1136KiB/s (1164kB/s)(5120KiB/4506msec) clat (msec): min=128, max=419, avg=221.09, stdev=115.35 lat (msec): min=128, max=419, avg=221.10, stdev=115.35 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 3893, max= 4047, per=95.59%, avg=3970.00, stdev=108.89, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1591KiB/s (1629kB/s)(7168KiB/4506msec); 0 zone resets clat (msec): min=262, max=631, avg=417.73, stdev=153.07 lat (msec): min=262, max=631, avg=418.01, stdev=152.93 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 279], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 334], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 567], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1980, max= 4039, per=41.73%, avg=2426.40, stdev=901.83, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=25.00% cpu : usr=0.02%, sys=2.64%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4153KiB/s (4253kB/s), 415KiB/s-1715KiB/s (425kB/s-1756kB/s), io=20.0MiB (20.0MB), run=4106-4931msec WRITE: bw=5815KiB/s (5954kB/s), 1225KiB/s-2077KiB/s (1254kB/s-2126kB/s), io=28.0MiB (29.4MB), run=4106-4931msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148092: Mon Mar 16 06:41:03 2026 read: IOPS=1, BW=7153KiB/s (7324kB/s)(12.0MiB/1718msec) clat (msec): min=281, max=984, avg=561.96, stdev=372.57 lat (msec): min=281, max=984, avg=561.96, stdev=372.57 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7366, max= 8031, per=100.00%, avg=7698.50, stdev=470.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.05%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148093: Mon Mar 16 06:41:03 2026 read: IOPS=0, BW=1189KiB/s (1218kB/s)(4096KiB/3445msec) clat (nsec): min=642607k, max=642607k, avg=642607213.00, stdev= 0.00 lat (nsec): min=642609k, max=642609k, avg=642609497.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2378KiB/s (2435kB/s)(8192KiB/3445msec); 0 zone resets clat (msec): min=980, max=1667, avg=1323.89, stdev=485.72 lat (msec): min=981, max=1668, avg=1324.72, stdev=485.66 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8126, max= 8126, per=87.84%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.58%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148094: Mon Mar 16 06:41:03 2026 write: IOPS=0, BW=3469KiB/s (3552kB/s)(12.0MiB/3542msec); 0 zone resets clat (msec): min=554, max=1567, avg=1105.85, stdev=512.28 lat (msec): min=555, max=1567, avg=1106.21, stdev=512.26 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7937, max= 8192, per=87.17%, avg=8064.50, stdev=180.31, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.45%, ctx=109, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148096: Mon Mar 16 06:41:03 2026 write: IOPS=1, BW=4333KiB/s (4437kB/s)(12.0MiB/2836msec); 0 zone resets clat (msec): min=510, max=1383, avg=876.65, stdev=453.23 lat (msec): min=510, max=1384, avg=877.05, stdev=453.33 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8015, max= 8031, per=86.73%, avg=8023.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.07%, sys=3.95%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4756KiB/s (4870kB/s), 1189KiB/s-7153KiB/s (1218kB/s-7324kB/s), io=16.0MiB (16.8MB), run=1718-3445msec WRITE: bw=9251KiB/s (9473kB/s), 2378KiB/s-4333KiB/s (2435kB/s-4437kB/s), io=32.0MiB (33.6MB), run=2836-3542msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148097: Mon Mar 16 06:41:04 2026 read: IOPS=0, BW=4095KiB/s (4193kB/s)(12.0MiB/3001msec) clat (msec): min=755, max=1055, avg=871.22, stdev=161.09 lat (msec): min=755, max=1055, avg=871.22, stdev=161.09 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.37%, ctx=404, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148098: Mon Mar 16 06:41:04 2026 read: IOPS=0, BW=1097KiB/s (1123kB/s)(4096KiB/3735msec) clat (nsec): min=905684k, max=905684k, avg=905683801.00, stdev= 0.00 lat (nsec): min=905687k, max=905687k, avg=905686512.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2193KiB/s (2246kB/s)(8192KiB/3735msec); 0 zone resets clat (msec): min=1275, max=1289, avg=1282.35, stdev=10.01 lat (msec): min=1275, max=1289, avg=1282.62, stdev= 9.90 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8175, max= 8175, per=93.22%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.97%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148099: Mon Mar 16 06:41:04 2026 write: IOPS=0, BW=3289KiB/s (3368kB/s)(12.0MiB/3736msec); 0 zone resets clat (msec): min=417, max=1902, avg=1175.77, stdev=742.55 lat (msec): min=418, max=1904, avg=1177.26, stdev=743.59 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8047, max= 8175, per=92.49%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.20%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148100: Mon Mar 16 06:41:04 2026 write: IOPS=1, BW=4351KiB/s (4456kB/s)(12.0MiB/2824msec); 0 zone resets clat (msec): min=333, max=1345, avg=907.79, stdev=519.62 lat (msec): min=333, max=1346, avg=908.11, stdev=519.65 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.90%, ctx=33, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4387KiB/s (4492kB/s), 1097KiB/s-4095KiB/s (1123kB/s-4193kB/s), io=16.0MiB (16.8MB), run=3001-3735msec WRITE: bw=8771KiB/s (8981kB/s), 2193KiB/s-4351KiB/s (2246kB/s-4456kB/s), io=32.0MiB (33.6MB), run=2824-3736msec