== sanity test 398b: DIO and buffer IO race ============== 20:56:39 (1782867399) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.80083 s, 18.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158872: Tue Jun 30 20:57:43 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(5992KiB/55086msec) clat (usec): min=28, max=684572, avg=18822.63, stdev=21469.82 lat (usec): min=29, max=684572, avg=18823.11, stdev=21469.82 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 178], 10.00th=[ 7242], 20.00th=[ 9372], | 30.00th=[ 10945], 40.00th=[ 13042], 50.00th=[ 15795], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 26346], 90.00th=[ 32900], 95.00th=[ 39584], | 99.00th=[ 68682], 99.50th=[ 83362], 99.90th=[135267], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 13, max= 200, per=25.41%, avg=108.24, stdev=37.08, samples=109 iops : min= 3, max= 50, avg=26.68, stdev= 9.33, samples=109 write: IOPS=28, BW=114KiB/s (117kB/s)(6296KiB/55086msec); 0 zone resets clat (usec): min=752, max=99140, avg=16965.79, stdev=14569.90 lat (usec): min=752, max=99140, avg=16966.43, stdev=14569.87 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 1745], 10.00th=[ 2835], 20.00th=[ 3884], | 30.00th=[ 6456], 40.00th=[10159], 50.00th=[13435], 60.00th=[17695], | 70.00th=[21627], 80.00th=[27132], 90.00th=[36963], 95.00th=[44827], | 99.00th=[66847], 99.50th=[77071], 99.90th=[93848], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 31, max= 208, per=25.69%, avg=114.58, stdev=35.72, samples=108 iops : min= 7, max= 52, avg=28.27, stdev= 9.01, samples=108 lat (usec) : 50=0.36%, 100=0.72%, 250=1.53%, 500=0.07%, 750=0.03% lat (usec) : 1000=1.27% lat (msec) : 2=1.56%, 4=7.65%, 10=18.65%, 20=33.20%, 50=32.36% lat (msec) : 100=2.41%, 250=0.16%, 750=0.03% cpu : usr=0.05%, sys=26.25%, ctx=8905, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158873: Tue Jun 30 20:57:43 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(5940KiB/56107msec) clat (usec): min=24, max=103287, avg=18325.03, stdev=11503.18 lat (usec): min=25, max=103288, avg=18325.51, stdev=11503.22 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 184], 10.00th=[ 7177], 20.00th=[ 9503], | 30.00th=[ 11338], 40.00th=[ 13698], 50.00th=[ 16319], 60.00th=[ 19006], | 70.00th=[ 22676], 80.00th=[ 26608], 90.00th=[ 32637], 95.00th=[ 39584], | 99.00th=[ 55313], 99.50th=[ 58983], 99.90th=[ 82314], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 6, max= 208, per=24.64%, avg=104.96, stdev=37.06, samples=111 iops : min= 1, max= 52, avg=25.86, stdev= 9.37, samples=111 write: IOPS=28, BW=113KiB/s (116kB/s)(6348KiB/56107msec); 0 zone resets clat (usec): min=739, max=699118, avg=18090.75, stdev=23408.99 lat (usec): min=740, max=699118, avg=18091.31, stdev=23408.98 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 1729], 10.00th=[ 2966], 20.00th=[ 3884], | 30.00th=[ 6325], 40.00th=[ 10421], 50.00th=[ 14222], 60.00th=[ 17957], | 70.00th=[ 22414], 80.00th=[ 27657], 90.00th=[ 38536], 95.00th=[ 46924], | 99.00th=[ 71828], 99.50th=[ 87557], 99.90th=[168821], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 6, max= 223, per=24.99%, avg=111.45, stdev=38.99, samples=111 iops : min= 1, max= 55, avg=27.48, stdev= 9.76, samples=111 lat (usec) : 50=0.29%, 100=0.72%, 250=1.76%, 750=0.13%, 1000=1.53% lat (msec) : 2=1.27%, 4=8.01%, 10=17.64%, 20=32.71%, 50=33.30% lat (msec) : 100=2.41%, 250=0.20%, 750=0.03% cpu : usr=0.05%, sys=25.94%, ctx=8804, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158874: Tue Jun 30 20:57:43 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(6028KiB/56146msec) clat (usec): min=29, max=709515, avg=19535.23, stdev=21849.04 lat (usec): min=30, max=709516, avg=19535.93, stdev=21849.14 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 5604], 10.00th=[ 7832], 20.00th=[ 9765], | 30.00th=[ 11469], 40.00th=[ 13435], 50.00th=[ 16450], 60.00th=[ 19268], | 70.00th=[ 22676], 80.00th=[ 27395], 90.00th=[ 34341], 95.00th=[ 41157], | 99.00th=[ 65274], 99.50th=[ 76022], 99.90th=[137364], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 47, max= 184, per=25.28%, avg=107.69, stdev=33.28, samples=110 iops : min= 11, max= 46, avg=26.54, stdev= 8.39, samples=110 write: IOPS=27, BW=111KiB/s (114kB/s)(6260KiB/56146msec); 0 zone resets clat (usec): min=732, max=186232, avg=16944.87, stdev=15830.15 lat (usec): min=733, max=186232, avg=16945.52, stdev=15830.14 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 1893], 10.00th=[ 2900], 20.00th=[ 3851], | 30.00th=[ 6128], 40.00th=[ 9503], 50.00th=[ 12911], 60.00th=[ 16909], | 70.00th=[ 21365], 80.00th=[ 27132], 90.00th=[ 36439], 95.00th=[ 45876], | 99.00th=[ 70779], 99.50th=[ 88605], 99.90th=[137364], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 19, max= 223, per=24.75%, avg=110.41, stdev=41.43, samples=111 iops : min= 4, max= 55, avg=27.22, stdev=10.41, samples=111 lat (usec) : 50=0.36%, 100=0.65%, 250=1.07%, 500=0.07%, 750=0.10% lat (usec) : 1000=1.53% lat (msec) : 2=1.04%, 4=8.33%, 10=18.46%, 20=33.01%, 50=32.52% lat (msec) : 100=2.60%, 250=0.23%, 750=0.03% cpu : usr=0.05%, sys=25.46%, ctx=8869, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158875: Tue Jun 30 20:57:43 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(6052KiB/56262msec) clat (usec): min=22, max=126494, avg=18719.18, stdev=13114.77 lat (usec): min=22, max=126494, avg=18719.65, stdev=13114.78 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 165], 10.00th=[ 7177], 20.00th=[ 9503], | 30.00th=[ 11076], 40.00th=[ 13435], 50.00th=[ 15795], 60.00th=[ 19268], | 70.00th=[ 22676], 80.00th=[ 26346], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 61604], 99.50th=[ 79168], 99.90th=[125305], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 32, max= 216, per=25.46%, avg=108.44, stdev=33.86, samples=111 iops : min= 8, max= 54, avg=26.73, stdev= 8.54, samples=111 write: IOPS=27, BW=111KiB/s (113kB/s)(6236KiB/56262msec); 0 zone resets clat (usec): min=741, max=736190, avg=17803.24, stdev=23588.96 lat (usec): min=742, max=736192, avg=17803.84, stdev=23588.96 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 1369], 10.00th=[ 2737], 20.00th=[ 3982], | 30.00th=[ 6521], 40.00th=[ 10421], 50.00th=[ 14222], 60.00th=[ 17695], | 70.00th=[ 21890], 80.00th=[ 27919], 90.00th=[ 37487], 95.00th=[ 44827], | 99.00th=[ 68682], 99.50th=[ 86508], 99.90th=[119014], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 47, max= 208, per=25.06%, avg=111.75, stdev=37.80, samples=111 iops : min= 11, max= 52, avg=27.56, stdev= 9.54, samples=111 lat (usec) : 50=0.23%, 100=0.78%, 250=1.79%, 500=0.07%, 750=0.07% lat (usec) : 1000=1.73% lat (msec) : 2=1.50%, 4=6.93%, 10=17.90%, 20=33.30%, 50=32.68% lat (msec) : 100=2.80%, 250=0.20%, 750=0.03% cpu : usr=0.07%, sys=25.65%, ctx=8752, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=427KiB/s (437kB/s), 106KiB/s-109KiB/s (108kB/s-111kB/s), io=23.4MiB (24.6MB), run=55086-56262msec WRITE: bw=447KiB/s (458kB/s), 111KiB/s-114KiB/s (113kB/s-117kB/s), io=24.6MiB (25.7MB), run=55086-56262msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158878: Tue Jun 30 20:58:11 2026 read: IOPS=17, BW=71.6KiB/s (73.4kB/s)(5992KiB/83635msec) clat (msec): min=2, max=697, avg=16.51, stdev=24.43 lat (msec): min=2, max=697, avg=16.51, stdev=24.43 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 13], | 70.00th=[ 18], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 83], 99.50th=[ 90], 99.90th=[ 130], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 216, per=25.11%, avg=72.07, stdev=46.16, samples=164 iops : min= 1, max= 54, avg=17.74, stdev=11.69, samples=164 write: IOPS=18, BW=75.3KiB/s (77.1kB/s)(6296KiB/83635msec); 0 zone resets clat (msec): min=11, max=208, avg=37.36, stdev=20.29 lat (msec): min=11, max=208, avg=37.36, stdev=20.29 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 68], 95.00th=[ 78], | 99.00th=[ 104], 99.50th=[ 116], 99.90th=[ 157], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 15, max= 168, per=25.09%, avg=75.27, stdev=40.74, samples=165 iops : min= 3, max= 42, avg=18.55, stdev=10.37, samples=165 lat (msec) : 4=6.35%, 10=19.99%, 20=15.17%, 50=44.69%, 100=12.96% lat (msec) : 250=0.81%, 750=0.03% cpu : usr=0.05%, sys=8.70%, ctx=6127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158879: Tue Jun 30 20:58:11 2026 read: IOPS=17, BW=71.1KiB/s (72.8kB/s)(5940KiB/83544msec) clat (msec): min=2, max=712, avg=16.31, stdev=24.84 lat (msec): min=2, max=712, avg=16.31, stdev=24.84 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 17], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 53], | 99.00th=[ 78], 99.50th=[ 100], 99.90th=[ 133], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8, max= 208, per=24.84%, avg=71.30, stdev=47.28, samples=165 iops : min= 2, max= 52, avg=17.55, stdev=11.98, samples=165 write: IOPS=18, BW=75.0KiB/s (77.8kB/s)(6348KiB/83544msec); 0 zone resets clat (msec): min=11, max=191, avg=37.31, stdev=21.21 lat (msec): min=11, max=191, avg=37.31, stdev=21.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 67], 95.00th=[ 78], | 99.00th=[ 118], 99.50th=[ 127], 99.90th=[ 169], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 8, max= 176, per=25.35%, avg=76.05, stdev=41.89, samples=165 iops : min= 2, max= 44, avg=18.74, stdev=10.65, samples=165 lat (msec) : 4=7.13%, 10=19.56%, 20=15.14%, 50=44.17%, 100=12.92% lat (msec) : 250=1.04%, 750=0.03% cpu : usr=0.05%, sys=8.68%, ctx=6193, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158880: Tue Jun 30 20:58:11 2026 read: IOPS=18, BW=72.1KiB/s (73.9kB/s)(6028KiB/83554msec) clat (msec): min=2, max=143, avg=16.21, stdev=17.65 lat (msec): min=2, max=143, avg=16.21, stdev=17.65 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 25], 90.00th=[ 40], 95.00th=[ 55], | 99.00th=[ 85], 99.50th=[ 107], 99.90th=[ 123], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 15, max= 224, per=25.21%, avg=72.36, stdev=44.09, samples=165 iops : min= 3, max= 56, avg=17.82, stdev=11.19, samples=165 write: IOPS=18, BW=74.9KiB/s (76.7kB/s)(6260KiB/83554msec); 0 zone resets clat (msec): min=12, max=733, avg=37.71, stdev=27.02 lat (msec): min=12, max=733, avg=37.71, stdev=27.02 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 67], 95.00th=[ 78], | 99.00th=[ 114], 99.50th=[ 130], 99.90th=[ 159], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 15, max= 160, per=25.01%, avg=75.02, stdev=41.57, samples=165 iops : min= 3, max= 40, avg=18.48, stdev=10.57, samples=165 lat (msec) : 4=6.25%, 10=19.79%, 20=16.41%, 50=43.55%, 100=12.96% lat (msec) : 250=1.01%, 750=0.03% cpu : usr=0.05%, sys=8.72%, ctx=6152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158881: Tue Jun 30 20:58:11 2026 read: IOPS=18, BW=72.5KiB/s (74.3kB/s)(6052KiB/83421msec) clat (msec): min=2, max=142, avg=15.54, stdev=16.56 lat (msec): min=2, max=142, avg=15.54, stdev=16.56 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 81], 99.50th=[ 101], 99.90th=[ 124], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 7, max= 216, per=25.40%, avg=72.90, stdev=46.68, samples=165 iops : min= 1, max= 54, avg=17.95, stdev=11.84, samples=165 write: IOPS=18, BW=74.8KiB/s (76.5kB/s)(6236KiB/83421msec); 0 zone resets clat (msec): min=13, max=724, avg=38.37, stdev=27.84 lat (msec): min=13, max=724, avg=38.37, stdev=27.84 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 68], 95.00th=[ 81], | 99.00th=[ 126], 99.50th=[ 153], 99.90th=[ 205], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 15, max= 152, per=25.01%, avg=75.02, stdev=40.20, samples=165 iops : min= 3, max= 38, avg=18.48, stdev=10.23, samples=165 lat (msec) : 4=6.02%, 10=21.09%, 20=14.84%, 50=44.37%, 100=12.63% lat (msec) : 250=1.01%, 750=0.03% cpu : usr=0.05%, sys=8.76%, ctx=6136, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=287KiB/s (294kB/s), 71.1KiB/s-72.5KiB/s (72.8kB/s-74.3kB/s), io=23.4MiB (24.6MB), run=83421-83635msec WRITE: bw=301KiB/s (308kB/s), 74.8KiB/s-75.0KiB/s (76.5kB/s-77.8kB/s), io=24.6MiB (25.7MB), run=83421-83635msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158911: Tue Jun 30 20:58:32 2026 read: IOPS=23, BW=382KiB/s (391kB/s)(5920KiB/15516msec) clat (usec): min=38, max=93346, avg=21442.37, stdev=12628.12 lat (usec): min=39, max=93347, avg=21442.84, stdev=12628.14 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 137], 10.00th=[ 8717], 20.00th=[12518], | 30.00th=[15401], 40.00th=[17957], 50.00th=[20055], 60.00th=[22414], | 70.00th=[25035], 80.00th=[29492], 90.00th=[36963], 95.00th=[42730], | 99.00th=[66847], 99.50th=[69731], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 190, max= 670, per=24.67%, avg=377.90, stdev=120.44, samples=30 iops : min= 11, max= 41, avg=23.13, stdev= 7.72, samples=30 write: IOPS=25, BW=410KiB/s (420kB/s)(6368KiB/15516msec); 0 zone resets clat (usec): min=1056, max=88319, avg=19029.07, stdev=13573.72 lat (usec): min=1056, max=88320, avg=19030.10, stdev=13573.70 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 4752], 10.00th=[ 5866], 20.00th=[ 7898], | 30.00th=[10552], 40.00th=[12649], 50.00th=[15401], 60.00th=[18744], | 70.00th=[22152], 80.00th=[27132], 90.00th=[39060], 95.00th=[46400], | 99.00th=[65274], 99.50th=[76022], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 223, max= 634, per=25.47%, avg=410.53, stdev=121.16, samples=30 iops : min= 13, max= 39, avg=25.20, stdev= 7.54, samples=30 lat (usec) : 50=0.13%, 100=0.39%, 250=3.26%, 500=0.39% lat (msec) : 2=1.17%, 4=1.04%, 10=13.67%, 20=37.11%, 50=39.84% lat (msec) : 100=2.99% cpu : usr=0.06%, sys=31.03%, ctx=2996, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158912: Tue Jun 30 20:58:32 2026 read: IOPS=24, BW=384KiB/s (393kB/s)(5744KiB/14948msec) clat (usec): min=76, max=78585, avg=20451.52, stdev=12697.52 lat (usec): min=76, max=78586, avg=20451.98, stdev=12697.51 clat percentiles (usec): | 1.00th=[ 103], 5.00th=[ 169], 10.00th=[ 1483], 20.00th=[11076], | 30.00th=[13960], 40.00th=[16909], 50.00th=[19006], 60.00th=[21890], | 70.00th=[24773], 80.00th=[28967], 90.00th=[35914], 95.00th=[44303], | 99.00th=[59507], 99.50th=[66847], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 224, max= 640, per=25.17%, avg=385.59, stdev=106.97, samples=29 iops : min= 14, max= 40, avg=23.62, stdev= 6.80, samples=29 write: IOPS=27, BW=438KiB/s (448kB/s)(6544KiB/14948msec); 0 zone resets clat (usec): min=1079, max=80640, avg=18566.81, stdev=12508.56 lat (usec): min=1079, max=80642, avg=18567.66, stdev=12508.60 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 4359], 10.00th=[ 5211], 20.00th=[ 8029], | 30.00th=[10421], 40.00th=[12649], 50.00th=[15664], 60.00th=[19006], | 70.00th=[23725], 80.00th=[28443], 90.00th=[35390], 95.00th=[43779], | 99.00th=[55313], 99.50th=[56886], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 223, max= 669, per=27.07%, avg=436.41, stdev=124.87, samples=29 iops : min= 13, max= 41, avg=26.83, stdev= 7.93, samples=29 lat (usec) : 100=0.39%, 250=3.39%, 500=0.65% lat (msec) : 2=0.65%, 4=1.69%, 10=15.76%, 20=35.55%, 50=39.19% lat (msec) : 100=2.73% cpu : usr=0.06%, sys=32.23%, ctx=3005, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158913: Tue Jun 30 20:58:32 2026 read: IOPS=25, BW=400KiB/s (410kB/s)(6256KiB/15626msec) clat (usec): min=55, max=73156, avg=21004.76, stdev=12670.70 lat (usec): min=55, max=73157, avg=21005.25, stdev=12670.71 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 123], 10.00th=[ 251], 20.00th=[12387], | 30.00th=[14746], 40.00th=[17433], 50.00th=[19792], 60.00th=[22676], | 70.00th=[25560], 80.00th=[29754], 90.00th=[38011], 95.00th=[44827], | 99.00th=[58983], 99.50th=[69731], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 160, max= 574, per=26.14%, avg=400.48, stdev=107.79, samples=31 iops : min= 10, max= 35, avg=24.55, stdev= 6.74, samples=31 write: IOPS=24, BW=386KiB/s (395kB/s)(6032KiB/15626msec); 0 zone resets clat (usec): min=1270, max=151891, avg=19636.04, stdev=14798.09 lat (usec): min=1271, max=151892, avg=19637.57, stdev=14797.69 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 67], 99.50th=[ 105], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 160, max= 699, per=23.78%, avg=383.32, stdev=144.18, samples=31 iops : min= 10, max= 43, avg=23.45, stdev= 9.09, samples=31 lat (usec) : 100=1.04%, 250=4.17%, 500=0.52% lat (msec) : 2=0.39%, 4=1.04%, 10=12.50%, 20=35.81%, 50=41.80% lat (msec) : 100=2.47%, 250=0.26% cpu : usr=0.10%, sys=31.03%, ctx=3011, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158914: Tue Jun 30 20:58:32 2026 read: IOPS=24, BW=390KiB/s (399kB/s)(6032KiB/15473msec) clat (usec): min=93, max=90171, avg=20738.00, stdev=12884.55 lat (usec): min=94, max=90171, avg=20738.47, stdev=12884.54 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 135], 10.00th=[ 251], 20.00th=[12125], | 30.00th=[14484], 40.00th=[17171], 50.00th=[20055], 60.00th=[22676], | 70.00th=[25297], 80.00th=[29230], 90.00th=[36963], 95.00th=[45351], | 99.00th=[57410], 99.50th=[67634], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 191, max= 766, per=25.37%, avg=388.70, stdev=123.87, samples=30 iops : min= 11, max= 47, avg=23.80, stdev= 7.89, samples=30 write: IOPS=25, BW=404KiB/s (414kB/s)(6256KiB/15473msec); 0 zone resets clat (usec): min=1168, max=89882, avg=19556.98, stdev=13407.44 lat (usec): min=1168, max=89883, avg=19557.81, stdev=13407.48 clat percentiles (usec): | 1.00th=[ 2769], 5.00th=[ 5342], 10.00th=[ 5997], 20.00th=[ 8291], | 30.00th=[10814], 40.00th=[13698], 50.00th=[16909], 60.00th=[19792], | 70.00th=[23462], 80.00th=[28181], 90.00th=[35914], 95.00th=[44303], | 99.00th=[72877], 99.50th=[73925], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 222, max= 662, per=25.08%, avg=404.23, stdev=103.81, samples=30 iops : min= 13, max= 41, avg=24.80, stdev= 6.53, samples=30 lat (usec) : 100=0.65%, 250=4.17%, 500=0.91% lat (msec) : 2=0.39%, 4=1.30%, 10=13.02%, 20=34.64%, 50=41.93% lat (msec) : 100=2.99% cpu : usr=0.05%, sys=31.62%, ctx=3067, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1533KiB/s (1570kB/s), 382KiB/s-400KiB/s (391kB/s-410kB/s), io=23.4MiB (24.5MB), run=14948-15626msec WRITE: bw=1613KiB/s (1651kB/s), 386KiB/s-438KiB/s (395kB/s-448kB/s), io=24.6MiB (25.8MB), run=14948-15626msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158906: Tue Jun 30 20:58:38 2026 read: IOPS=17, BW=272KiB/s (279kB/s)(5920KiB/21731msec) clat (msec): min=3, max=109, avg=19.38, stdev=15.56 lat (msec): min=3, max=109, avg=19.39, stdev=15.56 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 90], 99.50th=[ 107], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 63, max= 608, per=24.64%, avg=271.51, stdev=141.57, samples=43 iops : min= 3, max= 38, avg=16.47, stdev= 9.07, samples=43 write: IOPS=18, BW=293KiB/s (300kB/s)(6368KiB/21731msec); 0 zone resets clat (msec): min=13, max=148, avg=36.49, stdev=19.33 lat (msec): min=13, max=148, avg=36.49, stdev=19.33 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 49], 90.00th=[ 63], 95.00th=[ 73], | 99.00th=[ 110], 99.50th=[ 124], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 128, max= 544, per=25.16%, avg=291.60, stdev=117.56, samples=43 iops : min= 8, max= 34, avg=17.72, stdev= 7.62, samples=43 lat (msec) : 4=0.91%, 10=10.29%, 20=29.95%, 50=46.88%, 100=10.94% lat (msec) : 250=1.04% cpu : usr=0.03%, sys=13.50%, ctx=1969, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158907: Tue Jun 30 20:58:38 2026 read: IOPS=16, BW=264KiB/s (271kB/s)(5744KiB/21727msec) clat (msec): min=3, max=186, avg=20.28, stdev=18.74 lat (msec): min=3, max=186, avg=20.28, stdev=18.74 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 27], 90.00th=[ 44], 95.00th=[ 56], | 99.00th=[ 95], 99.50th=[ 130], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 63, max= 576, per=23.93%, avg=263.67, stdev=130.59, samples=43 iops : min= 3, max= 36, avg=15.98, stdev= 8.37, samples=43 write: IOPS=18, BW=301KiB/s (308kB/s)(6544KiB/21727msec); 0 zone resets clat (msec): min=13, max=116, avg=35.28, stdev=18.02 lat (msec): min=13, max=116, avg=35.28, stdev=18.02 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 62], 95.00th=[ 72], | 99.00th=[ 101], 99.50th=[ 110], 99.90th=[ 117], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 95, max= 608, per=25.90%, avg=300.14, stdev=132.17, samples=43 iops : min= 5, max= 38, avg=18.26, stdev= 8.50, samples=43 lat (msec) : 4=1.17%, 10=11.72%, 20=26.30%, 50=48.83%, 100=11.07% lat (msec) : 250=0.91% cpu : usr=0.10%, sys=13.24%, ctx=1930, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158908: Tue Jun 30 20:58:38 2026 read: IOPS=18, BW=291KiB/s (298kB/s)(6256KiB/21470msec) clat (usec): min=3361, max=96266, avg=19434.46, stdev=15307.44 lat (usec): min=3362, max=96267, avg=19435.03, stdev=15307.51 clat percentiles (usec): | 1.00th=[ 3720], 5.00th=[ 4817], 10.00th=[ 6521], 20.00th=[ 8586], | 30.00th=[10421], 40.00th=[12125], 50.00th=[14353], 60.00th=[17171], | 70.00th=[20055], 80.00th=[27395], 90.00th=[41681], 95.00th=[49021], | 99.00th=[80217], 99.50th=[94897], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 63, max= 736, per=26.47%, avg=291.67, stdev=161.33, samples=42 iops : min= 3, max= 46, avg=17.71, stdev=10.30, samples=42 write: IOPS=17, BW=281KiB/s (288kB/s)(6032KiB/21470msec); 0 zone resets clat (msec): min=13, max=114, avg=36.68, stdev=19.80 lat (msec): min=13, max=114, avg=36.69, stdev=19.80 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 49], 90.00th=[ 64], 95.00th=[ 83], | 99.00th=[ 104], 99.50th=[ 114], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 126, max= 576, per=23.92%, avg=277.29, stdev=117.19, samples=42 iops : min= 7, max= 36, avg=16.83, stdev= 7.54, samples=42 lat (msec) : 4=0.78%, 10=13.67%, 20=26.82%, 50=47.14%, 100=10.68% lat (msec) : 250=0.91% cpu : usr=0.07%, sys=13.68%, ctx=1918, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158909: Tue Jun 30 20:58:38 2026 read: IOPS=17, BW=279KiB/s (286kB/s)(6032KiB/21612msec) clat (msec): min=3, max=149, avg=19.81, stdev=17.82 lat (msec): min=3, max=149, avg=19.81, stdev=17.82 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 90], 99.50th=[ 126], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 64, max= 608, per=24.77%, avg=272.93, stdev=135.37, samples=42 iops : min= 4, max= 38, avg=16.55, stdev= 8.59, samples=42 write: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21612msec); 0 zone resets clat (msec): min=15, max=141, avg=36.06, stdev=18.58 lat (msec): min=15, max=141, avg=36.06, stdev=18.58 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 56], 95.00th=[ 70], | 99.00th=[ 121], 99.50th=[ 123], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 63, max= 576, per=24.64%, avg=285.60, stdev=119.75, samples=42 iops : min= 3, max= 36, avg=17.33, stdev= 7.77, samples=42 lat (msec) : 4=0.91%, 10=11.98%, 20=27.34%, 50=48.57%, 100=9.90% lat (msec) : 250=1.30% cpu : usr=0.07%, sys=13.47%, ctx=1902, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1102KiB/s (1129kB/s), 264KiB/s-291KiB/s (271kB/s-298kB/s), io=23.4MiB (24.5MB), run=21470-21731msec WRITE: bw=1160KiB/s (1187kB/s), 281KiB/s-301KiB/s (288kB/s-308kB/s), io=24.6MiB (25.8MB), run=21470-21731msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158926: Tue Jun 30 20:58:49 2026 read: IOPS=1, BW=1888KiB/s (1934kB/s)(7168KiB/3796msec) clat (usec): min=587, max=462194, avg=235607.05, stdev=158046.15 lat (usec): min=589, max=462195, avg=235607.97, stdev=158046.18 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[124257], | 30.00th=[149947], 40.00th=[149947], 50.00th=[225444], 60.00th=[333448], | 70.00th=[333448], 80.00th=[354419], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 1980, max= 3494, per=57.99%, avg=2320.80, stdev=656.42, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1349KiB/s (1381kB/s)(5120KiB/3796msec); 0 zone resets clat (msec): min=261, max=553, avg=418.68, stdev=124.88 lat (msec): min=261, max=553, avg=418.74, stdev=124.88 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1946, max= 4079, per=47.97%, avg=2688.00, stdev=1205.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.08%, sys=48.67%, ctx=650, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158927: Tue Jun 30 20:58:49 2026 read: IOPS=0, BW=400KiB/s (410kB/s)(2048KiB/5117msec) clat (msec): min=138, max=479, avg=308.70, stdev=241.19 lat (msec): min=138, max=479, avg=308.70, stdev=241.19 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1735, max= 1980, per=46.41%, avg=1857.50, stdev=173.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2001KiB/s (2049kB/s)(10.0MiB/5117msec); 0 zone resets clat (msec): min=224, max=793, avg=448.69, stdev=216.82 lat (msec): min=224, max=793, avg=448.76, stdev=216.79 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 247], | 30.00th=[ 249], 40.00th=[ 300], 50.00th=[ 313], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 634], 90.00th=[ 760], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1946, max= 4087, per=48.24%, avg=2703.00, stdev=1069.57, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.04%, sys=38.17%, ctx=780, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158928: Tue Jun 30 20:58:49 2026 read: IOPS=1, BW=1421KiB/s (1455kB/s)(6144KiB/4324msec) clat (usec): min=327, max=257664, avg=85987.69, stdev=132315.28 lat (usec): min=328, max=257665, avg=85988.56, stdev=132315.61 clat percentiles (usec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 461], | 30.00th=[ 461], 40.00th=[ 545], 50.00th=[ 545], 60.00th=[ 979], | 70.00th=[256902], 80.00th=[256902], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 1980, max= 4096, per=84.58%, avg=3385.00, stdev=1216.80, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1421KiB/s (1455kB/s)(6144KiB/4324msec); 0 zone resets clat (msec): min=322, max=1126, avg=629.46, stdev=356.43 lat (msec): min=322, max=1126, avg=629.51, stdev=356.46 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 456], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1774, max= 2048, per=35.39%, avg=1983.17, stdev=105.52, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 500=50.00%, 2000=16.67% cpu : usr=0.00%, sys=32.78%, ctx=268, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158929: Tue Jun 30 20:58:49 2026 read: IOPS=1, BW=1329KiB/s (1361kB/s)(5120KiB/3852msec) clat (usec): min=353, max=345523, avg=136970.17, stdev=186954.38 lat (usec): min=354, max=345524, avg=136970.78, stdev=186954.54 clat percentiles (usec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 433], 40.00th=[ 433], 50.00th=[ 570], 60.00th=[ 570], | 70.00th=[337642], 80.00th=[337642], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1861KiB/s (1906kB/s)(7168KiB/3852msec); 0 zone resets clat (msec): min=272, max=758, avg=446.56, stdev=189.58 lat (msec): min=273, max=758, avg=446.61, stdev=189.56 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 347], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 625], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1762, max= 3961, per=42.31%, avg=2370.60, stdev=897.37, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=41.81%, ctx=235, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4002KiB/s (4098kB/s), 400KiB/s-1888KiB/s (410kB/s-1934kB/s), io=20.0MiB (20.0MB), run=3796-5117msec WRITE: bw=5603KiB/s (5738kB/s), 1349KiB/s-2001KiB/s (1381kB/s-2049kB/s), io=28.0MiB (29.4MB), run=3796-5117msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158931: Tue Jun 30 20:58:49 2026 read: IOPS=1, BW=1582KiB/s (1620kB/s)(7168KiB/4530msec) clat (msec): min=70, max=656, avg=290.32, stdev=215.70 lat (msec): min=70, max=656, avg=290.32, stdev=215.70 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 97], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 209], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 443], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1976, max= 4071, per=60.22%, avg=2533.25, stdev=1025.65, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1130KiB/s (1157kB/s)(5120KiB/4530msec); 0 zone resets clat (msec): min=188, max=1051, avg=476.79, stdev=350.45 lat (msec): min=188, max=1051, avg=476.83, stdev=350.46 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1935, max= 6131, per=68.48%, avg=4033.00, stdev=2967.02, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=17.64%, ctx=166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158932: Tue Jun 30 20:58:49 2026 read: IOPS=0, BW=421KiB/s (431kB/s)(2048KiB/4868msec) clat (msec): min=145, max=264, avg=204.80, stdev=83.87 lat (msec): min=145, max=264, avg=204.80, stdev=83.87 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 1387, max= 1980, per=40.02%, avg=1683.50, stdev=419.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2104KiB/s (2154kB/s)(10.0MiB/4868msec); 0 zone resets clat (msec): min=121, max=701, avg=433.04, stdev=234.12 lat (msec): min=121, max=701, avg=433.11, stdev=234.11 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 133], | 30.00th=[ 197], 40.00th=[ 257], 50.00th=[ 435], 60.00th=[ 575], | 70.00th=[ 609], 80.00th=[ 642], 90.00th=[ 667], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1928, max= 4087, per=38.59%, avg=2272.75, stdev=734.23, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=33.33%, 500=25.00%, 750=41.67% cpu : usr=0.00%, sys=17.01%, ctx=517, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158933: Tue Jun 30 20:58:49 2026 read: IOPS=1, BW=1365KiB/s (1398kB/s)(6144KiB/4501msec) clat (msec): min=93, max=657, avg=282.95, stdev=233.32 lat (msec): min=93, max=657, avg=282.95, stdev=233.32 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 239], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1928, max= 3961, per=59.11%, avg=2486.75, stdev=984.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1365KiB/s (1398kB/s)(6144KiB/4501msec); 0 zone resets clat (msec): min=133, max=1325, avg=423.41, stdev=450.17 lat (msec): min=133, max=1326, avg=423.48, stdev=450.18 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 305], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1372, max= 2043, per=32.20%, avg=1896.20, stdev=294.30, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=15.02%, ctx=174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158934: Tue Jun 30 20:58:49 2026 read: IOPS=1, BW=1063KiB/s (1089kB/s)(5120KiB/4815msec) clat (msec): min=37, max=766, avg=253.46, stdev=292.20 lat (msec): min=37, max=766, avg=253.46, stdev=292.20 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 38], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1980, max= 6131, per=96.40%, avg=4055.50, stdev=2935.20, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1489KiB/s (1524kB/s)(7168KiB/4815msec); 0 zone resets clat (msec): min=123, max=1211, avg=493.28, stdev=370.20 lat (msec): min=123, max=1211, avg=493.35, stdev=370.20 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 136], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 464], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 609], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1398, max= 6131, per=45.78%, avg=2696.00, stdev=1937.33, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 50=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=16.22%, ctx=273, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4207KiB/s (4308kB/s), 421KiB/s-1582KiB/s (431kB/s-1620kB/s), io=20.0MiB (20.0MB), run=4501-4868msec WRITE: bw=5890KiB/s (6031kB/s), 1130KiB/s-2104KiB/s (1157kB/s-2154kB/s), io=28.0MiB (29.4MB), run=4501-4868msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158940: Tue Jun 30 20:58:58 2026 read: IOPS=1, BW=4963KiB/s (5082kB/s)(12.0MiB/2476msec) clat (msec): min=753, max=900, avg=811.37, stdev=78.69 lat (msec): min=753, max=900, avg=811.37, stdev=78.69 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7757, max= 8192, per=100.00%, avg=7974.50, stdev=307.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=52.61%, ctx=2778, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158941: Tue Jun 30 20:58:58 2026 read: IOPS=0, BW=1440KiB/s (1474kB/s)(4096KiB/2845msec) clat (nsec): min=757577k, max=757577k, avg=757577256.00, stdev= 0.00 lat (nsec): min=757580k, max=757580k, avg=757580007.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2879KiB/s (2949kB/s)(8192KiB/2845msec); 0 zone resets clat (msec): min=569, max=1476, avg=1023.28, stdev=641.65 lat (msec): min=570, max=1477, avg=1023.74, stdev=641.53 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8062, max= 8062, per=70.96%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=26.69%, ctx=765, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158942: Tue Jun 30 20:58:58 2026 write: IOPS=1, BW=4261KiB/s (4363kB/s)(12.0MiB/2884msec); 0 zone resets clat (msec): min=705, max=1182, avg=946.35, stdev=238.46 lat (msec): min=706, max=1182, avg=946.66, stdev=238.46 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8143, max= 8192, per=71.89%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=21.26%, ctx=303, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158943: Tue Jun 30 20:58:58 2026 write: IOPS=1, BW=4498KiB/s (4606kB/s)(12.0MiB/2732msec); 0 zone resets clat (msec): min=300, max=1826, avg=901.91, stdev=812.48 lat (msec): min=300, max=1826, avg=902.25, stdev=812.48 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 5468, max= 8047, per=59.48%, avg=6757.50, stdev=1823.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=17.32%, ctx=110, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5759KiB/s (5897kB/s), 1440KiB/s-4963KiB/s (1474kB/s-5082kB/s), io=16.0MiB (16.8MB), run=2476-2845msec WRITE: bw=11.1MiB/s (11.6MB/s), 2879KiB/s-4498KiB/s (2949kB/s-4606kB/s), io=32.0MiB (33.6MB), run=2732-2884msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158945: Tue Jun 30 20:58:59 2026 read: IOPS=0, BW=4035KiB/s (4132kB/s)(12.0MiB/3045msec) clat (msec): min=230, max=1660, avg=1014.47, stdev=725.07 lat (msec): min=230, max=1660, avg=1014.47, stdev=725.07 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.78%, ctx=75, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158946: Tue Jun 30 20:58:59 2026 read: IOPS=0, BW=1241KiB/s (1271kB/s)(4096KiB/3301msec) clat (nsec): min=1722.7M, max=1722.7M, avg=1722727068.00, stdev= 0.00 lat (nsec): min=1722.7M, max=1722.7M, avg=1722728071.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2482KiB/s (2541kB/s)(8192KiB/3301msec); 0 zone resets clat (msec): min=560, max=1015, avg=787.86, stdev=321.33 lat (msec): min=560, max=1015, avg=788.12, stdev=321.50 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8078, max= 8078, per=81.38%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=19.09%, ctx=207, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158947: Tue Jun 30 20:58:59 2026 write: IOPS=0, BW=3736KiB/s (3826kB/s)(12.0MiB/3289msec); 0 zone resets clat (msec): min=262, max=2106, avg=1095.68, stdev=935.12 lat (msec): min=262, max=2106, avg=1095.92, stdev=935.03 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 7861, max= 8078, per=80.29%, avg=7969.50, stdev=153.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=14.11%, ctx=122, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158948: Tue Jun 30 20:58:59 2026 write: IOPS=1, BW=4457KiB/s (4564kB/s)(12.0MiB/2757msec); 0 zone resets clat (msec): min=667, max=1265, avg=918.40, stdev=310.54 lat (msec): min=667, max=1265, avg=918.63, stdev=310.50 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 5868, max= 8192, per=70.82%, avg=7030.00, stdev=1643.32, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=29.39%, ctx=100, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4963KiB/s (5082kB/s), 1241KiB/s-4035KiB/s (1271kB/s-4132kB/s), io=16.0MiB (16.8MB), run=3045-3301msec WRITE: bw=9927KiB/s (10.2MB/s), 2482KiB/s-4457KiB/s (2541kB/s-4564kB/s), io=32.0MiB (33.6MB), run=2757-3301msec