== sanity test 398b: DIO and buffer IO race ============== 23:03:54 (1784084634) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.15953 s, 15.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158947: Tue Jul 14 23:04:58 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(5992KiB/53976msec) clat (usec): min=24, max=671213, avg=18029.26, stdev=19841.37 lat (usec): min=25, max=671214, avg=18030.46, stdev=19841.39 clat percentiles (usec): | 1.00th=[ 80], 5.00th=[ 139], 10.00th=[ 7373], 20.00th=[ 10028], | 30.00th=[ 11863], 40.00th=[ 13566], 50.00th=[ 15795], 60.00th=[ 18482], | 70.00th=[ 21365], 80.00th=[ 25035], 90.00th=[ 30802], 95.00th=[ 36439], | 99.00th=[ 49021], 99.50th=[ 55313], 99.90th=[ 92799], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 15, max= 200, per=25.28%, avg=110.47, stdev=31.08, samples=107 iops : min= 3, max= 50, avg=27.21, stdev= 7.76, samples=107 write: IOPS=29, BW=117KiB/s (119kB/s)(6296KiB/53976msec); 0 zone resets clat (usec): min=826, max=157818, avg=16936.82, stdev=14080.93 lat (usec): min=827, max=157819, avg=16938.17, stdev=14081.03 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2376], 10.00th=[ 3097], 20.00th=[ 4424], | 30.00th=[ 6915], 40.00th=[ 10552], 50.00th=[ 13829], 60.00th=[ 17433], | 70.00th=[ 21890], 80.00th=[ 27132], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 60556], 99.50th=[ 68682], 99.90th=[100140], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 32, max= 224, per=25.60%, avg=117.24, stdev=32.39, samples=106 iops : min= 8, max= 56, avg=28.91, stdev= 8.09, samples=106 lat (usec) : 50=0.07%, 100=1.07%, 250=2.12%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=1.43%, 4=7.36%, 10=16.83%, 20=36.91%, 50=32.19% lat (msec) : 100=1.56%, 250=0.07%, 750=0.03% cpu : usr=0.16%, sys=25.95%, ctx=9148, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158949: Tue Jul 14 23:04:58 2026 read: IOPS=27, BW=110KiB/s (112kB/s)(5940KiB/54156msec) clat (usec): min=41, max=139981, avg=18302.66, stdev=11886.26 lat (usec): min=41, max=139981, avg=18303.86, stdev=11886.30 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 151], 10.00th=[ 7635], 20.00th=[ 9896], | 30.00th=[ 11600], 40.00th=[ 13435], 50.00th=[ 16188], 60.00th=[ 18744], | 70.00th=[ 22152], 80.00th=[ 26346], 90.00th=[ 32375], 95.00th=[ 37487], | 99.00th=[ 60556], 99.50th=[ 69731], 99.90th=[121111], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 7, max= 184, per=25.16%, avg=109.93, stdev=31.02, samples=106 iops : min= 1, max= 46, avg=27.07, stdev= 7.77, samples=106 write: IOPS=29, BW=117KiB/s (120kB/s)(6348KiB/54156msec); 0 zone resets clat (usec): min=811, max=702889, avg=16811.66, stdev=21683.97 lat (usec): min=812, max=702891, avg=16813.03, stdev=21684.00 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2245], 10.00th=[ 2966], 20.00th=[ 4424], | 30.00th=[ 6521], 40.00th=[ 10290], 50.00th=[ 13566], 60.00th=[ 16909], | 70.00th=[ 20841], 80.00th=[ 25822], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 58983], 99.50th=[ 64750], 99.90th=[ 79168], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 200, per=25.22%, avg=115.52, stdev=34.75, samples=107 iops : min= 1, max= 50, avg=28.48, stdev= 8.71, samples=107 lat (usec) : 50=0.16%, 100=1.04%, 250=1.69%, 500=0.10%, 1000=0.07% lat (msec) : 2=1.92%, 4=7.32%, 10=18.00%, 20=35.81%, 50=31.77% lat (msec) : 100=2.02%, 250=0.07%, 750=0.03% cpu : usr=0.14%, sys=25.95%, ctx=9077, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158951: Tue Jul 14 23:04:58 2026 read: IOPS=27, BW=110KiB/s (113kB/s)(6028KiB/54859msec) clat (usec): min=36, max=168415, avg=18174.53, stdev=11716.14 lat (usec): min=37, max=168416, avg=18176.70, stdev=11715.55 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 4817], 10.00th=[ 7635], 20.00th=[ 9765], | 30.00th=[ 11469], 40.00th=[ 13698], 50.00th=[ 15926], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 25822], 90.00th=[ 31851], 95.00th=[ 37487], | 99.00th=[ 53740], 99.50th=[ 62129], 99.90th=[133694], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 24, max= 280, per=25.43%, avg=111.13, stdev=34.40, samples=107 iops : min= 6, max= 70, avg=27.38, stdev= 8.63, samples=107 write: IOPS=28, BW=114KiB/s (117kB/s)(6260KiB/54859msec); 0 zone resets clat (usec): min=787, max=759597, avg=17362.04, stdev=23850.08 lat (usec): min=788, max=759599, avg=17363.42, stdev=23850.08 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2180], 10.00th=[ 2835], 20.00th=[ 4146], | 30.00th=[ 6521], 40.00th=[ 10159], 50.00th=[ 13829], 60.00th=[ 16712], | 70.00th=[ 21627], 80.00th=[ 26870], 90.00th=[ 35914], 95.00th=[ 44303], | 99.00th=[ 61604], 99.50th=[ 83362], 99.90th=[173016], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 8, max= 288, per=24.88%, avg=113.96, stdev=36.98, samples=108 iops : min= 2, max= 72, avg=28.09, stdev= 9.31, samples=108 lat (usec) : 50=0.03%, 100=0.72%, 250=1.30%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=1.99%, 4=7.68%, 10=18.68%, 20=34.77%, 50=32.52% lat (msec) : 100=1.86%, 250=0.13%, 1000=0.03% cpu : usr=0.14%, sys=25.38%, ctx=9215, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158954: Tue Jul 14 23:04:58 2026 read: IOPS=28, BW=114KiB/s (116kB/s)(6052KiB/53273msec) clat (usec): min=33, max=699221, avg=17859.50, stdev=20664.74 lat (usec): min=33, max=699222, avg=17861.03, stdev=20664.58 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 151], 10.00th=[ 7111], 20.00th=[ 9503], | 30.00th=[ 11207], 40.00th=[ 13304], 50.00th=[ 15401], 60.00th=[ 18220], | 70.00th=[ 21365], 80.00th=[ 25035], 90.00th=[ 30540], 95.00th=[ 35914], | 99.00th=[ 55313], 99.50th=[ 59507], 99.90th=[120062], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 32, max= 192, per=26.18%, avg=114.41, stdev=26.43, samples=105 iops : min= 8, max= 48, avg=28.20, stdev= 6.60, samples=105 write: IOPS=29, BW=117KiB/s (120kB/s)(6236KiB/53273msec); 0 zone resets clat (usec): min=950, max=94837, avg=16646.67, stdev=13434.70 lat (usec): min=951, max=94839, avg=16649.06, stdev=13435.95 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2376], 10.00th=[ 3195], 20.00th=[ 4359], | 30.00th=[ 6521], 40.00th=[10028], 50.00th=[13435], 60.00th=[17171], | 70.00th=[21627], 80.00th=[27395], 90.00th=[35390], 95.00th=[43254], | 99.00th=[58459], 99.50th=[61604], 99.90th=[81265], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 8, max= 208, per=25.48%, avg=116.72, stdev=37.40, samples=106 iops : min= 2, max= 52, avg=28.77, stdev= 9.33, samples=106 lat (usec) : 50=0.26%, 100=0.98%, 250=2.08%, 500=0.26%, 1000=0.07% lat (msec) : 2=1.40%, 4=7.85%, 10=18.36%, 20=35.64%, 50=31.22% lat (msec) : 100=1.82%, 250=0.03%, 750=0.03% cpu : usr=0.16%, sys=26.03%, ctx=9055, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=438KiB/s (448kB/s), 110KiB/s-114KiB/s (112kB/s-116kB/s), io=23.4MiB (24.6MB), run=53273-54859msec WRITE: bw=458KiB/s (469kB/s), 114KiB/s-117KiB/s (117kB/s-120kB/s), io=24.6MiB (25.7MB), run=53273-54859msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158948: Tue Jul 14 23:05:31 2026 read: IOPS=17, BW=68.9KiB/s (70.5kB/s)(5992KiB/86974msec) clat (msec): min=3, max=689, avg=16.16, stdev=21.66 lat (msec): min=3, max=689, avg=16.16, stdev=21.66 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 42], | 99.00th=[ 69], 99.50th=[ 80], 99.90th=[ 110], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8, max= 176, per=25.12%, avg=69.08, stdev=35.94, samples=172 iops : min= 2, max= 44, avg=16.96, stdev= 9.08, samples=172 write: IOPS=18, BW=72.4KiB/s (74.1kB/s)(6296KiB/86974msec); 0 zone resets clat (msec): min=16, max=229, avg=39.69, stdev=18.58 lat (msec): min=16, max=229, avg=39.69, stdev=18.58 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 64], 95.00th=[ 74], | 99.00th=[ 102], 99.50th=[ 127], 99.90th=[ 188], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 7, max= 143, per=25.16%, avg=72.47, stdev=29.19, samples=172 iops : min= 1, max= 35, avg=17.81, stdev= 7.40, samples=172 lat (msec) : 4=0.20%, 10=20.31%, 20=18.46%, 50=48.50%, 100=11.88% lat (msec) : 250=0.62%, 750=0.03% cpu : usr=0.12%, sys=8.58%, ctx=6135, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158950: Tue Jul 14 23:05:31 2026 read: IOPS=17, BW=68.5KiB/s (70.1kB/s)(5940KiB/86716msec) clat (msec): min=3, max=722, avg=15.93, stdev=22.27 lat (msec): min=3, max=722, avg=15.93, stdev=22.27 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 31], 95.00th=[ 41], | 99.00th=[ 66], 99.50th=[ 81], 99.90th=[ 124], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 192, per=24.94%, avg=68.59, stdev=36.08, samples=171 iops : min= 1, max= 48, avg=16.84, stdev= 9.07, samples=171 write: IOPS=18, BW=73.2KiB/s (74.0kB/s)(6348KiB/86716msec); 0 zone resets clat (msec): min=15, max=227, avg=39.55, stdev=18.63 lat (msec): min=15, max=227, avg=39.55, stdev=18.63 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 45], 80.00th=[ 52], 90.00th=[ 63], 95.00th=[ 73], | 99.00th=[ 97], 99.50th=[ 130], 99.90th=[ 190], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 136, per=25.39%, avg=73.13, stdev=29.79, samples=171 iops : min= 1, max= 34, avg=17.97, stdev= 7.56, samples=171 lat (msec) : 4=0.36%, 10=20.15%, 20=18.95%, 50=47.88%, 100=12.08% lat (msec) : 250=0.55%, 750=0.03% cpu : usr=0.10%, sys=8.58%, ctx=6102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158952: Tue Jul 14 23:05:31 2026 read: IOPS=17, BW=69.2KiB/s (70.9kB/s)(6028KiB/87065msec) clat (msec): min=3, max=217, avg=16.70, stdev=15.48 lat (msec): min=3, max=217, avg=16.70, stdev=15.48 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 46], | 99.00th=[ 71], 99.50th=[ 100], 99.90th=[ 161], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 15, max= 184, per=25.39%, avg=69.81, stdev=35.47, samples=171 iops : min= 3, max= 46, avg=17.15, stdev= 8.95, samples=171 write: IOPS=17, BW=71.9KiB/s (73.6kB/s)(6260KiB/87065msec); 0 zone resets clat (msec): min=15, max=751, avg=39.37, stdev=24.64 lat (msec): min=15, max=751, avg=39.37, stdev=24.64 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 64], 95.00th=[ 72], | 99.00th=[ 93], 99.50th=[ 105], 99.90th=[ 140], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 144, per=24.97%, avg=71.91, stdev=30.11, samples=172 iops : min= 1, max= 36, avg=17.67, stdev= 7.62, samples=172 lat (msec) : 4=0.29%, 10=20.21%, 20=18.59%, 50=48.34%, 100=11.98% lat (msec) : 250=0.55%, 1000=0.03% cpu : usr=0.09%, sys=8.54%, ctx=6167, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158953: Tue Jul 14 23:05:31 2026 read: IOPS=17, BW=69.8KiB/s (71.5kB/s)(6052KiB/86698msec) clat (msec): min=3, max=124, avg=15.90, stdev=13.93 lat (msec): min=3, max=124, avg=15.90, stdev=13.93 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 69], 99.50th=[ 88], 99.90th=[ 120], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 7, max= 200, per=25.50%, avg=70.13, stdev=37.07, samples=170 iops : min= 1, max= 50, avg=17.22, stdev= 9.33, samples=170 write: IOPS=17, BW=71.9KiB/s (73.7kB/s)(6236KiB/86698msec); 0 zone resets clat (msec): min=15, max=734, avg=40.00, stdev=25.61 lat (msec): min=15, max=734, avg=40.00, stdev=25.61 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 65], 95.00th=[ 78], | 99.00th=[ 107], 99.50th=[ 124], 99.90th=[ 144], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 144, per=24.97%, avg=71.91, stdev=30.03, samples=171 iops : min= 1, max= 36, avg=17.67, stdev= 7.62, samples=171 lat (msec) : 4=0.29%, 10=21.29%, 20=18.20%, 50=47.14%, 100=12.24% lat (msec) : 250=0.81%, 750=0.03% cpu : usr=0.12%, sys=8.50%, ctx=6190, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=276KiB/s (282kB/s), 68.5KiB/s-69.8KiB/s (70.1kB/s-71.5kB/s), io=23.4MiB (24.6MB), run=86698-87065msec WRITE: bw=289KiB/s (296kB/s), 71.9KiB/s-73.2KiB/s (73.6kB/s-74.0kB/s), io=24.6MiB (25.7MB), run=86698-87065msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158977: Tue Jul 14 23:05:50 2026 read: IOPS=26, BW=427KiB/s (437kB/s)(5920KiB/13878msec) clat (usec): min=32, max=113544, avg=19664.90, stdev=12778.89 lat (usec): min=32, max=113544, avg=19665.98, stdev=12778.90 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 109], 10.00th=[ 6783], 20.00th=[ 11600], | 30.00th=[ 13960], 40.00th=[ 15533], 50.00th=[ 17957], 60.00th=[ 20317], | 70.00th=[ 23462], 80.00th=[ 26608], 90.00th=[ 31327], 95.00th=[ 40109], | 99.00th=[ 69731], 99.50th=[ 77071], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 256, max= 699, per=24.73%, avg=426.56, stdev=108.46, samples=27 iops : min= 16, max= 43, avg=26.00, stdev= 6.82, samples=27 write: IOPS=28, BW=459KiB/s (470kB/s)(6368KiB/13878msec); 0 zone resets clat (usec): min=1109, max=183880, avg=16488.24, stdev=15007.90 lat (usec): min=1110, max=183881, avg=16490.40, stdev=15007.88 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3752], 10.00th=[ 4293], 20.00th=[ 5276], | 30.00th=[ 6783], 40.00th=[ 9634], 50.00th=[ 12125], 60.00th=[ 15533], | 70.00th=[ 20841], 80.00th=[ 26870], 90.00th=[ 33817], 95.00th=[ 40633], | 99.00th=[ 62129], 99.50th=[ 77071], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 160, max= 699, per=25.44%, avg=461.67, stdev=127.65, samples=27 iops : min= 10, max= 43, avg=28.22, stdev= 7.93, samples=27 lat (usec) : 50=0.26%, 100=1.17%, 250=2.86%, 500=0.13% lat (msec) : 2=0.78%, 4=2.73%, 10=20.70%, 20=34.90%, 50=34.11% lat (msec) : 100=2.08%, 250=0.26% cpu : usr=0.12%, sys=27.61%, ctx=2562, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158978: Tue Jul 14 23:05:50 2026 read: IOPS=25, BW=415KiB/s (425kB/s)(5744KiB/13848msec) clat (usec): min=74, max=170079, avg=19346.03, stdev=14541.99 lat (usec): min=75, max=170080, avg=19347.16, stdev=14542.02 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 117], 10.00th=[ 223], 20.00th=[ 11994], | 30.00th=[ 13960], 40.00th=[ 15926], 50.00th=[ 17957], 60.00th=[ 19792], | 70.00th=[ 22414], 80.00th=[ 25560], 90.00th=[ 31065], 95.00th=[ 38011], | 99.00th=[ 74974], 99.50th=[ 94897], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 160, max= 604, per=23.97%, avg=413.56, stdev=114.68, samples=27 iops : min= 10, max= 37, avg=25.19, stdev= 7.07, samples=27 write: IOPS=29, BW=473KiB/s (484kB/s)(6544KiB/13848msec); 0 zone resets clat (usec): min=1410, max=97621, avg=16684.98, stdev=12986.13 lat (usec): min=1411, max=97624, avg=16687.19, stdev=12986.08 clat percentiles (usec): | 1.00th=[ 2933], 5.00th=[ 3851], 10.00th=[ 4359], 20.00th=[ 5604], | 30.00th=[ 7570], 40.00th=[10159], 50.00th=[13435], 60.00th=[16909], | 70.00th=[20579], 80.00th=[25822], 90.00th=[33424], 95.00th=[42206], | 99.00th=[57410], 99.50th=[71828], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 288, max= 636, per=25.94%, avg=470.85, stdev=73.03, samples=27 iops : min= 18, max= 39, avg=28.78, stdev= 4.53, samples=27 lat (usec) : 100=0.91%, 250=3.91%, 500=0.52% lat (msec) : 2=0.13%, 4=3.26%, 10=18.36%, 20=38.02%, 50=32.68% lat (msec) : 100=2.08%, 250=0.13% cpu : usr=0.11%, sys=28.48%, ctx=2680, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158979: Tue Jul 14 23:05:50 2026 read: IOPS=28, BW=452KiB/s (463kB/s)(6256KiB/13839msec) clat (usec): min=56, max=219859, avg=19175.60, stdev=15759.39 lat (usec): min=57, max=219860, avg=19176.72, stdev=15759.51 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 117], 10.00th=[ 186], 20.00th=[ 10683], | 30.00th=[ 13042], 40.00th=[ 15008], 50.00th=[ 17695], 60.00th=[ 20317], | 70.00th=[ 23200], 80.00th=[ 26084], 90.00th=[ 32113], 95.00th=[ 40109], | 99.00th=[ 61080], 99.50th=[ 99091], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 285, max= 670, per=26.46%, avg=456.48, stdev=94.85, samples=27 iops : min= 17, max= 41, avg=27.89, stdev= 5.82, samples=27 write: IOPS=27, BW=436KiB/s (446kB/s)(6032KiB/13839msec); 0 zone resets clat (usec): min=1451, max=88918, avg=16596.87, stdev=12828.84 lat (usec): min=1454, max=88920, avg=16599.10, stdev=12828.86 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 3654], 10.00th=[ 4228], 20.00th=[ 5407], | 30.00th=[ 7373], 40.00th=[10290], 50.00th=[13173], 60.00th=[17171], | 70.00th=[21627], 80.00th=[25560], 90.00th=[32637], 95.00th=[40633], | 99.00th=[60031], 99.50th=[81265], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 128, max= 766, per=23.75%, avg=431.00, stdev=159.01, samples=27 iops : min= 8, max= 47, avg=26.30, stdev= 9.90, samples=27 lat (usec) : 100=1.17%, 250=4.43%, 500=0.26% lat (msec) : 2=0.52%, 4=3.78%, 10=17.32%, 20=34.51%, 50=35.68% lat (msec) : 100=2.21%, 250=0.13% cpu : usr=0.12%, sys=27.71%, ctx=2647, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158980: Tue Jul 14 23:05:50 2026 read: IOPS=27, BW=448KiB/s (458kB/s)(6032KiB/13478msec) clat (usec): min=44, max=204101, avg=18755.05, stdev=16380.21 lat (usec): min=45, max=204101, avg=18756.08, stdev=16380.07 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 114], 10.00th=[ 155], 20.00th=[ 10028], | 30.00th=[ 13173], 40.00th=[ 14877], 50.00th=[ 17433], 60.00th=[ 19530], | 70.00th=[ 21627], 80.00th=[ 26084], 90.00th=[ 32900], 95.00th=[ 37487], | 99.00th=[ 66847], 99.50th=[122160], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 255, max= 636, per=26.05%, avg=449.42, stdev=106.29, samples=26 iops : min= 15, max= 39, avg=27.46, stdev= 6.61, samples=26 write: IOPS=29, BW=464KiB/s (475kB/s)(6256KiB/13478msec); 0 zone resets clat (usec): min=1599, max=106505, avg=16107.31, stdev=13132.99 lat (usec): min=1601, max=106506, avg=16109.12, stdev=13133.06 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 33], 95.00th=[ 43], | 99.00th=[ 58], 99.50th=[ 67], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 192, max= 768, per=25.67%, avg=465.85, stdev=130.60, samples=26 iops : min= 12, max= 48, avg=28.46, stdev= 8.23, samples=26 lat (usec) : 50=0.13%, 100=1.56%, 250=5.21%, 500=0.52%, 1000=0.13% lat (msec) : 2=0.26%, 4=3.52%, 10=19.92%, 20=35.94%, 50=30.47% lat (msec) : 100=1.95%, 250=0.39% cpu : usr=0.19%, sys=28.17%, ctx=2562, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1726KiB/s (1767kB/s), 415KiB/s-452KiB/s (425kB/s-463kB/s), io=23.4MiB (24.5MB), run=13478-13878msec WRITE: bw=1816KiB/s (1859kB/s), 436KiB/s-473KiB/s (446kB/s-484kB/s), io=24.6MiB (25.8MB), run=13478-13878msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158982: Tue Jul 14 23:06:00 2026 read: IOPS=15, BW=254KiB/s (260kB/s)(5920KiB/23339msec) clat (msec): min=4, max=241, avg=18.60, stdev=19.42 lat (msec): min=4, max=241, avg=18.60, stdev=19.42 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 56], | 99.00th=[ 83], 99.50th=[ 106], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 95, max= 544, per=24.41%, avg=250.41, stdev=118.17, samples=46 iops : min= 5, max= 34, avg=15.07, stdev= 7.55, samples=46 write: IOPS=17, BW=273KiB/s (279kB/s)(6368KiB/23339msec); 0 zone resets clat (msec): min=15, max=138, avg=40.96, stdev=19.61 lat (msec): min=15, max=138, avg=40.96, stdev=19.61 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 54], 90.00th=[ 66], 95.00th=[ 78], | 99.00th=[ 128], 99.50th=[ 131], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 95, max= 542, per=25.15%, avg=271.41, stdev=119.66, samples=46 iops : min= 5, max= 33, avg=16.39, stdev= 7.59, samples=46 lat (msec) : 10=16.02%, 20=21.48%, 50=47.01%, 100=14.06%, 250=1.43% cpu : usr=0.07%, sys=9.24%, ctx=1701, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158983: Tue Jul 14 23:06:00 2026 read: IOPS=15, BW=247KiB/s (253kB/s)(5744KiB/23245msec) clat (usec): min=4067, max=84361, avg=16590.98, stdev=13716.22 lat (usec): min=4068, max=84361, avg=16591.96, stdev=13716.17 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 5800], 10.00th=[ 6521], 20.00th=[ 7832], | 30.00th=[ 9110], 40.00th=[10421], 50.00th=[11994], 60.00th=[13960], | 70.00th=[16057], 80.00th=[20841], 90.00th=[34341], 95.00th=[46400], | 99.00th=[76022], 99.50th=[78119], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 53, max= 512, per=23.97%, avg=245.96, stdev=125.96, samples=46 iops : min= 3, max= 32, avg=14.80, stdev= 7.97, samples=46 write: IOPS=17, BW=282KiB/s (288kB/s)(6544KiB/23245msec); 0 zone resets clat (msec): min=16, max=253, avg=42.16, stdev=22.15 lat (msec): min=16, max=253, avg=42.16, stdev=22.15 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 40], | 70.00th=[ 45], 80.00th=[ 53], 90.00th=[ 67], 95.00th=[ 82], | 99.00th=[ 118], 99.50th=[ 142], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 127, max= 448, per=25.96%, avg=280.13, stdev=100.91, samples=46 iops : min= 7, max= 28, avg=16.93, stdev= 6.44, samples=46 lat (msec) : 10=16.67%, 20=21.09%, 50=48.57%, 100=12.76%, 250=0.78% lat (msec) : 500=0.13% cpu : usr=0.10%, sys=9.04%, ctx=1702, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158984: Tue Jul 14 23:06:00 2026 read: IOPS=17, BW=277KiB/s (283kB/s)(6256KiB/22604msec) clat (msec): min=4, max=142, avg=17.33, stdev=14.13 lat (msec): min=4, max=142, avg=17.33, stdev=14.13 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 22], 90.00th=[ 35], 95.00th=[ 48], | 99.00th=[ 68], 99.50th=[ 73], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 63, max= 793, per=27.01%, avg=277.09, stdev=147.88, samples=44 iops : min= 3, max= 49, avg=16.77, stdev= 9.24, samples=44 write: IOPS=16, BW=267KiB/s (273kB/s)(6032KiB/22604msec); 0 zone resets clat (msec): min=19, max=256, avg=41.63, stdev=20.97 lat (msec): min=19, max=256, avg=41.63, stdev=20.97 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 67], 95.00th=[ 85], | 99.00th=[ 103], 99.50th=[ 126], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 95, max= 480, per=24.41%, avg=263.36, stdev=104.30, samples=44 iops : min= 5, max= 30, avg=15.91, stdev= 6.73, samples=44 lat (msec) : 10=16.54%, 20=22.40%, 50=48.44%, 100=11.98%, 250=0.52% lat (msec) : 500=0.13% cpu : usr=0.11%, sys=9.70%, ctx=1752, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158985: Tue Jul 14 23:06:00 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6032KiB/23093msec) clat (msec): min=4, max=103, avg=17.85, stdev=14.54 lat (msec): min=4, max=103, avg=17.85, stdev=14.54 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 52], | 99.00th=[ 75], 99.50th=[ 80], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 95, max= 574, per=24.89%, avg=255.42, stdev=117.22, samples=45 iops : min= 5, max= 35, avg=15.40, stdev= 7.28, samples=45 write: IOPS=16, BW=271KiB/s (277kB/s)(6256KiB/23093msec); 0 zone resets clat (msec): min=15, max=176, avg=41.59, stdev=19.54 lat (msec): min=15, max=176, avg=41.59, stdev=19.54 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 54], 90.00th=[ 65], 95.00th=[ 83], | 99.00th=[ 105], 99.50th=[ 146], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 95, max= 480, per=24.92%, avg=268.93, stdev=109.20, samples=45 iops : min= 5, max= 30, avg=16.24, stdev= 6.97, samples=45 lat (msec) : 10=16.93%, 20=19.92%, 50=47.40%, 100=14.97%, 250=0.78% cpu : usr=0.09%, sys=9.43%, ctx=1744, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1026KiB/s (1051kB/s), 247KiB/s-277KiB/s (253kB/s-283kB/s), io=23.4MiB (24.5MB), run=22604-23339msec WRITE: bw=1080KiB/s (1106kB/s), 267KiB/s-282KiB/s (273kB/s-288kB/s), io=24.6MiB (25.8MB), run=22604-23339msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158998: Tue Jul 14 23:06:09 2026 read: IOPS=2, BW=2840KiB/s (2908kB/s)(7168KiB/2524msec) clat (msec): min=93, max=423, avg=202.42, stdev=122.15 lat (msec): min=93, max=423, avg=202.42, stdev=122.15 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 102], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 169], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 271], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2048, max= 6131, per=72.08%, avg=3885.33, stdev=2071.90, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=1, BW=2029KiB/s (2077kB/s)(5120KiB/2524msec); 0 zone resets clat (msec): min=91, max=434, avg=215.14, stdev=141.11 lat (msec): min=91, max=434, avg=215.25, stdev=141.11 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2043, max= 4039, per=35.91%, avg=2710.00, stdev=1150.95, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=14.51%, ctx=97, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158999: Tue Jul 14 23:06:09 2026 read: IOPS=0, BW=539KiB/s (552kB/s)(2048KiB/3799msec) clat (usec): min=60344, max=74912, avg=67628.63, stdev=10300.69 lat (usec): min=60347, max=74913, avg=67630.58, stdev=10299.62 clat percentiles (usec): | 1.00th=[60556], 5.00th=[60556], 10.00th=[60556], 20.00th=[60556], | 30.00th=[60556], 40.00th=[60556], 50.00th=[60556], 60.00th=[74974], | 70.00th=[74974], 80.00th=[74974], 90.00th=[74974], 95.00th=[74974], | 99.00th=[74974], 99.50th=[74974], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 1738, max= 2048, per=35.12%, avg=1893.00, stdev=219.20, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2695KiB/s (2760kB/s)(10.0MiB/3799msec); 0 zone resets clat (msec): min=51, max=1169, avg=362.49, stdev=370.39 lat (msec): min=51, max=1170, avg=362.58, stdev=370.38 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 90], | 30.00th=[ 115], 40.00th=[ 117], 50.00th=[ 186], 60.00th=[ 226], | 70.00th=[ 409], 80.00th=[ 418], 90.00th=[ 844], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1738, max= 6144, per=42.51%, avg=3208.00, stdev=1893.44, samples=5 iops : min= 1, max= 6, avg= 2.60, stdev= 2.30, samples=5 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=19.67%, ctx=232, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159000: Tue Jul 14 23:06:09 2026 read: IOPS=1, BW=1808KiB/s (1851kB/s)(6144KiB/3399msec) clat (msec): min=72, max=274, avg=150.81, stdev=89.74 lat (msec): min=72, max=274, avg=150.81, stdev=89.74 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 88], 50.00th=[ 88], 60.00th=[ 150], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2019, max= 4096, per=47.34%, avg=2551.50, stdev=1029.74, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1808KiB/s (1851kB/s)(6144KiB/3399msec); 0 zone resets clat (msec): min=75, max=736, avg=411.68, stdev=244.22 lat (msec): min=75, max=736, avg=411.80, stdev=244.24 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 464], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1741, max= 2048, per=26.23%, avg=1979.80, stdev=134.03, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=14.07%, ctx=119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159001: Tue Jul 14 23:06:09 2026 read: IOPS=2, BW=2145KiB/s (2196kB/s)(5120KiB/2387msec) clat (msec): min=58, max=370, avg=177.35, stdev=145.79 lat (msec): min=58, max=370, avg=177.35, stdev=145.79 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 71], 40.00th=[ 71], 50.00th=[ 90], 60.00th=[ 90], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2043, max= 6059, per=75.16%, avg=4051.00, stdev=2839.74, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=3003KiB/s (3075kB/s)(7168KiB/2387msec); 0 zone resets clat (msec): min=50, max=533, avg=212.49, stdev=165.99 lat (msec): min=50, max=533, avg=212.63, stdev=165.98 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 83], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 201], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 296], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 2043, max= 5224, per=41.14%, avg=3105.00, stdev=1835.11, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 lat (msec) : 100=41.67%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=14.46%, ctx=172, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5391KiB/s (5520kB/s), 539KiB/s-2840KiB/s (552kB/s-2908kB/s), io=20.0MiB (20.0MB), run=2387-3799msec WRITE: bw=7547KiB/s (7728kB/s), 1808KiB/s-3003KiB/s (1851kB/s-3075kB/s), io=28.0MiB (29.4MB), run=2387-3799msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159003: Tue Jul 14 23:06:09 2026 read: IOPS=2, BW=2185KiB/s (2237kB/s)(7168KiB/3281msec) clat (msec): min=144, max=414, avg=228.77, stdev=88.57 lat (msec): min=144, max=414, avg=228.77, stdev=88.57 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 169], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 213], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 236], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1744, max= 4023, per=52.95%, avg=2950.50, stdev=1226.67, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1560KiB/s (1598kB/s)(5120KiB/3281msec); 0 zone resets clat (msec): min=115, max=495, avg=318.19, stdev=166.34 lat (msec): min=115, max=495, avg=318.32, stdev=166.30 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1950, max= 4096, per=32.32%, avg=2521.25, stdev=1050.52, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.03%, sys=44.12%, ctx=903, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159004: Tue Jul 14 23:06:09 2026 read: IOPS=0, BW=574KiB/s (588kB/s)(2048KiB/3566msec) clat (msec): min=82, max=198, avg=140.72, stdev=82.38 lat (msec): min=82, max=198, avg=140.72, stdev=82.38 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1723, max= 1950, per=32.96%, avg=1836.50, stdev=160.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2872KiB/s (2940kB/s)(10.0MiB/3566msec); 0 zone resets clat (msec): min=162, max=638, avg=326.53, stdev=128.34 lat (msec): min=162, max=638, avg=326.67, stdev=128.35 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 203], | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 317], 60.00th=[ 321], | 70.00th=[ 334], 80.00th=[ 351], 90.00th=[ 384], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1723, max= 4096, per=33.82%, avg=2638.50, stdev=1106.41, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=58.33%, 750=8.33% cpu : usr=0.08%, sys=40.62%, ctx=500, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159005: Tue Jul 14 23:06:09 2026 read: IOPS=1, BW=1672KiB/s (1712kB/s)(6144KiB/3675msec) clat (usec): min=559, max=379418, avg=136810.27, stdev=150206.26 lat (usec): min=560, max=379421, avg=136811.62, stdev=150206.50 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 47449], 50.00th=[ 47449], 60.00th=[166724], | 70.00th=[225444], 80.00th=[225444], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 1950, max= 4087, per=45.05%, avg=2510.00, stdev=1051.64, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1672KiB/s (1712kB/s)(6144KiB/3675msec); 0 zone resets clat (msec): min=108, max=826, avg=466.87, stdev=305.93 lat (msec): min=108, max=827, avg=466.94, stdev=305.94 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 558], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1747, max= 3984, per=30.22%, avg=2357.20, stdev=917.16, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=29.83%, ctx=400, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159006: Tue Jul 14 23:06:09 2026 read: IOPS=1, BW=1718KiB/s (1759kB/s)(5120KiB/2980msec) clat (usec): min=866, max=211501, avg=105713.52, stdev=99561.18 lat (usec): min=868, max=211502, avg=105714.96, stdev=99560.72 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 865], 10.00th=[ 865], 20.00th=[ 865], | 30.00th=[ 1450], 40.00th=[ 1450], 50.00th=[132645], 60.00th=[132645], | 70.00th=[181404], 80.00th=[181404], 90.00th=[210764], 95.00th=[210764], | 99.00th=[210764], 99.50th=[210764], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 3900, max= 4096, per=71.75%, avg=3998.00, stdev=138.59, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2405KiB/s (2463kB/s)(7168KiB/2980msec); 0 zone resets clat (msec): min=157, max=598, avg=341.02, stdev=150.40 lat (msec): min=157, max=598, avg=341.10, stdev=150.42 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 167], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 342], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 397], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1765, max= 2048, per=25.05%, avg=1954.00, stdev=111.34, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=42.30%, ctx=399, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5573KiB/s (5707kB/s), 574KiB/s-2185KiB/s (588kB/s-2237kB/s), io=20.0MiB (20.0MB), run=2980-3675msec WRITE: bw=7802KiB/s (7989kB/s), 1560KiB/s-2872KiB/s (1598kB/s-2940kB/s), io=28.0MiB (29.4MB), run=2980-3675msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159012: Tue Jul 14 23:06:19 2026 read: IOPS=1, BW=7416KiB/s (7594kB/s)(12.0MiB/1657msec) clat (msec): min=427, max=588, avg=522.82, stdev=84.92 lat (msec): min=427, max=588, avg=522.82, stdev=84.92 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8192, max= 8192, per=83.70%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=47.34%, ctx=2404, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159013: Tue Jul 14 23:06:19 2026 read: IOPS=0, BW=2447KiB/s (2506kB/s)(4096KiB/1674msec) clat (nsec): min=590044k, max=590044k, avg=590043986.00, stdev= 0.00 lat (nsec): min=590048k, max=590048k, avg=590047984.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8192, max= 8192, per=83.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4894KiB/s (5011kB/s)(8192KiB/1674msec); 0 zone resets clat (msec): min=244, max=749, avg=496.85, stdev=357.41 lat (msec): min=244, max=749, avg=497.13, stdev=357.44 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8192, max= 8192, per=50.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=28.21%, ctx=799, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159014: Tue Jul 14 23:06:19 2026 write: IOPS=1, BW=6068KiB/s (6214kB/s)(12.0MiB/2025msec); 0 zone resets clat (msec): min=452, max=778, avg=645.58, stdev=170.88 lat (msec): min=453, max=779, avg=645.92, stdev=170.84 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8192, max= 8192, per=50.63%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=29.40%, ctx=283, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159015: Tue Jul 14 23:06:19 2026 write: IOPS=1, BW=7148KiB/s (7320kB/s)(12.0MiB/1719msec); 0 zone resets clat (msec): min=174, max=1156, avg=539.76, stdev=536.80 lat (msec): min=174, max=1156, avg=540.07, stdev=536.77 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7757, max= 8192, per=49.28%, avg=7974.50, stdev=307.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=20.02%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9787KiB/s (10.0MB/s), 2447KiB/s-7416KiB/s (2506kB/s-7594kB/s), io=16.0MiB (16.8MB), run=1657-1674msec WRITE: bw=15.8MiB/s (16.6MB/s), 4894KiB/s-7148KiB/s (5011kB/s-7320kB/s), io=32.0MiB (33.6MB), run=1674-2025msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159017: Tue Jul 14 23:06:19 2026 read: IOPS=1, BW=6086KiB/s (6232kB/s)(12.0MiB/2019msec) clat (msec): min=218, max=960, avg=667.81, stdev=395.33 lat (msec): min=218, max=960, avg=667.81, stdev=395.33 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.08%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159018: Tue Jul 14 23:06:19 2026 read: IOPS=0, BW=1887KiB/s (1932kB/s)(4096KiB/2171msec) clat (nsec): min=1220.4M, max=1220.4M, avg=1220397157.00, stdev= 0.00 lat (nsec): min=1220.4M, max=1220.4M, avg=1220399840.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3773KiB/s (3864kB/s)(8192KiB/2171msec); 0 zone resets clat (msec): min=350, max=495, avg=422.94, stdev=102.28 lat (msec): min=351, max=495, avg=423.42, stdev=102.34 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 8015, max= 8015, per=53.10%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=17.28%, ctx=116, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159019: Tue Jul 14 23:06:19 2026 write: IOPS=1, BW=5660KiB/s (5796kB/s)(12.0MiB/2171msec); 0 zone resets clat (msec): min=147, max=1050, avg=710.31, stdev=491.24 lat (msec): min=147, max=1050, avg=710.65, stdev=491.39 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8192, max= 8192, per=54.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.17%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159020: Tue Jul 14 23:06:19 2026 write: IOPS=1, BW=6763KiB/s (6925kB/s)(12.0MiB/1817msec); 0 zone resets clat (msec): min=163, max=1247, avg=593.07, stdev=576.01 lat (msec): min=163, max=1247, avg=593.37, stdev=576.00 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min=11160, max=11160, per=73.94%, avg=11160.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=19.60%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7547KiB/s (7728kB/s), 1887KiB/s-6086KiB/s (1932kB/s-6232kB/s), io=16.0MiB (16.8MB), run=2019-2171msec WRITE: bw=14.7MiB/s (15.5MB/s), 3773KiB/s-6763KiB/s (3864kB/s-6925kB/s), io=32.0MiB (33.6MB), run=1817-2171msec