== sanity test 398b: DIO and buffer IO race ============== 20:57:57 (1763344677) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.84813 s, 10.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183244: Sun Nov 16 20:59:44 2025 read: IOPS=16, BW=65.2KiB/s (66.8kB/s)(5992KiB/91868msec) clat (usec): min=117, max=528265, avg=33960.92, stdev=24056.06 lat (usec): min=118, max=528266, avg=33964.01, stdev=24056.64 clat percentiles (usec): | 1.00th=[ 161], 5.00th=[ 9896], 10.00th=[ 13698], 20.00th=[ 18482], | 30.00th=[ 22152], 40.00th=[ 25560], 50.00th=[ 30016], 60.00th=[ 34341], | 70.00th=[ 40633], 80.00th=[ 46924], 90.00th=[ 57410], 95.00th=[ 67634], | 99.00th=[104334], 99.50th=[139461], 99.90th=[170918], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 8, max= 120, per=24.85%, avg=64.61, stdev=21.02, samples=181 iops : min= 2, max= 30, avg=15.54, stdev= 5.28, samples=181 write: IOPS=17, BW=68.5KiB/s (70.2kB/s)(6296KiB/91868msec); 0 zone resets clat (usec): min=923, max=193113, avg=25805.52, stdev=25952.16 lat (usec): min=924, max=193115, avg=25816.47, stdev=25946.19 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1205], 10.00th=[ 1418], 20.00th=[ 3032], | 30.00th=[ 6259], 40.00th=[ 13829], 50.00th=[ 19268], 60.00th=[ 24773], | 70.00th=[ 32113], 80.00th=[ 44303], 90.00th=[ 61080], 95.00th=[ 77071], | 99.00th=[109577], 99.50th=[129500], 99.90th=[181404], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 7, max= 159, per=24.99%, avg=67.96, stdev=28.26, samples=181 iops : min= 1, max= 39, avg=16.37, stdev= 7.11, samples=181 lat (usec) : 250=1.40%, 500=0.33%, 750=0.03%, 1000=0.20% lat (msec) : 2=7.29%, 4=4.62%, 10=6.67%, 20=17.45%, 50=45.74% lat (msec) : 100=15.01%, 250=1.24%, 750=0.03% cpu : usr=0.10%, sys=8.51%, ctx=6811, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183245: Sun Nov 16 20:59:44 2025 read: IOPS=16, BW=64.5KiB/s (66.0kB/s)(5940KiB/92158msec) clat (usec): min=135, max=193919, avg=35273.74, stdev=22630.85 lat (usec): min=136, max=193920, avg=35275.08, stdev=22630.92 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 11600], 10.00th=[ 14222], 20.00th=[ 18220], | 30.00th=[ 22152], 40.00th=[ 25822], 50.00th=[ 30540], 60.00th=[ 35390], | 70.00th=[ 41681], 80.00th=[ 50070], 90.00th=[ 60031], 95.00th=[ 76022], | 99.00th=[116917], 99.50th=[135267], 99.90th=[189793], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 23, max= 135, per=24.73%, avg=64.31, stdev=22.57, samples=181 iops : min= 5, max= 33, avg=15.46, stdev= 5.67, samples=181 write: IOPS=17, BW=68.9KiB/s (70.5kB/s)(6348KiB/92158msec); 0 zone resets clat (usec): min=848, max=516695, avg=24843.60, stdev=28372.70 lat (usec): min=849, max=516696, avg=24845.19, stdev=28372.70 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 2409], | 30.00th=[ 5080], 40.00th=[ 11469], 50.00th=[ 18482], 60.00th=[ 24249], | 70.00th=[ 31065], 80.00th=[ 42206], 90.00th=[ 60031], 95.00th=[ 74974], | 99.00th=[112722], 99.50th=[131597], 99.90th=[196084], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 15, max= 144, per=25.13%, avg=68.36, stdev=26.03, samples=182 iops : min= 3, max= 36, avg=16.49, stdev= 6.57, samples=182 lat (usec) : 250=0.98%, 500=0.39%, 750=0.07%, 1000=0.23% lat (msec) : 2=8.85%, 4=4.33%, 10=6.80%, 20=17.42%, 50=43.82% lat (msec) : 100=15.20%, 250=1.89%, 750=0.03% cpu : usr=0.12%, sys=8.52%, ctx=6763, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183246: Sun Nov 16 20:59:44 2025 read: IOPS=16, BW=65.7KiB/s (67.2kB/s)(6028KiB/91791msec) clat (usec): min=101, max=218714, avg=34518.12, stdev=21975.04 lat (usec): min=102, max=218715, avg=34524.08, stdev=21977.69 clat percentiles (usec): | 1.00th=[ 155], 5.00th=[ 10290], 10.00th=[ 14091], 20.00th=[ 18220], | 30.00th=[ 21890], 40.00th=[ 25822], 50.00th=[ 29754], 60.00th=[ 35390], | 70.00th=[ 40633], 80.00th=[ 47973], 90.00th=[ 60031], 95.00th=[ 70779], | 99.00th=[109577], 99.50th=[132645], 99.90th=[173016], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 127, per=25.10%, avg=65.26, stdev=23.25, samples=181 iops : min= 1, max= 31, avg=15.70, stdev= 5.86, samples=181 write: IOPS=17, BW=68.2KiB/s (69.8kB/s)(6260KiB/91791msec); 0 zone resets clat (usec): min=932, max=519468, avg=25188.95, stdev=28352.36 lat (usec): min=932, max=519468, avg=25202.36, stdev=28365.17 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1237], 10.00th=[ 1401], 20.00th=[ 2409], | 30.00th=[ 5407], 40.00th=[ 12125], 50.00th=[ 18482], 60.00th=[ 24249], | 70.00th=[ 31851], 80.00th=[ 42730], 90.00th=[ 60031], 95.00th=[ 72877], | 99.00th=[113771], 99.50th=[129500], 99.90th=[183501], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 15, max= 178, per=24.88%, avg=67.68, stdev=28.16, samples=181 iops : min= 3, max= 44, avg=16.31, stdev= 7.07, samples=181 lat (usec) : 250=1.24%, 500=0.46%, 750=0.03%, 1000=0.16% lat (msec) : 2=8.69%, 4=4.69%, 10=6.18%, 20=17.15%, 50=44.99% lat (msec) : 100=14.68%, 250=1.69%, 750=0.03% cpu : usr=0.12%, sys=8.41%, ctx=6684, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183247: Sun Nov 16 20:59:44 2025 read: IOPS=16, BW=65.0KiB/s (67.6kB/s)(6052KiB/91698msec) clat (usec): min=126, max=216170, avg=34223.06, stdev=21570.78 lat (usec): min=126, max=216171, avg=34224.41, stdev=21570.76 clat percentiles (usec): | 1.00th=[ 157], 5.00th=[ 8979], 10.00th=[ 13829], 20.00th=[ 18220], | 30.00th=[ 21627], 40.00th=[ 25822], 50.00th=[ 30016], 60.00th=[ 35390], | 70.00th=[ 40633], 80.00th=[ 47973], 90.00th=[ 60031], 95.00th=[ 71828], | 99.00th=[110625], 99.50th=[137364], 99.90th=[152044], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 160, per=25.36%, avg=65.93, stdev=22.19, samples=180 iops : min= 1, max= 40, avg=15.87, stdev= 5.61, samples=180 write: IOPS=17, BW=68.0KiB/s (69.6kB/s)(6236KiB/91698msec); 0 zone resets clat (usec): min=888, max=502139, avg=25386.71, stdev=28648.66 lat (usec): min=889, max=502141, avg=25391.40, stdev=28647.17 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1369], 20.00th=[ 2671], | 30.00th=[ 5604], 40.00th=[ 12387], 50.00th=[ 19006], 60.00th=[ 25035], | 70.00th=[ 32113], 80.00th=[ 42730], 90.00th=[ 58983], 95.00th=[ 71828], | 99.00th=[120062], 99.50th=[154141], 99.90th=[229639], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 7, max= 136, per=24.82%, avg=67.52, stdev=25.87, samples=181 iops : min= 1, max= 34, avg=16.27, stdev= 6.51, samples=181 lat (usec) : 250=1.43%, 500=0.46%, 1000=0.26% lat (msec) : 2=8.17%, 4=4.85%, 10=6.25%, 20=17.55%, 50=44.66% lat (msec) : 100=14.84%, 250=1.50%, 750=0.03% cpu : usr=0.10%, sys=8.40%, ctx=6743, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=261KiB/s (267kB/s), 64.5KiB/s-65.0KiB/s (66.0kB/s-67.6kB/s), io=23.4MiB (24.6MB), run=91698-92158msec WRITE: bw=273KiB/s (279kB/s), 68.0KiB/s-68.9KiB/s (69.6kB/s-70.5kB/s), io=24.6MiB (25.7MB), run=91698-92158msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183249: Sun Nov 16 21:00:17 2025 read: IOPS=12, BW=48.3KiB/s (49.4kB/s)(5992KiB/124173msec) clat (msec): min=5, max=730, avg=32.11, stdev=33.39 lat (msec): min=5, max=730, avg=32.12, stdev=33.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 69], 95.00th=[ 87], | 99.00th=[ 142], 99.50th=[ 165], 99.90th=[ 321], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 174, per=25.42%, avg=48.55, stdev=30.84, samples=241 iops : min= 1, max= 43, avg=11.49, stdev= 7.76, samples=241 write: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6296KiB/124173msec); 0 zone resets clat (msec): min=7, max=254, avg=48.24, stdev=32.58 lat (msec): min=7, max=254, avg=48.25, stdev=32.58 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 70], 90.00th=[ 91], 95.00th=[ 109], | 99.00th=[ 171], 99.50th=[ 203], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 151, per=25.30%, avg=50.60, stdev=28.75, samples=243 iops : min= 1, max= 37, avg=12.00, stdev= 7.22, samples=243 lat (msec) : 10=4.52%, 20=23.34%, 50=46.03%, 100=20.74%, 250=5.24% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.10%, sys=2.86%, ctx=4884, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183250: Sun Nov 16 21:00:17 2025 read: IOPS=11, BW=47.6KiB/s (48.7kB/s)(5940KiB/124811msec) clat (msec): min=5, max=557, avg=32.37, stdev=31.12 lat (msec): min=5, max=557, avg=32.37, stdev=31.12 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 72], 95.00th=[ 91], | 99.00th=[ 142], 99.50th=[ 167], 99.90th=[ 201], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 6, max= 159, per=24.92%, avg=47.59, stdev=31.19, samples=243 iops : min= 1, max= 39, avg=11.24, stdev= 7.83, samples=243 write: IOPS=12, BW=50.9KiB/s (52.1kB/s)(6348KiB/124811msec); 0 zone resets clat (msec): min=8, max=261, avg=48.25, stdev=32.29 lat (msec): min=8, max=261, avg=48.25, stdev=32.29 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 69], 90.00th=[ 90], 95.00th=[ 111], | 99.00th=[ 174], 99.50th=[ 197], 99.90th=[ 236], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 134, per=25.22%, avg=50.43, stdev=28.55, samples=245 iops : min= 1, max= 33, avg=11.95, stdev= 7.18, samples=245 lat (msec) : 10=5.73%, 20=22.62%, 50=44.14%, 100=22.53%, 250=4.92% lat (msec) : 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=2.90%, ctx=4977, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183251: Sun Nov 16 21:00:17 2025 read: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6028KiB/125163msec) clat (msec): min=4, max=218, avg=32.34, stdev=27.41 lat (msec): min=4, max=218, avg=32.35, stdev=27.41 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 71], 95.00th=[ 89], | 99.00th=[ 132], 99.50th=[ 150], 99.90th=[ 201], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 7, max= 166, per=25.12%, avg=47.99, stdev=29.65, samples=245 iops : min= 1, max= 41, avg=11.33, stdev= 7.46, samples=245 write: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6260KiB/125163msec); 0 zone resets clat (msec): min=8, max=571, avg=48.76, stdev=35.20 lat (msec): min=8, max=571, avg=48.76, stdev=35.20 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 70], 90.00th=[ 91], 95.00th=[ 111], | 99.00th=[ 165], 99.50th=[ 224], 99.90th=[ 275], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 158, per=24.66%, avg=49.32, stdev=29.76, samples=247 iops : min= 1, max= 39, avg=11.68, stdev= 7.47, samples=247 lat (msec) : 10=4.92%, 20=22.69%, 50=44.47%, 100=22.36%, 250=5.47% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=2.90%, ctx=4974, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183252: Sun Nov 16 21:00:17 2025 read: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6052KiB/123745msec) clat (msec): min=5, max=315, avg=31.67, stdev=26.45 lat (msec): min=5, max=315, avg=31.67, stdev=26.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 68], 95.00th=[ 89], | 99.00th=[ 120], 99.50th=[ 138], 99.90th=[ 163], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 158, per=25.79%, avg=49.26, stdev=30.67, samples=240 iops : min= 1, max= 39, avg=11.65, stdev= 7.70, samples=240 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6236KiB/123745msec); 0 zone resets clat (msec): min=9, max=581, avg=48.58, stdev=35.04 lat (msec): min=9, max=581, avg=48.58, stdev=35.04 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 70], 90.00th=[ 91], 95.00th=[ 109], | 99.00th=[ 165], 99.50th=[ 211], 99.90th=[ 259], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 6, max= 151, per=24.93%, avg=49.86, stdev=29.10, samples=244 iops : min= 1, max= 37, avg=11.80, stdev= 7.31, samples=244 lat (msec) : 10=4.62%, 20=23.99%, 50=44.21%, 100=21.84%, 250=5.24% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=2.90%, ctx=4961, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=192KiB/s (196kB/s), 47.6KiB/s-48.9KiB/s (48.7kB/s-50.1kB/s), io=23.4MiB (24.6MB), run=123745-125163msec WRITE: bw=201KiB/s (206kB/s), 50.0KiB/s-50.9KiB/s (51.2kB/s-52.1kB/s), io=24.6MiB (25.7MB), run=123745-125163msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183295: Sun Nov 16 21:00:51 2025 read: IOPS=14, BW=233KiB/s (239kB/s)(5920KiB/25396msec) clat (usec): min=130, max=243108, avg=36631.84, stdev=25630.51 lat (usec): min=131, max=243109, avg=36633.10, stdev=25630.53 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 192], 10.00th=[ 11338], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 28181], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 43779], 80.00th=[ 51119], 90.00th=[ 62653], 95.00th=[ 77071], | 99.00th=[135267], 99.50th=[164627], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 63, max= 382, per=24.39%, avg=229.29, stdev=79.51, samples=49 iops : min= 3, max= 23, avg=13.61, stdev= 5.03, samples=49 write: IOPS=15, BW=251KiB/s (257kB/s)(6368KiB/25396msec); 0 zone resets clat (usec): min=1390, max=191273, avg=29644.88, stdev=29128.31 lat (usec): min=1391, max=191275, avg=29653.46, stdev=29124.25 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1729], 10.00th=[ 2040], 20.00th=[ 5342], | 30.00th=[ 9634], 40.00th=[ 14746], 50.00th=[ 21103], 60.00th=[ 28443], | 70.00th=[ 36963], 80.00th=[ 49021], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[130548], 99.50th=[179307], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 95, max= 574, per=25.36%, avg=250.78, stdev=92.58, samples=49 iops : min= 5, max= 35, avg=14.96, stdev= 5.83, samples=49 lat (usec) : 250=3.26%, 500=0.65%, 1000=0.13% lat (msec) : 2=5.08%, 4=3.78%, 10=7.16%, 20=14.58%, 50=44.79% lat (msec) : 100=18.62%, 250=1.95% cpu : usr=0.10%, sys=9.10%, ctx=1813, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183296: Sun Nov 16 21:00:51 2025 read: IOPS=14, BW=226KiB/s (231kB/s)(5744KiB/25467msec) clat (usec): min=118, max=129325, avg=36838.72, stdev=22202.57 lat (usec): min=118, max=129326, avg=36840.00, stdev=22202.70 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 212], 10.00th=[ 13042], 20.00th=[ 20055], | 30.00th=[ 24511], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 45351], 80.00th=[ 54264], 90.00th=[ 65274], 95.00th=[ 76022], | 99.00th=[106431], 99.50th=[120062], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 44, max= 448, per=24.08%, avg=226.39, stdev=85.43, samples=49 iops : min= 2, max= 28, avg=13.43, stdev= 5.44, samples=49 write: IOPS=16, BW=257KiB/s (263kB/s)(6544KiB/25467msec); 0 zone resets clat (usec): min=1289, max=198093, avg=29783.85, stdev=27809.00 lat (usec): min=1291, max=198093, avg=29786.21, stdev=27808.95 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1795], 10.00th=[ 2180], 20.00th=[ 5080], | 30.00th=[ 10421], 40.00th=[ 16712], 50.00th=[ 23462], 60.00th=[ 29492], | 70.00th=[ 39060], 80.00th=[ 50594], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[117965], 99.50th=[133694], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 94, max= 440, per=25.65%, avg=253.69, stdev=87.12, samples=49 iops : min= 5, max= 27, avg=15.14, stdev= 5.50, samples=49 lat (usec) : 250=2.34%, 500=0.65%, 1000=0.13% lat (msec) : 2=4.69%, 4=4.82%, 10=6.51%, 20=14.58%, 50=43.88% lat (msec) : 100=20.31%, 250=2.08% cpu : usr=0.12%, sys=8.91%, ctx=1743, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183297: Sun Nov 16 21:00:51 2025 read: IOPS=15, BW=247KiB/s (253kB/s)(6256KiB/25312msec) clat (usec): min=111, max=142398, avg=36172.80, stdev=22147.87 lat (usec): min=111, max=142400, avg=36174.17, stdev=22147.94 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 182], 10.00th=[ 11076], 20.00th=[ 20579], | 30.00th=[ 25822], 40.00th=[ 28967], 50.00th=[ 32637], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 64750], 95.00th=[ 71828], | 99.00th=[110625], 99.50th=[127402], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 95, max= 509, per=26.53%, avg=249.43, stdev=80.11, samples=49 iops : min= 5, max= 31, avg=14.88, stdev= 5.02, samples=49 write: IOPS=14, BW=238KiB/s (244kB/s)(6032KiB/25312msec); 0 zone resets clat (usec): min=1527, max=184523, avg=29495.36, stdev=28720.60 lat (usec): min=1530, max=184525, avg=29498.03, stdev=28720.76 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1778], 10.00th=[ 2147], 20.00th=[ 4686], | 30.00th=[ 9896], 40.00th=[ 16057], 50.00th=[ 22676], 60.00th=[ 27132], | 70.00th=[ 36963], 80.00th=[ 50070], 90.00th=[ 67634], 95.00th=[ 85459], | 99.00th=[128451], 99.50th=[156238], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 94, max= 415, per=23.87%, avg=236.10, stdev=72.46, samples=49 iops : min= 5, max= 25, avg=14.04, stdev= 4.58, samples=49 lat (usec) : 250=2.99%, 500=1.30% lat (msec) : 2=4.56%, 4=4.43%, 10=6.38%, 20=12.24%, 50=46.88% lat (msec) : 100=18.62%, 250=2.60% cpu : usr=0.15%, sys=8.86%, ctx=1779, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183298: Sun Nov 16 21:00:51 2025 read: IOPS=15, BW=242KiB/s (248kB/s)(6032KiB/24900msec) clat (usec): min=131, max=176990, avg=36129.00, stdev=24992.35 lat (usec): min=131, max=176991, avg=36133.29, stdev=24993.78 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 172], 10.00th=[ 1582], 20.00th=[ 17695], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 51643], 90.00th=[ 65274], 95.00th=[ 83362], | 99.00th=[111674], 99.50th=[168821], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 94, max= 407, per=25.41%, avg=238.83, stdev=73.34, samples=48 iops : min= 5, max= 25, avg=14.23, stdev= 4.64, samples=48 write: IOPS=15, BW=251KiB/s (257kB/s)(6256KiB/24900msec); 0 zone resets clat (usec): min=1211, max=190675, avg=28679.54, stdev=28455.95 lat (usec): min=1213, max=190677, avg=28682.19, stdev=28455.60 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1729], 10.00th=[ 2057], 20.00th=[ 3687], | 30.00th=[ 8094], 40.00th=[ 13960], 50.00th=[ 22152], 60.00th=[ 28705], | 70.00th=[ 35390], 80.00th=[ 50070], 90.00th=[ 62653], 95.00th=[ 80217], | 99.00th=[116917], 99.50th=[162530], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 125, max= 537, per=25.19%, avg=249.10, stdev=98.14, samples=48 iops : min= 7, max= 33, avg=14.87, stdev= 6.23, samples=48 lat (usec) : 250=4.04%, 500=0.39%, 1000=0.26% lat (msec) : 2=4.82%, 4=6.38%, 10=7.29%, 20=13.02%, 50=43.10% lat (msec) : 100=17.84%, 250=2.86% cpu : usr=0.09%, sys=8.54%, ctx=1737, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=941KiB/s (963kB/s), 226KiB/s-247KiB/s (231kB/s-253kB/s), io=23.4MiB (24.5MB), run=24900-25467msec WRITE: bw=990KiB/s (1013kB/s), 238KiB/s-257KiB/s (244kB/s-263kB/s), io=24.6MiB (25.8MB), run=24900-25467msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183290: Sun Nov 16 21:01:02 2025 read: IOPS=10, BW=162KiB/s (166kB/s)(5920KiB/36448msec) clat (msec): min=7, max=182, avg=39.01, stdev=27.68 lat (msec): min=7, max=182, avg=39.01, stdev=27.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 54], 90.00th=[ 77], 95.00th=[ 90], | 99.00th=[ 144], 99.50th=[ 165], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 414, per=24.77%, avg=161.76, stdev=82.36, samples=72 iops : min= 1, max= 25, avg= 9.32, stdev= 5.23, samples=72 write: IOPS=10, BW=175KiB/s (179kB/s)(6368KiB/36448msec); 0 zone resets clat (msec): min=12, max=225, avg=55.14, stdev=34.62 lat (msec): min=12, max=225, avg=55.15, stdev=34.62 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 62], 80.00th=[ 73], 90.00th=[ 99], 95.00th=[ 122], | 99.00th=[ 207], 99.50th=[ 222], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 63, max= 352, per=25.34%, avg=174.11, stdev=71.71, samples=72 iops : min= 3, max= 22, avg=10.10, stdev= 4.55, samples=72 lat (msec) : 10=1.56%, 20=12.63%, 50=50.78%, 100=28.26%, 250=6.77% cpu : usr=0.08%, sys=2.55%, ctx=1226, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183291: Sun Nov 16 21:01:02 2025 read: IOPS=9, BW=159KiB/s (163kB/s)(5744KiB/36145msec) clat (msec): min=6, max=146, avg=34.69, stdev=23.65 lat (msec): min=6, max=146, avg=34.69, stdev=23.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 70], 95.00th=[ 83], | 99.00th=[ 124], 99.50th=[ 127], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 31, max= 478, per=25.26%, avg=164.96, stdev=90.65, samples=68 iops : min= 1, max= 29, avg= 9.51, stdev= 5.78, samples=68 write: IOPS=11, BW=181KiB/s (185kB/s)(6544KiB/36145msec); 0 zone resets clat (msec): min=10, max=229, avg=57.45, stdev=35.11 lat (msec): min=10, max=229, avg=57.47, stdev=35.11 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 66], 80.00th=[ 81], 90.00th=[ 107], 95.00th=[ 121], | 99.00th=[ 174], 99.50th=[ 218], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 62, max= 447, per=26.23%, avg=180.18, stdev=75.32, samples=71 iops : min= 3, max= 27, avg=10.48, stdev= 4.78, samples=71 lat (msec) : 10=1.69%, 20=13.93%, 50=49.87%, 100=27.21%, 250=7.29% cpu : usr=0.05%, sys=2.84%, ctx=1260, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183292: Sun Nov 16 21:01:02 2025 read: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36301msec) clat (msec): min=6, max=181, avg=38.95, stdev=28.71 lat (msec): min=6, max=181, avg=38.96, stdev=28.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 79], 95.00th=[ 99], | 99.00th=[ 146], 99.50th=[ 180], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 31, max= 440, per=26.42%, avg=172.55, stdev=94.06, samples=71 iops : min= 1, max= 27, avg=10.00, stdev= 5.96, samples=71 write: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36301msec); 0 zone resets clat (msec): min=13, max=237, avg=55.39, stdev=34.18 lat (msec): min=13, max=237, avg=55.39, stdev=34.18 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 26], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 62], 80.00th=[ 79], 90.00th=[ 101], 95.00th=[ 131], | 99.00th=[ 174], 99.50th=[ 199], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 415, per=23.76%, avg=163.24, stdev=76.05, samples=71 iops : min= 1, max= 25, avg= 9.41, stdev= 4.81, samples=71 lat (msec) : 10=1.30%, 20=13.80%, 50=52.08%, 100=25.78%, 250=7.03% cpu : usr=0.05%, sys=2.81%, ctx=1243, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183293: Sun Nov 16 21:01:02 2025 read: IOPS=10, BW=165KiB/s (169kB/s)(6032KiB/36655msec) clat (msec): min=7, max=182, avg=40.14, stdev=30.78 lat (msec): min=7, max=182, avg=40.14, stdev=30.78 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 81], 95.00th=[ 105], | 99.00th=[ 157], 99.50th=[ 171], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 29, max= 351, per=24.79%, avg=161.88, stdev=79.62, samples=72 iops : min= 1, max= 21, avg= 9.32, stdev= 5.03, samples=72 write: IOPS=10, BW=171KiB/s (175kB/s)(6256KiB/36655msec); 0 zone resets clat (msec): min=10, max=227, avg=54.58, stdev=34.08 lat (msec): min=10, max=227, avg=54.58, stdev=34.08 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 62], 80.00th=[ 75], 90.00th=[ 93], 95.00th=[ 115], | 99.00th=[ 207], 99.50th=[ 224], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 31, max= 442, per=24.58%, avg=168.85, stdev=83.94, samples=72 iops : min= 1, max= 27, avg= 9.76, stdev= 5.34, samples=72 lat (msec) : 10=1.04%, 20=14.97%, 50=48.18%, 100=28.91%, 250=6.90% cpu : usr=0.08%, sys=2.67%, ctx=1262, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=653KiB/s (669kB/s), 159KiB/s-172KiB/s (163kB/s-176kB/s), io=23.4MiB (24.5MB), run=36145-36655msec WRITE: bw=687KiB/s (704kB/s), 166KiB/s-181KiB/s (170kB/s-185kB/s), io=24.6MiB (25.8MB), run=36145-36655msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183325: Sun Nov 16 21:01:16 2025 read: IOPS=1, BW=1508KiB/s (1544kB/s)(7168KiB/4754msec) clat (msec): min=184, max=295, avg=232.07, stdev=43.01 lat (msec): min=184, max=295, avg=232.07, stdev=43.01 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 199], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 230], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 284], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 2019, max= 4047, per=65.63%, avg=2704.00, stdev=953.24, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1077KiB/s (1103kB/s)(5120KiB/4754msec); 0 zone resets clat (msec): min=225, max=1479, avg=576.67, stdev=516.71 lat (msec): min=225, max=1480, avg=576.78, stdev=516.72 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 2003, max= 3908, per=45.89%, avg=2647.33, stdev=1091.86, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=15.86%, ctx=257, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183326: Sun Nov 16 21:01:16 2025 read: IOPS=0, BW=425KiB/s (435kB/s)(2048KiB/4817msec) clat (usec): min=936, max=203905, avg=102420.69, stdev=143520.73 lat (usec): min=937, max=203907, avg=102422.70, stdev=143521.56 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 938], 10.00th=[ 938], 20.00th=[ 938], | 30.00th=[ 938], 40.00th=[ 938], 50.00th=[ 938], 60.00th=[204473], | 70.00th=[204473], 80.00th=[204473], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 2035, max= 2035, per=49.39%, avg=2035.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2126KiB/s (2177kB/s)(10.0MiB/4817msec); 0 zone resets clat (msec): min=179, max=979, avg=435.04, stdev=269.95 lat (msec): min=179, max=979, avg=435.41, stdev=270.21 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 184], | 30.00th=[ 192], 40.00th=[ 264], 50.00th=[ 279], 60.00th=[ 456], | 70.00th=[ 472], 80.00th=[ 659], 90.00th=[ 693], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1950, max= 4047, per=44.82%, avg=2585.57, stdev=993.50, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.04%, sys=17.32%, ctx=170, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183327: Sun Nov 16 21:01:16 2025 read: IOPS=1, BW=1236KiB/s (1266kB/s)(6144KiB/4970msec) clat (msec): min=10, max=546, avg=253.64, stdev=181.09 lat (msec): min=10, max=546, avg=253.64, stdev=181.09 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 11], 10.00th=[ 11], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 236], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2015, max= 4079, per=80.92%, avg=3334.00, stdev=1145.48, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1236KiB/s (1266kB/s)(6144KiB/4970msec); 0 zone resets clat (msec): min=133, max=1748, avg=531.65, stdev=615.27 lat (msec): min=133, max=1748, avg=531.75, stdev=615.27 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 397], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1954, max= 2848, per=37.70%, avg=2175.00, stdev=377.56, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 20=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=13.18%, ctx=246, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183328: Sun Nov 16 21:01:16 2025 read: IOPS=1, BW=1331KiB/s (1363kB/s)(5120KiB/3846msec) clat (usec): min=619, max=355372, avg=192062.80, stdev=127839.62 lat (usec): min=621, max=355373, avg=192064.43, stdev=127839.62 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[166724], 40.00th=[166724], 50.00th=[212861], 60.00th=[212861], | 70.00th=[223347], 80.00th=[223347], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 3900, max= 4071, per=96.74%, avg=3985.50, stdev=120.92, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1864KiB/s (1908kB/s)(7168KiB/3846msec); 0 zone resets clat (msec): min=134, max=949, avg=402.10, stdev=280.14 lat (msec): min=134, max=949, avg=402.19, stdev=280.15 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 230], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 275], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 592], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1885, max= 3938, per=40.88%, avg=2358.20, stdev=884.63, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=17.06%, ctx=131, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4121KiB/s (4220kB/s), 425KiB/s-1508KiB/s (435kB/s-1544kB/s), io=20.0MiB (20.0MB), run=3846-4970msec WRITE: bw=5769KiB/s (5907kB/s), 1077KiB/s-2126KiB/s (1103kB/s-2177kB/s), io=28.0MiB (29.4MB), run=3846-4970msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183321: Sun Nov 16 21:01:17 2025 read: IOPS=1, BW=1949KiB/s (1996kB/s)(7168KiB/3677msec) clat (msec): min=69, max=483, avg=252.12, stdev=164.72 lat (msec): min=69, max=483, avg=252.12, stdev=164.72 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 100], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 271], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 426], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1910, max= 4471, per=70.83%, avg=2615.00, stdev=1238.86, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1392KiB/s (1426kB/s)(5120KiB/3677msec); 0 zone resets clat (msec): min=192, max=617, avg=369.91, stdev=176.58 lat (msec): min=192, max=617, avg=370.01, stdev=176.57 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1882, max= 2048, per=38.25%, avg=1977.20, stdev=75.69, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=4.16%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183322: Sun Nov 16 21:01:17 2025 read: IOPS=0, BW=398KiB/s (407kB/s)(2048KiB/5152msec) clat (msec): min=99, max=415, avg=257.48, stdev=224.12 lat (msec): min=99, max=415, avg=257.49, stdev=224.12 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1499, max= 2015, per=47.59%, avg=1757.00, stdev=364.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1988KiB/s (2035kB/s)(10.0MiB/5152msec); 0 zone resets clat (msec): min=100, max=1125, avg=450.70, stdev=352.29 lat (msec): min=100, max=1125, avg=450.82, stdev=352.30 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 106], | 30.00th=[ 132], 40.00th=[ 207], 50.00th=[ 275], 60.00th=[ 514], | 70.00th=[ 575], 80.00th=[ 592], 90.00th=[ 885], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1946, max= 5731, per=61.24%, avg=3165.40, stdev=1690.03, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=6.43%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183323: Sun Nov 16 21:01:17 2025 read: IOPS=1, BW=1227KiB/s (1257kB/s)(6144KiB/5007msec) clat (msec): min=70, max=812, avg=399.10, stdev=270.50 lat (msec): min=70, max=812, avg=399.10, stdev=270.50 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 393], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1882, max= 2039, per=54.20%, avg=2001.20, stdev=66.87, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1227KiB/s (1257kB/s)(6144KiB/5007msec); 0 zone resets clat (msec): min=131, max=1122, avg=430.09, stdev=354.73 lat (msec): min=132, max=1122, avg=430.31, stdev=354.63 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 368], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1882, max= 2039, per=38.67%, avg=1998.80, stdev=66.47, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=4.39%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183324: Sun Nov 16 21:01:17 2025 read: IOPS=0, BW=923KiB/s (945kB/s)(5120KiB/5546msec) clat (msec): min=42, max=1762, avg=486.64, stdev=723.78 lat (msec): min=42, max=1762, avg=486.64, stdev=723.78 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 2015, max= 6119, per=100.00%, avg=4067.00, stdev=2901.97, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1292KiB/s (1323kB/s)(7168KiB/5546msec); 0 zone resets clat (msec): min=52, max=1606, avg=426.32, stdev=552.40 lat (msec): min=52, max=1606, avg=426.41, stdev=552.40 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 74], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 213], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 542], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1404, max= 2048, per=35.54%, avg=1837.25, stdev=297.61, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=16.67%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=3.75%, ctx=93, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3693KiB/s (3781kB/s), 398KiB/s-1949KiB/s (407kB/s-1996kB/s), io=20.0MiB (20.0MB), run=3677-5546msec WRITE: bw=5170KiB/s (5294kB/s), 1227KiB/s-1988KiB/s (1257kB/s-2035kB/s), io=28.0MiB (29.4MB), run=3677-5546msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183334: Sun Nov 16 21:01:29 2025 read: IOPS=1, BW=5240KiB/s (5366kB/s)(12.0MiB/2345msec) clat (msec): min=643, max=801, avg=709.64, stdev=82.39 lat (msec): min=643, max=801, avg=709.64, stdev=82.39 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.13%, sys=18.47%, ctx=546, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183336: Sun Nov 16 21:01:29 2025 read: IOPS=0, BW=1498KiB/s (1534kB/s)(4096KiB/2735msec) clat (nsec): min=694288k, max=694288k, avg=694288007.00, stdev= 0.00 lat (nsec): min=694291k, max=694291k, avg=694290627.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2995KiB/s (3067kB/s)(8192KiB/2735msec); 0 zone resets clat (msec): min=578, max=1214, avg=896.63, stdev=449.97 lat (msec): min=578, max=1215, avg=897.07, stdev=449.95 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8110, max= 8110, per=74.77%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.71%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183337: Sun Nov 16 21:01:29 2025 write: IOPS=0, BW=4068KiB/s (4165kB/s)(12.0MiB/3021msec); 0 zone resets clat (msec): min=482, max=1750, avg=915.49, stdev=723.68 lat (msec): min=482, max=1751, avg=915.87, stdev=723.71 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8110, max= 8175, per=75.07%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.43%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183338: Sun Nov 16 21:01:29 2025 write: IOPS=1, BW=4861KiB/s (4977kB/s)(12.0MiB/2528msec); 0 zone resets clat (msec): min=190, max=1648, avg=754.80, stdev=782.50 lat (msec): min=191, max=1648, avg=755.72, stdev=782.21 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min=16221, max=16221, per=100.00%, avg=16221.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.46%, ctx=46, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5990KiB/s (6134kB/s), 1498KiB/s-5240KiB/s (1534kB/s-5366kB/s), io=16.0MiB (16.8MB), run=2345-2735msec WRITE: bw=10.6MiB/s (11.1MB/s), 2995KiB/s-4861KiB/s (3067kB/s-4977kB/s), io=32.0MiB (33.6MB), run=2528-3021msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183339: Sun Nov 16 21:01:29 2025 read: IOPS=1, BW=4475KiB/s (4582kB/s)(12.0MiB/2746msec) clat (msec): min=658, max=1246, avg=881.49, stdev=318.87 lat (msec): min=658, max=1246, avg=881.49, stdev=318.87 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.52%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183340: Sun Nov 16 21:01:29 2025 read: IOPS=0, BW=1482KiB/s (1518kB/s)(4096KiB/2763msec) clat (nsec): min=1160.3M, max=1160.3M, avg=1160281728.00, stdev= 0.00 lat (nsec): min=1160.3M, max=1160.3M, avg=1160284077.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2965KiB/s (3036kB/s)(8192KiB/2763msec); 0 zone resets clat (msec): min=209, max=1254, avg=731.98, stdev=738.84 lat (msec): min=209, max=1254, avg=732.40, stdev=738.79 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8126, max= 8126, per=72.37%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.77%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183341: Sun Nov 16 21:01:29 2025 write: IOPS=1, BW=4211KiB/s (4312kB/s)(12.0MiB/2918msec); 0 zone resets clat (msec): min=418, max=1634, avg=879.29, stdev=659.04 lat (msec): min=420, max=1634, avg=880.18, stdev=658.55 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7684, max= 8126, per=70.40%, avg=7905.00, stdev=312.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.21%, sys=4.79%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183342: Sun Nov 16 21:01:29 2025 write: IOPS=1, BW=4787KiB/s (4902kB/s)(12.0MiB/2567msec); 0 zone resets clat (msec): min=647, max=1089, avg=815.81, stdev=238.74 lat (msec): min=647, max=1089, avg=816.18, stdev=238.76 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8126, max= 8192, per=72.66%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.42%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5930KiB/s (6072kB/s), 1482KiB/s-4475KiB/s (1518kB/s-4582kB/s), io=16.0MiB (16.8MB), run=2746-2763msec WRITE: bw=10.0MiB/s (11.5MB/s), 2965KiB/s-4787KiB/s (3036kB/s-4902kB/s), io=32.0MiB (33.6MB), run=2567-2918msec