== sanity test 398b: DIO and buffer IO race ============== 14:26:37 (1767036397) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.05084 s, 16.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151938: Mon Dec 29 14:27:29 2025 read: IOPS=34, BW=138KiB/s (141kB/s)(5992KiB/43402msec) clat (usec): min=173, max=148643, avg=14469.33, stdev=9439.13 lat (usec): min=174, max=148644, avg=14470.30, stdev=9439.17 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 734], 10.00th=[ 6849], 20.00th=[ 8455], | 30.00th=[ 9634], 40.00th=[ 11076], 50.00th=[ 12649], 60.00th=[ 14877], | 70.00th=[ 17171], 80.00th=[ 20055], 90.00th=[ 24511], 95.00th=[ 28705], | 99.00th=[ 42730], 99.50th=[ 54789], 99.90th=[131597], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 20, max= 208, per=25.14%, avg=137.74, stdev=33.31, samples=86 iops : min= 5, max= 52, avg=34.20, stdev= 8.38, samples=86 write: IOPS=36, BW=145KiB/s (149kB/s)(6296KiB/43402msec); 0 zone resets clat (usec): min=672, max=666753, avg=13683.08, stdev=19970.79 lat (usec): min=673, max=666753, avg=13685.70, stdev=19971.31 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1893], 10.00th=[ 2474], 20.00th=[ 3195], | 30.00th=[ 4817], 40.00th=[ 8455], 50.00th=[ 11207], 60.00th=[ 13698], | 70.00th=[ 16712], 80.00th=[ 20579], 90.00th=[ 27919], 95.00th=[ 33817], | 99.00th=[ 51119], 99.50th=[ 64226], 99.90th=[ 98042], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 56, max= 239, per=25.48%, avg=146.26, stdev=36.75, samples=85 iops : min= 14, max= 59, avg=36.33, stdev= 9.22, samples=85 lat (usec) : 250=0.36%, 500=1.86%, 750=0.39%, 1000=0.49% lat (msec) : 2=2.34%, 4=10.51%, 10=23.31%, 20=40.43%, 50=19.50% lat (msec) : 100=0.72%, 250=0.07%, 750=0.03% cpu : usr=0.13%, sys=27.32%, ctx=8334, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151939: Mon Dec 29 14:27:29 2025 read: IOPS=33, BW=136KiB/s (139kB/s)(5940KiB/43777msec) clat (usec): min=77, max=136764, avg=14910.13, stdev=10518.08 lat (usec): min=78, max=136764, avg=14911.54, stdev=10518.60 clat percentiles (usec): | 1.00th=[ 269], 5.00th=[ 3195], 10.00th=[ 6652], 20.00th=[ 8356], | 30.00th=[ 9634], 40.00th=[ 11207], 50.00th=[ 12780], 60.00th=[ 14746], | 70.00th=[ 17433], 80.00th=[ 19792], 90.00th=[ 25297], 95.00th=[ 30802], | 99.00th=[ 54264], 99.50th=[ 70779], 99.90th=[111674], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 6, max= 240, per=24.68%, avg=135.26, stdev=35.53, samples=87 iops : min= 1, max= 60, avg=33.57, stdev= 8.86, samples=87 write: IOPS=36, BW=145KiB/s (148kB/s)(6348KiB/43777msec); 0 zone resets clat (usec): min=671, max=664463, avg=13525.98, stdev=19688.59 lat (usec): min=672, max=664464, avg=13526.93, stdev=19688.60 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 2147], 10.00th=[ 2540], 20.00th=[ 3261], | 30.00th=[ 4817], 40.00th=[ 8029], 50.00th=[ 10683], 60.00th=[ 13435], | 70.00th=[ 16712], 80.00th=[ 21103], 90.00th=[ 27657], 95.00th=[ 34341], | 99.00th=[ 49546], 99.50th=[ 58459], 99.90th=[ 86508], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 27, max= 376, per=25.13%, avg=144.23, stdev=45.47, samples=87 iops : min= 6, max= 94, avg=35.82, stdev=11.45, samples=87 lat (usec) : 100=0.03%, 250=0.42%, 500=1.56%, 750=0.33%, 1000=0.55% lat (msec) : 2=1.66%, 4=11.36%, 10=24.15%, 20=39.32%, 50=19.47% lat (msec) : 100=1.04%, 250=0.07%, 750=0.03% cpu : usr=0.11%, sys=27.12%, ctx=8250, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151940: Mon Dec 29 14:27:29 2025 read: IOPS=34, BW=139KiB/s (143kB/s)(6028KiB/43234msec) clat (usec): min=102, max=671736, avg=14973.20, stdev=18973.12 lat (usec): min=103, max=671737, avg=14974.09, stdev=18973.15 clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 4948], 10.00th=[ 6980], 20.00th=[ 8455], | 30.00th=[ 9634], 40.00th=[ 11076], 50.00th=[ 12780], 60.00th=[ 14615], | 70.00th=[ 17171], 80.00th=[ 20055], 90.00th=[ 24773], 95.00th=[ 29230], | 99.00th=[ 43779], 99.50th=[ 52167], 99.90th=[ 77071], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 13, max= 216, per=25.46%, avg=139.52, stdev=34.37, samples=86 iops : min= 3, max= 54, avg=34.64, stdev= 8.57, samples=86 write: IOPS=36, BW=145KiB/s (148kB/s)(6260KiB/43234msec); 0 zone resets clat (usec): min=656, max=143968, avg=13100.00, stdev=11735.84 lat (usec): min=656, max=143969, avg=13101.06, stdev=11735.87 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 2114], 10.00th=[ 2573], 20.00th=[ 3228], | 30.00th=[ 4948], 40.00th=[ 8029], 50.00th=[ 10552], 60.00th=[ 12911], | 70.00th=[ 16581], 80.00th=[ 21103], 90.00th=[ 27395], 95.00th=[ 32637], | 99.00th=[ 48497], 99.50th=[ 69731], 99.90th=[129500], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 27, max= 224, per=25.21%, avg=144.69, stdev=34.75, samples=86 iops : min= 6, max= 56, avg=35.93, stdev= 8.76, samples=86 lat (usec) : 250=0.20%, 500=1.63%, 750=0.26%, 1000=0.49% lat (msec) : 2=1.63%, 4=11.49%, 10=24.41%, 20=38.74%, 50=20.31% lat (msec) : 100=0.75%, 250=0.07%, 750=0.03% cpu : usr=0.13%, sys=27.35%, ctx=8341, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151941: Mon Dec 29 14:27:29 2025 read: IOPS=35, BW=140KiB/s (144kB/s)(6052KiB/43097msec) clat (usec): min=115, max=675077, avg=14955.30, stdev=19469.62 lat (usec): min=116, max=675079, avg=14956.07, stdev=19469.65 clat percentiles (usec): | 1.00th=[ 277], 5.00th=[ 619], 10.00th=[ 6718], 20.00th=[ 8291], | 30.00th=[ 9372], 40.00th=[ 10814], 50.00th=[ 12780], 60.00th=[ 14746], | 70.00th=[ 16712], 80.00th=[ 20055], 90.00th=[ 24511], 95.00th=[ 29492], | 99.00th=[ 47973], 99.50th=[ 60031], 99.90th=[139461], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 13, max= 224, per=25.44%, avg=139.39, stdev=32.28, samples=85 iops : min= 3, max= 56, avg=34.60, stdev= 8.07, samples=85 write: IOPS=36, BW=145KiB/s (148kB/s)(6236KiB/43097msec); 0 zone resets clat (usec): min=668, max=114391, avg=13023.08, stdev=10983.77 lat (usec): min=668, max=114391, avg=13024.06, stdev=10983.81 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 2024], 10.00th=[ 2442], 20.00th=[ 3163], | 30.00th=[ 4883], 40.00th=[ 8291], 50.00th=[ 10683], 60.00th=[ 13435], | 70.00th=[ 16581], 80.00th=[ 20841], 90.00th=[ 26870], 95.00th=[ 33162], | 99.00th=[ 49021], 99.50th=[ 60556], 99.90th=[ 95945], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 27, max= 248, per=25.09%, avg=144.04, stdev=36.59, samples=85 iops : min= 6, max= 62, avg=35.76, stdev= 9.22, samples=85 lat (usec) : 250=0.36%, 500=1.95%, 750=0.36%, 1000=0.36% lat (msec) : 2=1.89%, 4=10.74%, 10=25.16%, 20=38.15%, 50=20.12% lat (msec) : 100=0.81%, 250=0.07%, 750=0.03% cpu : usr=0.14%, sys=27.37%, ctx=8340, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=549KiB/s (562kB/s), 136KiB/s-140KiB/s (139kB/s-144kB/s), io=23.4MiB (24.6MB), run=43097-43777msec WRITE: bw=574KiB/s (588kB/s), 145KiB/s-145KiB/s (148kB/s-149kB/s), io=24.6MiB (25.7MB), run=43097-43777msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151943: Mon Dec 29 14:27:55 2025 read: IOPS=21, BW=85.7KiB/s (87.8kB/s)(5992KiB/69881msec) clat (msec): min=2, max=701, avg=12.46, stdev=21.31 lat (msec): min=2, max=701, avg=12.46, stdev=21.31 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 8], 60.00th=[ 10], | 70.00th=[ 14], 80.00th=[ 18], 90.00th=[ 26], 95.00th=[ 35], | 99.00th=[ 66], 99.50th=[ 83], 99.90th=[ 116], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 23, max= 224, per=25.15%, avg=86.27, stdev=43.94, samples=138 iops : min= 5, max= 56, avg=21.36, stdev=11.08, samples=138 write: IOPS=22, BW=90.1KiB/s (92.3kB/s)(6296KiB/69881msec); 0 zone resets clat (msec): min=13, max=166, avg=32.47, stdev=15.23 lat (msec): min=13, max=166, avg=32.47, stdev=15.23 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 61], | 99.00th=[ 82], 99.50th=[ 99], 99.90th=[ 165], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 32, max= 184, per=25.23%, avg=90.56, stdev=37.48, samples=138 iops : min= 8, max= 46, avg=22.43, stdev= 9.49, samples=138 lat (msec) : 4=4.13%, 10=25.81%, 20=18.20%, 50=45.35%, 100=6.25% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.12%, sys=7.84%, ctx=5461, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151944: Mon Dec 29 14:27:55 2025 read: IOPS=21, BW=84.9KiB/s (86.9kB/s)(5940KiB/69974msec) clat (msec): min=2, max=675, avg=12.77, stdev=20.90 lat (msec): min=2, max=675, avg=12.77, stdev=20.90 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 10], | 70.00th=[ 14], 80.00th=[ 18], 90.00th=[ 27], 95.00th=[ 36], | 99.00th=[ 62], 99.50th=[ 83], 99.90th=[ 108], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 15, max= 216, per=24.88%, avg=85.34, stdev=46.76, samples=138 iops : min= 3, max= 54, avg=21.12, stdev=11.79, samples=138 write: IOPS=22, BW=90.7KiB/s (92.9kB/s)(6348KiB/69974msec); 0 zone resets clat (msec): min=13, max=139, avg=32.09, stdev=14.61 lat (msec): min=13, max=139, avg=32.09, stdev=14.61 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 87], 99.50th=[ 101], 99.90th=[ 112], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 184, per=25.35%, avg=91.02, stdev=37.45, samples=138 iops : min= 7, max= 46, avg=22.54, stdev= 9.47, samples=138 lat (msec) : 4=4.04%, 10=25.20%, 20=19.04%, 50=45.12%, 100=6.25% lat (msec) : 250=0.33%, 750=0.03% cpu : usr=0.13%, sys=7.95%, ctx=5443, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151945: Mon Dec 29 14:27:55 2025 read: IOPS=21, BW=86.7KiB/s (88.8kB/s)(6028KiB/69489msec) clat (msec): min=2, max=133, avg=12.33, stdev=12.03 lat (msec): min=2, max=133, avg=12.33, stdev=12.03 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 10], | 70.00th=[ 14], 80.00th=[ 18], 90.00th=[ 27], 95.00th=[ 36], | 99.00th=[ 59], 99.50th=[ 71], 99.90th=[ 103], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 23, max= 215, per=25.47%, avg=87.36, stdev=43.77, samples=137 iops : min= 5, max= 53, avg=21.63, stdev=11.02, samples=137 write: IOPS=22, BW=90.1KiB/s (92.2kB/s)(6260KiB/69489msec); 0 zone resets clat (msec): min=13, max=703, avg=32.47, stdev=22.38 lat (msec): min=13, max=703, avg=32.48, stdev=22.38 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 83], 99.50th=[ 90], 99.90th=[ 201], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 24, max= 168, per=25.21%, avg=90.52, stdev=37.77, samples=137 iops : min= 6, max= 42, avg=22.42, stdev= 9.57, samples=137 lat (msec) : 4=4.04%, 10=25.59%, 20=19.21%, 50=44.73%, 100=6.25% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.13%, sys=8.03%, ctx=5428, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151946: Mon Dec 29 14:27:55 2025 read: IOPS=21, BW=87.3KiB/s (89.4kB/s)(6052KiB/69329msec) clat (usec): min=3051, max=93496, avg=12098.42, stdev=11245.51 lat (usec): min=3052, max=93496, avg=12099.38, stdev=11245.51 clat percentiles (usec): | 1.00th=[ 3359], 5.00th=[ 3818], 10.00th=[ 4113], 20.00th=[ 4686], | 30.00th=[ 5342], 40.00th=[ 6128], 50.00th=[ 7308], 60.00th=[10028], | 70.00th=[13304], 80.00th=[17433], 90.00th=[25297], 95.00th=[34341], | 99.00th=[57934], 99.50th=[67634], 99.90th=[84411], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 16, max= 240, per=25.83%, avg=88.60, stdev=46.48, samples=136 iops : min= 4, max= 60, avg=21.93, stdev=11.71, samples=136 write: IOPS=22, BW=89.9KiB/s (92.1kB/s)(6236KiB/69329msec); 0 zone resets clat (msec): min=13, max=711, avg=32.68, stdev=23.24 lat (msec): min=13, max=711, avg=32.68, stdev=23.24 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 36], 80.00th=[ 42], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 86], 99.50th=[ 107], 99.90th=[ 197], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 39, max= 160, per=25.21%, avg=90.52, stdev=36.98, samples=137 iops : min= 9, max= 40, avg=22.42, stdev= 9.38, samples=137 lat (msec) : 4=3.74%, 10=25.68%, 20=20.21%, 50=44.17%, 100=5.92% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.12%, sys=8.05%, ctx=5492, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=343KiB/s (351kB/s), 84.9KiB/s-87.3KiB/s (86.9kB/s-89.4kB/s), io=23.4MiB (24.6MB), run=69329-69974msec WRITE: bw=359KiB/s (368kB/s), 89.9KiB/s-90.7KiB/s (92.1kB/s-92.9kB/s), io=24.6MiB (25.7MB), run=69329-69974msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151977: Mon Dec 29 14:28:13 2025 read: IOPS=31, BW=503KiB/s (515kB/s)(5920KiB/11776msec) clat (usec): min=127, max=75553, avg=15656.30, stdev=9324.81 lat (usec): min=128, max=75553, avg=15657.07, stdev=9324.83 clat percentiles (usec): | 1.00th=[ 255], 5.00th=[ 363], 10.00th=[ 766], 20.00th=[ 9634], | 30.00th=[10945], 40.00th=[12649], 50.00th=[14615], 60.00th=[16319], | 70.00th=[19006], 80.00th=[22152], 90.00th=[27395], 95.00th=[31065], | 99.00th=[43254], 99.50th=[50070], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 287, max= 768, per=24.76%, avg=500.39, stdev=120.84, samples=23 iops : min= 17, max= 48, avg=30.83, stdev= 7.64, samples=23 write: IOPS=33, BW=541KiB/s (554kB/s)(6368KiB/11776msec); 0 zone resets clat (usec): min=893, max=99422, avg=14924.88, stdev=11648.87 lat (usec): min=895, max=99424, avg=14926.63, stdev=11648.86 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 3589], 10.00th=[ 4113], 20.00th=[ 5276], | 30.00th=[ 7898], 40.00th=[ 9896], 50.00th=[12518], 60.00th=[14353], | 70.00th=[17957], 80.00th=[21627], 90.00th=[28967], 95.00th=[36439], | 99.00th=[58459], 99.50th=[66847], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 383, max= 862, per=25.40%, avg=540.22, stdev=123.92, samples=23 iops : min= 23, max= 53, avg=33.30, stdev= 7.83, samples=23 lat (usec) : 250=0.39%, 500=3.26%, 750=1.04%, 1000=0.26% lat (msec) : 2=0.65%, 4=3.65%, 10=22.66%, 20=42.19%, 50=24.74% lat (msec) : 100=1.17% cpu : usr=0.15%, sys=32.18%, ctx=2517, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151978: Mon Dec 29 14:28:13 2025 read: IOPS=30, BW=485KiB/s (496kB/s)(5744KiB/11847msec) clat (usec): min=151, max=86236, avg=16178.82, stdev=11078.27 lat (usec): min=152, max=86236, avg=16179.76, stdev=11078.25 clat percentiles (usec): | 1.00th=[ 269], 5.00th=[ 388], 10.00th=[ 603], 20.00th=[ 9241], | 30.00th=[10945], 40.00th=[13173], 50.00th=[14877], 60.00th=[17171], | 70.00th=[19006], 80.00th=[21890], 90.00th=[25822], 95.00th=[35390], | 99.00th=[64226], 99.50th=[76022], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 129, max= 766, per=23.98%, avg=484.70, stdev=170.79, samples=23 iops : min= 8, max= 47, avg=29.87, stdev=10.64, samples=23 write: IOPS=34, BW=552KiB/s (566kB/s)(6544KiB/11847msec); 0 zone resets clat (usec): min=961, max=82514, avg=14589.82, stdev=11203.39 lat (usec): min=963, max=82517, avg=14591.61, stdev=11203.45 clat percentiles (usec): | 1.00th=[ 2409], 5.00th=[ 3589], 10.00th=[ 4047], 20.00th=[ 4817], | 30.00th=[ 6587], 40.00th=[ 9634], 50.00th=[11863], 60.00th=[14746], | 70.00th=[18744], 80.00th=[22152], 90.00th=[27919], 95.00th=[33817], | 99.00th=[51643], 99.50th=[64226], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 284, max= 894, per=25.79%, avg=548.48, stdev=162.75, samples=23 iops : min= 17, max= 55, avg=33.83, stdev=10.29, samples=23 lat (usec) : 250=0.39%, 500=3.91%, 750=0.39%, 1000=0.39% lat (msec) : 2=0.39%, 4=4.30%, 10=24.48%, 20=39.71%, 50=24.61% lat (msec) : 100=1.43% cpu : usr=0.08%, sys=31.76%, ctx=2555, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151979: Mon Dec 29 14:28:13 2025 read: IOPS=33, BW=532KiB/s (545kB/s)(6256KiB/11758msec) clat (usec): min=221, max=98535, avg=16229.26, stdev=10594.02 lat (usec): min=222, max=98535, avg=16230.30, stdev=10593.97 clat percentiles (usec): | 1.00th=[ 269], 5.00th=[ 445], 10.00th=[ 6587], 20.00th=[ 9765], | 30.00th=[11207], 40.00th=[12780], 50.00th=[14746], 60.00th=[16712], | 70.00th=[19268], 80.00th=[22938], 90.00th=[27132], 95.00th=[31851], | 99.00th=[55313], 99.50th=[80217], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 255, max= 736, per=26.49%, avg=535.35, stdev=134.70, samples=23 iops : min= 15, max= 46, avg=33.04, stdev= 8.48, samples=23 write: IOPS=32, BW=513KiB/s (525kB/s)(6032KiB/11758msec); 0 zone resets clat (usec): min=1159, max=54687, avg=14286.59, stdev=9990.52 lat (usec): min=1160, max=54689, avg=14288.22, stdev=9990.64 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3785], 10.00th=[ 4359], 20.00th=[ 5211], | 30.00th=[ 7046], 40.00th=[ 9503], 50.00th=[11994], 60.00th=[14353], | 70.00th=[17957], 80.00th=[21890], 90.00th=[28181], 95.00th=[35390], | 99.00th=[43254], 99.50th=[53740], 99.90th=[54789], 99.95th=[54789], | 99.99th=[54789] bw ( KiB/s): min= 256, max= 800, per=23.84%, avg=507.09, stdev=148.17, samples=23 iops : min= 16, max= 50, avg=31.26, stdev= 9.39, samples=23 lat (usec) : 250=0.13%, 500=3.39%, 750=0.65%, 1000=0.13% lat (msec) : 2=0.91%, 4=2.60%, 10=24.61%, 20=41.80%, 50=24.87% lat (msec) : 100=0.91% cpu : usr=0.13%, sys=31.63%, ctx=2593, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151980: Mon Dec 29 14:28:13 2025 read: IOPS=32, BW=520KiB/s (532kB/s)(6032KiB/11605msec) clat (usec): min=84, max=52847, avg=16113.04, stdev=9945.65 lat (usec): min=84, max=52848, avg=16113.83, stdev=9945.69 clat percentiles (usec): | 1.00th=[ 253], 5.00th=[ 396], 10.00th=[ 523], 20.00th=[ 9372], | 30.00th=[10683], 40.00th=[12911], 50.00th=[15401], 60.00th=[17695], | 70.00th=[19792], 80.00th=[22676], 90.00th=[28967], 95.00th=[33424], | 99.00th=[49021], 99.50th=[49546], 99.90th=[52691], 99.95th=[52691], | 99.99th=[52691] bw ( KiB/s): min= 223, max= 672, per=25.65%, avg=518.36, stdev=126.10, samples=22 iops : min= 13, max= 42, avg=31.95, stdev= 8.17, samples=22 write: IOPS=33, BW=539KiB/s (552kB/s)(6256KiB/11605msec); 0 zone resets clat (usec): min=919, max=73365, avg=14014.44, stdev=11043.25 lat (usec): min=922, max=73369, avg=14016.07, stdev=11043.62 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3654], 10.00th=[ 4293], 20.00th=[ 4948], | 30.00th=[ 6063], 40.00th=[ 8455], 50.00th=[10159], 60.00th=[12911], | 70.00th=[16909], 80.00th=[21365], 90.00th=[30540], 95.00th=[35390], | 99.00th=[47449], 99.50th=[70779], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 311, max= 926, per=25.51%, avg=542.68, stdev=151.53, samples=22 iops : min= 19, max= 57, avg=33.50, stdev= 9.50, samples=22 lat (usec) : 100=0.13%, 250=0.26%, 500=4.30%, 750=1.04%, 1000=0.39% lat (msec) : 2=0.52%, 4=3.39%, 10=27.34%, 20=36.72%, 50=25.39% lat (msec) : 100=0.52% cpu : usr=0.10%, sys=32.14%, ctx=2494, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2022KiB/s (2070kB/s), 485KiB/s-532KiB/s (496kB/s-545kB/s), io=23.4MiB (24.5MB), run=11605-11847msec WRITE: bw=2127KiB/s (2178kB/s), 513KiB/s-552KiB/s (525kB/s-566kB/s), io=24.6MiB (25.8MB), run=11605-11847msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151972: Mon Dec 29 14:28:18 2025 read: IOPS=21, BW=339KiB/s (347kB/s)(5920KiB/17460msec) clat (usec): min=2874, max=76401, avg=13669.90, stdev=13126.10 lat (usec): min=2875, max=76402, avg=13670.71, stdev=13126.08 clat percentiles (usec): | 1.00th=[ 3359], 5.00th=[ 3949], 10.00th=[ 4359], 20.00th=[ 5014], | 30.00th=[ 5997], 40.00th=[ 7242], 50.00th=[ 8717], 60.00th=[11076], | 70.00th=[13173], 80.00th=[19006], 90.00th=[29230], 95.00th=[46400], | 99.00th=[64750], 99.50th=[69731], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 127, max= 736, per=24.44%, avg=330.41, stdev=157.34, samples=34 iops : min= 7, max= 46, avg=20.24, stdev=10.03, samples=34 write: IOPS=22, BW=365KiB/s (373kB/s)(6368KiB/17460msec); 0 zone resets clat (msec): min=12, max=103, avg=31.11, stdev=14.36 lat (msec): min=12, max=103, avg=31.11, stdev=14.36 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 80], 99.50th=[ 93], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 159, max= 672, per=25.40%, avg=361.18, stdev=159.73, samples=34 iops : min= 9, max= 42, avg=22.18, stdev=10.26, samples=34 lat (msec) : 4=2.73%, 10=24.22%, 20=22.53%, 50=43.49%, 100=6.90% lat (msec) : 250=0.13% cpu : usr=0.06%, sys=10.48%, ctx=1529, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151973: Mon Dec 29 14:28:18 2025 read: IOPS=20, BW=324KiB/s (332kB/s)(5744KiB/17713msec) clat (usec): min=2473, max=67898, avg=13252.53, stdev=12272.54 lat (usec): min=2473, max=67899, avg=13253.37, stdev=12272.52 clat percentiles (usec): | 1.00th=[ 2966], 5.00th=[ 3621], 10.00th=[ 4080], 20.00th=[ 4817], | 30.00th=[ 5538], 40.00th=[ 6521], 50.00th=[ 7963], 60.00th=[10814], | 70.00th=[14091], 80.00th=[18744], 90.00th=[29754], 95.00th=[41157], | 99.00th=[57934], 99.50th=[63177], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 96, max= 704, per=23.90%, avg=323.09, stdev=169.56, samples=35 iops : min= 6, max= 44, avg=19.80, stdev=10.81, samples=35 write: IOPS=23, BW=369KiB/s (378kB/s)(6544KiB/17713msec); 0 zone resets clat (msec): min=10, max=102, avg=31.59, stdev=15.11 lat (msec): min=10, max=102, avg=31.59, stdev=15.11 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 27], 60.00th=[ 30], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 54], 95.00th=[ 65], | 99.00th=[ 79], 99.50th=[ 80], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 159, max= 736, per=25.86%, avg=367.74, stdev=156.95, samples=35 iops : min= 9, max= 46, avg=22.57, stdev=10.12, samples=35 lat (msec) : 4=3.91%, 10=23.05%, 20=22.01%, 50=43.62%, 100=7.29% lat (msec) : 250=0.13% cpu : usr=0.13%, sys=10.00%, ctx=1480, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151974: Mon Dec 29 14:28:18 2025 read: IOPS=22, BW=362KiB/s (371kB/s)(6256KiB/17266msec) clat (usec): min=2612, max=69816, avg=13265.29, stdev=11786.50 lat (usec): min=2613, max=69817, avg=13266.44, stdev=11786.46 clat percentiles (usec): | 1.00th=[ 3228], 5.00th=[ 4047], 10.00th=[ 4424], 20.00th=[ 4948], | 30.00th=[ 5800], 40.00th=[ 6849], 50.00th=[ 8979], 60.00th=[11207], | 70.00th=[13829], 80.00th=[18744], 90.00th=[30802], 95.00th=[40109], | 99.00th=[56886], 99.50th=[62653], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 127, max= 1024, per=27.01%, avg=365.15, stdev=212.69, samples=34 iops : min= 7, max= 64, avg=22.41, stdev=13.52, samples=34 write: IOPS=21, BW=349KiB/s (358kB/s)(6032KiB/17266msec); 0 zone resets clat (msec): min=14, max=133, avg=31.90, stdev=14.83 lat (msec): min=14, max=133, avg=31.90, stdev=14.83 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 63], | 99.00th=[ 77], 99.50th=[ 84], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 190, max= 672, per=24.52%, avg=348.62, stdev=144.36, samples=34 iops : min= 11, max= 42, avg=21.38, stdev= 9.29, samples=34 lat (msec) : 4=2.47%, 10=25.65%, 20=22.79%, 50=42.84%, 100=6.12% lat (msec) : 250=0.13% cpu : usr=0.14%, sys=10.50%, ctx=1480, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151975: Mon Dec 29 14:28:18 2025 read: IOPS=21, BW=342KiB/s (350kB/s)(6032KiB/17636msec) clat (usec): min=3190, max=67298, avg=14212.74, stdev=12441.10 lat (usec): min=3191, max=67298, avg=14213.64, stdev=12441.10 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 3785], 10.00th=[ 4293], 20.00th=[ 5342], | 30.00th=[ 6128], 40.00th=[ 6915], 50.00th=[ 8717], 60.00th=[12256], | 70.00th=[16057], 80.00th=[22414], 90.00th=[32900], 95.00th=[41157], | 99.00th=[55837], 99.50th=[66323], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 158, max= 704, per=24.60%, avg=332.65, stdev=147.42, samples=34 iops : min= 9, max= 44, avg=20.38, stdev= 9.45, samples=34 write: IOPS=22, BW=355KiB/s (363kB/s)(6256KiB/17636msec); 0 zone resets clat (msec): min=13, max=107, avg=31.29, stdev=14.78 lat (msec): min=13, max=107, avg=31.30, stdev=14.78 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 49], 95.00th=[ 58], | 99.00th=[ 99], 99.50th=[ 106], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 159, max= 672, per=24.37%, avg=346.53, stdev=154.46, samples=34 iops : min= 9, max= 42, avg=21.24, stdev= 9.95, samples=34 lat (msec) : 4=3.39%, 10=23.18%, 20=20.96%, 50=46.48%, 100=5.60% lat (msec) : 250=0.39% cpu : usr=0.08%, sys=10.55%, ctx=1512, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1352KiB/s (1385kB/s), 324KiB/s-362KiB/s (332kB/s-371kB/s), io=23.4MiB (24.5MB), run=17266-17713msec WRITE: bw=1423KiB/s (1457kB/s), 349KiB/s-369KiB/s (358kB/s-378kB/s), io=24.6MiB (25.8MB), run=17266-17713msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151988: Mon Dec 29 14:28:26 2025 read: IOPS=3, BW=3976KiB/s (4071kB/s)(7168KiB/1803msec) clat (msec): min=47, max=330, avg=132.23, stdev=102.37 lat (msec): min=47, max=330, avg=132.23, stdev=102.37 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 50], | 30.00th=[ 77], 40.00th=[ 77], 50.00th=[ 84], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 194], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1903, max= 6965, per=50.68%, avg=3625.00, stdev=2892.99, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=2, BW=2840KiB/s (2908kB/s)(5120KiB/1803msec); 0 zone resets clat (msec): min=124, max=197, avg=173.88, stdev=28.46 lat (msec): min=124, max=197, avg=173.96, stdev=28.46 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1741, max= 4015, per=31.83%, avg=3187.33, stdev=1256.91, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 50=16.67%, 100=16.67%, 250=58.33%, 500=8.33% cpu : usr=0.06%, sys=17.70%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151989: Mon Dec 29 14:28:26 2025 read: IOPS=0, BW=715KiB/s (733kB/s)(2048KiB/2863msec) clat (msec): min=47, max=179, avg=113.39, stdev=92.89 lat (msec): min=47, max=179, avg=113.39, stdev=92.89 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 48], 40.00th=[ 48], 50.00th=[ 48], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1732, max= 2007, per=26.14%, avg=1869.50, stdev=194.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3577KiB/s (3663kB/s)(10.0MiB/2863msec); 0 zone resets clat (msec): min=82, max=565, avg=259.90, stdev=142.40 lat (msec): min=82, max=565, avg=259.97, stdev=142.41 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 101], | 30.00th=[ 165], 40.00th=[ 215], 50.00th=[ 222], 60.00th=[ 251], | 70.00th=[ 300], 80.00th=[ 317], 90.00th=[ 384], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1732, max= 5710, per=31.08%, avg=3112.60, stdev=1727.53, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=21.38%, ctx=278, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151990: Mon Dec 29 14:28:26 2025 read: IOPS=2, BW=2577KiB/s (2639kB/s)(6144KiB/2384msec) clat (msec): min=79, max=444, avg=191.60, stdev=132.41 lat (msec): min=79, max=444, avg=191.60, stdev=132.41 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 190], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2035, max= 4015, per=45.93%, avg=3285.33, stdev=1087.85, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2577KiB/s (2639kB/s)(6144KiB/2384msec); 0 zone resets clat (msec): min=60, max=355, avg=198.53, stdev=120.01 lat (msec): min=60, max=355, avg=198.61, stdev=120.01 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 262], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1903, max= 3488, per=23.55%, avg=2358.25, stdev=755.30, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=13.97%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151991: Mon Dec 29 14:28:26 2025 read: IOPS=2, BW=2076KiB/s (2126kB/s)(5120KiB/2466msec) clat (msec): min=77, max=288, avg=170.07, stdev=86.82 lat (msec): min=77, max=288, avg=170.07, stdev=86.82 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 3806, max= 4015, per=54.67%, avg=3910.50, stdev=147.79, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2907KiB/s (2976kB/s)(7168KiB/2466msec); 0 zone resets clat (msec): min=52, max=569, avg=226.73, stdev=173.20 lat (msec): min=52, max=569, avg=226.82, stdev=173.20 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 113], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 165], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 296], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1903, max= 5215, per=37.06%, avg=3711.00, stdev=1676.80, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=12.33%, ctx=197, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7153KiB/s (7325kB/s), 715KiB/s-3976KiB/s (733kB/s-4071kB/s), io=20.0MiB (20.0MB), run=1803-2863msec WRITE: bw=9.78MiB/s (10.3MB/s), 2577KiB/s-3577KiB/s (2639kB/s-3663kB/s), io=28.0MiB (29.4MB), run=1803-2863msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151993: Mon Dec 29 14:28:27 2025 read: IOPS=2, BW=2945KiB/s (3016kB/s)(7168KiB/2434msec) clat (usec): min=844, max=366187, avg=165801.28, stdev=112162.08 lat (usec): min=845, max=366188, avg=165802.22, stdev=112162.07 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[108528], | 30.00th=[121111], 40.00th=[121111], 50.00th=[162530], 60.00th=[187696], | 70.00th=[187696], 80.00th=[214959], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 3984, max= 5233, per=65.26%, avg=4608.50, stdev=883.18, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2104KiB/s (2154kB/s)(5120KiB/2434msec); 0 zone resets clat (msec): min=146, max=411, avg=235.72, stdev=106.96 lat (msec): min=146, max=411, avg=235.79, stdev=106.96 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1992, max= 4096, per=27.43%, avg=2712.00, stdev=1198.91, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=75.00%, 500=16.67% cpu : usr=0.04%, sys=48.34%, ctx=982, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151994: Mon Dec 29 14:28:27 2025 read: IOPS=0, BW=706KiB/s (723kB/s)(2048KiB/2900msec) clat (usec): min=790, max=322036, avg=161413.45, stdev=227155.01 lat (usec): min=791, max=322038, avg=161415.08, stdev=227156.17 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[ 791], 50.00th=[ 791], 60.00th=[320865], | 70.00th=[320865], 80.00th=[320865], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 1744, max= 2039, per=26.78%, avg=1891.50, stdev=208.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3531KiB/s (3616kB/s)(10.0MiB/2900msec); 0 zone resets clat (msec): min=58, max=673, avg=251.76, stdev=200.61 lat (msec): min=59, max=673, avg=251.82, stdev=200.61 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 61], | 30.00th=[ 65], 40.00th=[ 106], 50.00th=[ 167], 60.00th=[ 288], | 70.00th=[ 317], 80.00th=[ 363], 90.00th=[ 422], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1992, max= 4079, per=25.71%, avg=2541.75, stdev=1025.17, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=25.00%, 250=16.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=37.43%, ctx=209, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151995: Mon Dec 29 14:28:27 2025 read: IOPS=2, BW=2446KiB/s (2505kB/s)(6144KiB/2512msec) clat (msec): min=45, max=231, avg=160.16, stdev=72.34 lat (msec): min=45, max=231, avg=160.16, stdev=72.34 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 192], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 1992, max= 4096, per=38.40%, avg=2712.00, stdev=1198.91, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2446KiB/s (2505kB/s)(6144KiB/2512msec); 0 zone resets clat (msec): min=121, max=497, avg=253.78, stdev=144.29 lat (msec): min=121, max=497, avg=253.84, stdev=144.28 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 222], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1992, max= 3436, per=24.08%, avg=2381.00, stdev=703.83, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=66.67%, 500=16.67% cpu : usr=0.00%, sys=39.15%, ctx=590, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151996: Mon Dec 29 14:28:27 2025 read: IOPS=1, BW=1871KiB/s (1916kB/s)(5120KiB/2737msec) clat (usec): min=660, max=294269, avg=162265.04, stdev=106948.52 lat (usec): min=661, max=294270, avg=162265.88, stdev=106948.61 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[139461], 40.00th=[139461], 50.00th=[177210], 60.00th=[177210], | 70.00th=[200279], 80.00th=[200279], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 2048, max= 6144, per=58.00%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2619KiB/s (2682kB/s)(7168KiB/2737msec); 0 zone resets clat (msec): min=119, max=447, avg=269.94, stdev=103.62 lat (msec): min=119, max=447, avg=270.01, stdev=103.63 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 209], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 243], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 334], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1780, max= 4079, per=30.07%, avg=2972.75, stdev=1228.04, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=33.33% cpu : usr=0.04%, sys=43.27%, ctx=521, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7062KiB/s (7232kB/s), 706KiB/s-2945KiB/s (723kB/s-3016kB/s), io=20.0MiB (20.0MB), run=2434-2900msec WRITE: bw=9887KiB/s (10.1MB/s), 2104KiB/s-3531KiB/s (2154kB/s-3616kB/s), io=28.0MiB (29.4MB), run=2434-2900msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152001: Mon Dec 29 14:28:35 2025 read: IOPS=1, BW=6589KiB/s (6747kB/s)(12.0MiB/1865msec) clat (msec): min=502, max=643, avg=571.60, stdev=70.22 lat (msec): min=502, max=643, avg=571.60, stdev=70.22 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8078, max= 8192, per=92.61%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=21.14%, ctx=101, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152002: Mon Dec 29 14:28:35 2025 read: IOPS=0, BW=2485KiB/s (2545kB/s)(4096KiB/1648msec) clat (nsec): min=198045k, max=198045k, avg=198045220.00, stdev= 0.00 lat (nsec): min=198047k, max=198047k, avg=198047484.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 8000, max= 8000, per=91.07%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4971KiB/s (5090kB/s)(8192KiB/1648msec); 0 zone resets clat (msec): min=405, max=894, avg=649.86, stdev=345.99 lat (msec): min=405, max=894, avg=650.12, stdev=346.00 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=54.40%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=19.55%, ctx=84, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152003: Mon Dec 29 14:28:35 2025 write: IOPS=1, BW=5647KiB/s (5783kB/s)(12.0MiB/2176msec); 0 zone resets clat (msec): min=142, max=1480, avg=674.39, stdev=709.63 lat (msec): min=143, max=1480, avg=674.68, stdev=709.61 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min=15875, max=15875, per=100.00%, avg=15875.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.40%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152005: Mon Dec 29 14:28:35 2025 write: IOPS=1, BW=6744KiB/s (6906kB/s)(12.0MiB/1822msec); 0 zone resets clat (msec): min=316, max=903, avg=557.16, stdev=307.43 lat (msec): min=316, max=903, avg=557.41, stdev=307.43 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.19%, ctx=382, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8785KiB/s (8996kB/s), 2485KiB/s-6589KiB/s (2545kB/s-6747kB/s), io=16.0MiB (16.8MB), run=1648-1865msec WRITE: bw=14.7MiB/s (15.4MB/s), 4971KiB/s-6744KiB/s (5090kB/s-6906kB/s), io=32.0MiB (33.6MB), run=1648-2176msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152006: Mon Dec 29 14:28:35 2025 read: IOPS=1, BW=7488KiB/s (7668kB/s)(12.0MiB/1641msec) clat (msec): min=469, max=631, avg=538.08, stdev=84.10 lat (msec): min=469, max=631, avg=538.08, stdev=84.10 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 5649, max= 8192, per=77.60%, avg=6920.50, stdev=1798.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=53.72%, ctx=2383, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152007: Mon Dec 29 14:28:35 2025 read: IOPS=0, BW=2230KiB/s (2283kB/s)(4096KiB/1837msec) clat (nsec): min=514855k, max=514855k, avg=514854564.00, stdev= 0.00 lat (nsec): min=514856k, max=514856k, avg=514855603.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 5550, max= 5550, per=62.23%, avg=5550.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4459KiB/s (4566kB/s)(8192KiB/1837msec); 0 zone resets clat (msec): min=616, max=664, avg=640.49, stdev=34.11 lat (msec): min=616, max=664, avg=640.82, stdev=34.01 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8192, max= 8192, per=54.60%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.11%, sys=17.86%, ctx=694, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152008: Mon Dec 29 14:28:35 2025 write: IOPS=1, BW=5626KiB/s (5761kB/s)(12.0MiB/2184msec); 0 zone resets clat (msec): min=78, max=1825, avg=698.47, stdev=977.65 lat (msec): min=78, max=1825, avg=698.74, stdev=977.65 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8175, max= 8175, per=54.49%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 250=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.55%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152009: Mon Dec 29 14:28:35 2025 write: IOPS=2, BW=9309KiB/s (9533kB/s)(12.0MiB/1320msec); 0 zone resets clat (msec): min=229, max=803, avg=423.71, stdev=328.61 lat (msec): min=229, max=803, avg=423.94, stdev=328.65 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min=10981, max=10981, per=73.19%, avg=10981.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=26.23%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8919KiB/s (9133kB/s), 2230KiB/s-7488KiB/s (2283kB/s-7668kB/s), io=16.0MiB (16.8MB), run=1641-1837msec WRITE: bw=14.7MiB/s (15.4MB/s), 4459KiB/s-9309KiB/s (4566kB/s-9533kB/s), io=32.0MiB (33.6MB), run=1320-2184msec