== sanity test 398b: DIO and buffer IO race ============== 18:08:35 (1777500515) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.66885 s, 18.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147116: Wed Apr 29 18:09:33 2026 read: IOPS=31, BW=124KiB/s (127kB/s)(5992KiB/48251msec) clat (usec): min=18, max=608982, avg=16338.86, stdev=18496.39 lat (usec): min=18, max=608984, avg=16340.00, stdev=18496.35 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 115], 10.00th=[ 6915], 20.00th=[ 8717], | 30.00th=[ 10290], 40.00th=[ 11994], 50.00th=[ 13698], 60.00th=[ 16188], | 70.00th=[ 19268], 80.00th=[ 22414], 90.00th=[ 27919], 95.00th=[ 33424], | 99.00th=[ 56361], 99.50th=[ 66847], 99.90th=[111674], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 223, per=25.24%, avg=123.95, stdev=32.88, samples=96 iops : min= 1, max= 55, avg=30.60, stdev= 8.22, samples=96 write: IOPS=32, BW=130KiB/s (134kB/s)(6296KiB/48251msec); 0 zone resets clat (usec): min=804, max=131392, avg=14977.32, stdev=13151.28 lat (usec): min=805, max=131393, avg=14978.86, stdev=13151.56 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1860], 10.00th=[ 2343], 20.00th=[ 3261], | 30.00th=[ 5080], 40.00th=[ 8979], 50.00th=[ 12256], 60.00th=[ 15533], | 70.00th=[ 19530], 80.00th=[ 24249], 90.00th=[ 31327], 95.00th=[ 39060], | 99.00th=[ 57410], 99.50th=[ 77071], 99.90th=[ 95945], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 64, max= 200, per=25.58%, avg=131.47, stdev=30.45, samples=95 iops : min= 16, max= 50, avg=32.49, stdev= 7.57, samples=95 lat (usec) : 20=0.03%, 50=0.16%, 100=1.56%, 250=1.50%, 500=0.03% lat (usec) : 750=0.03%, 1000=0.23% lat (msec) : 2=3.06%, 4=9.34%, 10=19.43%, 20=36.46%, 50=26.53% lat (msec) : 100=1.53%, 250=0.07%, 750=0.03% cpu : usr=0.16%, sys=22.58%, ctx=8349, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147117: Wed Apr 29 18:09:33 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(5940KiB/48191msec) clat (usec): min=36, max=148333, avg=15842.18, stdev=10220.28 lat (usec): min=37, max=148335, avg=15843.18, stdev=10220.35 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 155], 10.00th=[ 7111], 20.00th=[ 9110], | 30.00th=[ 10421], 40.00th=[ 11731], 50.00th=[ 13698], 60.00th=[ 16450], | 70.00th=[ 19268], 80.00th=[ 22152], 90.00th=[ 27132], 95.00th=[ 31327], | 99.00th=[ 45351], 99.50th=[ 55837], 99.90th=[110625], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 7, max= 198, per=25.07%, avg=123.10, stdev=33.00, samples=96 iops : min= 1, max= 49, avg=30.40, stdev= 8.28, samples=96 write: IOPS=32, BW=132KiB/s (135kB/s)(6348KiB/48191msec); 0 zone resets clat (usec): min=830, max=605640, avg=15421.62, stdev=20237.41 lat (usec): min=831, max=605641, avg=15423.23, stdev=20237.47 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1811], 10.00th=[ 2311], 20.00th=[ 3294], | 30.00th=[ 4948], 40.00th=[ 9110], 50.00th=[ 12256], 60.00th=[ 15270], | 70.00th=[ 19268], 80.00th=[ 24249], 90.00th=[ 30802], 95.00th=[ 38536], | 99.00th=[ 57410], 99.50th=[ 96994], 99.90th=[132645], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 72, max= 230, per=25.88%, avg=133.01, stdev=36.39, samples=95 iops : min= 18, max= 57, avg=32.87, stdev= 9.07, samples=95 lat (usec) : 50=0.29%, 100=1.43%, 250=0.88%, 500=0.07%, 1000=0.13% lat (msec) : 2=3.39%, 4=9.77%, 10=18.98%, 20=36.95%, 50=26.95% lat (msec) : 100=0.88%, 250=0.26%, 750=0.03% cpu : usr=0.14%, sys=22.39%, ctx=8323, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147119: Wed Apr 29 18:09:33 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(6028KiB/47968msec) clat (usec): min=32, max=606273, avg=16298.08, stdev=18658.76 lat (usec): min=32, max=606274, avg=16303.30, stdev=18655.86 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 115], 10.00th=[ 6849], 20.00th=[ 8586], | 30.00th=[ 10421], 40.00th=[ 11863], 50.00th=[ 13698], 60.00th=[ 16319], | 70.00th=[ 19268], 80.00th=[ 22414], 90.00th=[ 27395], 95.00th=[ 32113], | 99.00th=[ 53740], 99.50th=[ 77071], 99.90th=[133694], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 200, per=25.49%, avg=125.15, stdev=35.30, samples=95 iops : min= 1, max= 50, avg=30.91, stdev= 8.88, samples=95 write: IOPS=32, BW=131KiB/s (134kB/s)(6260KiB/47968msec); 0 zone resets clat (usec): min=795, max=111416, avg=14833.48, stdev=12825.86 lat (usec): min=796, max=111417, avg=14834.89, stdev=12825.78 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1991], 10.00th=[ 2540], 20.00th=[ 3294], | 30.00th=[ 4686], 40.00th=[ 8848], 50.00th=[ 12125], 60.00th=[ 15795], | 70.00th=[ 19530], 80.00th=[ 24249], 90.00th=[ 31065], 95.00th=[ 38011], | 99.00th=[ 55313], 99.50th=[ 64226], 99.90th=[100140], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 22, max= 215, per=25.20%, avg=129.55, stdev=35.70, samples=95 iops : min= 5, max= 53, avg=32.00, stdev= 8.97, samples=95 lat (usec) : 50=0.16%, 100=1.66%, 250=1.53%, 500=0.07%, 1000=0.16% lat (msec) : 2=2.44%, 4=11.07%, 10=19.04%, 20=35.25%, 50=27.02% lat (msec) : 100=1.43%, 250=0.13%, 750=0.03% cpu : usr=0.13%, sys=22.79%, ctx=8395, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147121: Wed Apr 29 18:09:33 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(6052KiB/48816msec) clat (usec): min=29, max=600226, avg=15950.94, stdev=18209.00 lat (usec): min=29, max=600227, avg=15952.09, stdev=18208.94 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 105], 10.00th=[ 6521], 20.00th=[ 8717], | 30.00th=[ 10421], 40.00th=[ 11863], 50.00th=[ 13829], 60.00th=[ 16057], | 70.00th=[ 18744], 80.00th=[ 21890], 90.00th=[ 26870], 95.00th=[ 32113], | 99.00th=[ 50594], 99.50th=[ 72877], 99.90th=[106431], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 63, max= 208, per=25.38%, avg=124.62, stdev=31.49, samples=96 iops : min= 15, max= 52, avg=30.78, stdev= 7.88, samples=96 write: IOPS=31, BW=128KiB/s (131kB/s)(6236KiB/48816msec); 0 zone resets clat (usec): min=848, max=131019, avg=15703.78, stdev=14393.38 lat (usec): min=848, max=131021, avg=15705.25, stdev=14393.23 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1893], 10.00th=[ 2376], 20.00th=[ 3228], | 30.00th=[ 4948], 40.00th=[ 9241], 50.00th=[ 12518], 60.00th=[ 16188], | 70.00th=[ 20055], 80.00th=[ 25560], 90.00th=[ 32900], 95.00th=[ 40633], | 99.00th=[ 68682], 99.50th=[ 85459], 99.90th=[129500], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 29, max= 224, per=24.73%, avg=127.11, stdev=36.84, samples=97 iops : min= 7, max= 56, avg=31.40, stdev= 9.23, samples=97 lat (usec) : 50=0.33%, 100=1.86%, 250=1.60%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=2.93%, 4=9.77%, 10=18.59%, 20=36.78%, 50=26.27% lat (msec) : 100=1.53%, 250=0.16%, 750=0.03% cpu : usr=0.12%, sys=21.97%, ctx=8311, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=492KiB/s (504kB/s), 123KiB/s-126KiB/s (126kB/s-129kB/s), io=23.4MiB (24.6MB), run=47968-48816msec WRITE: bw=515KiB/s (527kB/s), 128KiB/s-132KiB/s (131kB/s-135kB/s), io=24.6MiB (25.7MB), run=47968-48816msec fio: pid=147120, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=147115: Wed Apr 29 18:10:09 2026 read: IOPS=17, BW=70.0KiB/s (72.7kB/s)(5992KiB/84401msec) clat (msec): min=3, max=611, avg=14.59, stdev=20.10 lat (msec): min=3, max=611, avg=14.59, stdev=20.10 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 29], 95.00th=[ 37], | 99.00th=[ 71], 99.50th=[ 91], 99.90th=[ 136], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8, max= 216, per=25.44%, avg=71.23, stdev=40.38, samples=167 iops : min= 2, max= 54, avg=17.55, stdev=10.16, samples=167 write: IOPS=18, BW=74.6KiB/s (76.4kB/s)(6296KiB/84401msec); 0 zone resets clat (msec): min=14, max=191, avg=39.62, stdev=19.53 lat (msec): min=14, max=191, avg=39.62, stdev=19.53 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 53], 90.00th=[ 66], 95.00th=[ 75], | 99.00th=[ 112], 99.50th=[ 130], 99.90th=[ 176], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 15, max= 152, per=25.42%, avg=74.72, stdev=32.50, samples=167 iops : min= 3, max= 38, avg=18.43, stdev= 8.21, samples=167 lat (msec) : 4=0.88%, 10=21.71%, 20=20.08%, 50=44.53%, 100=11.78% lat (msec) : 250=0.98%, 750=0.03% cpu : usr=0.10%, sys=6.62%, ctx=5903, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147118: Wed Apr 29 18:10:09 2026 read: IOPS=17, BW=69.8KiB/s (71.5kB/s)(5940KiB/85070msec) clat (msec): min=3, max=623, avg=14.87, stdev=20.95 lat (msec): min=3, max=623, avg=14.87, stdev=20.95 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 29], 95.00th=[ 39], | 99.00th=[ 62], 99.50th=[ 99], 99.90th=[ 199], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 176, per=25.01%, avg=70.04, stdev=39.52, samples=168 iops : min= 1, max= 44, avg=17.25, stdev= 9.97, samples=168 write: IOPS=18, BW=74.6KiB/s (76.4kB/s)(6348KiB/85070msec); 0 zone resets clat (msec): min=14, max=193, avg=39.57, stdev=19.29 lat (msec): min=14, max=193, avg=39.57, stdev=19.29 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 54], 90.00th=[ 65], 95.00th=[ 77], | 99.00th=[ 103], 99.50th=[ 117], 99.90th=[ 176], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 16, max= 152, per=25.41%, avg=74.70, stdev=32.92, samples=168 iops : min= 4, max= 38, avg=18.42, stdev= 8.30, samples=168 lat (msec) : 4=0.75%, 10=21.45%, 20=18.91%, 50=45.64%, 100=12.47% lat (msec) : 250=0.75%, 750=0.03% cpu : usr=0.09%, sys=6.63%, ctx=5960, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=147120: Wed Apr 29 18:10:09 2026 read: IOPS=17, BW=70.9KiB/s (72.6kB/s)(5912KiB/83387msec) clat (msec): min=3, max=152, avg=14.44, stdev=12.43 lat (msec): min=3, max=152, avg=14.44, stdev=12.43 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 20], 90.00th=[ 30], 95.00th=[ 39], | 99.00th=[ 63], 99.50th=[ 73], 99.90th=[ 101], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 8, max= 176, per=25.42%, avg=71.18, stdev=37.62, samples=165 iops : min= 2, max= 44, avg=17.54, stdev= 9.45, samples=165 write: IOPS=18, BW=73.6KiB/s (75.3kB/s)(6136KiB/83387msec); 0 zone resets clat (msec): min=13, max=661, avg=40.32, stdev=24.58 lat (msec): min=13, max=661, avg=40.32, stdev=24.58 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 55], 90.00th=[ 65], 95.00th=[ 74], | 99.00th=[ 103], 99.50th=[ 122], 99.90th=[ 169], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 23, max= 160, per=25.08%, avg=73.75, stdev=32.74, samples=165 iops : min= 5, max= 40, avg=18.18, stdev= 8.29, samples=165 lat (msec) : 4=0.73%, 10=21.74%, 20=19.55%, 50=44.34%, 100=12.94% lat (msec) : 250=0.63%, 750=0.03% cpu : usr=0.10%, sys=6.78%, ctx=5789, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1479,1534,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147122: Wed Apr 29 18:10:09 2026 read: IOPS=17, BW=71.8KiB/s (73.5kB/s)(6052KiB/84304msec) clat (msec): min=3, max=154, avg=14.51, stdev=13.66 lat (msec): min=3, max=154, avg=14.51, stdev=13.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 31], 95.00th=[ 40], | 99.00th=[ 66], 99.50th=[ 107], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 7, max= 216, per=25.73%, avg=72.04, stdev=40.09, samples=167 iops : min= 1, max= 54, avg=17.75, stdev=10.12, samples=167 write: IOPS=18, BW=73.0KiB/s (75.7kB/s)(6236KiB/84304msec); 0 zone resets clat (msec): min=15, max=655, avg=39.87, stdev=24.83 lat (msec): min=15, max=655, avg=39.87, stdev=24.83 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 54], 90.00th=[ 66], 95.00th=[ 77], | 99.00th=[ 109], 99.50th=[ 123], 99.90th=[ 211], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 23, max= 152, per=25.24%, avg=74.20, stdev=32.53, samples=167 iops : min= 5, max= 38, avg=18.29, stdev= 8.21, samples=167 lat (msec) : 4=0.78%, 10=22.59%, 20=18.46%, 50=45.64%, 100=11.65% lat (msec) : 250=0.85%, 750=0.03% cpu : usr=0.10%, sys=6.59%, ctx=5751, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=281KiB/s (288kB/s), 69.8KiB/s-71.8KiB/s (71.5kB/s-73.5kB/s), io=23.3MiB (24.5MB), run=83387-85070msec WRITE: bw=294KiB/s (301kB/s), 73.6KiB/s-74.6KiB/s (75.3kB/s-76.4kB/s), io=24.4MiB (25.6MB), run=83387-85070msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147148: Wed Apr 29 18:10:30 2026 read: IOPS=25, BW=415KiB/s (424kB/s)(5920KiB/14282msec) clat (usec): min=45, max=78937, avg=19080.83, stdev=13207.05 lat (usec): min=45, max=78938, avg=19081.79, stdev=13207.07 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 104], 10.00th=[ 178], 20.00th=[ 9765], | 30.00th=[12387], 40.00th=[15139], 50.00th=[17433], 60.00th=[20317], | 70.00th=[24249], 80.00th=[27395], 90.00th=[34341], 95.00th=[42206], | 99.00th=[66847], 99.50th=[74974], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 223, max= 576, per=24.50%, avg=408.00, stdev=106.39, samples=28 iops : min= 13, max= 36, avg=24.89, stdev= 6.65, samples=28 write: IOPS=27, BW=446KiB/s (457kB/s)(6368KiB/14282msec); 0 zone resets clat (usec): min=1531, max=116026, avg=18060.95, stdev=14212.12 lat (usec): min=1532, max=116029, avg=18062.78, stdev=14212.24 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 39], 95.00th=[ 42], | 99.00th=[ 62], 99.50th=[ 79], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 256, max= 795, per=25.30%, avg=443.00, stdev=128.05, samples=28 iops : min= 16, max= 49, avg=27.07, stdev= 8.08, samples=28 lat (usec) : 50=0.13%, 100=2.08%, 250=3.91%, 500=0.39%, 1000=0.13% lat (msec) : 2=0.39%, 4=4.30%, 10=18.23%, 20=32.16%, 50=35.81% lat (msec) : 100=2.34%, 250=0.13% cpu : usr=0.11%, sys=27.76%, ctx=2647, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147150: Wed Apr 29 18:10:30 2026 read: IOPS=25, BW=406KiB/s (416kB/s)(5744KiB/14140msec) clat (usec): min=39, max=79677, avg=20217.21, stdev=12915.29 lat (usec): min=40, max=79678, avg=20218.13, stdev=12915.34 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 129], 10.00th=[ 215], 20.00th=[11076], | 30.00th=[13960], 40.00th=[16450], 50.00th=[19530], 60.00th=[22152], | 70.00th=[24773], 80.00th=[28705], 90.00th=[35390], 95.00th=[41681], | 99.00th=[64750], 99.50th=[77071], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 253, max= 637, per=24.39%, avg=406.15, stdev=113.36, samples=27 iops : min= 15, max= 39, avg=24.74, stdev= 7.07, samples=27 write: IOPS=28, BW=463KiB/s (474kB/s)(6544KiB/14140msec); 0 zone resets clat (usec): min=1355, max=84891, avg=16669.12, stdev=12872.39 lat (usec): min=1355, max=84894, avg=16670.98, stdev=12872.49 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 3556], 10.00th=[ 4293], 20.00th=[ 6128], | 30.00th=[ 7767], 40.00th=[10421], 50.00th=[13042], 60.00th=[16319], | 70.00th=[21365], 80.00th=[26870], 90.00th=[33424], 95.00th=[38536], | 99.00th=[60031], 99.50th=[77071], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 287, max= 640, per=26.12%, avg=457.37, stdev=112.37, samples=27 iops : min= 17, max= 40, avg=27.96, stdev= 7.08, samples=27 lat (usec) : 50=0.13%, 100=1.17%, 250=4.04%, 500=0.26% lat (msec) : 2=1.30%, 4=3.39%, 10=18.49%, 20=31.90%, 50=37.24% lat (msec) : 100=2.08% cpu : usr=0.15%, sys=28.78%, ctx=2609, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147151: Wed Apr 29 18:10:30 2026 read: IOPS=27, BW=435KiB/s (445kB/s)(6256KiB/14384msec) clat (usec): min=68, max=64975, avg=19775.83, stdev=11936.34 lat (usec): min=69, max=64976, avg=19782.66, stdev=11935.49 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 128], 10.00th=[ 204], 20.00th=[10945], | 30.00th=[14091], 40.00th=[16909], 50.00th=[19530], 60.00th=[22152], | 70.00th=[24773], 80.00th=[28443], 90.00th=[34341], 95.00th=[41157], | 99.00th=[50594], 99.50th=[63701], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 253, max= 734, per=25.89%, avg=431.00, stdev=123.98, samples=28 iops : min= 15, max= 45, avg=26.32, stdev= 7.73, samples=28 write: IOPS=26, BW=419KiB/s (429kB/s)(6032KiB/14384msec); 0 zone resets clat (usec): min=1728, max=87607, avg=17450.49, stdev=12992.41 lat (usec): min=1729, max=87608, avg=17452.40, stdev=12992.39 clat percentiles (usec): | 1.00th=[ 2245], 5.00th=[ 3425], 10.00th=[ 4293], 20.00th=[ 6325], | 30.00th=[ 8356], 40.00th=[10552], 50.00th=[13304], 60.00th=[17957], | 70.00th=[22152], 80.00th=[28443], 90.00th=[35914], 95.00th=[41681], | 99.00th=[51643], 99.50th=[70779], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 223, max= 734, per=23.29%, avg=407.79, stdev=111.07, samples=28 iops : min= 13, max= 45, avg=24.86, stdev= 7.05, samples=28 lat (usec) : 100=1.17%, 250=4.69%, 500=0.65% lat (msec) : 2=0.26%, 4=3.78%, 10=17.06%, 20=29.56%, 50=41.41% lat (msec) : 100=1.43% cpu : usr=0.15%, sys=28.14%, ctx=2601, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147152: Wed Apr 29 18:10:30 2026 read: IOPS=26, BW=427KiB/s (438kB/s)(6032KiB/14115msec) clat (usec): min=57, max=99596, avg=19433.04, stdev=14373.59 lat (usec): min=58, max=99597, avg=19434.14, stdev=14373.41 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 118], 10.00th=[ 169], 20.00th=[ 9372], | 30.00th=[12387], 40.00th=[16057], 50.00th=[18482], 60.00th=[21103], | 70.00th=[24511], 80.00th=[30278], 90.00th=[34866], 95.00th=[41157], | 99.00th=[71828], 99.50th=[89654], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 191, max= 574, per=25.29%, avg=421.07, stdev=100.11, samples=27 iops : min= 11, max= 35, avg=25.67, stdev= 6.28, samples=27 write: IOPS=27, BW=443KiB/s (454kB/s)(6256KiB/14115msec); 0 zone resets clat (usec): min=1334, max=98266, avg=17201.79, stdev=13548.84 lat (usec): min=1335, max=98268, avg=17203.68, stdev=13548.77 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2966], 10.00th=[ 3982], 20.00th=[ 5604], | 30.00th=[ 7111], 40.00th=[10290], 50.00th=[13566], 60.00th=[17695], | 70.00th=[22152], 80.00th=[27132], 90.00th=[34866], 95.00th=[42206], | 99.00th=[61080], 99.50th=[69731], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 223, max= 667, per=25.11%, avg=439.59, stdev=115.68, samples=27 iops : min= 13, max= 41, avg=26.85, stdev= 7.26, samples=27 lat (usec) : 100=1.43%, 250=5.73%, 500=1.04%, 750=0.13% lat (msec) : 2=0.78%, 4=4.43%, 10=17.19%, 20=30.73%, 50=35.81% lat (msec) : 100=2.73% cpu : usr=0.16%, sys=27.72%, ctx=2505, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1665KiB/s (1705kB/s), 406KiB/s-435KiB/s (416kB/s-445kB/s), io=23.4MiB (24.5MB), run=14115-14384msec WRITE: bw=1752KiB/s (1794kB/s), 419KiB/s-463KiB/s (429kB/s-474kB/s), io=24.6MiB (25.8MB), run=14115-14384msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147153: Wed Apr 29 18:10:38 2026 read: IOPS=16, BW=265KiB/s (271kB/s)(5920KiB/22355msec) clat (msec): min=3, max=112, avg=16.16, stdev=14.81 lat (msec): min=3, max=112, avg=16.16, stdev=14.81 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 72], 99.50th=[ 80], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 63, max= 672, per=24.55%, avg=262.39, stdev=143.06, samples=44 iops : min= 3, max= 42, avg=15.98, stdev= 9.05, samples=44 write: IOPS=17, BW=285KiB/s (292kB/s)(6368KiB/22355msec); 0 zone resets clat (msec): min=18, max=143, avg=40.82, stdev=20.99 lat (msec): min=18, max=143, avg=40.82, stdev=20.99 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 68], 95.00th=[ 87], | 99.00th=[ 111], 99.50th=[ 127], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 96, max= 512, per=25.22%, avg=283.77, stdev=135.90, samples=44 iops : min= 6, max= 32, avg=17.32, stdev= 8.65, samples=44 lat (msec) : 4=0.13%, 10=25.00%, 20=10.42%, 50=50.13%, 100=12.76% lat (msec) : 250=1.56% cpu : usr=0.07%, sys=8.93%, ctx=1671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147154: Wed Apr 29 18:10:38 2026 read: IOPS=16, BW=256KiB/s (263kB/s)(5744KiB/22397msec) clat (msec): min=4, max=137, avg=17.06, stdev=17.99 lat (msec): min=4, max=137, avg=17.06, stdev=17.99 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 17], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 54], | 99.00th=[ 101], 99.50th=[ 106], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 736, per=23.86%, avg=255.11, stdev=160.80, samples=44 iops : min= 1, max= 46, avg=15.52, stdev=10.17, samples=44 write: IOPS=18, BW=292KiB/s (299kB/s)(6544KiB/22397msec); 0 zone resets clat (msec): min=17, max=126, avg=39.57, stdev=18.63 lat (msec): min=17, max=126, avg=39.57, stdev=18.63 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 64], 95.00th=[ 80], | 99.00th=[ 108], 99.50th=[ 115], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 127, max= 512, per=25.79%, avg=290.14, stdev=129.21, samples=44 iops : min= 7, max= 32, avg=17.70, stdev= 8.21, samples=44 lat (msec) : 10=25.91%, 20=10.55%, 50=49.35%, 100=13.02%, 250=1.17% cpu : usr=0.06%, sys=8.88%, ctx=1687, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147155: Wed Apr 29 18:10:38 2026 read: IOPS=17, BW=287KiB/s (294kB/s)(6256KiB/21826msec) clat (msec): min=4, max=145, avg=16.63, stdev=16.90 lat (msec): min=4, max=145, avg=16.63, stdev=16.90 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 25], 90.00th=[ 39], 95.00th=[ 57], | 99.00th=[ 79], 99.50th=[ 85], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 63, max= 768, per=27.01%, avg=288.72, stdev=167.00, samples=43 iops : min= 3, max= 48, avg=17.60, stdev=10.60, samples=43 write: IOPS=17, BW=276KiB/s (283kB/s)(6032KiB/21826msec); 0 zone resets clat (msec): min=18, max=127, avg=40.35, stdev=18.19 lat (msec): min=18, max=127, avg=40.35, stdev=18.19 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 55], 90.00th=[ 67], 95.00th=[ 78], | 99.00th=[ 102], 99.50th=[ 109], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 96, max= 544, per=24.41%, avg=274.58, stdev=129.48, samples=43 iops : min= 6, max= 34, avg=16.72, stdev= 8.19, samples=43 lat (msec) : 10=27.60%, 20=11.72%, 50=44.79%, 100=15.23%, 250=0.65% cpu : usr=0.09%, sys=9.18%, ctx=1645, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147156: Wed Apr 29 18:10:38 2026 read: IOPS=16, BW=272KiB/s (278kB/s)(6032KiB/22191msec) clat (msec): min=3, max=113, avg=17.58, stdev=18.10 lat (msec): min=3, max=113, avg=17.58, stdev=18.10 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 58], | 99.00th=[ 95], 99.50th=[ 108], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 95, max= 640, per=25.32%, avg=270.64, stdev=138.89, samples=44 iops : min= 5, max= 40, avg=16.50, stdev= 8.84, samples=44 write: IOPS=17, BW=282KiB/s (289kB/s)(6256KiB/22191msec); 0 zone resets clat (msec): min=15, max=138, avg=39.69, stdev=18.96 lat (msec): min=15, max=138, avg=39.69, stdev=18.96 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 23], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 64], 95.00th=[ 79], | 99.00th=[ 104], 99.50th=[ 126], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 96, max= 640, per=25.14%, avg=282.80, stdev=140.25, samples=44 iops : min= 6, max= 40, avg=17.25, stdev= 8.90, samples=44 lat (msec) : 4=0.13%, 10=25.52%, 20=12.24%, 50=47.40%, 100=13.54% lat (msec) : 250=1.17% cpu : usr=0.09%, sys=9.15%, ctx=1661, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1069KiB/s (1095kB/s), 256KiB/s-287KiB/s (263kB/s-294kB/s), io=23.4MiB (24.5MB), run=21826-22397msec WRITE: bw=1125KiB/s (1152kB/s), 276KiB/s-292KiB/s (283kB/s-299kB/s), io=24.6MiB (25.8MB), run=21826-22397msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147166: Wed Apr 29 18:10:47 2026 read: IOPS=2, BW=3021KiB/s (3093kB/s)(7168KiB/2373msec) clat (msec): min=47, max=1005, avg=224.60, stdev=346.78 lat (msec): min=47, max=1005, avg=224.60, stdev=346.78 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 51], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 121], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 144], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 4087, max= 5171, per=77.89%, avg=4629.00, stdev=766.50, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2158KiB/s (2209kB/s)(5120KiB/2373msec); 0 zone resets clat (msec): min=79, max=232, avg=154.25, stdev=61.56 lat (msec): min=79, max=232, avg=154.32, stdev=61.58 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 1723, max= 4096, per=31.50%, avg=2620.67, stdev=1287.66, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=58.33%, 2000=8.33% cpu : usr=0.00%, sys=13.62%, ctx=132, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147167: Wed Apr 29 18:10:47 2026 read: IOPS=0, BW=594KiB/s (609kB/s)(2048KiB/3446msec) clat (usec): min=48742, max=77432, avg=63087.54, stdev=20286.69 lat (usec): min=48744, max=77433, avg=63088.97, stdev=20285.80 clat percentiles (usec): | 1.00th=[48497], 5.00th=[48497], 10.00th=[48497], 20.00th=[48497], | 30.00th=[48497], 40.00th=[48497], 50.00th=[48497], 60.00th=[77071], | 70.00th=[77071], 80.00th=[77071], 90.00th=[77071], 95.00th=[77071], | 99.00th=[77071], 99.50th=[77071], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 1721, max= 1988, per=31.20%, avg=1854.50, stdev=188.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2972KiB/s (3043kB/s)(10.0MiB/3446msec); 0 zone resets clat (msec): min=77, max=1360, avg=328.50, stdev=378.37 lat (msec): min=77, max=1360, avg=328.57, stdev=378.37 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 86], | 30.00th=[ 114], 40.00th=[ 167], 50.00th=[ 186], 60.00th=[ 257], | 70.00th=[ 321], 80.00th=[ 330], 90.00th=[ 388], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1988, max= 5807, per=41.76%, avg=3474.40, stdev=1585.98, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.48, samples=5 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=12.66%, ctx=103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147168: Wed Apr 29 18:10:47 2026 read: IOPS=2, BW=2131KiB/s (2182kB/s)(6144KiB/2883msec) clat (msec): min=49, max=366, avg=168.79, stdev=107.33 lat (msec): min=49, max=366, avg=168.79, stdev=107.33 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2043, max= 3976, per=45.25%, avg=2689.00, stdev=1114.58, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2131KiB/s (2182kB/s)(6144KiB/2883msec); 0 zone resets clat (msec): min=66, max=1378, avg=309.86, stdev=524.11 lat (msec): min=66, max=1378, avg=309.93, stdev=524.13 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 131], | 70.00th=[ 132], 80.00th=[ 132], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1988, max= 3447, per=28.62%, avg=2381.50, stdev=710.85, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=50.00%, 500=8.33%, 2000=8.33% cpu : usr=0.03%, sys=8.29%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147169: Wed Apr 29 18:10:47 2026 read: IOPS=1, BW=1632KiB/s (1671kB/s)(5120KiB/3137msec) clat (msec): min=83, max=177, avg=118.89, stdev=42.66 lat (msec): min=83, max=177, avg=118.89, stdev=42.66 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 99], 60.00th=[ 99], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 178], 95.00th=[ 178], | 99.00th=[ 178], 99.50th=[ 178], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 1988, max= 6144, per=68.42%, avg=4066.00, stdev=2938.74, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2285KiB/s (2340kB/s)(7168KiB/3137msec); 0 zone resets clat (msec): min=58, max=1367, avg=356.28, stdev=471.67 lat (msec): min=58, max=1367, avg=356.41, stdev=471.62 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 117], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 142], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 523], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1723, max= 4096, per=29.60%, avg=2462.50, stdev=1097.92, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=33.33%, 250=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.02%, ctx=121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5943KiB/s (6086kB/s), 594KiB/s-3021KiB/s (609kB/s-3093kB/s), io=20.0MiB (20.0MB), run=2373-3446msec WRITE: bw=8320KiB/s (8520kB/s), 2131KiB/s-2972KiB/s (2182kB/s-3043kB/s), io=28.0MiB (29.4MB), run=2373-3446msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147171: Wed Apr 29 18:10:47 2026 read: IOPS=2, BW=2124KiB/s (2175kB/s)(7168KiB/3374msec) clat (msec): min=11, max=1190, avg=254.88, stdev=416.97 lat (msec): min=11, max=1190, avg=254.88, stdev=416.97 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 12], 10.00th=[ 12], 20.00th=[ 34], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 108], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 171], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1712, max= 4096, per=49.64%, avg=2983.75, stdev=1281.88, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=1, BW=1517KiB/s (1554kB/s)(5120KiB/3374msec); 0 zone resets clat (msec): min=233, max=432, avg=312.31, stdev=74.09 lat (msec): min=233, max=432, avg=312.39, stdev=74.10 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2007, max= 4096, per=32.29%, avg=2717.00, stdev=1194.42, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 20=8.33%, 50=8.33%, 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=29.59%, ctx=1076, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147172: Wed Apr 29 18:10:47 2026 read: IOPS=0, BW=601KiB/s (616kB/s)(2048KiB/3407msec) clat (msec): min=115, max=148, avg=131.89, stdev=22.88 lat (msec): min=115, max=148, avg=131.89, stdev=22.88 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 148], 95.00th=[ 148], | 99.00th=[ 148], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 1768, max= 2007, per=31.40%, avg=1887.50, stdev=169.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3006KiB/s (3078kB/s)(10.0MiB/3407msec); 0 zone resets clat (msec): min=69, max=1495, avg=309.75, stdev=430.41 lat (msec): min=69, max=1495, avg=309.83, stdev=430.41 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 71], | 30.00th=[ 88], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 218], | 70.00th=[ 241], 80.00th=[ 262], 90.00th=[ 414], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 2048, max= 4096, per=40.69%, avg=3424.00, stdev=949.91, samples=4 iops : min= 2, max= 4, avg= 3.00, stdev= 0.82, samples=4 lat (msec) : 100=25.00%, 250=50.00%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=29.89%, ctx=350, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147173: Wed Apr 29 18:10:47 2026 read: IOPS=1, BW=1893KiB/s (1939kB/s)(6144KiB/3245msec) clat (msec): min=113, max=174, avg=144.26, stdev=23.95 lat (msec): min=113, max=174, avg=144.26, stdev=23.95 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 2007, max= 4096, per=56.56%, avg=3399.67, stdev=1206.08, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1893KiB/s (1939kB/s)(6144KiB/3245msec); 0 zone resets clat (msec): min=120, max=1394, avg=385.74, stdev=504.42 lat (msec): min=120, max=1394, avg=385.83, stdev=504.41 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 146], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 2007, max= 4096, per=34.76%, avg=2925.00, stdev=1060.26, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 250=83.33%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=31.94%, ctx=931, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147174: Wed Apr 29 18:10:47 2026 read: IOPS=1, BW=1581KiB/s (1619kB/s)(5120KiB/3239msec) clat (usec): min=409, max=180332, avg=70926.98, stdev=96494.49 lat (usec): min=409, max=180333, avg=70927.99, stdev=96494.75 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 408], 10.00th=[ 408], 20.00th=[ 408], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 545], 60.00th=[ 545], | 70.00th=[173016], 80.00th=[173016], 90.00th=[179307], 95.00th=[179307], | 99.00th=[179307], 99.50th=[179307], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2213KiB/s (2266kB/s)(7168KiB/3239msec); 0 zone resets clat (msec): min=147, max=1355, avg=406.41, stdev=425.41 lat (msec): min=147, max=1355, avg=406.48, stdev=425.42 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 180], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 253], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 1747, max= 4096, per=28.37%, avg=2387.40, stdev=963.16, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=29.18%, ctx=535, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6011KiB/s (6155kB/s), 601KiB/s-2124KiB/s (616kB/s-2175kB/s), io=20.0MiB (20.0MB), run=3239-3407msec WRITE: bw=8416KiB/s (8618kB/s), 1517KiB/s-3006KiB/s (1554kB/s-3078kB/s), io=28.0MiB (29.4MB), run=3239-3407msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147181: Wed Apr 29 18:10:55 2026 read: IOPS=3, BW=15.6MiB/s (16.3MB/s)(12.0MiB/770msec) clat (msec): min=175, max=343, avg=234.19, stdev=94.79 lat (msec): min=175, max=343, avg=234.19, stdev=94.79 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min=13170, max=13170, per=100.00%, avg=13170.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=31.60%, ctx=289, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147183: Wed Apr 29 18:10:55 2026 read: IOPS=0, BW=2246KiB/s (2300kB/s)(4096KiB/1824msec) clat (nsec): min=512609k, max=512609k, avg=512608812.00, stdev= 0.00 lat (nsec): min=512610k, max=512610k, avg=512609842.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 6574, max= 6574, per=73.19%, avg=6574.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4491KiB/s (4599kB/s)(8192KiB/1824msec); 0 zone resets clat (msec): min=390, max=852, avg=621.42, stdev=326.83 lat (msec): min=390, max=852, avg=621.71, stdev=326.82 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=45.60%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=12.45%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147185: Wed Apr 29 18:10:55 2026 write: IOPS=1, BW=7753KiB/s (7939kB/s)(12.0MiB/1585msec); 0 zone resets clat (msec): min=172, max=982, avg=505.76, stdev=423.54 lat (msec): min=172, max=983, avg=506.29, stdev=423.94 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8192, max= 8192, per=45.60%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.15%, ctx=57, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147187: Wed Apr 29 18:10:55 2026 write: IOPS=1, BW=7543KiB/s (7724kB/s)(12.0MiB/1629msec); 0 zone resets clat (msec): min=160, max=1003, avg=517.41, stdev=436.16 lat (msec): min=160, max=1003, avg=517.65, stdev=436.09 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 6532, max= 6532, per=36.36%, avg=6532.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.22%, ctx=88, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8982KiB/s (9198kB/s), 2246KiB/s-15.6MiB/s (2300kB/s-16.3MB/s), io=16.0MiB (16.8MB), run=770-1824msec WRITE: bw=17.5MiB/s (18.4MB/s), 4491KiB/s-7753KiB/s (4599kB/s-7939kB/s), io=32.0MiB (33.6MB), run=1585-1824msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147180: Wed Apr 29 18:10:55 2026 read: IOPS=2, BW=9302KiB/s (9525kB/s)(12.0MiB/1321msec) clat (msec): min=373, max=446, avg=414.94, stdev=37.77 lat (msec): min=373, max=446, avg=414.94, stdev=37.77 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 6311, max= 8192, per=75.11%, avg=7251.50, stdev=1330.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=45.38%, ctx=2729, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147182: Wed Apr 29 18:10:55 2026 read: IOPS=0, BW=2414KiB/s (2472kB/s)(4096KiB/1697msec) clat (nsec): min=457095k, max=457095k, avg=457095158.00, stdev= 0.00 lat (nsec): min=457096k, max=457096k, avg=457096385.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 5712, max= 5712, per=59.17%, avg=5712.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4827KiB/s (4943kB/s)(8192KiB/1697msec); 0 zone resets clat (msec): min=421, max=683, avg=552.64, stdev=184.98 lat (msec): min=422, max=683, avg=552.98, stdev=185.06 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=23.76%, ctx=733, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147184: Wed Apr 29 18:10:55 2026 write: IOPS=1, BW=6457KiB/s (6612kB/s)(12.0MiB/1903msec); 0 zone resets clat (msec): min=119, max=1166, avg=587.35, stdev=532.59 lat (msec): min=119, max=1167, avg=587.55, stdev=532.55 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8192, max= 8192, per=47.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=15.40%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147186: Wed Apr 29 18:10:55 2026 write: IOPS=2, BW=8715KiB/s (8924kB/s)(12.0MiB/1410msec); 0 zone resets clat (msec): min=214, max=563, avg=443.43, stdev=198.25 lat (msec): min=215, max=564, avg=443.73, stdev=198.15 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 6187, max= 8192, per=41.75%, avg=7189.50, stdev=1417.75, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.14%, sys=17.89%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9655KiB/s (9886kB/s), 2414KiB/s-9302KiB/s (2472kB/s-9525kB/s), io=16.0MiB (16.8MB), run=1321-1697msec WRITE: bw=16.8MiB/s (17.6MB/s), 4827KiB/s-8715KiB/s (4943kB/s-8924kB/s), io=32.0MiB (33.6MB), run=1410-1903msec