== sanity test 398b: DIO and buffer IO race ============== 22:20:32 (1772680832) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.86497 s, 17.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190644: Wed Mar 4 22:21:53 2026 read: IOPS=21, BW=84.1KiB/s (86.1kB/s)(5992KiB/71279msec) clat (usec): min=486, max=706275, avg=25791.67, stdev=21560.59 lat (usec): min=486, max=706275, avg=25792.42, stdev=21560.60 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 9634], 10.00th=[ 11863], 20.00th=[ 15139], | 30.00th=[ 18220], 40.00th=[ 20579], 50.00th=[ 23200], 60.00th=[ 26608], | 70.00th=[ 30540], 80.00th=[ 34341], 90.00th=[ 41157], 95.00th=[ 47449], | 99.00th=[ 67634], 99.50th=[ 72877], 99.90th=[117965], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 191, per=24.90%, avg=83.18, stdev=26.91, samples=141 iops : min= 1, max= 47, avg=20.28, stdev= 6.76, samples=141 write: IOPS=22, BW=88.3KiB/s (90.4kB/s)(6296KiB/71279msec); 0 zone resets clat (usec): min=854, max=83528, avg=20600.71, stdev=13713.83 lat (usec): min=854, max=83528, avg=20601.72, stdev=13713.85 clat percentiles (usec): | 1.00th=[ 2835], 5.00th=[ 4015], 10.00th=[ 5407], 20.00th=[ 7570], | 30.00th=[11076], 40.00th=[14484], 50.00th=[17957], 60.00th=[21890], | 70.00th=[25822], 80.00th=[31851], 90.00th=[40109], 95.00th=[46924], | 99.00th=[60556], 99.50th=[64750], 99.90th=[76022], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 24, max= 183, per=25.10%, avg=87.60, stdev=28.35, samples=140 iops : min= 6, max= 45, avg=21.39, stdev= 7.07, samples=140 lat (usec) : 500=0.03%, 750=0.23%, 1000=0.55% lat (msec) : 2=0.49%, 4=2.34%, 10=12.79%, 20=30.11%, 50=50.13% lat (msec) : 100=3.22%, 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=27.32%, ctx=11434, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190646: Wed Mar 4 22:21:53 2026 read: IOPS=20, BW=83.4KiB/s (85.4kB/s)(5940KiB/71257msec) clat (usec): min=398, max=80898, avg=25840.74, stdev=11688.98 lat (usec): min=398, max=80900, avg=25842.10, stdev=11689.19 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[10290], 10.00th=[12780], 20.00th=[15795], | 30.00th=[19006], 40.00th=[21365], 50.00th=[23987], 60.00th=[26870], | 70.00th=[30540], 80.00th=[34866], 90.00th=[41157], 95.00th=[48497], | 99.00th=[58983], 99.50th=[63701], 99.90th=[78119], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 7, max= 159, per=24.77%, avg=82.72, stdev=25.28, samples=141 iops : min= 1, max= 39, avg=20.16, stdev= 6.33, samples=141 write: IOPS=22, BW=89.1KiB/s (91.2kB/s)(6348KiB/71257msec); 0 zone resets clat (usec): min=899, max=685869, avg=20597.42, stdev=21332.55 lat (usec): min=900, max=685870, avg=20598.38, stdev=21332.60 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 61], 99.50th=[ 66], 99.90th=[ 99], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 24, max= 191, per=25.41%, avg=88.69, stdev=31.69, samples=140 iops : min= 6, max= 47, avg=21.66, stdev= 7.94, samples=140 lat (usec) : 500=0.07%, 750=0.07%, 1000=0.16% lat (msec) : 2=0.55%, 4=2.51%, 10=12.40%, 20=29.59%, 50=51.17% lat (msec) : 100=3.45%, 750=0.03% cpu : usr=0.10%, sys=27.87%, ctx=11458, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190648: Wed Mar 4 22:21:53 2026 read: IOPS=21, BW=84.6KiB/s (86.6kB/s)(6028KiB/71244msec) clat (usec): min=148, max=90977, avg=25683.89, stdev=11945.68 lat (usec): min=148, max=90978, avg=25686.63, stdev=11944.65 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 9765], 10.00th=[12387], 20.00th=[15533], | 30.00th=[18482], 40.00th=[21103], 50.00th=[24249], 60.00th=[27395], | 70.00th=[30802], 80.00th=[34866], 90.00th=[41157], 95.00th=[46924], | 99.00th=[61080], 99.50th=[67634], 99.90th=[81265], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 39, max= 167, per=25.25%, avg=84.35, stdev=24.06, samples=140 iops : min= 9, max= 41, avg=20.57, stdev= 6.00, samples=140 write: IOPS=21, BW=87.9KiB/s (89.0kB/s)(6260KiB/71244msec); 0 zone resets clat (usec): min=903, max=723591, avg=20663.17, stdev=22099.83 lat (usec): min=904, max=723592, avg=20665.17, stdev=22100.51 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 61], 99.50th=[ 68], 99.90th=[ 93], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 31, max= 183, per=25.05%, avg=87.44, stdev=28.36, samples=140 iops : min= 7, max= 45, avg=21.34, stdev= 7.10, samples=140 lat (usec) : 250=0.03%, 750=0.07%, 1000=0.29% lat (msec) : 2=0.81%, 4=2.12%, 10=12.37%, 20=31.18%, 50=50.00% lat (msec) : 100=3.09%, 750=0.03% cpu : usr=0.08%, sys=27.63%, ctx=11509, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190650: Wed Mar 4 22:21:53 2026 read: IOPS=21, BW=84.2KiB/s (86.3kB/s)(6052KiB/71841msec) clat (usec): min=296, max=140782, avg=25355.81, stdev=12218.40 lat (usec): min=297, max=140783, avg=25356.66, stdev=12218.58 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 9765], 10.00th=[ 12125], 20.00th=[ 15533], | 30.00th=[ 18482], 40.00th=[ 21103], 50.00th=[ 23725], 60.00th=[ 26608], | 70.00th=[ 30016], 80.00th=[ 33817], 90.00th=[ 40109], 95.00th=[ 45876], | 99.00th=[ 61604], 99.50th=[ 70779], 99.90th=[ 90702], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 16, max= 216, per=25.28%, avg=84.44, stdev=28.18, samples=142 iops : min= 4, max= 54, avg=20.60, stdev= 7.06, samples=142 write: IOPS=21, BW=86.8KiB/s (88.9kB/s)(6236KiB/71841msec); 0 zone resets clat (usec): min=1044, max=724711, avg=21342.67, stdev=22612.83 lat (usec): min=1045, max=724712, avg=21343.60, stdev=22612.86 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 48], | 99.00th=[ 64], 99.50th=[ 72], 99.90th=[ 95], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 31, max= 216, per=24.91%, avg=86.93, stdev=28.12, samples=142 iops : min= 7, max= 54, avg=21.22, stdev= 7.06, samples=142 lat (usec) : 500=0.10%, 750=0.20%, 1000=0.20% lat (msec) : 2=0.81%, 4=2.31%, 10=12.17%, 20=30.01%, 50=50.85% lat (msec) : 100=3.29%, 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=27.30%, ctx=11664, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=334KiB/s (342kB/s), 83.4KiB/s-84.6KiB/s (85.4kB/s-86.6kB/s), io=23.4MiB (24.6MB), run=71244-71841msec WRITE: bw=350KiB/s (358kB/s), 86.8KiB/s-89.1KiB/s (88.9kB/s-91.2kB/s), io=24.6MiB (25.7MB), run=71244-71841msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190643: Wed Mar 4 22:22:00 2026 read: IOPS=19, BW=76.2KiB/s (78.1kB/s)(5992KiB/78611msec) clat (msec): min=3, max=704, avg=23.66, stdev=23.69 lat (msec): min=3, max=704, avg=23.66, stdev=23.69 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 55], | 99.00th=[ 75], 99.50th=[ 91], 99.90th=[ 106], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 23, max= 280, per=24.84%, avg=75.76, stdev=46.14, samples=155 iops : min= 5, max= 70, avg=18.48, stdev=11.66, samples=155 write: IOPS=20, BW=80.1KiB/s (82.0kB/s)(6296KiB/78611msec); 0 zone resets clat (msec): min=5, max=138, avg=27.30, stdev=16.98 lat (msec): min=5, max=138, avg=27.30, stdev=16.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 41], 90.00th=[ 50], 95.00th=[ 60], | 99.00th=[ 80], 99.50th=[ 97], 99.90th=[ 121], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 23, max= 296, per=24.88%, avg=79.37, stdev=49.00, samples=155 iops : min= 5, max= 74, avg=19.39, stdev=12.36, samples=155 lat (msec) : 4=0.46%, 10=17.71%, 20=27.64%, 50=45.83%, 100=8.11% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.08%, sys=16.30%, ctx=7924, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190645: Wed Mar 4 22:22:00 2026 read: IOPS=18, BW=75.7KiB/s (77.5kB/s)(5940KiB/78439msec) clat (msec): min=3, max=705, avg=22.77, stdev=23.26 lat (msec): min=3, max=705, avg=22.77, stdev=23.26 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 73], 99.50th=[ 82], 99.90th=[ 113], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 16, max= 296, per=24.84%, avg=75.76, stdev=48.75, samples=155 iops : min= 4, max= 74, avg=18.48, stdev=12.30, samples=155 write: IOPS=20, BW=80.9KiB/s (82.9kB/s)(6348KiB/78439msec); 0 zone resets clat (msec): min=5, max=120, avg=27.99, stdev=17.33 lat (msec): min=5, max=120, avg=27.99, stdev=17.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 62], | 99.00th=[ 81], 99.50th=[ 101], 99.90th=[ 117], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 31, max= 280, per=25.32%, avg=80.77, stdev=46.66, samples=155 iops : min= 7, max= 70, avg=19.74, stdev=11.77, samples=155 lat (msec) : 4=0.13%, 10=16.76%, 20=30.92%, 50=43.29%, 100=8.50% lat (msec) : 250=0.36%, 750=0.03% cpu : usr=0.08%, sys=16.36%, ctx=7859, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190647: Wed Mar 4 22:22:00 2026 read: IOPS=19, BW=77.0KiB/s (78.9kB/s)(6028KiB/78243msec) clat (msec): min=2, max=128, avg=23.21, stdev=15.59 lat (msec): min=2, max=128, avg=23.21, stdev=15.59 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 55], | 99.00th=[ 69], 99.50th=[ 78], 99.90th=[ 102], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 15, max= 296, per=25.24%, avg=76.99, stdev=47.46, samples=154 iops : min= 3, max= 74, avg=18.79, stdev=11.97, samples=154 write: IOPS=20, BW=80.0KiB/s (81.9kB/s)(6260KiB/78243msec); 0 zone resets clat (msec): min=5, max=708, avg=27.53, stdev=23.72 lat (msec): min=5, max=708, avg=27.53, stdev=23.73 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 41], 90.00th=[ 49], 95.00th=[ 57], | 99.00th=[ 82], 99.50th=[ 90], 99.90th=[ 131], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 16, max= 296, per=25.05%, avg=79.90, stdev=47.27, samples=154 iops : min= 4, max= 74, avg=19.51, stdev=11.94, samples=154 lat (msec) : 4=0.26%, 10=16.37%, 20=29.30%, 50=46.22%, 100=7.58% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.08%, sys=16.43%, ctx=7918, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190649: Wed Mar 4 22:22:00 2026 read: IOPS=19, BW=77.2KiB/s (79.0kB/s)(6052KiB/78411msec) clat (msec): min=3, max=114, avg=22.95, stdev=15.49 lat (msec): min=3, max=114, avg=22.95, stdev=15.49 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 74], 99.50th=[ 89], 99.90th=[ 104], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 15, max= 336, per=25.32%, avg=77.21, stdev=47.55, samples=155 iops : min= 3, max= 84, avg=18.85, stdev=11.99, samples=155 write: IOPS=19, BW=79.5KiB/s (81.4kB/s)(6236KiB/78411msec); 0 zone resets clat (msec): min=5, max=710, avg=27.91, stdev=24.29 lat (msec): min=5, max=710, avg=27.91, stdev=24.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 60], | 99.00th=[ 80], 99.50th=[ 93], 99.90th=[ 138], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 23, max= 288, per=24.91%, avg=79.48, stdev=48.48, samples=155 iops : min= 5, max= 72, avg=19.41, stdev=12.25, samples=155 lat (msec) : 4=0.13%, 10=16.89%, 20=29.62%, 50=44.92%, 100=8.17% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.08%, sys=16.42%, ctx=7920, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=305KiB/s (313kB/s), 75.7KiB/s-77.2KiB/s (77.5kB/s-79.0kB/s), io=23.4MiB (24.6MB), run=78243-78611msec WRITE: bw=320KiB/s (327kB/s), 79.5KiB/s-80.9KiB/s (81.4kB/s-82.9kB/s), io=24.6MiB (25.7MB), run=78243-78611msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190671: Wed Mar 4 22:22:25 2026 read: IOPS=20, BW=320KiB/s (328kB/s)(5920KiB/18495msec) clat (usec): min=509, max=73981, avg=24114.81, stdev=13242.87 lat (usec): min=509, max=73982, avg=24115.67, stdev=13242.87 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 1221], 10.00th=[10945], 20.00th=[14091], | 30.00th=[16319], 40.00th=[19268], 50.00th=[21627], 60.00th=[24773], | 70.00th=[28443], 80.00th=[34341], 90.00th=[41157], 95.00th=[47449], | 99.00th=[67634], 99.50th=[73925], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 127, max= 544, per=24.35%, avg=315.39, stdev=117.58, samples=36 iops : min= 7, max= 34, avg=19.06, stdev= 7.45, samples=36 write: IOPS=21, BW=344KiB/s (353kB/s)(6368KiB/18495msec); 0 zone resets clat (msec): min=2, max=119, avg=23.76, stdev=16.32 lat (msec): min=2, max=119, avg=23.76, stdev=16.32 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 88], 99.50th=[ 110], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 159, max= 573, per=25.20%, avg=343.28, stdev=107.83, samples=36 iops : min= 9, max= 35, avg=20.81, stdev= 6.77, samples=36 lat (usec) : 750=1.43%, 1000=0.52% lat (msec) : 2=0.52%, 4=0.52%, 10=9.90%, 20=33.85%, 50=48.05% lat (msec) : 100=4.82%, 250=0.39% cpu : usr=0.12%, sys=28.61%, ctx=3237, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190672: Wed Mar 4 22:22:25 2026 read: IOPS=19, BW=315KiB/s (323kB/s)(5744KiB/18207msec) clat (usec): min=314, max=68060, avg=25526.77, stdev=12399.13 lat (usec): min=315, max=68060, avg=25527.86, stdev=12398.95 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[10028], 10.00th=[12518], 20.00th=[16188], | 30.00th=[19268], 40.00th=[21365], 50.00th=[23462], 60.00th=[26346], | 70.00th=[30016], 80.00th=[34341], 90.00th=[41157], 95.00th=[52691], | 99.00th=[60556], 99.50th=[67634], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 159, max= 479, per=24.39%, avg=315.89, stdev=91.12, samples=36 iops : min= 9, max= 29, avg=19.08, stdev= 5.76, samples=36 write: IOPS=22, BW=359KiB/s (368kB/s)(6544KiB/18207msec); 0 zone resets clat (usec): min=1783, max=91516, avg=21965.53, stdev=14051.80 lat (usec): min=1805, max=91519, avg=21967.05, stdev=14051.76 clat percentiles (usec): | 1.00th=[ 3884], 5.00th=[ 5669], 10.00th=[ 6783], 20.00th=[ 9765], | 30.00th=[12518], 40.00th=[15664], 50.00th=[18744], 60.00th=[22676], | 70.00th=[26870], 80.00th=[32375], 90.00th=[41681], 95.00th=[45876], | 99.00th=[69731], 99.50th=[73925], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 159, max= 670, per=26.30%, avg=358.25, stdev=122.13, samples=36 iops : min= 9, max= 41, avg=21.75, stdev= 7.73, samples=36 lat (usec) : 500=0.13%, 750=0.26%, 1000=1.17% lat (msec) : 2=0.52%, 4=0.52%, 10=10.55%, 20=31.25%, 50=51.17% lat (msec) : 100=4.43% cpu : usr=0.09%, sys=29.52%, ctx=3261, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190673: Wed Mar 4 22:22:25 2026 read: IOPS=21, BW=350KiB/s (358kB/s)(6256KiB/17879msec) clat (usec): min=182, max=78906, avg=24760.13, stdev=12735.01 lat (usec): min=183, max=78906, avg=24760.97, stdev=12735.08 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 1188], 10.00th=[11863], 20.00th=[15139], | 30.00th=[18482], 40.00th=[20317], 50.00th=[22938], 60.00th=[25297], | 70.00th=[28705], 80.00th=[33817], 90.00th=[41157], 95.00th=[49021], | 99.00th=[66847], 99.50th=[69731], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 126, max= 544, per=27.23%, avg=352.69, stdev=114.11, samples=35 iops : min= 7, max= 34, avg=21.40, stdev= 7.26, samples=35 write: IOPS=21, BW=337KiB/s (345kB/s)(6032KiB/17879msec); 0 zone resets clat (usec): min=1375, max=83885, avg=21684.63, stdev=14127.49 lat (usec): min=1376, max=83887, avg=21686.17, stdev=14127.70 clat percentiles (usec): | 1.00th=[ 3884], 5.00th=[ 5342], 10.00th=[ 6128], 20.00th=[ 9765], | 30.00th=[12518], 40.00th=[15008], 50.00th=[17695], 60.00th=[21890], | 70.00th=[25822], 80.00th=[33424], 90.00th=[41681], 95.00th=[50070], | 99.00th=[62653], 99.50th=[74974], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 159, max= 542, per=24.44%, avg=332.91, stdev=93.58, samples=35 iops : min= 9, max= 33, avg=20.17, stdev= 5.79, samples=35 lat (usec) : 250=0.13%, 500=0.13%, 750=1.04%, 1000=0.78% lat (msec) : 2=0.65%, 4=0.52%, 10=10.16%, 20=32.81%, 50=49.09% lat (msec) : 100=4.69% cpu : usr=0.07%, sys=29.40%, ctx=3219, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190674: Wed Mar 4 22:22:25 2026 read: IOPS=21, BW=345KiB/s (353kB/s)(6032KiB/17503msec) clat (usec): min=378, max=77879, avg=24191.40, stdev=13067.57 lat (usec): min=378, max=77879, avg=24192.17, stdev=13067.64 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 1029], 10.00th=[10552], 20.00th=[14484], | 30.00th=[16909], 40.00th=[20055], 50.00th=[22938], 60.00th=[25560], | 70.00th=[29230], 80.00th=[33162], 90.00th=[39584], 95.00th=[50070], | 99.00th=[69731], 99.50th=[73925], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 160, max= 576, per=26.17%, avg=338.94, stdev=108.00, samples=34 iops : min= 10, max= 36, avg=20.53, stdev= 6.86, samples=34 write: IOPS=22, BW=357KiB/s (366kB/s)(6256KiB/17503msec); 0 zone resets clat (usec): min=2723, max=81042, avg=21227.08, stdev=14457.75 lat (usec): min=2724, max=81043, avg=21228.37, stdev=14457.82 clat percentiles (usec): | 1.00th=[ 3949], 5.00th=[ 5538], 10.00th=[ 6063], 20.00th=[ 8586], | 30.00th=[11600], 40.00th=[14091], 50.00th=[16712], 60.00th=[20579], | 70.00th=[26084], 80.00th=[32637], 90.00th=[42730], 95.00th=[50070], | 99.00th=[66323], 99.50th=[80217], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 159, max= 702, per=26.10%, avg=355.44, stdev=134.11, samples=34 iops : min= 9, max= 43, avg=21.59, stdev= 8.43, samples=34 lat (usec) : 500=0.52%, 750=1.56%, 1000=0.26% lat (msec) : 2=0.78%, 4=0.65%, 10=12.63%, 20=33.20%, 50=45.44% lat (msec) : 100=4.95% cpu : usr=0.07%, sys=29.33%, ctx=3240, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1295KiB/s (1326kB/s), 315KiB/s-350KiB/s (323kB/s-358kB/s), io=23.4MiB (24.5MB), run=17503-18495msec WRITE: bw=1363KiB/s (1395kB/s), 337KiB/s-359KiB/s (345kB/s-368kB/s), io=24.6MiB (25.8MB), run=17503-18495msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190675: Wed Mar 4 22:22:27 2026 read: IOPS=18, BW=290KiB/s (297kB/s)(5920KiB/20396msec) clat (usec): min=4845, max=77707, avg=23495.37, stdev=15170.29 lat (usec): min=4845, max=77708, avg=23496.17, stdev=15170.32 clat percentiles (usec): | 1.00th=[ 5538], 5.00th=[ 7308], 10.00th=[ 8717], 20.00th=[11076], | 30.00th=[12780], 40.00th=[16319], 50.00th=[18744], 60.00th=[22152], | 70.00th=[27132], 80.00th=[34341], 90.00th=[48497], 95.00th=[56361], | 99.00th=[66847], 99.50th=[76022], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 158, max= 704, per=24.31%, avg=284.63, stdev=132.93, samples=40 iops : min= 9, max= 44, avg=17.22, stdev= 8.49, samples=40 write: IOPS=19, BW=312KiB/s (320kB/s)(6368KiB/20396msec); 0 zone resets clat (msec): min=6, max=112, avg=29.28, stdev=17.75 lat (msec): min=6, max=112, avg=29.28, stdev=17.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 54], 95.00th=[ 65], | 99.00th=[ 86], 99.50th=[ 104], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 158, max= 768, per=25.18%, avg=310.25, stdev=144.94, samples=40 iops : min= 9, max= 48, avg=18.83, stdev= 9.29, samples=40 lat (msec) : 10=10.03%, 20=35.42%, 50=43.23%, 100=11.07%, 250=0.26% cpu : usr=0.07%, sys=15.45%, ctx=1990, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190676: Wed Mar 4 22:22:27 2026 read: IOPS=17, BW=281KiB/s (288kB/s)(5744KiB/20440msec) clat (usec): min=2972, max=96579, avg=23775.67, stdev=15997.85 lat (usec): min=2973, max=96580, avg=23776.44, stdev=15997.87 clat percentiles (usec): | 1.00th=[ 3785], 5.00th=[ 7111], 10.00th=[ 9110], 20.00th=[11731], | 30.00th=[14091], 40.00th=[15664], 50.00th=[18220], 60.00th=[22152], | 70.00th=[27657], 80.00th=[35390], 90.00th=[45351], 95.00th=[59507], | 99.00th=[77071], 99.50th=[86508], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 95, max= 640, per=23.76%, avg=278.25, stdev=127.36, samples=40 iops : min= 5, max= 40, avg=16.83, stdev= 8.20, samples=40 write: IOPS=20, BW=320KiB/s (328kB/s)(6544KiB/20440msec); 0 zone resets clat (msec): min=5, max=110, avg=28.81, stdev=18.19 lat (msec): min=5, max=110, avg=28.81, stdev=18.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 86], 99.50th=[ 105], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 159, max= 896, per=25.36%, avg=312.45, stdev=156.86, samples=40 iops : min= 9, max= 56, avg=18.97, stdev= 9.92, samples=40 lat (msec) : 4=0.52%, 10=9.24%, 20=38.54%, 50=41.93%, 100=9.24% lat (msec) : 250=0.52% cpu : usr=0.05%, sys=15.17%, ctx=2017, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190677: Wed Mar 4 22:22:27 2026 read: IOPS=19, BW=308KiB/s (316kB/s)(6256KiB/20287msec) clat (usec): min=4737, max=97753, avg=23770.08, stdev=16501.81 lat (usec): min=4738, max=97754, avg=23770.93, stdev=16501.83 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 7504], 10.00th=[ 9110], 20.00th=[11338], | 30.00th=[13173], 40.00th=[15926], 50.00th=[18220], 60.00th=[21890], | 70.00th=[26346], 80.00th=[33424], 90.00th=[47449], 95.00th=[60031], | 99.00th=[78119], 99.50th=[91751], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 127, max= 960, per=26.35%, avg=308.50, stdev=168.75, samples=40 iops : min= 7, max= 60, avg=18.72, stdev=10.71, samples=40 write: IOPS=18, BW=297KiB/s (304kB/s)(6032KiB/20287msec); 0 zone resets clat (msec): min=6, max=107, avg=29.08, stdev=17.27 lat (msec): min=6, max=107, avg=29.08, stdev=17.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 41], 90.00th=[ 55], 95.00th=[ 66], | 99.00th=[ 83], 99.50th=[ 87], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 127, max= 672, per=23.82%, avg=293.43, stdev=116.62, samples=40 iops : min= 7, max= 42, avg=17.77, stdev= 7.52, samples=40 lat (msec) : 10=8.72%, 20=37.37%, 50=43.10%, 100=10.68%, 250=0.13% cpu : usr=0.09%, sys=15.31%, ctx=2109, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190678: Wed Mar 4 22:22:27 2026 read: IOPS=18, BW=296KiB/s (303kB/s)(6032KiB/20398msec) clat (usec): min=5184, max=90956, avg=23690.48, stdev=15536.42 lat (usec): min=5185, max=90957, avg=23691.32, stdev=15536.40 clat percentiles (usec): | 1.00th=[ 6259], 5.00th=[ 7439], 10.00th=[ 8979], 20.00th=[11207], | 30.00th=[13304], 40.00th=[15139], 50.00th=[18220], 60.00th=[22414], | 70.00th=[28181], 80.00th=[34866], 90.00th=[47973], 95.00th=[56361], | 99.00th=[71828], 99.50th=[76022], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 126, max= 896, per=24.83%, avg=290.77, stdev=157.49, samples=40 iops : min= 7, max= 56, avg=17.60, stdev=10.07, samples=40 write: IOPS=19, BW=307KiB/s (314kB/s)(6256KiB/20398msec); 0 zone resets clat (msec): min=6, max=118, avg=29.12, stdev=17.76 lat (msec): min=6, max=118, avg=29.12, stdev=17.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 41], 90.00th=[ 55], 95.00th=[ 66], | 99.00th=[ 92], 99.50th=[ 99], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 126, max= 704, per=24.60%, avg=303.10, stdev=133.91, samples=40 iops : min= 7, max= 44, avg=18.40, stdev= 8.53, samples=40 lat (msec) : 10=9.38%, 20=37.63%, 50=42.71%, 100=10.16%, 250=0.13% cpu : usr=0.08%, sys=15.38%, ctx=2121, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1172KiB/s (1200kB/s), 281KiB/s-308KiB/s (288kB/s-316kB/s), io=23.4MiB (24.5MB), run=20287-20440msec WRITE: bw=1233KiB/s (1262kB/s), 297KiB/s-320KiB/s (304kB/s-328kB/s), io=24.6MiB (25.8MB), run=20287-20440msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190693: Wed Mar 4 22:22:37 2026 read: IOPS=2, BW=2208KiB/s (2261kB/s)(7168KiB/3246msec) clat (msec): min=53, max=421, avg=149.69, stdev=126.30 lat (msec): min=53, max=421, avg=149.69, stdev=126.30 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 62], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 121], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 159], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2048, max= 4970, per=70.85%, avg=3704.67, stdev=1499.79, samples=3 iops : min= 2, max= 4, avg= 3.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1577KiB/s (1615kB/s)(5120KiB/3246msec); 0 zone resets clat (msec): min=74, max=1256, avg=434.82, stdev=490.41 lat (msec): min=74, max=1256, avg=434.88, stdev=490.41 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2048, max= 6144, per=55.95%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 lat (msec) : 100=33.33%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.33%, ctx=218, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190695: Wed Mar 4 22:22:37 2026 read: IOPS=0, BW=523KiB/s (536kB/s)(2048KiB/3916msec) clat (usec): min=46443, max=58039, avg=52241.51, stdev=8199.13 lat (usec): min=46445, max=58039, avg=52242.60, stdev=8198.15 clat percentiles (usec): | 1.00th=[46400], 5.00th=[46400], 10.00th=[46400], 20.00th=[46400], | 30.00th=[46400], 40.00th=[46400], 50.00th=[46400], 60.00th=[57934], | 70.00th=[57934], 80.00th=[57934], 90.00th=[57934], 95.00th=[57934], | 99.00th=[57934], 99.50th=[57934], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 1638, max= 2048, per=35.25%, avg=1843.00, stdev=289.91, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2615KiB/s (2678kB/s)(10.0MiB/3916msec); 0 zone resets clat (msec): min=65, max=1219, avg=380.13, stdev=327.60 lat (msec): min=65, max=1219, avg=380.19, stdev=327.60 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 110], | 30.00th=[ 165], 40.00th=[ 222], 50.00th=[ 321], 60.00th=[ 393], | 70.00th=[ 397], 80.00th=[ 430], 90.00th=[ 485], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1638, max= 6144, per=37.93%, avg=2777.00, stdev=1890.09, samples=5 iops : min= 1, max= 6, avg= 2.40, stdev= 2.07, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=16.76%, ctx=347, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190697: Wed Mar 4 22:22:37 2026 read: IOPS=1, BW=1969KiB/s (2016kB/s)(6144KiB/3120msec) clat (msec): min=62, max=445, avg=208.77, stdev=147.02 lat (msec): min=62, max=445, avg=208.78, stdev=147.02 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 230], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2048, max= 4096, per=65.28%, avg=3413.33, stdev=1182.41, samples=3 iops : min= 2, max= 4, avg= 3.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1969KiB/s (2016kB/s)(6144KiB/3120msec); 0 zone resets clat (msec): min=98, max=468, avg=307.33, stdev=144.52 lat (msec): min=98, max=468, avg=307.39, stdev=144.51 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 347], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2048, max= 5036, per=38.18%, avg=2795.00, stdev=1494.00, samples=4 iops : min= 2, max= 4, avg= 2.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=50.00% cpu : usr=0.00%, sys=12.28%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190699: Wed Mar 4 22:22:37 2026 read: IOPS=1, BW=1500KiB/s (1536kB/s)(5120KiB/3414msec) clat (msec): min=63, max=215, avg=129.75, stdev=63.73 lat (msec): min=63, max=215, avg=129.75, stdev=63.73 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 108], 60.00th=[ 108], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 4096, max= 4096, per=78.33%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2100KiB/s (2150kB/s)(7168KiB/3414msec); 0 zone resets clat (msec): min=92, max=1106, avg=387.64, stdev=361.81 lat (msec): min=92, max=1106, avg=387.70, stdev=361.82 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 112], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 230], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 567], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 2048, max= 3453, per=34.37%, avg=2516.33, stdev=811.18, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=12.95%, ctx=433, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5230KiB/s (5355kB/s), 523KiB/s-2208KiB/s (536kB/s-2261kB/s), io=20.0MiB (20.0MB), run=3120-3916msec WRITE: bw=7322KiB/s (7497kB/s), 1577KiB/s-2615KiB/s (1615kB/s-2678kB/s), io=28.0MiB (29.4MB), run=3120-3916msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190692: Wed Mar 4 22:22:37 2026 read: IOPS=4, BW=4117KiB/s (4216kB/s)(7168KiB/1741msec) clat (msec): min=88, max=229, avg=132.56, stdev=46.83 lat (msec): min=88, max=229, avg=132.56, stdev=46.83 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 103], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 116], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 2043, max= 5137, per=70.04%, avg=3650.33, stdev=1550.53, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2941KiB/s (3011kB/s)(5120KiB/1741msec); 0 zone resets clat (msec): min=113, max=252, avg=159.76, stdev=59.03 lat (msec): min=113, max=252, avg=159.82, stdev=59.03 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 127], 60.00th=[ 127], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 1885, max= 6131, per=54.93%, avg=4008.00, stdev=3002.38, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=83.33%, 500=8.33% cpu : usr=0.00%, sys=68.68%, ctx=1535, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190694: Wed Mar 4 22:22:37 2026 read: IOPS=0, BW=521KiB/s (534kB/s)(2048KiB/3929msec) clat (msec): min=113, max=261, avg=187.50, stdev=104.23 lat (msec): min=113, max=261, avg=187.51, stdev=104.23 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1747, max= 2011, per=36.05%, avg=1879.00, stdev=186.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2606KiB/s (2669kB/s)(10.0MiB/3929msec); 0 zone resets clat (msec): min=45, max=1244, avg=350.94, stdev=343.22 lat (msec): min=45, max=1244, avg=351.01, stdev=343.22 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 148], | 30.00th=[ 163], 40.00th=[ 180], 50.00th=[ 194], 60.00th=[ 236], | 70.00th=[ 388], 80.00th=[ 447], 90.00th=[ 468], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2043, max= 4096, per=47.74%, avg=3483.25, stdev=970.21, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (msec) : 50=8.33%, 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=36.79%, ctx=492, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190696: Wed Mar 4 22:22:37 2026 read: IOPS=1, BW=1821KiB/s (1865kB/s)(6144KiB/3374msec) clat (msec): min=84, max=1070, avg=298.05, stdev=380.49 lat (msec): min=84, max=1070, avg=298.05, stdev=380.49 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1885, max= 4023, per=47.94%, avg=2498.50, stdev=1019.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1821KiB/s (1865kB/s)(6144KiB/3374msec); 0 zone resets clat (msec): min=182, max=339, avg=252.20, stdev=57.66 lat (msec): min=182, max=339, avg=252.26, stdev=57.67 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 251], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1744, max= 3771, per=32.78%, avg=2392.25, stdev=928.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=43.05%, ctx=984, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190698: Wed Mar 4 22:22:37 2026 read: IOPS=1, BW=1422KiB/s (1456kB/s)(5120KiB/3600msec) clat (usec): min=806, max=220297, avg=109220.77, stdev=103011.35 lat (usec): min=807, max=220298, avg=109221.73, stdev=103011.21 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 807], | 30.00th=[ 906], 40.00th=[ 906], 50.00th=[139461], 60.00th=[139461], | 70.00th=[185598], 80.00th=[185598], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 2043, max= 6035, per=77.49%, avg=4039.00, stdev=2822.77, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1991KiB/s (2039kB/s)(7168KiB/3600msec); 0 zone resets clat (msec): min=106, max=1139, avg=425.21, stdev=362.04 lat (msec): min=107, max=1139, avg=425.27, stdev=362.04 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 126], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 418], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 542], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2043, max= 3771, per=35.89%, avg=2619.00, stdev=997.66, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=16.67% lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=33.93%, ctx=314, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5213KiB/s (5338kB/s), 521KiB/s-4117KiB/s (534kB/s-4216kB/s), io=20.0MiB (20.0MB), run=1741-3929msec WRITE: bw=7298KiB/s (7473kB/s), 1821KiB/s-2941KiB/s (1865kB/s-3011kB/s), io=28.0MiB (29.4MB), run=1741-3929msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190705: Wed Mar 4 22:22:46 2026 read: IOPS=1, BW=5810KiB/s (5949kB/s)(12.0MiB/2115msec) clat (msec): min=438, max=1070, avg=658.45, stdev=357.07 lat (msec): min=438, max=1070, avg=658.45, stdev=357.07 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=33.87%, ctx=2908, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190706: Wed Mar 4 22:22:46 2026 read: IOPS=0, BW=1799KiB/s (1842kB/s)(4096KiB/2277msec) clat (nsec): min=1070.7M, max=1070.7M, avg=1070659228.00, stdev= 0.00 lat (nsec): min=1070.7M, max=1070.7M, avg=1070660449.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3598KiB/s (3684kB/s)(8192KiB/2277msec); 0 zone resets clat (msec): min=361, max=699, avg=530.73, stdev=239.19 lat (msec): min=361, max=700, avg=530.99, stdev=239.20 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8192, max= 8192, per=67.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=24.65%, ctx=1141, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190707: Wed Mar 4 22:22:46 2026 write: IOPS=1, BW=5238KiB/s (5364kB/s)(12.0MiB/2346msec); 0 zone resets clat (msec): min=508, max=941, avg=733.48, stdev=217.04 lat (msec): min=508, max=941, avg=733.75, stdev=217.00 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8192, max= 8192, per=67.33%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.09%, sys=15.69%, ctx=93, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190708: Wed Mar 4 22:22:46 2026 write: IOPS=1, BW=4563KiB/s (4672kB/s)(12.0MiB/2693msec); 0 zone resets clat (msec): min=690, max=956, avg=849.79, stdev=140.59 lat (msec): min=690, max=956, avg=850.09, stdev=140.56 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8192, max= 8192, per=67.33%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=13.93%, ctx=109, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7195KiB/s (7368kB/s), 1799KiB/s-5810KiB/s (1842kB/s-5949kB/s), io=16.0MiB (16.8MB), run=2115-2277msec WRITE: bw=11.9MiB/s (12.5MB/s), 3598KiB/s-5238KiB/s (3684kB/s-5364kB/s), io=32.0MiB (33.6MB), run=2277-2693msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190709: Wed Mar 4 22:22:46 2026 read: IOPS=1, BW=4768KiB/s (4883kB/s)(12.0MiB/2577msec) clat (msec): min=238, max=1803, avg=845.56, stdev=839.23 lat (msec): min=238, max=1803, avg=845.56, stdev=839.23 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.30%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190710: Wed Mar 4 22:22:46 2026 read: IOPS=0, BW=1609KiB/s (1647kB/s)(4096KiB/2546msec) clat (nsec): min=1390.5M, max=1390.5M, avg=1390502879.00, stdev= 0.00 lat (nsec): min=1390.5M, max=1390.5M, avg=1390505134.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3218KiB/s (3295kB/s)(8192KiB/2546msec); 0 zone resets clat (msec): min=466, max=625, avg=546.05, stdev=112.99 lat (msec): min=466, max=626, avg=546.38, stdev=113.00 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8192, max= 8192, per=68.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.73%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190711: Wed Mar 4 22:22:46 2026 write: IOPS=1, BW=4486KiB/s (4594kB/s)(12.0MiB/2739msec); 0 zone resets clat (msec): min=71, max=2161, avg=881.44, stdev=1121.65 lat (msec): min=72, max=2162, avg=881.76, stdev=1121.65 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8192, max= 8192, per=68.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.11%, sys=8.77%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190712: Wed Mar 4 22:22:46 2026 write: IOPS=1, BW=5176KiB/s (5300kB/s)(12.0MiB/2374msec); 0 zone resets clat (msec): min=130, max=1384, avg=772.76, stdev=627.91 lat (msec): min=130, max=1385, avg=773.00, stdev=627.95 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 5587, max= 8192, per=57.59%, avg=6889.50, stdev=1842.01, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.25%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6358KiB/s (6510kB/s), 1609KiB/s-4768KiB/s (1647kB/s-4883kB/s), io=16.0MiB (16.8MB), run=2546-2577msec WRITE: bw=11.7MiB/s (12.2MB/s), 3218KiB/s-5176KiB/s (3295kB/s-5300kB/s), io=32.0MiB (33.6MB), run=2374-2739msec