== sanity test 398b: DIO and buffer IO race ============== 12:07:29 (1781280449) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.22014 s, 7.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179212: Fri Jun 12 12:10:34 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(5992KiB/159883msec) clat (usec): min=31, max=1088.8k, avg=58682.30, stdev=46073.07 lat (usec): min=32, max=1088.8k, avg=58692.28, stdev=46070.66 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 10159], 10.00th=[ 21103], | 20.00th=[ 29754], 30.00th=[ 36963], 40.00th=[ 44303], | 50.00th=[ 50594], 60.00th=[ 60556], 70.00th=[ 68682], | 80.00th=[ 83362], 90.00th=[ 103285], 95.00th=[ 126354], | 99.00th=[ 191890], 99.50th=[ 225444], 99.90th=[ 425722], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 93, per=25.10%, avg=37.40, stdev=15.14, samples=310 iops : min= 1, max= 23, avg= 8.68, stdev= 3.81, samples=310 write: IOPS=9, BW=39.4KiB/s (40.3kB/s)(6296KiB/159883msec); 0 zone resets clat (usec): min=1089, max=334610, avg=45346.18, stdev=46791.80 lat (usec): min=1090, max=334611, avg=45350.55, stdev=46798.50 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 1975], 20.00th=[ 4948], | 30.00th=[ 9765], 40.00th=[ 21627], 50.00th=[ 32375], 60.00th=[ 43254], | 70.00th=[ 58459], 80.00th=[ 78119], 90.00th=[110625], 95.00th=[137364], | 99.00th=[204473], 99.50th=[231736], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 118, per=25.51%, avg=39.79, stdev=18.54, samples=306 iops : min= 1, max= 29, avg= 9.29, stdev= 4.65, samples=306 lat (usec) : 50=0.20%, 100=1.82%, 250=0.20%, 500=0.03% lat (msec) : 2=5.31%, 4=3.52%, 10=6.90%, 20=6.09%, 50=33.37% lat (msec) : 100=30.57%, 250=11.75%, 500=0.23%, 2000=0.03% cpu : usr=0.06%, sys=4.03%, ctx=6507, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179215: Fri Jun 12 12:10:34 2026 read: IOPS=9, BW=38.6KiB/s (39.6kB/s)(5940KiB/153726msec) clat (usec): min=37, max=283493, avg=57345.57, stdev=37464.42 lat (usec): min=38, max=283494, avg=57349.64, stdev=37462.70 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 13173], 10.00th=[ 21627], 20.00th=[ 29492], | 30.00th=[ 35914], 40.00th=[ 42206], 50.00th=[ 49546], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 81265], 90.00th=[100140], 95.00th=[125305], | 99.00th=[208667], 99.50th=[231736], 99.90th=[278922], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 6, max= 87, per=25.76%, avg=38.38, stdev=16.42, samples=299 iops : min= 1, max= 21, avg= 8.93, stdev= 4.13, samples=299 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6348KiB/153726msec); 0 zone resets clat (usec): min=1108, max=942134, avg=42848.90, stdev=49804.41 lat (usec): min=1109, max=942135, avg=42854.42, stdev=49807.71 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1401], 10.00th=[ 1942], 20.00th=[ 5211], | 30.00th=[ 9372], 40.00th=[ 19530], 50.00th=[ 29754], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[127402], | 99.00th=[191890], 99.50th=[217056], 99.90th=[387974], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 95, per=26.36%, avg=41.12, stdev=19.38, samples=298 iops : min= 1, max= 23, avg= 9.62, stdev= 4.88, samples=298 lat (usec) : 50=0.20%, 100=1.50%, 250=0.29%, 750=0.07% lat (msec) : 2=5.24%, 4=3.39%, 10=7.65%, 20=6.71%, 50=33.79% lat (msec) : 100=31.05%, 250=9.83%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=4.28%, ctx=6501, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179216: Fri Jun 12 12:10:34 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6028KiB/160682msec) clat (usec): min=32, max=300166, avg=57796.04, stdev=38210.80 lat (usec): min=33, max=300167, avg=57798.29, stdev=38210.74 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 13566], 10.00th=[ 21627], 20.00th=[ 28705], | 30.00th=[ 35390], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 57934], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[105382], 95.00th=[127402], | 99.00th=[196084], 99.50th=[225444], 99.90th=[295699], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 95, per=25.34%, avg=37.76, stdev=15.51, samples=309 iops : min= 1, max= 23, avg= 8.77, stdev= 3.90, samples=309 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6260KiB/160682msec); 0 zone resets clat (usec): min=1095, max=1097.4k, avg=46580.60, stdev=55154.49 lat (usec): min=1097, max=1097.4k, avg=46584.50, stdev=55155.55 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 1729], | 20.00th=[ 5014], 30.00th=[ 9896], 40.00th=[ 20317], | 50.00th=[ 33424], 60.00th=[ 44827], 70.00th=[ 58983], | 80.00th=[ 77071], 90.00th=[ 110625], 95.00th=[ 143655], | 99.00th=[ 212861], 99.50th=[ 242222], 99.90th=[ 362808], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 95, per=25.14%, avg=39.22, stdev=18.82, samples=309 iops : min= 1, max= 23, avg= 9.14, stdev= 4.76, samples=309 lat (usec) : 50=0.13%, 100=1.63%, 250=0.16%, 500=0.03% lat (msec) : 2=5.60%, 4=3.39%, 10=6.67%, 20=6.80%, 50=33.24% lat (msec) : 100=30.05%, 250=11.98%, 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=4.13%, ctx=6598, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179218: Fri Jun 12 12:10:34 2026 read: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6052KiB/157962msec) clat (usec): min=39, max=952230, avg=58360.94, stdev=45891.06 lat (usec): min=39, max=952231, avg=58369.85, stdev=45893.00 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 14746], 10.00th=[ 21890], 20.00th=[ 28967], | 30.00th=[ 34341], 40.00th=[ 42206], 50.00th=[ 49021], 60.00th=[ 57934], | 70.00th=[ 67634], 80.00th=[ 82314], 90.00th=[104334], 95.00th=[128451], | 99.00th=[208667], 99.50th=[252707], 99.90th=[408945], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 6, max= 79, per=25.51%, avg=38.00, stdev=15.79, samples=309 iops : min= 1, max= 19, avg= 8.84, stdev= 3.99, samples=309 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6236KiB/157962msec); 0 zone resets clat (usec): min=1010, max=340156, avg=44276.61, stdev=46362.34 lat (usec): min=1011, max=340157, avg=44286.90, stdev=46363.17 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1401], 10.00th=[ 2040], 20.00th=[ 5014], | 30.00th=[ 8979], 40.00th=[ 18220], 50.00th=[ 31851], 60.00th=[ 43254], | 70.00th=[ 59507], 80.00th=[ 78119], 90.00th=[104334], 95.00th=[133694], | 99.00th=[206570], 99.50th=[240124], 99.90th=[304088], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 110, per=25.17%, avg=39.27, stdev=19.44, samples=308 iops : min= 1, max= 27, avg= 9.15, stdev= 4.89, samples=308 lat (usec) : 50=0.16%, 100=1.66%, 250=0.20%, 500=0.03%, 750=0.03% lat (msec) : 2=4.98%, 4=3.74%, 10=7.75%, 20=6.54%, 50=33.04% lat (msec) : 100=30.27%, 250=11.13%, 500=0.42%, 1000=0.03% cpu : usr=0.06%, sys=4.23%, ctx=6583, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 37.5KiB/s-38.6KiB/s (38.4kB/s-39.6kB/s), io=23.4MiB (24.6MB), run=153726-160682msec WRITE: bw=156KiB/s (160kB/s), 38.0KiB/s-41.3KiB/s (39.9kB/s-42.3kB/s), io=24.6MiB (25.7MB), run=153726-160682msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179213: Fri Jun 12 12:11:37 2026 read: IOPS=6, BW=26.9KiB/s (27.6kB/s)(5992KiB/222657msec) clat (msec): min=7, max=1027, avg=58.09, stdev=56.54 lat (msec): min=7, max=1027, avg=58.09, stdev=56.54 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 81], 90.00th=[ 124], 95.00th=[ 169], | 99.00th=[ 253], 99.50th=[ 284], 99.90th=[ 409], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 102, per=25.85%, avg=27.66, stdev=18.23, samples=418 iops : min= 1, max= 25, avg= 6.24, stdev= 4.60, samples=418 write: IOPS=7, BW=28.3KiB/s (28.0kB/s)(6296KiB/222657msec); 0 zone resets clat (msec): min=14, max=409, avg=85.83, stdev=57.98 lat (msec): min=14, max=409, avg=85.84, stdev=57.98 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 43], | 30.00th=[ 51], 40.00th=[ 59], 50.00th=[ 69], 60.00th=[ 81], | 70.00th=[ 97], 80.00th=[ 121], 90.00th=[ 159], 95.00th=[ 205], | 99.00th=[ 305], 99.50th=[ 342], 99.90th=[ 397], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 86, per=25.35%, avg=28.39, stdev=16.60, samples=428 iops : min= 1, max= 21, avg= 6.43, stdev= 4.19, samples=428 lat (msec) : 10=0.23%, 20=7.19%, 50=37.73%, 100=33.14%, 250=19.92% lat (msec) : 500=1.76%, 2000=0.03% cpu : usr=0.05%, sys=1.61%, ctx=4790, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179214: Fri Jun 12 12:11:37 2026 read: IOPS=6, BW=26.6KiB/s (27.3kB/s)(5940KiB/223072msec) clat (msec): min=7, max=959, avg=57.81, stdev=55.15 lat (msec): min=7, max=959, avg=57.81, stdev=55.15 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 117], 95.00th=[ 157], | 99.00th=[ 264], 99.50th=[ 300], 99.90th=[ 430], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 102, per=26.19%, avg=28.02, stdev=17.85, samples=408 iops : min= 1, max= 25, avg= 6.33, stdev= 4.50, samples=408 write: IOPS=7, BW=28.5KiB/s (29.1kB/s)(6348KiB/223072msec); 0 zone resets clat (msec): min=15, max=415, avg=86.14, stdev=55.74 lat (msec): min=15, max=415, avg=86.14, stdev=55.74 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 51], 40.00th=[ 61], 50.00th=[ 70], 60.00th=[ 83], | 70.00th=[ 99], 80.00th=[ 122], 90.00th=[ 165], 95.00th=[ 197], | 99.00th=[ 279], 99.50th=[ 334], 99.90th=[ 376], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 94, per=25.55%, avg=28.61, stdev=16.30, samples=426 iops : min= 1, max= 23, avg= 6.48, stdev= 4.11, samples=426 lat (msec) : 10=0.42%, 20=6.64%, 50=37.37%, 100=33.72%, 250=20.35% lat (msec) : 500=1.46%, 1000=0.03% cpu : usr=0.05%, sys=1.65%, ctx=4923, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179217: Fri Jun 12 12:11:37 2026 read: IOPS=6, BW=27.1KiB/s (27.8kB/s)(6028KiB/222288msec) clat (msec): min=6, max=440, avg=56.59, stdev=48.09 lat (msec): min=6, max=440, avg=56.59, stdev=48.09 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 62], 80.00th=[ 80], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 249], 99.50th=[ 275], 99.90th=[ 317], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 111, per=26.56%, avg=28.42, stdev=17.76, samples=409 iops : min= 1, max= 27, avg= 6.44, stdev= 4.48, samples=409 write: IOPS=7, BW=28.2KiB/s (28.8kB/s)(6260KiB/222288msec); 0 zone resets clat (msec): min=12, max=1010, avg=87.19, stdev=62.91 lat (msec): min=12, max=1010, avg=87.19, stdev=62.91 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 43], | 30.00th=[ 51], 40.00th=[ 59], 50.00th=[ 69], 60.00th=[ 82], | 70.00th=[ 99], 80.00th=[ 122], 90.00th=[ 163], 95.00th=[ 205], | 99.00th=[ 288], 99.50th=[ 376], 99.90th=[ 430], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 95, per=25.23%, avg=28.26, stdev=16.40, samples=427 iops : min= 1, max= 23, avg= 6.39, stdev= 4.15, samples=427 lat (msec) : 10=0.42%, 20=6.32%, 50=38.51%, 100=33.14%, 250=20.02% lat (msec) : 500=1.56%, 2000=0.03% cpu : usr=0.04%, sys=1.57%, ctx=4814, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179219: Fri Jun 12 12:11:37 2026 read: IOPS=6, BW=27.1KiB/s (27.8kB/s)(6052KiB/223163msec) clat (msec): min=5, max=433, avg=56.04, stdev=49.56 lat (msec): min=5, max=433, avg=56.05, stdev=49.56 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 78], 90.00th=[ 122], 95.00th=[ 157], | 99.00th=[ 245], 99.50th=[ 264], 99.90th=[ 426], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 111, per=26.52%, avg=28.37, stdev=18.11, samples=412 iops : min= 1, max= 27, avg= 6.42, stdev= 4.57, samples=412 write: IOPS=6, BW=27.9KiB/s (28.6kB/s)(6236KiB/223163msec); 0 zone resets clat (msec): min=14, max=980, avg=88.41, stdev=63.63 lat (msec): min=14, max=980, avg=88.42, stdev=63.63 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 35], 20.00th=[ 44], | 30.00th=[ 53], 40.00th=[ 61], 50.00th=[ 69], 60.00th=[ 83], | 70.00th=[ 100], 80.00th=[ 122], 90.00th=[ 165], 95.00th=[ 211], | 99.00th=[ 313], 99.50th=[ 347], 99.90th=[ 430], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 87, per=25.23%, avg=28.26, stdev=15.75, samples=426 iops : min= 1, max= 21, avg= 6.39, stdev= 3.98, samples=426 lat (msec) : 10=0.68%, 20=6.58%, 50=37.63%, 100=33.27%, 250=20.15% lat (msec) : 500=1.66%, 1000=0.03% cpu : usr=0.05%, sys=1.61%, ctx=4851, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=108KiB/s (110kB/s), 26.6KiB/s-27.1KiB/s (27.3kB/s-27.8kB/s), io=23.4MiB (24.6MB), run=222288-223163msec WRITE: bw=113KiB/s (115kB/s), 27.9KiB/s-28.5KiB/s (28.6kB/s-29.1kB/s), io=24.6MiB (25.7MB), run=222288-223163msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179273: Fri Jun 12 12:12:34 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5920KiB/41146msec) clat (usec): min=43, max=299252, avg=62680.40, stdev=40734.64 lat (usec): min=43, max=299254, avg=62684.21, stdev=40734.16 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 82], 10.00th=[ 24773], 20.00th=[ 33817], | 30.00th=[ 41681], 40.00th=[ 48497], 50.00th=[ 54789], 60.00th=[ 64226], | 70.00th=[ 72877], 80.00th=[ 88605], 90.00th=[115868], 95.00th=[132645], | 99.00th=[221250], 99.50th=[240124], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 286, per=26.83%, avg=143.56, stdev=53.49, samples=81 iops : min= 1, max= 17, avg= 8.19, stdev= 3.35, samples=81 write: IOPS=9, BW=155KiB/s (158kB/s)(6368KiB/41146msec); 0 zone resets clat (usec): min=1889, max=232306, avg=44727.74, stdev=42111.19 lat (usec): min=1890, max=232310, avg=44733.22, stdev=42109.55 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 3294], 10.00th=[ 4948], 20.00th=[ 8455], | 30.00th=[ 11994], 40.00th=[ 19792], 50.00th=[ 31065], 60.00th=[ 43779], | 70.00th=[ 58983], 80.00th=[ 80217], 90.00th=[108528], 95.00th=[124257], | 99.00th=[185598], 99.50th=[193987], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 30, max= 315, per=27.77%, avg=156.05, stdev=70.63, samples=80 iops : min= 1, max= 19, avg= 8.97, stdev= 4.51, samples=80 lat (usec) : 50=0.13%, 100=2.86%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=0.65%, 4=2.99%, 10=8.72%, 20=9.24%, 50=28.91% lat (msec) : 100=32.03%, 250=13.67%, 500=0.13% cpu : usr=0.08%, sys=4.69%, ctx=1709, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179274: Fri Jun 12 12:12:34 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(5744KiB/44417msec) clat (usec): min=57, max=340669, avg=65187.62, stdev=38565.56 lat (usec): min=58, max=340671, avg=65191.38, stdev=38566.08 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 3785], 10.00th=[ 28705], 20.00th=[ 40633], | 30.00th=[ 46924], 40.00th=[ 52691], 50.00th=[ 60031], 60.00th=[ 65799], | 70.00th=[ 73925], 80.00th=[ 85459], 90.00th=[106431], 95.00th=[125305], | 99.00th=[202376], 99.50th=[254804], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 20, max= 284, per=24.23%, avg=129.64, stdev=55.12, samples=87 iops : min= 1, max= 17, avg= 7.33, stdev= 3.45, samples=87 write: IOPS=9, BW=147KiB/s (151kB/s)(6544KiB/44417msec); 0 zone resets clat (usec): min=1837, max=238949, avg=50480.49, stdev=50647.81 lat (usec): min=1839, max=238952, avg=50506.05, stdev=50664.64 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 2966], 10.00th=[ 4883], 20.00th=[ 8586], | 30.00th=[ 12911], 40.00th=[ 22152], 50.00th=[ 34341], 60.00th=[ 45351], | 70.00th=[ 63177], 80.00th=[ 89654], 90.00th=[125305], 95.00th=[160433], | 99.00th=[223347], 99.50th=[229639], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 30, max= 317, per=26.17%, avg=147.09, stdev=69.00, samples=87 iops : min= 1, max= 19, avg= 8.44, stdev= 4.35, samples=87 lat (usec) : 100=1.43%, 250=0.39%, 500=0.26% lat (msec) : 2=0.78%, 4=3.26%, 10=9.38%, 20=6.77%, 50=27.73% lat (msec) : 100=36.33%, 250=13.41%, 500=0.26% cpu : usr=0.06%, sys=4.60%, ctx=1735, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179275: Fri Jun 12 12:12:34 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6256KiB/44674msec) clat (usec): min=55, max=349214, avg=65024.71, stdev=42812.16 lat (usec): min=56, max=349217, avg=65034.93, stdev=42822.79 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 83], 10.00th=[ 21627], 20.00th=[ 32113], | 30.00th=[ 41681], 40.00th=[ 50594], 50.00th=[ 59507], 60.00th=[ 68682], | 70.00th=[ 80217], 80.00th=[ 92799], 90.00th=[115868], 95.00th=[143655], | 99.00th=[212861], 99.50th=[227541], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 30, max= 255, per=26.20%, avg=140.15, stdev=58.34, samples=87 iops : min= 1, max= 15, avg= 7.99, stdev= 3.66, samples=87 write: IOPS=8, BW=135KiB/s (138kB/s)(6032KiB/44674msec); 0 zone resets clat (usec): min=1702, max=408873, avg=50295.94, stdev=47404.81 lat (usec): min=1702, max=408874, avg=50301.68, stdev=47404.93 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 4490], 10.00th=[ 6521], 20.00th=[ 11076], | 30.00th=[ 16909], 40.00th=[ 27132], 50.00th=[ 40109], 60.00th=[ 49546], | 70.00th=[ 60556], 80.00th=[ 81265], 90.00th=[119014], 95.00th=[139461], | 99.00th=[185598], 99.50th=[267387], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 30, max= 308, per=23.53%, avg=132.25, stdev=60.62, samples=87 iops : min= 1, max= 19, avg= 7.49, stdev= 3.81, samples=87 lat (usec) : 100=2.86%, 250=0.91%, 500=0.26% lat (msec) : 2=1.17%, 4=1.17%, 10=5.47%, 20=9.24%, 50=28.78% lat (msec) : 100=34.90%, 250=14.84%, 500=0.39% cpu : usr=0.08%, sys=4.54%, ctx=1830, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179276: Fri Jun 12 12:12:34 2026 read: IOPS=8, BW=135KiB/s (138kB/s)(6032KiB/44767msec) clat (usec): min=52, max=311676, avg=65680.85, stdev=44198.50 lat (usec): min=53, max=311677, avg=65682.67, stdev=44198.59 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 81], 10.00th=[ 21103], 20.00th=[ 33817], | 30.00th=[ 44827], 40.00th=[ 51643], 50.00th=[ 60031], 60.00th=[ 70779], | 70.00th=[ 78119], 80.00th=[ 92799], 90.00th=[114820], 95.00th=[133694], | 99.00th=[263193], 99.50th=[308282], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 286, per=24.92%, avg=133.33, stdev=57.00, samples=87 iops : min= 1, max= 17, avg= 7.55, stdev= 3.60, samples=87 write: IOPS=8, BW=140KiB/s (143kB/s)(6256KiB/44767msec); 0 zone resets clat (usec): min=1682, max=220685, avg=50001.98, stdev=45978.47 lat (usec): min=1685, max=220691, avg=50008.74, stdev=45984.56 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 10], | 30.00th=[ 17], 40.00th=[ 27], 50.00th=[ 38], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 112], 95.00th=[ 153], | 99.00th=[ 194], 99.50th=[ 215], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 318, per=24.97%, avg=140.35, stdev=63.65, samples=86 iops : min= 1, max= 19, avg= 8.01, stdev= 4.00, samples=86 lat (usec) : 100=3.26%, 250=0.26%, 500=0.26%, 750=0.26% lat (msec) : 2=0.65%, 4=2.99%, 10=7.55%, 20=6.25%, 50=26.95% lat (msec) : 100=36.72%, 250=14.32%, 500=0.52% cpu : usr=0.06%, sys=4.36%, ctx=1790, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=535KiB/s (548kB/s), 129KiB/s-144KiB/s (132kB/s-147kB/s), io=23.4MiB (24.5MB), run=41146-44767msec WRITE: bw=563KiB/s (576kB/s), 135KiB/s-155KiB/s (138kB/s-158kB/s), io=24.6MiB (25.8MB), run=41146-44767msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179268: Fri Jun 12 12:12:47 2026 read: IOPS=6, BW=102KiB/s (105kB/s)(5920KiB/57766msec) clat (msec): min=9, max=281, avg=61.17, stdev=53.21 lat (msec): min=9, max=281, avg=61.17, stdev=53.21 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 65], 80.00th=[ 88], 90.00th=[ 144], 95.00th=[ 178], | 99.00th=[ 243], 99.50th=[ 255], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 384, per=25.86%, avg=107.06, stdev=77.52, samples=107 iops : min= 1, max= 24, avg= 5.92, stdev= 4.93, samples=107 write: IOPS=6, BW=110KiB/s (113kB/s)(6368KiB/57766msec); 0 zone resets clat (msec): min=13, max=379, avg=87.43, stdev=64.24 lat (msec): min=13, max=379, avg=87.43, stdev=64.24 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 81], | 70.00th=[ 100], 80.00th=[ 129], 90.00th=[ 184], 95.00th=[ 222], | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 21, max= 345, per=25.41%, avg=110.52, stdev=73.17, samples=112 iops : min= 1, max= 21, avg= 6.13, stdev= 4.69, samples=112 lat (msec) : 10=0.26%, 20=7.68%, 50=40.76%, 100=27.47%, 250=22.01% lat (msec) : 500=1.82% cpu : usr=0.06%, sys=1.73%, ctx=1278, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179269: Fri Jun 12 12:12:47 2026 read: IOPS=6, BW=99.0KiB/s (102kB/s)(5744KiB/57445msec) clat (msec): min=9, max=393, avg=60.41, stdev=53.70 lat (msec): min=9, max=393, avg=60.41, stdev=53.70 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 88], 90.00th=[ 138], 95.00th=[ 186], | 99.00th=[ 241], 99.50th=[ 326], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 21, max= 480, per=25.60%, avg=105.98, stdev=83.10, samples=105 iops : min= 1, max= 30, avg= 5.84, stdev= 5.31, samples=105 write: IOPS=7, BW=114KiB/s (117kB/s)(6544KiB/57445msec); 0 zone resets clat (msec): min=15, max=396, avg=86.79, stdev=65.90 lat (msec): min=15, max=396, avg=86.79, stdev=65.90 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 64], 60.00th=[ 77], | 70.00th=[ 97], 80.00th=[ 132], 90.00th=[ 182], 95.00th=[ 222], | 99.00th=[ 313], 99.50th=[ 334], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 383, per=26.41%, avg=114.87, stdev=77.85, samples=110 iops : min= 1, max= 23, avg= 6.41, stdev= 4.94, samples=110 lat (msec) : 10=0.26%, 20=6.77%, 50=39.71%, 100=30.34%, 250=21.09% lat (msec) : 500=1.82% cpu : usr=0.06%, sys=1.77%, ctx=1255, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179271: Fri Jun 12 12:12:47 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6256KiB/57805msec) clat (msec): min=8, max=344, avg=59.47, stdev=50.05 lat (msec): min=8, max=344, avg=59.47, stdev=50.05 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 66], 80.00th=[ 94], 90.00th=[ 128], 95.00th=[ 169], | 99.00th=[ 232], 99.50th=[ 255], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 415, per=27.59%, avg=114.24, stdev=83.97, samples=107 iops : min= 1, max= 25, avg= 6.36, stdev= 5.35, samples=107 write: IOPS=6, BW=104KiB/s (107kB/s)(6032KiB/57805msec); 0 zone resets clat (msec): min=16, max=420, avg=91.06, stdev=64.76 lat (msec): min=16, max=420, avg=91.07, stdev=64.77 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 32], 20.00th=[ 38], | 30.00th=[ 46], 40.00th=[ 58], 50.00th=[ 71], 60.00th=[ 90], | 70.00th=[ 108], 80.00th=[ 140], 90.00th=[ 178], 95.00th=[ 218], | 99.00th=[ 321], 99.50th=[ 363], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 352, per=24.11%, avg=104.90, stdev=66.40, samples=110 iops : min= 1, max= 22, avg= 5.78, stdev= 4.24, samples=110 lat (msec) : 10=0.26%, 20=8.20%, 50=38.15%, 100=28.39%, 250=23.05% lat (msec) : 500=1.95% cpu : usr=0.05%, sys=1.72%, ctx=1308, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179272: Fri Jun 12 12:12:47 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(6032KiB/57306msec) clat (msec): min=9, max=294, avg=61.60, stdev=51.95 lat (msec): min=9, max=294, avg=61.60, stdev=51.95 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 53], | 70.00th=[ 69], 80.00th=[ 93], 90.00th=[ 134], 95.00th=[ 174], | 99.00th=[ 251], 99.50th=[ 271], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 320, per=26.30%, avg=108.89, stdev=72.75, samples=107 iops : min= 1, max= 20, avg= 6.03, stdev= 4.61, samples=107 write: IOPS=6, BW=109KiB/s (112kB/s)(6256KiB/57306msec); 0 zone resets clat (msec): min=18, max=421, avg=86.96, stdev=62.74 lat (msec): min=18, max=421, avg=87.02, stdev=62.72 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 32], 20.00th=[ 40], | 30.00th=[ 48], 40.00th=[ 55], 50.00th=[ 64], 60.00th=[ 81], | 70.00th=[ 101], 80.00th=[ 127], 90.00th=[ 174], 95.00th=[ 220], | 99.00th=[ 321], 99.50th=[ 351], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 416, per=24.97%, avg=108.63, stdev=74.87, samples=112 iops : min= 1, max= 26, avg= 6.00, stdev= 4.79, samples=112 lat (msec) : 10=0.26%, 20=5.60%, 50=39.84%, 100=30.08%, 250=22.66% lat (msec) : 500=1.56% cpu : usr=0.03%, sys=1.69%, ctx=1188, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=414KiB/s (424kB/s), 99.0KiB/s-108KiB/s (102kB/s-111kB/s), io=23.4MiB (24.5MB), run=57306-57805msec WRITE: bw=436KiB/s (446kB/s), 104KiB/s-114KiB/s (107kB/s-117kB/s), io=24.6MiB (25.8MB), run=57306-57805msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179300: Fri Jun 12 12:13:05 2026 read: IOPS=1, BW=1092KiB/s (1118kB/s)(7168KiB/6565msec) clat (msec): min=200, max=375, avg=293.29, stdev=55.42 lat (msec): min=200, max=375, avg=293.29, stdev=55.42 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 251], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 300], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 326], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1560, max= 4071, per=86.29%, avg=2319.40, stdev=997.15, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=780KiB/s (799kB/s)(5120KiB/6565msec); 0 zone resets clat (msec): min=319, max=1923, avg=830.87, stdev=640.44 lat (msec): min=319, max=1923, avg=831.02, stdev=640.58 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1851, max= 2031, per=52.52%, avg=1976.20, stdev=71.34, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=8.33%, 500=66.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.43%, ctx=194, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179301: Fri Jun 12 12:13:05 2026 read: IOPS=0, BW=288KiB/s (295kB/s)(2048KiB/7099msec) clat (msec): min=362, max=2414, avg=1388.78, stdev=1451.25 lat (msec): min=362, max=2414, avg=1388.78, stdev=1451.25 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1996, max= 2043, per=75.13%, avg=2019.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1442KiB/s (1477kB/s)(10.0MiB/7099msec); 0 zone resets clat (msec): min=122, max=858, avg=423.15, stdev=261.07 lat (msec): min=122, max=858, avg=423.73, stdev=260.50 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 142], | 30.00th=[ 241], 40.00th=[ 279], 50.00th=[ 321], 60.00th=[ 326], | 70.00th=[ 523], 80.00th=[ 659], 90.00th=[ 760], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1851, max= 6000, per=78.67%, avg=2960.50, stdev=1674.20, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=7.73%, ctx=429, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179302: Fri Jun 12 12:13:05 2026 read: IOPS=0, BW=807KiB/s (826kB/s)(6144KiB/7618msec) clat (usec): min=494, max=414526, avg=219829.15, stdev=135494.96 lat (usec): min=495, max=414528, avg=219830.47, stdev=135495.05 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[173016], | 30.00th=[173016], 40.00th=[210764], 50.00th=[210764], 60.00th=[246416], | 70.00th=[274727], 80.00th=[274727], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 1996, max= 4000, per=93.25%, avg=2506.50, stdev=995.76, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=807KiB/s (826kB/s)(6144KiB/7618msec); 0 zone resets clat (msec): min=129, max=3087, avg=988.19, stdev=1112.69 lat (msec): min=129, max=3087, avg=988.27, stdev=1112.74 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 953], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1595, max= 2031, per=51.32%, avg=1931.20, stdev=188.45, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=5.20%, ctx=187, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179303: Fri Jun 12 12:13:05 2026 read: IOPS=0, BW=790KiB/s (809kB/s)(5120KiB/6478msec) clat (msec): min=2, max=402, avg=233.42, stdev=152.77 lat (msec): min=2, max=402, avg=233.42, stdev=152.77 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1939, max= 4063, per=99.27%, avg=2668.33, stdev=1208.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1107KiB/s (1133kB/s)(7168KiB/6478msec); 0 zone resets clat (msec): min=155, max=2567, avg=718.13, stdev=842.73 lat (msec): min=155, max=2567, avg=718.22, stdev=842.73 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 239], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 368], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 726], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1939, max= 4063, per=79.68%, avg=2998.50, stdev=1188.80, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 4=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.79%, ctx=259, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2688KiB/s (2753kB/s), 288KiB/s-1092KiB/s (295kB/s-1118kB/s), io=20.0MiB (20.0MB), run=6478-7618msec WRITE: bw=3764KiB/s (3854kB/s), 780KiB/s-1442KiB/s (799kB/s-1477kB/s), io=28.0MiB (29.4MB), run=6478-7618msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179296: Fri Jun 12 12:13:06 2026 read: IOPS=1, BW=1108KiB/s (1134kB/s)(7168KiB/6472msec) clat (msec): min=128, max=813, avg=297.87, stdev=245.52 lat (msec): min=128, max=813, avg=297.87, stdev=245.52 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 134], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 176], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 376], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2007, max= 5976, per=100.00%, avg=3011.25, stdev=1976.54, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=0, BW=791KiB/s (810kB/s)(5120KiB/6472msec); 0 zone resets clat (msec): min=310, max=2346, avg=864.72, stdev=836.41 lat (msec): min=310, max=2346, avg=864.86, stdev=836.41 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1939, max= 2039, per=56.24%, avg=1987.00, stdev=41.67, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.40%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179297: Fri Jun 12 12:13:06 2026 read: IOPS=0, BW=257KiB/s (263kB/s)(2048KiB/7967msec) clat (msec): min=638, max=2611, avg=1624.67, stdev=1394.97 lat (msec): min=638, max=2611, avg=1624.67, stdev=1394.97 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 2601], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2015, max= 2019, per=79.94%, avg=2017.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1285KiB/s (1316kB/s)(10.0MiB/7967msec); 0 zone resets clat (msec): min=160, max=1249, avg=455.25, stdev=342.21 lat (msec): min=160, max=1249, avg=455.51, stdev=342.15 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 178], | 30.00th=[ 190], 40.00th=[ 271], 50.00th=[ 317], 60.00th=[ 384], | 70.00th=[ 451], 80.00th=[ 550], 90.00th=[ 802], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1943, max= 6119, per=73.27%, avg=2588.57, stdev=1557.27, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.64%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179298: Fri Jun 12 12:13:06 2026 read: IOPS=0, BW=836KiB/s (856kB/s)(6144KiB/7347msec) clat (msec): min=108, max=580, avg=355.19, stdev=181.37 lat (msec): min=108, max=580, avg=355.19, stdev=181.37 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 384], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2015, max= 3886, per=100.00%, avg=2645.33, stdev=1074.50, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=836KiB/s (856kB/s)(6144KiB/7347msec); 0 zone resets clat (msec): min=169, max=3042, avg=852.80, stdev=1087.45 lat (msec): min=169, max=3042, avg=853.01, stdev=1087.40 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 456], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1385, max= 2043, per=53.37%, avg=1885.60, stdev=282.22, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=16.67%, 500=50.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.34%, ctx=133, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179299: Fri Jun 12 12:13:06 2026 read: IOPS=0, BW=631KiB/s (646kB/s)(5120KiB/8115msec) clat (msec): min=52, max=934, avg=351.56, stdev=358.73 lat (msec): min=52, max=934, avg=351.56, stdev=358.73 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 53], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 2015, max= 4031, per=100.00%, avg=2695.00, stdev=1157.07, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=883KiB/s (905kB/s)(7168KiB/8115msec); 0 zone resets clat (msec): min=70, max=2951, avg=838.94, stdev=991.48 lat (msec): min=70, max=2952, avg=839.57, stdev=991.62 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 182], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 634], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 1062], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1943, max= 2043, per=57.03%, avg=2015.00, stdev=41.67, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.32%, ctx=88, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2524KiB/s (2584kB/s), 257KiB/s-1108KiB/s (263kB/s-1134kB/s), io=20.0MiB (20.0MB), run=6472-8115msec WRITE: bw=3533KiB/s (3618kB/s), 791KiB/s-1285KiB/s (810kB/s-1316kB/s), io=28.0MiB (29.4MB), run=6472-8115msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179310: Fri Jun 12 12:13:22 2026 read: IOPS=1, BW=4844KiB/s (4960kB/s)(12.0MiB/2537msec) clat (msec): min=793, max=853, avg=820.09, stdev=30.39 lat (msec): min=793, max=853, avg=820.09, stdev=30.39 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.04%, ctx=176, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179311: Fri Jun 12 12:13:22 2026 read: IOPS=0, BW=1535KiB/s (1571kB/s)(4096KiB/2669msec) clat (nsec): min=963584k, max=963584k, avg=963584165.00, stdev= 0.00 lat (nsec): min=963587k, max=963587k, avg=963586664.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3069KiB/s (3143kB/s)(8192KiB/2669msec); 0 zone resets clat (msec): min=613, max=901, avg=757.64, stdev=203.25 lat (msec): min=616, max=902, avg=759.40, stdev=202.14 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8126, max= 8126, per=99.62%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.58%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179313: Fri Jun 12 12:13:22 2026 write: IOPS=0, BW=3059KiB/s (3132kB/s)(12.0MiB/4017msec); 0 zone resets clat (msec): min=337, max=2940, avg=1252.67, stdev=1463.32 lat (msec): min=342, max=2943, avg=1255.27, stdev=1463.35 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min=16031, max=16031, per=100.00%, avg=16031.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.84%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179314: Fri Jun 12 12:13:22 2026 write: IOPS=0, BW=3444KiB/s (3527kB/s)(12.0MiB/3568msec); 0 zone resets clat (msec): min=333, max=2544, avg=1109.28, stdev=1244.35 lat (msec): min=334, max=2547, avg=1110.49, stdev=1245.63 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min=15875, max=15875, per=100.00%, avg=15875.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.48%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6139KiB/s (6286kB/s), 1535KiB/s-4844KiB/s (1571kB/s-4960kB/s), io=16.0MiB (16.8MB), run=2537-2669msec WRITE: bw=8157KiB/s (8353kB/s), 3059KiB/s-3444KiB/s (3132kB/s-3527kB/s), io=32.0MiB (33.6MB), run=2669-4017msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179315: Fri Jun 12 12:13:23 2026 read: IOPS=1, BW=4490KiB/s (4597kB/s)(12.0MiB/2737msec) clat (msec): min=747, max=1099, avg=890.95, stdev=184.78 lat (msec): min=747, max=1099, avg=890.96, stdev=184.78 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=3.62%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179316: Fri Jun 12 12:13:23 2026 read: IOPS=0, BW=1095KiB/s (1121kB/s)(4096KiB/3741msec) clat (nsec): min=2181.5M, max=2181.5M, avg=2181465928.00, stdev= 0.00 lat (nsec): min=2181.5M, max=2181.5M, avg=2181468303.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2198], 5.00th=[ 2198], 10.00th=[ 2198], 20.00th=[ 2198], | 30.00th=[ 2198], 40.00th=[ 2198], 50.00th=[ 2198], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2190KiB/s (2242kB/s)(8192KiB/3741msec); 0 zone resets clat (msec): min=340, max=1042, avg=691.48, stdev=496.47 lat (msec): min=340, max=1042, avg=691.89, stdev=496.47 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.26%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179317: Fri Jun 12 12:13:23 2026 write: IOPS=0, BW=2827KiB/s (2895kB/s)(12.0MiB/4347msec); 0 zone resets clat (msec): min=214, max=3807, avg=1422.71, stdev=2065.74 lat (msec): min=214, max=3808, avg=1423.30, stdev=2065.93 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.05%, sys=2.21%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179318: Fri Jun 12 12:13:23 2026 write: IOPS=0, BW=3465KiB/s (3548kB/s)(12.0MiB/3546msec); 0 zone resets clat (msec): min=588, max=2299, avg=1167.29, stdev=980.71 lat (msec): min=588, max=2300, avg=1167.62, stdev=980.76 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 6340, max= 8175, per=96.28%, avg=7257.50, stdev=1297.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.48%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4380KiB/s (4485kB/s), 1095KiB/s-4490KiB/s (1121kB/s-4597kB/s), io=16.0MiB (16.8MB), run=2737-3741msec WRITE: bw=7538KiB/s (7719kB/s), 2190KiB/s-3465KiB/s (2242kB/s-3548kB/s), io=32.0MiB (33.6MB), run=3546-4347msec