== sanity test 398b: DIO and buffer IO race ============== 06:25:24 (1781000724) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.60418 s, 7.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144949: Tue Jun 9 06:28:04 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(5992KiB/139649msec) clat (usec): min=37, max=258676, avg=47151.14, stdev=29776.58 lat (usec): min=37, max=258678, avg=47156.50, stdev=29777.25 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 96], 10.00th=[ 17957], 20.00th=[ 24773], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[141558], 99.50th=[162530], 99.90th=[233833], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 103, per=24.83%, avg=42.46, stdev=16.72, samples=274 iops : min= 1, max= 25, avg= 9.93, stdev= 4.19, samples=274 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6296KiB/139649msec); 0 zone resets clat (usec): min=1198, max=827478, avg=43548.62, stdev=46353.82 lat (usec): min=1199, max=827479, avg=43557.18, stdev=46353.00 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1663], 10.00th=[ 3130], 20.00th=[ 6587], | 30.00th=[ 11600], 40.00th=[ 23462], 50.00th=[ 32637], 60.00th=[ 43779], | 70.00th=[ 56361], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[183501], 99.50th=[231736], 99.90th=[413139], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 6, max= 95, per=24.94%, avg=44.64, stdev=18.70, samples=274 iops : min= 1, max= 23, avg=10.48, stdev= 4.70, samples=274 lat (usec) : 50=0.20%, 100=2.31%, 250=0.39%, 500=0.03% lat (msec) : 2=3.65%, 4=2.70%, 10=7.65%, 20=8.01%, 50=38.61% lat (msec) : 100=28.97%, 250=7.26%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=5.27%, ctx=7176, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144950: Tue Jun 9 06:28:04 2026 read: IOPS=10, BW=42.3KiB/s (43.3kB/s)(5940KiB/140414msec) clat (usec): min=44, max=237224, avg=47398.58, stdev=30738.77 lat (usec): min=44, max=237226, avg=47402.49, stdev=30738.67 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 100], 10.00th=[ 18744], 20.00th=[ 25297], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[152044], 99.50th=[181404], 99.90th=[225444], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 111, per=24.48%, avg=41.87, stdev=16.62, samples=276 iops : min= 1, max= 27, avg= 9.78, stdev= 4.16, samples=276 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6348KiB/140414msec); 0 zone resets clat (usec): min=1161, max=850606, avg=43825.54, stdev=46424.71 lat (usec): min=1163, max=850607, avg=43833.73, stdev=46427.58 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1647], 10.00th=[ 2933], 20.00th=[ 6325], | 30.00th=[ 11731], 40.00th=[ 23200], 50.00th=[ 33817], 60.00th=[ 45351], | 70.00th=[ 56361], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[187696], 99.50th=[200279], 99.90th=[446694], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 174, per=24.98%, avg=44.72, stdev=20.96, samples=276 iops : min= 1, max= 43, avg=10.50, stdev= 5.27, samples=276 lat (usec) : 50=0.23%, 100=2.18%, 250=0.36%, 500=0.13%, 1000=0.03% lat (msec) : 2=3.65%, 4=3.48%, 10=7.29%, 20=7.36%, 50=38.48% lat (msec) : 100=29.52%, 250=7.16%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=5.41%, ctx=7074, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Tue Jun 9 06:28:04 2026 read: IOPS=10, BW=43.1KiB/s (44.1kB/s)(6028KiB/139908msec) clat (usec): min=28, max=225247, avg=45100.50, stdev=30223.69 lat (usec): min=29, max=225248, avg=45103.11, stdev=30223.32 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 75], 10.00th=[ 16581], 20.00th=[ 22938], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[154141], 99.50th=[177210], 99.90th=[223347], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 6, max= 103, per=24.97%, avg=42.70, stdev=18.70, samples=275 iops : min= 1, max= 25, avg= 9.99, stdev= 4.71, samples=275 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6260KiB/139908msec); 0 zone resets clat (usec): min=1139, max=857509, avg=45657.79, stdev=47888.55 lat (usec): min=1140, max=857510, avg=45669.72, stdev=47885.59 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1893], 10.00th=[ 3392], 20.00th=[ 6718], | 30.00th=[ 12125], 40.00th=[ 23725], 50.00th=[ 36439], 60.00th=[ 46400], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[131597], | 99.00th=[183501], 99.50th=[225444], 99.90th=[325059], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 94, per=24.77%, avg=44.35, stdev=16.71, samples=275 iops : min= 1, max= 23, avg=10.40, stdev= 4.21, samples=275 lat (usec) : 50=0.39%, 100=2.60%, 250=0.52%, 500=0.03%, 750=0.10% lat (msec) : 2=2.77%, 4=3.42%, 10=7.65%, 20=8.27%, 50=38.41% lat (msec) : 100=28.03%, 250=7.65%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=5.35%, ctx=7023, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Tue Jun 9 06:28:04 2026 read: IOPS=10, BW=43.2KiB/s (44.3kB/s)(6052KiB/139996msec) clat (usec): min=32, max=309976, avg=44714.62, stdev=30759.00 lat (usec): min=33, max=309977, avg=44717.37, stdev=30759.20 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 14484], 20.00th=[ 23725], | 30.00th=[ 28705], 40.00th=[ 33424], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[168821], 99.90th=[270533], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 95, per=25.17%, avg=43.05, stdev=16.95, samples=273 iops : min= 1, max= 23, avg=10.08, stdev= 4.27, samples=273 write: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6236KiB/139996msec); 0 zone resets clat (usec): min=1113, max=906280, avg=46063.84, stdev=48092.95 lat (usec): min=1113, max=906282, avg=46068.09, stdev=48093.49 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1680], 10.00th=[ 3392], 20.00th=[ 6652], | 30.00th=[ 11731], 40.00th=[ 24249], 50.00th=[ 36963], 60.00th=[ 48497], | 70.00th=[ 61080], 80.00th=[ 77071], 90.00th=[100140], 95.00th=[122160], | 99.00th=[204473], 99.50th=[240124], 99.90th=[287310], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 8, max= 95, per=24.79%, avg=44.37, stdev=17.44, samples=273 iops : min= 2, max= 23, avg=10.41, stdev= 4.38, samples=273 lat (usec) : 50=0.23%, 100=3.26%, 250=0.36%, 500=0.13%, 750=0.07% lat (msec) : 2=3.32%, 4=2.77%, 10=8.01%, 20=7.65%, 50=38.57% lat (msec) : 100=28.29%, 250=7.06%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=5.29%, ctx=6974, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.3KiB/s-43.2KiB/s (43.3kB/s-44.3kB/s), io=23.4MiB (24.6MB), run=139649-140414msec WRITE: bw=179KiB/s (183kB/s), 44.5KiB/s-45.2KiB/s (45.6kB/s-46.3kB/s), io=24.6MiB (25.7MB), run=139649-140414msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144954: Tue Jun 9 06:30:12 2026 read: IOPS=5, BW=22.6KiB/s (23.1kB/s)(5992KiB/265471msec) clat (msec): min=5, max=981, avg=36.91, stdev=45.68 lat (msec): min=5, max=981, avg=36.91, stdev=45.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 51], 90.00th=[ 79], 95.00th=[ 111], | 99.00th=[ 203], 99.50th=[ 292], 99.90th=[ 376], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 87, per=28.04%, avg=24.96, stdev=17.80, samples=464 iops : min= 1, max= 21, avg= 5.60, stdev= 4.50, samples=464 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6296KiB/265471msec); 0 zone resets clat (msec): min=35, max=468, avg=133.40, stdev=65.50 lat (msec): min=35, max=468, avg=133.41, stdev=65.50 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 115], 60.00th=[ 133], | 70.00th=[ 155], 80.00th=[ 184], 90.00th=[ 224], 95.00th=[ 266], | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 460], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 56, per=25.28%, avg=23.51, stdev=11.53, samples=516 iops : min= 1, max= 14, avg= 5.23, stdev= 2.94, samples=516 lat (msec) : 10=2.64%, 20=18.29%, 50=18.65%, 100=25.88%, 250=30.99% lat (msec) : 500=3.52%, 1000=0.03% cpu : usr=0.05%, sys=1.50%, ctx=5305, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144955: Tue Jun 9 06:30:12 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(5940KiB/268156msec) clat (msec): min=6, max=954, avg=37.82, stdev=44.62 lat (msec): min=6, max=954, avg=37.82, stdev=44.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 54], 90.00th=[ 87], 95.00th=[ 114], | 99.00th=[ 190], 99.50th=[ 226], 99.90th=[ 342], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 119, per=28.41%, avg=25.28, stdev=17.34, samples=453 iops : min= 1, max= 29, avg= 5.68, stdev= 4.36, samples=453 write: IOPS=5, BW=23.7KiB/s (24.2kB/s)(6348KiB/268156msec); 0 zone resets clat (msec): min=40, max=510, avg=133.44, stdev=65.90 lat (msec): min=40, max=510, avg=133.45, stdev=65.89 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 133], | 70.00th=[ 153], 80.00th=[ 182], 90.00th=[ 226], 95.00th=[ 264], | 99.00th=[ 347], 99.50th=[ 388], 99.90th=[ 481], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 48, per=24.98%, avg=23.23, stdev=11.25, samples=525 iops : min= 1, max= 12, avg= 5.16, stdev= 2.89, samples=525 lat (msec) : 10=2.25%, 20=18.33%, 50=18.23%, 100=25.29%, 250=32.49% lat (msec) : 500=3.35%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.48%, ctx=5419, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Tue Jun 9 06:30:12 2026 read: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6028KiB/266377msec) clat (msec): min=6, max=379, avg=37.76, stdev=39.81 lat (msec): min=6, max=379, avg=37.76, stdev=39.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 83], 95.00th=[ 115], | 99.00th=[ 199], 99.50th=[ 264], 99.90th=[ 321], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 95, per=27.70%, avg=24.65, stdev=16.25, samples=472 iops : min= 1, max= 23, avg= 5.52, stdev= 4.10, samples=472 write: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6260KiB/266377msec); 0 zone resets clat (msec): min=37, max=1244, avg=133.72, stdev=70.91 lat (msec): min=37, max=1244, avg=133.73, stdev=70.91 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 115], 60.00th=[ 130], | 70.00th=[ 150], 80.00th=[ 180], 90.00th=[ 226], 95.00th=[ 268], | 99.00th=[ 347], 99.50th=[ 388], 99.90th=[ 510], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 56, per=25.21%, avg=23.45, stdev=11.25, samples=514 iops : min= 1, max= 14, avg= 5.21, stdev= 2.88, samples=514 lat (msec) : 10=1.89%, 20=18.26%, 50=19.53%, 100=25.91%, 250=30.66% lat (msec) : 500=3.68%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.50%, ctx=5479, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144957: Tue Jun 9 06:30:12 2026 read: IOPS=5, BW=22.7KiB/s (23.3kB/s)(6052KiB/266042msec) clat (msec): min=6, max=441, avg=36.16, stdev=38.43 lat (msec): min=6, max=441, avg=36.16, stdev=38.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 82], 95.00th=[ 108], | 99.00th=[ 180], 99.50th=[ 257], 99.90th=[ 359], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 119, per=29.48%, avg=26.23, stdev=18.56, samples=446 iops : min= 1, max= 29, avg= 5.92, stdev= 4.69, samples=446 write: IOPS=5, BW=23.4KiB/s (24.0kB/s)(6236KiB/266042msec); 0 zone resets clat (msec): min=36, max=1128, avg=135.43, stdev=73.70 lat (msec): min=36, max=1128, avg=135.44, stdev=73.70 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 117], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 184], 90.00th=[ 228], 95.00th=[ 275], | 99.00th=[ 376], 99.50th=[ 418], 99.90th=[ 527], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 55, per=24.95%, avg=23.20, stdev=11.37, samples=517 iops : min= 1, max= 13, avg= 5.15, stdev= 2.90, samples=517 lat (msec) : 10=2.51%, 20=18.72%, 50=18.98%, 100=25.29%, 250=30.47% lat (msec) : 500=3.97%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.54%, ctx=5422, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.5KiB/s (91.7kB/s), 22.2KiB/s-22.7KiB/s (22.7kB/s-23.3kB/s), io=23.4MiB (24.6MB), run=265471-268156msec WRITE: bw=93.8KiB/s (96.0kB/s), 23.4KiB/s-23.7KiB/s (24.0kB/s-24.3kB/s), io=24.6MiB (25.7MB), run=265471-268156msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145029: Tue Jun 9 06:30:56 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5920KiB/32343msec) clat (usec): min=31, max=228754, avg=43206.11, stdev=37360.44 lat (usec): min=31, max=228756, avg=43215.16, stdev=37354.87 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 104], | 30.00th=[ 23200], 40.00th=[ 31589], 50.00th=[ 40109], 60.00th=[ 51119], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[183501], 99.50th=[212861], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 62, max= 439, per=25.80%, avg=186.52, stdev=84.68, samples=61 iops : min= 3, max= 27, avg=10.97, stdev= 5.36, samples=61 write: IOPS=12, BW=197KiB/s (202kB/s)(6368KiB/32343msec); 0 zone resets clat (usec): min=1682, max=247069, avg=41010.43, stdev=44872.60 lat (usec): min=1684, max=247073, avg=41016.18, stdev=44873.99 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2671], 10.00th=[ 4080], 20.00th=[ 6849], | 30.00th=[ 10028], 40.00th=[ 15008], 50.00th=[ 22676], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[212861], 99.50th=[238027], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 542, per=25.78%, avg=196.21, stdev=95.04, samples=63 iops : min= 1, max= 33, avg=11.59, stdev= 6.02, samples=63 lat (usec) : 50=1.43%, 100=7.94%, 250=1.56%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.43%, 4=4.04%, 10=10.68%, 20=9.51%, 50=27.21% lat (msec) : 100=27.73%, 250=7.68% cpu : usr=0.10%, sys=5.77%, ctx=1520, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145030: Tue Jun 9 06:30:56 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(5744KiB/33084msec) clat (usec): min=38, max=396435, avg=44765.81, stdev=40280.32 lat (usec): min=38, max=396437, avg=44771.81, stdev=40275.21 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 231], | 30.00th=[ 27132], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 73925], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[162530], 99.50th=[229639], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 31, max= 446, per=24.01%, avg=173.62, stdev=82.77, samples=65 iops : min= 1, max= 27, avg=10.15, stdev= 5.15, samples=65 write: IOPS=12, BW=198KiB/s (203kB/s)(6544KiB/33084msec); 0 zone resets clat (usec): min=1451, max=304084, avg=41436.93, stdev=45046.69 lat (usec): min=1453, max=304087, avg=41443.02, stdev=45045.60 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2573], 10.00th=[ 3851], 20.00th=[ 6521], | 30.00th=[ 10552], 40.00th=[ 16450], 50.00th=[ 27132], 60.00th=[ 38536], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 99091], 95.00th=[128451], | 99.00th=[200279], 99.50th=[263193], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 379, per=25.89%, avg=197.02, stdev=87.40, samples=65 iops : min= 1, max= 23, avg=11.63, stdev= 5.50, samples=65 lat (usec) : 50=0.78%, 100=7.55%, 250=1.17%, 500=0.39%, 750=0.26% lat (msec) : 2=2.21%, 4=4.30%, 10=9.64%, 20=8.33%, 50=30.86% lat (msec) : 100=25.78%, 250=8.07%, 500=0.65% cpu : usr=0.08%, sys=6.42%, ctx=1603, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145031: Tue Jun 9 06:30:56 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31148msec) clat (usec): min=39, max=212153, avg=40711.50, stdev=35088.01 lat (usec): min=39, max=212155, avg=40712.75, stdev=35088.08 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 98], | 30.00th=[ 22152], 40.00th=[ 30802], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[143655], 99.50th=[200279], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 62, max= 542, per=27.98%, avg=202.28, stdev=112.74, samples=61 iops : min= 3, max= 33, avg=11.95, stdev= 7.08, samples=61 write: IOPS=12, BW=194KiB/s (198kB/s)(6032KiB/31148msec); 0 zone resets clat (usec): min=1559, max=249808, avg=40277.29, stdev=40357.54 lat (usec): min=1562, max=249809, avg=40280.12, stdev=40357.29 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2933], 10.00th=[ 4146], 20.00th=[ 7767], | 30.00th=[ 11076], 40.00th=[ 16319], 50.00th=[ 26870], 60.00th=[ 38536], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[181404], 99.50th=[219153], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 91, max= 416, per=25.34%, avg=192.80, stdev=75.75, samples=61 iops : min= 5, max= 26, avg=11.34, stdev= 4.83, samples=61 lat (usec) : 50=1.69%, 100=8.85%, 250=2.21%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=1.43%, 4=3.26%, 10=9.38%, 20=8.98%, 50=29.30% lat (msec) : 100=27.08%, 250=6.77% cpu : usr=0.10%, sys=6.01%, ctx=1552, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145032: Tue Jun 9 06:30:56 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30882msec) clat (usec): min=36, max=312817, avg=44200.71, stdev=40358.47 lat (usec): min=36, max=312818, avg=44203.31, stdev=40360.39 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 91], | 30.00th=[ 20841], 40.00th=[ 33424], 50.00th=[ 41681], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[168821], 99.50th=[221250], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 442, per=26.86%, avg=194.17, stdev=88.31, samples=60 iops : min= 1, max= 27, avg=11.43, stdev= 5.59, samples=60 write: IOPS=12, BW=203KiB/s (207kB/s)(6256KiB/30882msec); 0 zone resets clat (usec): min=1547, max=287711, avg=36237.45, stdev=37876.54 lat (usec): min=1548, max=287714, avg=36240.64, stdev=37876.66 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2343], 10.00th=[ 3654], 20.00th=[ 6259], | 30.00th=[ 9503], 40.00th=[ 15139], 50.00th=[ 24249], 60.00th=[ 34341], | 70.00th=[ 44827], 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[164627], 99.50th=[235930], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 510, per=26.63%, avg=202.67, stdev=102.39, samples=60 iops : min= 1, max= 31, avg=11.97, stdev= 6.46, samples=60 lat (usec) : 50=1.82%, 100=8.85%, 250=1.30%, 500=0.65%, 750=0.13% lat (msec) : 2=1.69%, 4=5.21%, 10=9.90%, 20=8.33%, 50=27.86% lat (msec) : 100=27.21%, 250=6.77%, 500=0.26% cpu : usr=0.06%, sys=6.29%, ctx=1467, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=724KiB/s (741kB/s), 174KiB/s-201KiB/s (178kB/s-206kB/s), io=23.4MiB (24.5MB), run=30882-33084msec WRITE: bw=762KiB/s (780kB/s), 194KiB/s-203KiB/s (198kB/s-207kB/s), io=24.6MiB (25.8MB), run=30882-33084msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145024: Tue Jun 9 06:31:38 2026 read: IOPS=4, BW=79.4KiB/s (81.3kB/s)(5920KiB/74576msec) clat (msec): min=8, max=393, avg=43.69, stdev=46.44 lat (msec): min=8, max=393, avg=43.69, stdev=46.44 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 93], 95.00th=[ 129], | 99.00th=[ 264], 99.50th=[ 313], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 254, per=28.01%, avg=88.78, stdev=54.96, samples=130 iops : min= 1, max= 15, avg= 4.75, stdev= 3.50, samples=130 write: IOPS=5, BW=85.4KiB/s (87.4kB/s)(6368KiB/74576msec); 0 zone resets clat (msec): min=48, max=566, avg=146.42, stdev=65.27 lat (msec): min=48, max=566, avg=146.43, stdev=65.27 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 355], 99.50th=[ 388], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 29, max= 160, per=26.03%, avg=86.68, stdev=38.56, samples=144 iops : min= 1, max= 10, avg= 4.62, stdev= 2.47, samples=144 lat (msec) : 10=0.52%, 20=12.50%, 50=24.22%, 100=21.09%, 250=37.37% lat (msec) : 500=4.17%, 750=0.13% cpu : usr=0.05%, sys=1.43%, ctx=1363, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145025: Tue Jun 9 06:31:38 2026 read: IOPS=4, BW=76.1KiB/s (77.0kB/s)(5744KiB/75453msec) clat (msec): min=6, max=366, avg=43.88, stdev=48.63 lat (msec): min=6, max=366, avg=43.88, stdev=48.63 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 58], 90.00th=[ 91], 95.00th=[ 148], | 99.00th=[ 271], 99.50th=[ 321], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 29, max= 318, per=28.77%, avg=91.20, stdev=58.44, samples=123 iops : min= 1, max= 19, avg= 4.91, stdev= 3.68, samples=123 write: IOPS=5, BW=86.7KiB/s (88.8kB/s)(6544KiB/75453msec); 0 zone resets clat (msec): min=44, max=418, avg=145.61, stdev=65.38 lat (msec): min=44, max=418, avg=145.63, stdev=65.36 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 79], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 117], 50.00th=[ 132], 60.00th=[ 146], | 70.00th=[ 163], 80.00th=[ 197], 90.00th=[ 232], 95.00th=[ 275], | 99.00th=[ 359], 99.50th=[ 388], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 189, per=26.37%, avg=87.82, stdev=38.87, samples=146 iops : min= 1, max= 11, avg= 4.69, stdev= 2.49, samples=146 lat (msec) : 10=0.39%, 20=13.02%, 50=22.79%, 100=21.74%, 250=37.37% lat (msec) : 500=4.69% cpu : usr=0.04%, sys=1.39%, ctx=1320, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145026: Tue Jun 9 06:31:38 2026 read: IOPS=5, BW=87.1KiB/s (89.2kB/s)(6256KiB/71849msec) clat (msec): min=8, max=253, avg=39.80, stdev=36.43 lat (msec): min=8, max=253, avg=39.80, stdev=36.43 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 80], 95.00th=[ 113], | 99.00th=[ 218], 99.50th=[ 222], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 29, max= 286, per=30.71%, avg=97.35, stdev=62.09, samples=127 iops : min= 1, max= 17, avg= 5.29, stdev= 3.91, samples=127 write: IOPS=5, BW=83.0KiB/s (85.0kB/s)(6032KiB/71849msec); 0 zone resets clat (msec): min=48, max=602, avg=149.11, stdev=75.39 lat (msec): min=48, max=602, avg=149.12, stdev=75.40 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 117], 50.00th=[ 132], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 203], 90.00th=[ 243], 95.00th=[ 288], | 99.00th=[ 409], 99.50th=[ 567], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 31, max= 192, per=25.33%, avg=84.34, stdev=37.04, samples=140 iops : min= 1, max= 12, avg= 4.48, stdev= 2.41, samples=140 lat (msec) : 10=0.65%, 20=13.41%, 50=26.43%, 100=19.92%, 250=35.29% lat (msec) : 500=4.04%, 750=0.26% cpu : usr=0.04%, sys=1.47%, ctx=1402, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145027: Tue Jun 9 06:31:38 2026 read: IOPS=5, BW=80.1KiB/s (81.0kB/s)(6032KiB/75338msec) clat (msec): min=7, max=369, avg=40.29, stdev=38.29 lat (msec): min=7, max=369, avg=40.30, stdev=38.29 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 81], 95.00th=[ 116], | 99.00th=[ 188], 99.50th=[ 266], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 350, per=29.27%, avg=92.79, stdev=62.85, samples=127 iops : min= 1, max= 21, avg= 5.01, stdev= 3.97, samples=127 write: IOPS=5, BW=83.0KiB/s (85.0kB/s)(6256KiB/75338msec); 0 zone resets clat (msec): min=46, max=563, avg=153.51, stdev=75.58 lat (msec): min=46, max=563, avg=153.52, stdev=75.58 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 96], | 30.00th=[ 110], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 201], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 481], 99.50th=[ 485], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 30, max= 190, per=25.44%, avg=84.72, stdev=36.67, samples=145 iops : min= 1, max= 11, avg= 4.50, stdev= 2.37, samples=145 lat (msec) : 10=1.04%, 20=13.93%, 50=23.31%, 100=19.53%, 250=36.98% lat (msec) : 500=5.08%, 750=0.13% cpu : usr=0.04%, sys=1.46%, ctx=1328, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=317KiB/s (325kB/s), 76.1KiB/s-87.1KiB/s (77.0kB/s-89.2kB/s), io=23.4MiB (24.5MB), run=71849-75453msec WRITE: bw=334KiB/s (342kB/s), 83.0KiB/s-86.7KiB/s (85.0kB/s-88.8kB/s), io=24.6MiB (25.8MB), run=71849-75453msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145051: Tue Jun 9 06:31:56 2026 read: IOPS=0, BW=973KiB/s (996kB/s)(7168KiB/7369msec) clat (usec): min=754, max=3278.0k, avg=627257.79, stdev=1173556.10 lat (usec): min=755, max=3278.0k, avg=627259.09, stdev=1173556.53 clat percentiles (usec): | 1.00th=[ 758], 5.00th=[ 758], 10.00th=[ 758], | 20.00th=[ 147850], 30.00th=[ 189793], 40.00th=[ 189793], | 50.00th=[ 210764], 60.00th=[ 233833], 70.00th=[ 233833], | 80.00th=[ 333448], 90.00th=[3271558], 95.00th=[3271558], | 99.00th=[3271558], 99.50th=[3271558], 99.90th=[3271558], | 99.95th=[3271558], 99.99th=[3271558] bw ( KiB/s): min= 1961, max= 3864, per=86.01%, avg=2390.20, stdev=824.63, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=695KiB/s (711kB/s)(5120KiB/7369msec); 0 zone resets clat (msec): min=273, max=737, avg=548.62, stdev=213.95 lat (msec): min=273, max=737, avg=548.75, stdev=214.01 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1885, max= 2048, per=50.98%, avg=1983.00, stdev=70.65, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=7.42%, ctx=679, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145052: Tue Jun 9 06:31:56 2026 read: IOPS=0, BW=288KiB/s (295kB/s)(2048KiB/7113msec) clat (msec): min=5, max=242, avg=124.13, stdev=167.37 lat (msec): min=5, max=242, avg=124.13, stdev=167.37 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1802, max= 2023, per=68.82%, avg=1912.50, stdev=156.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1440KiB/s (1474kB/s)(10.0MiB/7113msec); 0 zone resets clat (msec): min=116, max=3726, avg=666.20, stdev=1097.02 lat (msec): min=116, max=3726, avg=666.59, stdev=1096.90 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 121], | 30.00th=[ 132], 40.00th=[ 176], 50.00th=[ 251], 60.00th=[ 338], | 70.00th=[ 485], 80.00th=[ 558], 90.00th=[ 768], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 1885, max= 6144, per=92.82%, avg=3610.80, stdev=1748.81, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 10=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=8.11%, ctx=210, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145053: Tue Jun 9 06:31:56 2026 read: IOPS=0, BW=915KiB/s (937kB/s)(6144KiB/6712msec) clat (usec): min=496, max=451852, avg=159437.52, stdev=188030.70 lat (usec): min=497, max=451853, avg=159438.66, stdev=188030.62 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 62129], 50.00th=[ 62129], 60.00th=[111674], | 70.00th=[329253], 80.00th=[329253], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 1885, max= 5885, per=100.00%, avg=3264.33, stdev=2270.61, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=915KiB/s (937kB/s)(6144KiB/6712msec); 0 zone resets clat (msec): min=192, max=3957, avg=946.69, stdev=1485.77 lat (msec): min=192, max=3957, avg=946.77, stdev=1485.78 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 351], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 1961, max= 3235, per=59.50%, avg=2314.50, stdev=614.59, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.09%, ctx=161, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145054: Tue Jun 9 06:31:56 2026 read: IOPS=0, BW=797KiB/s (816kB/s)(5120KiB/6426msec) clat (usec): min=345, max=359200, avg=72930.38, stdev=160035.76 lat (usec): min=345, max=359201, avg=72931.55, stdev=160035.86 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 453], 40.00th=[ 453], 50.00th=[ 938], 60.00th=[ 938], | 70.00th=[ 3720], 80.00th=[ 3720], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1115KiB/s (1142kB/s)(7168KiB/6426msec); 0 zone resets clat (msec): min=210, max=3629, avg=833.19, stdev=1238.11 lat (msec): min=210, max=3629, avg=833.28, stdev=1238.11 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 257], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 384], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 518], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1698, max= 3771, per=58.62%, avg=2280.20, stdev=843.02, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 4=8.33%, 250=8.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.35%, ctx=100, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2779KiB/s (2846kB/s), 288KiB/s-973KiB/s (295kB/s-996kB/s), io=20.0MiB (20.0MB), run=6426-7369msec WRITE: bw=3891KiB/s (3984kB/s), 695KiB/s-1440KiB/s (711kB/s-1474kB/s), io=28.0MiB (29.4MB), run=6426-7369msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145055: Tue Jun 9 06:31:57 2026 read: IOPS=1, BW=1058KiB/s (1084kB/s)(7168KiB/6772msec) clat (msec): min=95, max=3362, avg=661.74, stdev=1200.81 lat (msec): min=95, max=3362, avg=661.74, stdev=1200.81 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 99], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 550], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1510, max= 5840, per=100.00%, avg=2854.00, stdev=2005.88, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=0, BW=756KiB/s (774kB/s)(5120KiB/6772msec); 0 zone resets clat (msec): min=159, max=660, avg=407.60, stdev=178.01 lat (msec): min=159, max=661, avg=407.69, stdev=177.99 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1946, max= 4047, per=77.02%, avg=2652.67, stdev=1207.57, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.13%, ctx=60, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145056: Tue Jun 9 06:31:57 2026 read: IOPS=0, BW=249KiB/s (255kB/s)(2048KiB/8214msec) clat (msec): min=158, max=470, avg=314.41, stdev=220.44 lat (msec): min=158, max=470, avg=314.41, stdev=220.44 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1950, max= 2011, per=80.51%, avg=1980.50, stdev=43.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1247KiB/s (1277kB/s)(10.0MiB/8214msec); 0 zone resets clat (msec): min=174, max=4086, avg=726.22, stdev=1188.13 lat (msec): min=174, max=4086, avg=726.31, stdev=1188.13 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 186], | 30.00th=[ 245], 40.00th=[ 355], 50.00th=[ 359], 60.00th=[ 393], | 70.00th=[ 414], 80.00th=[ 422], 90.00th=[ 634], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 1950, max= 4079, per=77.40%, avg=2665.67, stdev=1044.58, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.13%, ctx=108, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145057: Tue Jun 9 06:31:57 2026 read: IOPS=0, BW=752KiB/s (770kB/s)(6144KiB/8170msec) clat (msec): min=112, max=977, avg=376.19, stdev=332.71 lat (msec): min=112, max=977, avg=376.19, stdev=332.71 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 368], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1973, max= 2039, per=81.97%, avg=2016.50, stdev=29.73, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=752KiB/s (770kB/s)(6144KiB/8170msec); 0 zone resets clat (msec): min=146, max=4194, avg=924.62, stdev=1606.55 lat (msec): min=146, max=4194, avg=924.68, stdev=1606.54 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 296], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 4212], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 1965, max= 4023, per=72.59%, avg=2500.00, stdev=1015.87, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.08%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145058: Tue Jun 9 06:31:57 2026 read: IOPS=0, BW=615KiB/s (630kB/s)(5120KiB/8324msec) clat (msec): min=86, max=578, avg=299.33, stdev=252.59 lat (msec): min=86, max=578, avg=299.33, stdev=252.59 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2031, max= 3900, per=100.00%, avg=2656.67, stdev=1076.77, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=861KiB/s (882kB/s)(7168KiB/8324msec); 0 zone resets clat (msec): min=163, max=4069, avg=886.10, stdev=1416.61 lat (msec): min=163, max=4070, avg=886.30, stdev=1416.61 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 167], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 443], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 667], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 1965, max= 6095, per=82.03%, avg=2825.00, stdev=1828.16, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.99%, ctx=147, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2460KiB/s (2519kB/s), 249KiB/s-1058KiB/s (255kB/s-1084kB/s), io=20.0MiB (20.0MB), run=6772-8324msec WRITE: bw=3444KiB/s (3527kB/s), 752KiB/s-1247KiB/s (770kB/s-1277kB/s), io=28.0MiB (29.4MB), run=6772-8324msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145064: Tue Jun 9 06:32:10 2026 read: IOPS=0, BW=3723KiB/s (3812kB/s)(12.0MiB/3301msec) clat (msec): min=937, max=1229, avg=1069.58, stdev=147.90 lat (msec): min=937, max=1229, avg=1069.58, stdev=147.90 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7984, max= 8192, per=100.00%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.06%, ctx=169, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145065: Tue Jun 9 06:32:10 2026 read: IOPS=0, BW=1023KiB/s (1047kB/s)(4096KiB/4005msec) clat (nsec): min=876931k, max=876931k, avg=876930813.00, stdev= 0.00 lat (nsec): min=876934k, max=876934k, avg=876933764.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2045KiB/s (2095kB/s)(8192KiB/4005msec); 0 zone resets clat (msec): min=1178, max=1837, avg=1507.68, stdev=466.22 lat (msec): min=1178, max=1837, avg=1507.96, stdev=466.04 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 7984, max= 7984, per=97.59%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.65%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145066: Tue Jun 9 06:32:10 2026 write: IOPS=1, BW=4188KiB/s (4289kB/s)(12.0MiB/2934msec); 0 zone resets clat (msec): min=646, max=1433, avg=935.60, stdev=433.36 lat (msec): min=647, max=1434, avg=936.05, stdev=433.13 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8159, max= 8192, per=99.93%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.03%, sys=4.84%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145067: Tue Jun 9 06:32:10 2026 write: IOPS=0, BW=3848KiB/s (3941kB/s)(12.0MiB/3193msec); 0 zone resets clat (msec): min=649, max=1705, avg=1018.32, stdev=595.92 lat (msec): min=650, max=1706, avg=1018.85, stdev=595.87 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7984, max= 8192, per=98.86%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.32%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4091KiB/s (4189kB/s), 1023KiB/s-3723KiB/s (1047kB/s-3812kB/s), io=16.0MiB (16.8MB), run=3301-4005msec WRITE: bw=8182KiB/s (8378kB/s), 2045KiB/s-4188KiB/s (2095kB/s-4289kB/s), io=32.0MiB (33.6MB), run=2934-4005msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145069: Tue Jun 9 06:32:11 2026 read: IOPS=0, BW=3541KiB/s (3626kB/s)(12.0MiB/3470msec) clat (msec): min=174, max=1939, avg=1155.91, stdev=899.38 lat (msec): min=174, max=1939, avg=1155.91, stdev=899.38 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.77%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145070: Tue Jun 9 06:32:11 2026 read: IOPS=0, BW=1112KiB/s (1138kB/s)(4096KiB/3685msec) clat (nsec): min=1016.3M, max=1016.3M, avg=1016279383.00, stdev= 0.00 lat (nsec): min=1016.3M, max=1016.3M, avg=1016281243.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2223KiB/s (2276kB/s)(8192KiB/3685msec); 0 zone resets clat (msec): min=1039, max=1628, avg=1333.63, stdev=416.39 lat (msec): min=1039, max=1628, avg=1333.91, stdev=416.42 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8175, max= 8175, per=91.94%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.88%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145071: Tue Jun 9 06:32:11 2026 write: IOPS=0, BW=3846KiB/s (3938kB/s)(12.0MiB/3195msec); 0 zone resets clat (msec): min=462, max=1970, avg=1054.32, stdev=804.22 lat (msec): min=465, max=1971, avg=1055.57, stdev=803.85 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8000, max= 8000, per=89.97%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.03%, sys=5.07%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145072: Tue Jun 9 06:32:11 2026 write: IOPS=1, BW=4544KiB/s (4653kB/s)(12.0MiB/2704msec); 0 zone resets clat (msec): min=368, max=1637, avg=893.78, stdev=662.42 lat (msec): min=369, max=1640, avg=894.94, stdev=663.21 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8000, max= 8175, per=90.95%, avg=8087.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.81%, ctx=36, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4446KiB/s (4553kB/s), 1112KiB/s-3541KiB/s (1138kB/s-3626kB/s), io=16.0MiB (16.8MB), run=3470-3685msec WRITE: bw=8892KiB/s (9106kB/s), 2223KiB/s-4544KiB/s (2276kB/s-4653kB/s), io=32.0MiB (33.6MB), run=2704-3685msec