== sanity test 398b: DIO and buffer IO race ============== 11:48:30 (1772470110) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.8151 s, 7.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147801: Mon Mar 2 11:50:56 2026 read: IOPS=11, BW=47.5KiB/s (48.6kB/s)(5992KiB/126230msec) clat (usec): min=102, max=1109.6k, avg=42056.27, stdev=42158.67 lat (usec): min=103, max=1109.6k, avg=42063.86, stdev=42157.94 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 167], 10.00th=[ 310], | 20.00th=[ 17957], 30.00th=[ 23200], 40.00th=[ 29230], | 50.00th=[ 35390], 60.00th=[ 42206], 70.00th=[ 51119], | 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[ 132645], 99.50th=[ 173016], 99.90th=[ 295699], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 5, max= 111, per=25.17%, avg=47.33, stdev=20.83, samples=245 iops : min= 1, max= 27, avg=11.16, stdev= 5.23, samples=245 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6296KiB/126230msec); 0 zone resets clat (usec): min=733, max=547497, avg=39802.24, stdev=43083.51 lat (usec): min=734, max=547499, avg=39816.10, stdev=43088.72 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 3687], | 30.00th=[ 8455], 40.00th=[ 17957], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[123208], | 99.00th=[181404], 99.50th=[204473], 99.90th=[265290], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 134, per=25.11%, avg=49.47, stdev=22.08, samples=246 iops : min= 1, max= 33, avg=11.71, stdev= 5.58, samples=246 lat (usec) : 250=4.75%, 500=0.42%, 750=0.33%, 1000=0.46% lat (msec) : 2=7.75%, 4=2.77%, 10=6.48%, 20=9.93%, 50=35.68% lat (msec) : 100=24.28%, 250=6.90%, 500=0.20%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.92%, ctx=6120, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147804: Mon Mar 2 11:50:56 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5940KiB/125669msec) clat (usec): min=100, max=292244, avg=41055.00, stdev=31870.21 lat (usec): min=100, max=292245, avg=41056.81, stdev=31870.52 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 157], 10.00th=[ 192], 20.00th=[ 17695], | 30.00th=[ 23725], 40.00th=[ 28967], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 50594], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[162530], 99.90th=[229639], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 5, max= 111, per=25.02%, avg=47.03, stdev=20.00, samples=246 iops : min= 1, max= 27, avg=11.09, stdev= 5.01, samples=246 write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6348KiB/125669msec); 0 zone resets clat (usec): min=768, max=1242.5k, avg=40453.18, stdev=52635.98 lat (usec): min=770, max=1242.5k, avg=40455.99, stdev=52637.42 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1254], | 20.00th=[ 3359], 30.00th=[ 8160], 40.00th=[ 17695], | 50.00th=[ 28443], 60.00th=[ 39584], 70.00th=[ 51643], | 80.00th=[ 66847], 90.00th=[ 93848], 95.00th=[ 124257], | 99.00th=[ 189793], 99.50th=[ 256902], 99.90th=[ 404751], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 5, max= 127, per=25.51%, avg=50.26, stdev=22.67, samples=246 iops : min= 1, max= 31, avg=11.91, stdev= 5.71, samples=246 lat (usec) : 250=5.34%, 500=0.46%, 750=0.42%, 1000=0.49% lat (msec) : 2=7.65%, 4=3.61%, 10=5.79%, 20=9.11%, 50=36.00% lat (msec) : 100=24.32%, 250=6.51%, 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=5.10%, ctx=6072, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147806: Mon Mar 2 11:50:56 2026 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6028KiB/127139msec) clat (usec): min=85, max=235046, avg=40033.76, stdev=31059.32 lat (usec): min=86, max=235048, avg=40038.52, stdev=31063.26 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 155], 10.00th=[ 198], 20.00th=[ 16188], | 30.00th=[ 23200], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 50594], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[131597], 99.50th=[149947], 99.90th=[206570], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 172, per=25.42%, avg=47.80, stdev=22.19, samples=245 iops : min= 1, max= 43, avg=11.28, stdev= 5.60, samples=245 write: IOPS=12, BW=49.2KiB/s (50.4kB/s)(6260KiB/127139msec); 0 zone resets clat (usec): min=912, max=1284.8k, avg=42312.42, stdev=55244.45 lat (usec): min=913, max=1284.8k, avg=42315.24, stdev=55246.28 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1237], | 20.00th=[ 3130], 30.00th=[ 7242], 40.00th=[ 16909], | 50.00th=[ 29754], 60.00th=[ 42206], 70.00th=[ 55837], | 80.00th=[ 72877], 90.00th=[ 103285], 95.00th=[ 123208], | 99.00th=[ 185598], 99.50th=[ 214959], 99.90th=[ 591397], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 7, max= 156, per=24.93%, avg=49.12, stdev=21.72, samples=247 iops : min= 1, max= 39, avg=11.62, stdev= 5.47, samples=247 lat (usec) : 100=0.07%, 250=5.47%, 500=0.52%, 750=0.23%, 1000=0.39% lat (msec) : 2=8.53%, 4=3.68%, 10=6.02%, 20=8.85%, 50=33.85% lat (msec) : 100=24.54%, 250=7.68%, 500=0.10%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.13%, ctx=6135, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147807: Mon Mar 2 11:50:56 2026 read: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6052KiB/127247msec) clat (usec): min=67, max=275471, avg=39692.08, stdev=33208.09 lat (usec): min=67, max=275472, avg=39698.15, stdev=33206.65 clat percentiles (usec): | 1.00th=[ 123], 5.00th=[ 151], 10.00th=[ 184], 20.00th=[ 15664], | 30.00th=[ 21890], 40.00th=[ 27395], 50.00th=[ 32900], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 61080], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[152044], 99.50th=[179307], 99.90th=[248513], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 112, per=25.41%, avg=47.77, stdev=20.89, samples=245 iops : min= 1, max= 28, avg=11.28, stdev= 5.28, samples=245 write: IOPS=12, BW=49.0KiB/s (50.2kB/s)(6236KiB/127247msec); 0 zone resets clat (usec): min=676, max=1293.0k, avg=42721.02, stdev=54193.46 lat (usec): min=676, max=1294.0k, avg=42725.67, stdev=54192.79 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1172], 10.00th=[ 1319], | 20.00th=[ 3884], 30.00th=[ 8979], 40.00th=[ 20055], | 50.00th=[ 30802], 60.00th=[ 42206], 70.00th=[ 54264], | 80.00th=[ 72877], 90.00th=[ 102237], 95.00th=[ 124257], | 99.00th=[ 189793], 99.50th=[ 231736], 99.90th=[ 400557], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 7, max= 111, per=24.83%, avg=48.91, stdev=20.81, samples=247 iops : min= 1, max= 27, avg=11.57, stdev= 5.24, samples=247 lat (usec) : 100=0.07%, 250=5.96%, 500=0.62%, 750=0.16%, 1000=0.49% lat (msec) : 2=7.13%, 4=3.26%, 10=5.83%, 20=9.93%, 50=35.48% lat (msec) : 100=23.27%, 250=7.58%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=4.98%, ctx=6124, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=189KiB/s (193kB/s), 47.3KiB/s-47.6KiB/s (48.4kB/s-48.7kB/s), io=23.4MiB (24.6MB), run=125669-127247msec WRITE: bw=198KiB/s (202kB/s), 49.0KiB/s-50.5KiB/s (50.2kB/s-51.7kB/s), io=24.6MiB (25.7MB), run=125669-127247msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147800: Mon Mar 2 11:53:14 2026 read: IOPS=5, BW=22.7KiB/s (23.2kB/s)(5992KiB/263960msec) clat (msec): min=4, max=1156, avg=33.54, stdev=47.36 lat (msec): min=4, max=1156, avg=33.55, stdev=47.36 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 73], 95.00th=[ 102], | 99.00th=[ 182], 99.50th=[ 236], 99.90th=[ 584], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 103, per=28.77%, avg=25.89, stdev=17.51, samples=448 iops : min= 1, max= 25, avg= 5.85, stdev= 4.41, samples=448 write: IOPS=5, BW=23.9KiB/s (24.4kB/s)(6296KiB/263960msec); 0 zone resets clat (msec): min=37, max=612, avg=135.43, stdev=69.76 lat (msec): min=37, max=612, avg=135.44, stdev=69.76 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 116], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 180], 90.00th=[ 228], 95.00th=[ 275], | 99.00th=[ 380], 99.50th=[ 414], 99.90th=[ 510], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 55, per=24.84%, avg=23.60, stdev=10.95, samples=514 iops : min= 1, max= 13, avg= 5.28, stdev= 2.81, samples=514 lat (msec) : 10=4.75%, 20=19.01%, 50=18.03%, 100=22.56%, 250=31.77% lat (msec) : 500=3.74%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5128, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147802: Mon Mar 2 11:53:14 2026 read: IOPS=5, BW=22.5KiB/s (22.0kB/s)(5940KiB/264577msec) clat (msec): min=4, max=1261, avg=33.87, stdev=48.57 lat (msec): min=4, max=1261, avg=33.87, stdev=48.57 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 78], 95.00th=[ 107], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 405], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 102, per=29.15%, avg=26.23, stdev=17.90, samples=438 iops : min= 1, max= 25, avg= 5.95, stdev= 4.52, samples=438 write: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6348KiB/264577msec); 0 zone resets clat (msec): min=38, max=619, avg=134.70, stdev=68.50 lat (msec): min=38, max=619, avg=134.70, stdev=68.50 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 182], 90.00th=[ 230], 95.00th=[ 275], | 99.00th=[ 363], 99.50th=[ 393], 99.90th=[ 472], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 56, per=25.03%, avg=23.78, stdev=11.44, samples=513 iops : min= 1, max= 14, avg= 5.32, stdev= 2.93, samples=513 lat (msec) : 10=5.44%, 20=18.65%, 50=16.47%, 100=23.99%, 250=31.15% lat (msec) : 500=4.23%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.14%, ctx=5236, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147803: Mon Mar 2 11:53:14 2026 read: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6028KiB/262745msec) clat (msec): min=5, max=584, avg=34.68, stdev=37.82 lat (msec): min=5, max=584, avg=34.68, stdev=37.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 174], 99.50th=[ 201], 99.90th=[ 405], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 103, per=27.99%, avg=25.19, stdev=17.21, samples=463 iops : min= 1, max= 25, avg= 5.68, stdev= 4.34, samples=463 write: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6260KiB/262745msec); 0 zone resets clat (msec): min=31, max=1339, avg=134.16, stdev=73.18 lat (msec): min=31, max=1339, avg=134.17, stdev=73.18 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 226], 95.00th=[ 275], | 99.00th=[ 359], 99.50th=[ 422], 99.90th=[ 502], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 63, per=25.08%, avg=23.83, stdev=11.25, samples=507 iops : min= 1, max= 15, avg= 5.34, stdev= 2.89, samples=507 lat (msec) : 10=4.10%, 20=18.78%, 50=17.77%, 100=23.57%, 250=32.29% lat (msec) : 500=3.39%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5181, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147805: Mon Mar 2 11:53:14 2026 read: IOPS=5, BW=23.0KiB/s (23.6kB/s)(6052KiB/262916msec) clat (msec): min=5, max=345, avg=33.73, stdev=36.02 lat (msec): min=5, max=345, avg=33.74, stdev=36.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 46], 90.00th=[ 80], 95.00th=[ 109], | 99.00th=[ 174], 99.50th=[ 207], 99.90th=[ 309], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 87, per=28.90%, avg=26.01, stdev=18.04, samples=450 iops : min= 1, max= 21, avg= 5.89, stdev= 4.58, samples=450 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6236KiB/262916msec); 0 zone resets clat (msec): min=29, max=1346, avg=135.56, stdev=75.80 lat (msec): min=29, max=1346, avg=135.57, stdev=75.80 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 132], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 359], 99.50th=[ 397], 99.90th=[ 609], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 56, per=24.94%, avg=23.69, stdev=11.48, samples=507 iops : min= 1, max= 14, avg= 5.30, stdev= 2.94, samples=507 lat (msec) : 10=4.69%, 20=19.47%, 50=17.25%, 100=23.80%, 250=30.70% lat (msec) : 500=4.04%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.13%, ctx=5441, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=90.8KiB/s (92.9kB/s), 22.5KiB/s-23.0KiB/s (22.0kB/s-23.6kB/s), io=23.4MiB (24.6MB), run=262745-264577msec WRITE: bw=95.0KiB/s (97.3kB/s), 23.7KiB/s-23.0KiB/s (24.3kB/s-24.6kB/s), io=24.6MiB (25.7MB), run=262745-264577msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147863: Mon Mar 2 11:53:54 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5920KiB/27988msec) clat (usec): min=112, max=182906, avg=38023.17, stdev=31315.73 lat (usec): min=113, max=182907, avg=38025.33, stdev=31315.62 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 151], 10.00th=[ 167], 20.00th=[ 578], | 30.00th=[ 21103], 40.00th=[ 28443], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 79168], 95.00th=[ 90702], | 99.00th=[143655], 99.50th=[170918], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 476, per=24.93%, avg=207.91, stdev=86.60, samples=54 iops : min= 3, max= 29, avg=12.28, stdev= 5.43, samples=54 write: IOPS=14, BW=228KiB/s (233kB/s)(6368KiB/27988msec); 0 zone resets clat (usec): min=950, max=255124, avg=34765.23, stdev=37525.82 lat (usec): min=950, max=255126, avg=34773.13, stdev=37523.26 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1663], 10.00th=[ 1926], 20.00th=[ 4686], | 30.00th=[ 9765], 40.00th=[ 15008], 50.00th=[ 21890], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 58983], 90.00th=[ 83362], 95.00th=[108528], | 99.00th=[160433], 99.50th=[248513], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 476, per=25.77%, avg=226.30, stdev=100.97, samples=54 iops : min= 1, max= 29, avg=13.44, stdev= 6.35, samples=54 lat (usec) : 250=8.72%, 500=0.78%, 750=0.26%, 1000=0.13% lat (msec) : 2=6.12%, 4=3.39%, 10=7.03%, 20=12.24%, 50=34.11% lat (msec) : 100=22.27%, 250=4.82%, 500=0.13% cpu : usr=0.07%, sys=5.95%, ctx=1409, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147864: Mon Mar 2 11:53:54 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5744KiB/28691msec) clat (usec): min=99, max=237385, avg=40604.58, stdev=34542.81 lat (usec): min=100, max=237387, avg=40605.87, stdev=34542.75 clat percentiles (usec): | 1.00th=[ 125], 5.00th=[ 163], 10.00th=[ 186], 20.00th=[ 14353], | 30.00th=[ 22152], 40.00th=[ 31327], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 58983], 90.00th=[ 79168], 95.00th=[105382], | 99.00th=[168821], 99.50th=[210764], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 46, max= 384, per=23.86%, avg=199.02, stdev=82.40, samples=56 iops : min= 2, max= 24, avg=11.70, stdev= 5.27, samples=56 write: IOPS=14, BW=228KiB/s (234kB/s)(6544KiB/28691msec); 0 zone resets clat (usec): min=845, max=234999, avg=34344.89, stdev=36510.26 lat (usec): min=845, max=235001, avg=34352.46, stdev=36507.26 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1713], 10.00th=[ 2040], 20.00th=[ 4817], | 30.00th=[ 7832], 40.00th=[ 13042], 50.00th=[ 23200], 60.00th=[ 31327], | 70.00th=[ 44303], 80.00th=[ 62129], 90.00th=[ 88605], 95.00th=[100140], | 99.00th=[152044], 99.50th=[198181], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 31, max= 542, per=25.67%, avg=225.39, stdev=98.36, samples=56 iops : min= 1, max= 33, avg=13.38, stdev= 6.18, samples=56 lat (usec) : 100=0.13%, 250=6.51%, 500=0.65%, 1000=0.52% lat (msec) : 2=4.69%, 4=4.43%, 10=10.81%, 20=10.03%, 50=34.24% lat (msec) : 100=22.66%, 250=5.34% cpu : usr=0.10%, sys=5.97%, ctx=1469, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147865: Mon Mar 2 11:53:54 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(6256KiB/27826msec) clat (usec): min=87, max=346745, avg=40739.61, stdev=35789.30 lat (usec): min=88, max=346746, avg=40740.82, stdev=35789.32 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 159], 10.00th=[ 178], 20.00th=[ 13566], | 30.00th=[ 23200], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 50070], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[185598], 99.50th=[204473], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 94, max= 448, per=27.20%, avg=226.81, stdev=79.68, samples=54 iops : min= 5, max= 28, avg=13.46, stdev= 5.06, samples=54 write: IOPS=13, BW=217KiB/s (222kB/s)(6032KiB/27826msec); 0 zone resets clat (usec): min=1337, max=278086, avg=31427.36, stdev=37860.09 lat (usec): min=1338, max=278089, avg=31429.53, stdev=37860.04 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1663], 10.00th=[ 1827], 20.00th=[ 4146], | 30.00th=[ 6980], 40.00th=[ 11600], 50.00th=[ 18744], 60.00th=[ 24511], | 70.00th=[ 36439], 80.00th=[ 51119], 90.00th=[ 78119], 95.00th=[109577], | 99.00th=[168821], 99.50th=[221250], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 92, max= 439, per=24.41%, avg=214.30, stdev=80.19, samples=54 iops : min= 5, max= 27, avg=12.67, stdev= 5.05, samples=54 lat (usec) : 100=0.26%, 250=8.20%, 500=0.39%, 750=0.26%, 1000=0.26% lat (msec) : 2=5.34%, 4=4.69%, 10=8.59%, 20=10.42%, 50=35.81% lat (msec) : 100=20.57%, 250=4.95%, 500=0.26% cpu : usr=0.08%, sys=6.05%, ctx=1437, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147866: Mon Mar 2 11:53:54 2026 read: IOPS=13, BW=219KiB/s (225kB/s)(6032KiB/27496msec) clat (usec): min=116, max=290726, avg=40140.02, stdev=32748.01 lat (usec): min=117, max=290727, avg=40141.88, stdev=32747.64 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 161], 10.00th=[ 182], 20.00th=[ 15664], | 30.00th=[ 23987], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 50594], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[170918], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 93, max= 377, per=26.32%, avg=219.48, stdev=71.01, samples=54 iops : min= 5, max= 23, avg=13.00, stdev= 4.41, samples=54 write: IOPS=14, BW=228KiB/s (233kB/s)(6256KiB/27496msec); 0 zone resets clat (usec): min=1322, max=196150, avg=31480.84, stdev=33328.71 lat (usec): min=1323, max=196152, avg=31501.87, stdev=33335.02 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1631], 10.00th=[ 1844], 20.00th=[ 4883], | 30.00th=[ 8586], 40.00th=[ 12256], 50.00th=[ 19268], 60.00th=[ 28967], | 70.00th=[ 40633], 80.00th=[ 53740], 90.00th=[ 76022], 95.00th=[101188], | 99.00th=[149947], 99.50th=[173016], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 446, per=25.93%, avg=227.65, stdev=87.89, samples=54 iops : min= 1, max= 27, avg=13.54, stdev= 5.50, samples=54 lat (usec) : 250=6.51%, 500=0.91%, 750=0.13%, 1000=0.13% lat (msec) : 2=6.12%, 4=2.73%, 10=9.77%, 20=11.85%, 50=35.03% lat (msec) : 100=22.01%, 250=4.69%, 500=0.13% cpu : usr=0.11%, sys=6.52%, ctx=1443, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=835KiB/s (855kB/s), 200KiB/s-225KiB/s (205kB/s-230kB/s), io=23.4MiB (24.5MB), run=27496-28691msec WRITE: bw=878KiB/s (899kB/s), 217KiB/s-228KiB/s (222kB/s-234kB/s), io=24.6MiB (25.8MB), run=27496-28691msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147858: Mon Mar 2 11:54:31 2026 read: IOPS=5, BW=90.6KiB/s (92.8kB/s)(5920KiB/65312msec) clat (msec): min=6, max=387, avg=34.08, stdev=41.20 lat (msec): min=6, max=387, avg=34.08, stdev=41.20 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 73], 95.00th=[ 106], | 99.00th=[ 224], 99.50th=[ 313], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 31, max= 345, per=28.10%, avg=102.02, stdev=61.24, samples=112 iops : min= 1, max= 21, avg= 5.63, stdev= 3.88, samples=112 write: IOPS=6, BW=97.5KiB/s (99.8kB/s)(6368KiB/65312msec); 0 zone resets clat (msec): min=42, max=646, avg=131.83, stdev=67.55 lat (msec): min=42, max=646, avg=131.84, stdev=67.55 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 71], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 103], 50.00th=[ 116], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 220], 95.00th=[ 275], | 99.00th=[ 351], 99.50th=[ 443], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 31, max= 192, per=25.72%, avg=98.25, stdev=43.00, samples=126 iops : min= 1, max= 12, avg= 5.37, stdev= 2.80, samples=126 lat (msec) : 10=3.52%, 20=20.18%, 50=16.67%, 100=25.13%, 250=30.60% lat (msec) : 500=3.78%, 750=0.13% cpu : usr=0.06%, sys=1.22%, ctx=1326, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147859: Mon Mar 2 11:54:31 2026 read: IOPS=5, BW=87.2KiB/s (89.3kB/s)(5744KiB/65877msec) clat (msec): min=6, max=400, avg=35.26, stdev=44.63 lat (msec): min=6, max=400, avg=35.26, stdev=44.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 43], 90.00th=[ 83], 95.00th=[ 126], | 99.00th=[ 226], 99.50th=[ 305], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 21, max= 320, per=27.42%, avg=99.52, stdev=67.52, samples=114 iops : min= 1, max= 20, avg= 5.46, stdev= 4.32, samples=114 write: IOPS=6, BW=99.3KiB/s (102kB/s)(6544KiB/65877msec); 0 zone resets clat (msec): min=35, max=431, avg=129.59, stdev=67.24 lat (msec): min=35, max=431, avg=129.59, stdev=67.24 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 53], 10.00th=[ 65], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 102], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 176], 90.00th=[ 224], 95.00th=[ 268], | 99.00th=[ 376], 99.50th=[ 409], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 287, per=26.28%, avg=100.39, stdev=48.73, samples=128 iops : min= 1, max= 17, avg= 5.52, stdev= 3.16, samples=128 lat (msec) : 10=4.95%, 20=18.36%, 50=17.06%, 100=23.96%, 250=31.77% lat (msec) : 500=3.91% cpu : usr=0.05%, sys=1.24%, ctx=1367, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147860: Mon Mar 2 11:54:31 2026 read: IOPS=6, BW=97.6KiB/s (99.9kB/s)(6256KiB/64113msec) clat (msec): min=5, max=317, avg=33.19, stdev=38.19 lat (msec): min=5, max=317, avg=33.19, stdev=38.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 67], 95.00th=[ 112], | 99.00th=[ 215], 99.50th=[ 232], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 288, per=30.16%, avg=109.50, stdev=70.31, samples=113 iops : min= 1, max= 18, avg= 6.08, stdev= 4.49, samples=113 write: IOPS=5, BW=94.1KiB/s (96.3kB/s)(6032KiB/64113msec); 0 zone resets clat (msec): min=43, max=551, avg=134.87, stdev=67.00 lat (msec): min=43, max=551, avg=134.87, stdev=67.00 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 222], 95.00th=[ 264], | 99.00th=[ 384], 99.50th=[ 489], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 191, per=25.04%, avg=95.65, stdev=40.57, samples=123 iops : min= 1, max= 11, avg= 5.21, stdev= 2.64, samples=123 lat (msec) : 10=4.17%, 20=20.18%, 50=19.40%, 100=20.18%, 250=32.94% lat (msec) : 500=2.99%, 750=0.13% cpu : usr=0.04%, sys=1.38%, ctx=1394, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147861: Mon Mar 2 11:54:31 2026 read: IOPS=5, BW=94.5KiB/s (96.7kB/s)(6032KiB/63846msec) clat (msec): min=6, max=315, avg=34.28, stdev=39.25 lat (msec): min=6, max=315, avg=34.28, stdev=39.25 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 74], 95.00th=[ 100], | 99.00th=[ 239], 99.50th=[ 257], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 352, per=30.17%, avg=109.53, stdev=70.79, samples=108 iops : min= 1, max= 22, avg= 6.10, stdev= 4.44, samples=108 write: IOPS=6, BW=97.0KiB/s (100kB/s)(6256KiB/63846msec); 0 zone resets clat (msec): min=41, max=426, avg=130.02, stdev=62.47 lat (msec): min=41, max=426, avg=130.03, stdev=62.47 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 79], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 218], 95.00th=[ 266], | 99.00th=[ 338], 99.50th=[ 401], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 31, max= 192, per=25.60%, avg=97.79, stdev=45.08, samples=126 iops : min= 1, max= 12, avg= 5.34, stdev= 2.90, samples=126 lat (msec) : 10=2.73%, 20=20.18%, 50=18.49%, 100=24.87%, 250=30.08% lat (msec) : 500=3.65% cpu : usr=0.05%, sys=1.31%, ctx=1374, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=364KiB/s (372kB/s), 87.2KiB/s-97.6KiB/s (89.3kB/s-99.9kB/s), io=23.4MiB (24.5MB), run=63846-65877msec WRITE: bw=383KiB/s (392kB/s), 94.1KiB/s-99.3KiB/s (96.3kB/s-102kB/s), io=24.6MiB (25.8MB), run=63846-65877msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147896: Mon Mar 2 11:54:45 2026 read: IOPS=2, BW=2834KiB/s (2902kB/s)(7168KiB/2529msec) clat (usec): min=1242, max=278589, avg=144692.42, stdev=106210.06 lat (usec): min=1243, max=278591, avg=144916.57, stdev=106357.36 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1237], 10.00th=[ 1237], 20.00th=[ 1401], | 30.00th=[149947], 40.00th=[149947], 50.00th=[164627], 60.00th=[204473], | 70.00th=[204473], 80.00th=[212861], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1957, max= 4140, per=58.97%, avg=2706.67, stdev=1241.74, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=2025KiB/s (2073kB/s)(5120KiB/2529msec); 0 zone resets clat (msec): min=184, max=384, avg=279.82, stdev=82.53 lat (msec): min=184, max=401, avg=283.37, stdev=88.13 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1957, max= 4079, per=46.96%, avg=3018.00, stdev=1500.48, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 2=16.67%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=17.44%, ctx=178, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147897: Mon Mar 2 11:54:45 2026 read: IOPS=0, BW=459KiB/s (470kB/s)(2048KiB/4461msec) clat (usec): min=987, max=662557, avg=331772.35, stdev=467800.48 lat (usec): min=988, max=662560, avg=331774.69, stdev=467801.73 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 988], | 30.00th=[ 988], 40.00th=[ 988], 50.00th=[ 988], 60.00th=[658506], | 70.00th=[658506], 80.00th=[658506], 90.00th=[658506], 95.00th=[658506], | 99.00th=[658506], 99.50th=[658506], 99.90th=[658506], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 1957, max= 2043, per=43.57%, avg=2000.00, stdev=60.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2295KiB/s (2351kB/s)(10.0MiB/4461msec); 0 zone resets clat (msec): min=83, max=961, avg=345.67, stdev=279.89 lat (msec): min=84, max=962, avg=345.83, stdev=279.83 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 85], | 30.00th=[ 153], 40.00th=[ 218], 50.00th=[ 230], 60.00th=[ 243], | 70.00th=[ 397], 80.00th=[ 430], 90.00th=[ 659], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1957, max= 4047, per=36.68%, avg=2357.33, stdev=828.42, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 1000=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=14.30%, ctx=138, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147898: Mon Mar 2 11:54:45 2026 read: IOPS=1, BW=1811KiB/s (1854kB/s)(6144KiB/3393msec) clat (usec): min=938, max=258212, avg=82460.35, stdev=125654.69 lat (usec): min=939, max=258213, avg=82461.65, stdev=125654.84 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 938], 10.00th=[ 938], 20.00th=[ 963], | 30.00th=[ 963], 40.00th=[ 1287], 50.00th=[ 1287], 60.00th=[ 3032], | 70.00th=[229639], 80.00th=[229639], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 4087, max= 6131, per=100.00%, avg=5109.00, stdev=1445.33, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1811KiB/s (1854kB/s)(6144KiB/3393msec); 0 zone resets clat (msec): min=151, max=1421, avg=419.51, stdev=495.91 lat (msec): min=151, max=1421, avg=419.59, stdev=495.93 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 232], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 2043, max= 4087, per=52.66%, avg=3384.33, stdev=1162.07, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 1000=16.67% lat (msec) : 2=8.33%, 4=8.33%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=12.18%, ctx=168, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147899: Mon Mar 2 11:54:45 2026 read: IOPS=1, BW=1251KiB/s (1281kB/s)(5120KiB/4093msec) clat (msec): min=8, max=762, avg=230.59, stdev=307.97 lat (msec): min=8, max=762, avg=230.59, stdev=307.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 9], | 30.00th=[ 27], 40.00th=[ 27], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2015, max= 4096, per=59.22%, avg=2718.00, stdev=1193.47, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1751KiB/s (1793kB/s)(7168KiB/4093msec); 0 zone resets clat (msec): min=92, max=1044, avg=396.26, stdev=314.63 lat (msec): min=92, max=1044, avg=396.42, stdev=314.62 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 129], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 359], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 443], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1416, max= 2048, per=29.69%, avg=1908.20, stdev=275.45, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 10=8.33%, 50=8.33%, 100=8.33%, 250=25.00%, 500=33.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.49%, ctx=140, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4591KiB/s (4701kB/s), 459KiB/s-2834KiB/s (470kB/s-2902kB/s), io=20.0MiB (20.0MB), run=2529-4461msec WRITE: bw=6427KiB/s (6582kB/s), 1751KiB/s-2295KiB/s (1793kB/s-2351kB/s), io=28.0MiB (29.4MB), run=2529-4461msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147891: Mon Mar 2 11:54:45 2026 read: IOPS=1, BW=1873KiB/s (1918kB/s)(7168KiB/3826msec) clat (msec): min=107, max=587, avg=260.47, stdev=157.72 lat (msec): min=107, max=587, avg=260.47, stdev=157.72 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 142], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 218], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 279], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1381, max= 4087, per=63.57%, avg=2880.50, stdev=1386.01, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1338KiB/s (1370kB/s)(5120KiB/3826msec); 0 zone resets clat (msec): min=149, max=651, avg=352.10, stdev=204.56 lat (msec): min=150, max=651, avg=352.19, stdev=204.57 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2043, max= 4047, per=53.26%, avg=3379.00, stdev=1157.01, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=33.33%, 750=16.67% cpu : usr=0.05%, sys=4.03%, ctx=53, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147892: Mon Mar 2 11:54:45 2026 read: IOPS=0, BW=453KiB/s (464kB/s)(2048KiB/4519msec) clat (msec): min=108, max=185, avg=147.05, stdev=54.19 lat (msec): min=108, max=185, avg=147.05, stdev=54.19 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 2035, max= 2043, per=45.00%, avg=2039.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2266KiB/s (2320kB/s)(10.0MiB/4519msec); 0 zone resets clat (msec): min=138, max=851, avg=391.35, stdev=282.63 lat (msec): min=138, max=851, avg=391.46, stdev=282.66 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 176], | 30.00th=[ 218], 40.00th=[ 226], 50.00th=[ 239], 60.00th=[ 266], | 70.00th=[ 279], 80.00th=[ 684], 90.00th=[ 844], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 2043, max= 4087, per=56.15%, avg=3562.00, stdev=1012.88, samples=4 iops : min= 1, max= 3, avg= 2.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=4.71%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147893: Mon Mar 2 11:54:45 2026 read: IOPS=1, BW=1451KiB/s (1486kB/s)(6144KiB/4234msec) clat (msec): min=92, max=721, avg=286.53, stdev=240.32 lat (msec): min=92, max=721, avg=286.53, stdev=240.32 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 243], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2015, max= 2043, per=44.77%, avg=2028.60, stdev=12.20, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1451KiB/s (1486kB/s)(6144KiB/4234msec); 0 zone resets clat (msec): min=209, max=948, avg=408.15, stdev=273.55 lat (msec): min=209, max=948, avg=408.60, stdev=273.46 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 368], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2019, max= 2043, per=32.05%, avg=2033.40, stdev=11.52, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.26%, ctx=75, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147895: Mon Mar 2 11:54:45 2026 read: IOPS=1, BW=1390KiB/s (1424kB/s)(5120KiB/3683msec) clat (msec): min=110, max=288, avg=188.71, stdev=75.37 lat (msec): min=110, max=288, avg=188.71, stdev=75.37 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 2039, max= 6047, per=89.23%, avg=4043.00, stdev=2834.08, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1946KiB/s (1993kB/s)(7168KiB/3683msec); 0 zone resets clat (msec): min=204, max=545, avg=353.32, stdev=127.14 lat (msec): min=205, max=545, avg=353.42, stdev=127.17 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 209], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 342], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 485], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2019, max= 4055, per=37.41%, avg=2373.00, stdev=824.06, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=5.84%, ctx=101, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4532KiB/s (4641kB/s), 453KiB/s-1873KiB/s (464kB/s-1918kB/s), io=20.0MiB (20.0MB), run=3683-4519msec WRITE: bw=6345KiB/s (6497kB/s), 1338KiB/s-2266KiB/s (1370kB/s-2320kB/s), io=28.0MiB (29.4MB), run=3683-4519msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147909: Mon Mar 2 11:54:58 2026 read: IOPS=2, BW=10.3MiB/s (10.8MB/s)(12.0MiB/1162msec) clat (msec): min=231, max=393, avg=324.96, stdev=83.97 lat (msec): min=231, max=393, avg=324.97, stdev=83.97 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7543, max= 8159, per=100.00%, avg=7851.00, stdev=435.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=9.99%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147910: Mon Mar 2 11:54:58 2026 read: IOPS=0, BW=1227KiB/s (1257kB/s)(4096KiB/3337msec) clat (nsec): min=861364k, max=861364k, avg=861363991.00, stdev= 0.00 lat (nsec): min=861367k, max=861367k, avg=861366765.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2455KiB/s (2514kB/s)(8192KiB/3337msec); 0 zone resets clat (msec): min=977, max=1369, avg=1173.45, stdev=277.42 lat (msec): min=977, max=1369, avg=1173.77, stdev=277.40 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7922, max= 7922, per=80.68%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.75%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147911: Mon Mar 2 11:54:58 2026 write: IOPS=0, BW=3685KiB/s (3773kB/s)(12.0MiB/3335msec); 0 zone resets clat (msec): min=363, max=1535, avg=1008.62, stdev=595.26 lat (msec): min=363, max=1536, avg=1009.39, stdev=595.50 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7801, max= 8143, per=81.19%, avg=7972.00, stdev=241.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.80%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147912: Mon Mar 2 11:54:58 2026 write: IOPS=1, BW=4834KiB/s (4950kB/s)(12.0MiB/2542msec); 0 zone resets clat (msec): min=345, max=1457, avg=767.10, stdev=602.44 lat (msec): min=345, max=1457, avg=767.52, stdev=602.43 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=5.79%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4910KiB/s (5028kB/s), 1227KiB/s-10.3MiB/s (1257kB/s-10.8MB/s), io=16.0MiB (16.8MB), run=1162-3337msec WRITE: bw=9820KiB/s (10.1MB/s), 2455KiB/s-4834KiB/s (2514kB/s-4950kB/s), io=32.0MiB (33.6MB), run=2542-3337msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147913: Mon Mar 2 11:54:58 2026 read: IOPS=1, BW=5040KiB/s (5161kB/s)(12.0MiB/2438msec) clat (msec): min=766, max=817, avg=790.81, stdev=25.65 lat (msec): min=766, max=817, avg=790.81, stdev=25.65 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8110, max= 8159, per=100.00%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.08%, sys=14.98%, ctx=306, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147914: Mon Mar 2 11:54:58 2026 read: IOPS=0, BW=1611KiB/s (1649kB/s)(4096KiB/2543msec) clat (nsec): min=674959k, max=674959k, avg=674958926.00, stdev= 0.00 lat (nsec): min=674962k, max=674962k, avg=674961529.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3221KiB/s (3299kB/s)(8192KiB/2543msec); 0 zone resets clat (msec): min=770, max=954, avg=862.71, stdev=129.92 lat (msec): min=771, max=954, avg=863.09, stdev=129.92 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8159, max= 8159, per=83.56%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.33%, ctx=131, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147915: Mon Mar 2 11:54:58 2026 write: IOPS=0, BW=3662KiB/s (3749kB/s)(12.0MiB/3356msec); 0 zone resets clat (msec): min=343, max=1847, avg=1044.74, stdev=757.37 lat (msec): min=343, max=1851, avg=1046.17, stdev=759.07 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8175, max= 8175, per=83.73%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.70%, ctx=50, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147916: Mon Mar 2 11:54:58 2026 write: IOPS=1, BW=4741KiB/s (4855kB/s)(12.0MiB/2592msec); 0 zone resets clat (msec): min=628, max=1167, avg=834.17, stdev=291.47 lat (msec): min=628, max=1168, avg=834.60, stdev=291.51 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8047, max= 8159, per=82.99%, avg=8103.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.75%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6443KiB/s (6597kB/s), 1611KiB/s-5040KiB/s (1649kB/s-5161kB/s), io=16.0MiB (16.8MB), run=2438-2543msec WRITE: bw=9764KiB/s (9998kB/s), 3221KiB/s-4741KiB/s (3299kB/s-4855kB/s), io=32.0MiB (33.6MB), run=2543-3356msec