== sanity test 398b: DIO and buffer IO race ============== 22:10:45 (1782612645) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.53057 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144391: Sat Jun 27 22:13:31 2026 read: IOPS=10, BW=42.0KiB/s (43.0kB/s)(5992KiB/142542msec) clat (usec): min=33, max=1342.6k, avg=48339.31, stdev=50382.60 lat (usec): min=33, max=1342.6k, avg=48342.19, stdev=50383.58 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 11207], | 20.00th=[ 21627], 30.00th=[ 28181], 40.00th=[ 33817], | 50.00th=[ 40109], 60.00th=[ 48497], 70.00th=[ 57410], | 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[ 107480], | 99.00th=[ 193987], 99.50th=[ 231736], 99.90th=[ 434111], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 119, per=25.41%, avg=41.92, stdev=18.32, samples=278 iops : min= 1, max= 29, avg= 9.81, stdev= 4.60, samples=278 write: IOPS=11, BW=44.2KiB/s (45.2kB/s)(6296KiB/142542msec); 0 zone resets clat (usec): min=1023, max=397518, avg=44179.99, stdev=44131.65 lat (usec): min=1026, max=397520, avg=44183.09, stdev=44131.35 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1467], 10.00th=[ 2278], 20.00th=[ 5932], | 30.00th=[ 11076], 40.00th=[ 22414], 50.00th=[ 33817], 60.00th=[ 44303], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[121111], | 99.00th=[181404], 99.50th=[242222], 99.90th=[367002], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 6, max= 119, per=25.57%, avg=44.23, stdev=19.18, samples=277 iops : min= 1, max= 29, avg=10.40, stdev= 4.82, samples=277 lat (usec) : 50=0.42%, 100=3.45%, 250=0.36%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.65%, 4=3.12%, 10=7.06%, 20=8.72%, 50=35.38% lat (msec) : 100=28.16%, 250=8.07%, 500=0.36%, 2000=0.03% cpu : usr=0.09%, sys=5.13%, ctx=6919, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144392: Sat Jun 27 22:13:31 2026 read: IOPS=10, BW=41.0KiB/s (42.0kB/s)(5940KiB/144743msec) clat (usec): min=32, max=513401, avg=48091.28, stdev=39823.29 lat (usec): min=33, max=513403, avg=48100.75, stdev=39820.91 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 70], 10.00th=[ 14615], 20.00th=[ 22938], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[106431], | 99.00th=[185598], 99.50th=[219153], 99.90th=[505414], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 7, max= 95, per=24.67%, avg=40.71, stdev=18.77, samples=283 iops : min= 1, max= 23, avg= 9.51, stdev= 4.71, samples=283 write: IOPS=10, BW=43.9KiB/s (44.9kB/s)(6348KiB/144743msec); 0 zone resets clat (usec): min=702, max=1345.4k, avg=45828.31, stdev=55583.00 lat (usec): min=702, max=1345.4k, avg=45830.53, stdev=55582.96 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1500], 10.00th=[ 2376], | 20.00th=[ 5276], 30.00th=[ 10814], 40.00th=[ 21627], | 50.00th=[ 34866], 60.00th=[ 45351], 70.00th=[ 58983], | 80.00th=[ 76022], 90.00th=[ 106431], 95.00th=[ 135267], | 99.00th=[ 189793], 99.50th=[ 225444], 99.90th=[ 320865], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 118, per=25.16%, avg=43.52, stdev=19.15, samples=282 iops : min= 1, max= 29, avg=10.22, stdev= 4.85, samples=282 lat (usec) : 50=0.46%, 100=2.96%, 250=0.13%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.33%, 4=3.52%, 10=7.45%, 20=8.33%, 50=35.55% lat (msec) : 100=27.99%, 250=8.59%, 500=0.26%, 750=0.10%, 2000=0.03% cpu : usr=0.08%, sys=5.12%, ctx=6808, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144393: Sat Jun 27 22:13:31 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6028KiB/141647msec) clat (usec): min=38, max=556882, avg=46463.39, stdev=36624.85 lat (usec): min=38, max=556884, avg=46467.65, stdev=36626.83 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 13829], 20.00th=[ 22938], | 30.00th=[ 28443], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[164627], 99.50th=[221250], 99.90th=[375391], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 102, per=25.83%, avg=42.61, stdev=19.33, samples=275 iops : min= 1, max= 25, avg= 9.99, stdev= 4.86, samples=275 write: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6260KiB/141647msec); 0 zone resets clat (usec): min=1099, max=1231.5k, avg=45383.10, stdev=55682.36 lat (usec): min=1100, max=1231.5k, avg=45387.64, stdev=55681.43 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1483], 10.00th=[ 2278], | 20.00th=[ 5538], 30.00th=[ 11207], 40.00th=[ 22152], | 50.00th=[ 32900], 60.00th=[ 43254], 70.00th=[ 57934], | 80.00th=[ 76022], 90.00th=[ 102237], 95.00th=[ 129500], | 99.00th=[ 200279], 99.50th=[ 261096], 99.90th=[ 484443], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 95, per=25.49%, avg=44.09, stdev=17.90, samples=276 iops : min= 1, max= 23, avg=10.36, stdev= 4.51, samples=276 lat (usec) : 50=0.36%, 100=3.06%, 250=0.36%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.43%, 4=3.81%, 10=6.48%, 20=8.33%, 50=37.89% lat (msec) : 100=26.79%, 250=7.94%, 500=0.36%, 750=0.03%, 2000=0.03% cpu : usr=0.10%, sys=5.19%, ctx=6696, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144394: Sat Jun 27 22:13:31 2026 read: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6052KiB/144948msec) clat (usec): min=25, max=598904, avg=47301.46, stdev=38601.48 lat (usec): min=25, max=598906, avg=47305.12, stdev=38600.35 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 12256], 20.00th=[ 22676], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[175113], 99.50th=[198181], 99.90th=[517997], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 135, per=25.32%, avg=41.77, stdev=19.62, samples=282 iops : min= 1, max= 33, avg= 9.78, stdev= 4.95, samples=282 write: IOPS=10, BW=43.0KiB/s (44.1kB/s)(6236KiB/144948msec); 0 zone resets clat (usec): min=904, max=1248.7k, avg=46685.44, stdev=56621.11 lat (usec): min=905, max=1248.7k, avg=46692.38, stdev=56617.58 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1483], 10.00th=[ 2180], | 20.00th=[ 5145], 30.00th=[ 11469], 40.00th=[ 23462], | 50.00th=[ 35390], 60.00th=[ 46400], 70.00th=[ 59507], | 80.00th=[ 79168], 90.00th=[ 104334], 95.00th=[ 128451], | 99.00th=[ 193987], 99.50th=[ 233833], 99.90th=[ 666895], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 103, per=24.99%, avg=43.23, stdev=18.88, samples=281 iops : min= 1, max= 25, avg=10.14, stdev= 4.74, samples=281 lat (usec) : 50=0.59%, 100=3.29%, 250=0.26%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.69%, 4=3.42%, 10=6.38%, 20=7.94%, 50=35.77% lat (msec) : 100=28.61%, 250=8.40%, 500=0.20%, 750=0.10%, 2000=0.03% cpu : usr=0.08%, sys=5.11%, ctx=6764, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 41.0KiB/s-42.6KiB/s (42.0kB/s-43.6kB/s), io=23.4MiB (24.6MB), run=141647-144948msec WRITE: bw=173KiB/s (178kB/s), 43.0KiB/s-44.2KiB/s (44.1kB/s-45.3kB/s), io=24.6MiB (25.7MB), run=141647-144948msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144396: Sat Jun 27 22:15:59 2026 read: IOPS=5, BW=20.7KiB/s (21.2kB/s)(5992KiB/290063msec) clat (msec): min=5, max=1390, avg=41.23, stdev=51.69 lat (msec): min=5, max=1390, avg=41.23, stdev=51.69 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 207], 99.50th=[ 243], 99.90th=[ 468], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 79, per=28.42%, avg=23.30, stdev=15.91, samples=496 iops : min= 1, max= 19, avg= 5.22, stdev= 4.03, samples=496 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6296KiB/290063msec); 0 zone resets clat (msec): min=33, max=684, avg=144.94, stdev=77.31 lat (msec): min=33, max=684, avg=144.94, stdev=77.32 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 84], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 126], 60.00th=[ 144], | 70.00th=[ 169], 80.00th=[ 199], 90.00th=[ 247], 95.00th=[ 292], | 99.00th=[ 401], 99.50th=[ 498], 99.90th=[ 592], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 64, per=25.26%, avg=21.47, stdev=10.78, samples=564 iops : min= 1, max= 16, avg= 4.75, stdev= 2.77, samples=564 lat (msec) : 10=2.64%, 20=11.98%, 50=23.54%, 100=23.83%, 250=32.98% lat (msec) : 500=4.79%, 750=0.23%, 2000=0.03% cpu : usr=0.04%, sys=1.43%, ctx=5610, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144397: Sat Jun 27 22:15:59 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(5940KiB/292695msec) clat (msec): min=5, max=1316, avg=41.26, stdev=53.13 lat (msec): min=5, max=1316, avg=41.26, stdev=53.13 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 211], 99.50th=[ 247], 99.90th=[ 768], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 96, per=28.88%, avg=23.68, stdev=15.60, samples=484 iops : min= 1, max= 24, avg= 5.30, stdev= 3.97, samples=484 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6348KiB/292695msec); 0 zone resets clat (msec): min=33, max=691, avg=145.68, stdev=77.42 lat (msec): min=33, max=691, avg=145.69, stdev=77.42 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 84], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 127], 60.00th=[ 144], | 70.00th=[ 167], 80.00th=[ 199], 90.00th=[ 249], 95.00th=[ 300], | 99.00th=[ 397], 99.50th=[ 464], 99.90th=[ 592], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 64, per=25.41%, avg=21.60, stdev=10.86, samples=565 iops : min= 1, max= 16, avg= 4.78, stdev= 2.78, samples=565 lat (msec) : 10=2.64%, 20=11.95%, 50=24.02%, 100=23.01%, 250=33.04% lat (msec) : 500=5.11%, 750=0.16%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.32%, ctx=5525, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144398: Sat Jun 27 22:15:59 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(6028KiB/289953msec) clat (msec): min=6, max=506, avg=42.32, stdev=41.03 lat (msec): min=6, max=506, avg=42.32, stdev=41.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 86], 95.00th=[ 116], | 99.00th=[ 207], 99.50th=[ 241], 99.90th=[ 460], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 95, per=28.32%, avg=23.22, stdev=16.09, samples=500 iops : min= 1, max= 23, avg= 5.19, stdev= 4.04, samples=500 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6260KiB/289953msec); 0 zone resets clat (msec): min=35, max=1468, avg=144.40, stdev=82.39 lat (msec): min=35, max=1468, avg=144.41, stdev=82.39 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 125], 60.00th=[ 142], | 70.00th=[ 167], 80.00th=[ 201], 90.00th=[ 245], 95.00th=[ 288], | 99.00th=[ 414], 99.50th=[ 468], 99.90th=[ 684], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7, max= 56, per=25.33%, avg=21.53, stdev=10.90, samples=558 iops : min= 1, max= 14, avg= 4.76, stdev= 2.80, samples=558 lat (msec) : 10=2.05%, 20=11.91%, 50=23.73%, 100=25.49%, 250=32.13% lat (msec) : 500=4.56%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.32%, ctx=5508, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144399: Sat Jun 27 22:15:59 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6052KiB/289142msec) clat (msec): min=5, max=763, avg=40.18, stdev=42.31 lat (msec): min=5, max=763, avg=40.18, stdev=42.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 110], | 99.00th=[ 186], 99.50th=[ 224], 99.90th=[ 506], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 95, per=29.20%, avg=23.94, stdev=16.99, samples=488 iops : min= 1, max= 23, avg= 5.38, stdev= 4.31, samples=488 write: IOPS=5, BW=21.6KiB/s (22.1kB/s)(6236KiB/289142msec); 0 zone resets clat (msec): min=39, max=1562, avg=146.37, stdev=82.97 lat (msec): min=39, max=1562, avg=146.38, stdev=82.97 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 112], 50.00th=[ 127], 60.00th=[ 146], | 70.00th=[ 171], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 288], | 99.00th=[ 393], 99.50th=[ 464], 99.90th=[ 709], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 56, per=25.17%, avg=21.40, stdev=10.51, samples=560 iops : min= 1, max= 14, avg= 4.73, stdev= 2.69, samples=560 lat (msec) : 10=2.18%, 20=11.95%, 50=24.97%, 100=23.70%, 250=32.42% lat (msec) : 500=4.59%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.40%, ctx=5486, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=82.0KiB/s (84.0kB/s), 20.3KiB/s-20.9KiB/s (20.8kB/s-21.4kB/s), io=23.4MiB (24.6MB), run=289142-292695msec WRITE: bw=85.9KiB/s (87.0kB/s), 21.6KiB/s-21.7KiB/s (22.1kB/s-22.2kB/s), io=24.6MiB (25.7MB), run=289142-292695msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144462: Sat Jun 27 22:16:41 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(5920KiB/30672msec) clat (usec): min=35, max=250713, avg=44040.07, stdev=39856.52 lat (usec): min=35, max=250714, avg=44046.48, stdev=39861.59 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 80], | 30.00th=[ 22152], 40.00th=[ 30802], 50.00th=[ 38011], 60.00th=[ 46400], | 70.00th=[ 57934], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[108528], | 99.00th=[202376], 99.50th=[248513], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 30, max= 568, per=25.03%, avg=193.20, stdev=101.43, samples=60 iops : min= 1, max= 35, avg=11.32, stdev= 6.41, samples=60 write: IOPS=12, BW=208KiB/s (213kB/s)(6368KiB/30672msec); 0 zone resets clat (usec): min=1480, max=225371, avg=35500.42, stdev=39395.16 lat (usec): min=1481, max=225373, avg=35508.76, stdev=39397.77 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1844], 10.00th=[ 2606], 20.00th=[ 5997], | 30.00th=[ 9503], 40.00th=[ 14746], 50.00th=[ 19268], 60.00th=[ 30278], | 70.00th=[ 41681], 80.00th=[ 60031], 90.00th=[ 91751], 95.00th=[117965], | 99.00th=[170918], 99.50th=[223347], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 508, per=25.66%, avg=208.38, stdev=114.05, samples=60 iops : min= 1, max= 31, avg=12.27, stdev= 7.21, samples=60 lat (usec) : 50=1.43%, 100=8.85%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=4.04%, 4=4.04%, 10=8.72%, 20=11.59%, 50=29.17% lat (msec) : 100=23.31%, 250=7.68%, 500=0.13% cpu : usr=0.08%, sys=5.53%, ctx=1390, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144463: Sat Jun 27 22:16:41 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(5744KiB/31010msec) clat (usec): min=34, max=266006, avg=44846.87, stdev=35959.01 lat (usec): min=34, max=266007, avg=44848.10, stdev=35958.99 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 16319], | 30.00th=[ 24773], 40.00th=[ 33162], 50.00th=[ 42206], 60.00th=[ 47449], | 70.00th=[ 55313], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[107480], | 99.00th=[152044], 99.50th=[191890], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 510, per=23.81%, avg=183.84, stdev=99.14, samples=61 iops : min= 1, max= 31, avg=10.72, stdev= 6.24, samples=61 write: IOPS=13, BW=211KiB/s (216kB/s)(6544KiB/31010msec); 0 zone resets clat (usec): min=1602, max=310326, avg=36007.78, stdev=43337.63 lat (usec): min=1604, max=310328, avg=36027.49, stdev=43340.50 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1893], 10.00th=[ 2802], 20.00th=[ 6063], | 30.00th=[ 9372], 40.00th=[ 12780], 50.00th=[ 20317], 60.00th=[ 29492], | 70.00th=[ 41681], 80.00th=[ 61604], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[198181], 99.50th=[250610], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 466, per=25.90%, avg=210.31, stdev=94.56, samples=61 iops : min= 1, max= 29, avg=12.39, stdev= 5.98, samples=61 lat (usec) : 50=1.17%, 100=6.12%, 250=0.78%, 500=0.52%, 1000=0.13% lat (msec) : 2=3.39%, 4=4.04%, 10=9.38%, 20=10.68%, 50=33.85% lat (msec) : 100=22.79%, 250=6.64%, 500=0.52% cpu : usr=0.09%, sys=6.24%, ctx=1393, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144464: Sat Jun 27 22:16:41 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30949msec) clat (usec): min=25, max=425580, avg=41804.13, stdev=41100.50 lat (usec): min=25, max=425580, avg=41863.76, stdev=41058.82 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 90], | 30.00th=[ 21103], 40.00th=[ 29492], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[179307], 99.50th=[221250], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 31, max= 477, per=26.17%, avg=202.05, stdev=98.12, samples=61 iops : min= 1, max= 29, avg=11.87, stdev= 6.20, samples=61 write: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30949msec); 0 zone resets clat (usec): min=1474, max=269050, avg=38502.38, stdev=40578.00 lat (usec): min=1477, max=269053, avg=38506.97, stdev=40580.08 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1795], 10.00th=[ 2704], 20.00th=[ 5407], | 30.00th=[ 9241], 40.00th=[ 15926], 50.00th=[ 25560], 60.00th=[ 36439], | 70.00th=[ 47449], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[122160], | 99.00th=[175113], 99.50th=[191890], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 444, per=23.91%, avg=194.13, stdev=93.41, samples=61 iops : min= 3, max= 27, avg=11.38, stdev= 5.89, samples=61 lat (usec) : 50=1.43%, 100=9.24%, 250=0.91%, 500=0.39% lat (msec) : 2=4.04%, 4=3.39%, 10=9.24%, 20=7.81%, 50=31.64% lat (msec) : 100=24.87%, 250=6.77%, 500=0.26% cpu : usr=0.08%, sys=5.98%, ctx=1460, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144465: Sat Jun 27 22:16:41 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29663msec) clat (usec): min=34, max=273119, avg=43789.76, stdev=41059.94 lat (usec): min=34, max=273121, avg=43791.61, stdev=41059.88 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 70], | 30.00th=[ 20841], 40.00th=[ 31327], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 57410], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[122160], | 99.00th=[175113], 99.50th=[261096], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 30, max= 411, per=26.75%, avg=206.54, stdev=97.36, samples=57 iops : min= 1, max= 25, avg=12.18, stdev= 6.18, samples=57 write: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29663msec); 0 zone resets clat (usec): min=1358, max=368656, avg=33109.10, stdev=44696.12 lat (usec): min=1360, max=368657, avg=33111.97, stdev=44695.83 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1713], 10.00th=[ 1991], 20.00th=[ 4228], | 30.00th=[ 6652], 40.00th=[ 11076], 50.00th=[ 17433], 60.00th=[ 26084], | 70.00th=[ 37487], 80.00th=[ 52691], 90.00th=[ 76022], 95.00th=[116917], | 99.00th=[225444], 99.50th=[312476], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 31, max= 534, per=25.93%, avg=210.57, stdev=120.46, samples=58 iops : min= 1, max= 33, avg=12.41, stdev= 7.59, samples=58 lat (usec) : 50=1.43%, 100=10.55%, 250=0.65%, 500=0.39% lat (msec) : 2=5.34%, 4=4.30%, 10=10.29%, 20=8.85%, 50=29.30% lat (msec) : 100=21.61%, 250=6.77%, 500=0.52% cpu : usr=0.10%, sys=5.69%, ctx=1345, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=772KiB/s (791kB/s), 185KiB/s-203KiB/s (190kB/s-208kB/s), io=23.4MiB (24.5MB), run=29663-31010msec WRITE: bw=813KiB/s (832kB/s), 195KiB/s-211KiB/s (200kB/s-216kB/s), io=24.6MiB (25.8MB), run=29663-31010msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144467: Sat Jun 27 22:17:25 2026 read: IOPS=5, BW=80.4KiB/s (82.4kB/s)(5920KiB/73610msec) clat (msec): min=5, max=302, avg=39.01, stdev=38.38 lat (msec): min=5, max=302, avg=39.02, stdev=38.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 117], | 99.00th=[ 230], 99.50th=[ 271], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 411, per=29.33%, avg=95.02, stdev=63.46, samples=122 iops : min= 1, max= 25, avg= 5.15, stdev= 4.04, samples=122 write: IOPS=5, BW=86.5KiB/s (88.6kB/s)(6368KiB/73610msec); 0 zone resets clat (msec): min=38, max=516, avg=148.36, stdev=89.52 lat (msec): min=38, max=516, avg=148.37, stdev=89.52 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 96], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 194], 90.00th=[ 275], 95.00th=[ 347], | 99.00th=[ 498], 99.50th=[ 510], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 26, max= 251, per=26.18%, avg=89.27, stdev=42.00, samples=140 iops : min= 1, max= 15, avg= 4.78, stdev= 2.74, samples=140 lat (msec) : 10=1.56%, 20=14.06%, 50=25.13%, 100=21.61%, 250=31.51% lat (msec) : 500=5.73%, 750=0.39% cpu : usr=0.05%, sys=1.49%, ctx=1369, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144468: Sat Jun 27 22:17:25 2026 read: IOPS=4, BW=77.9KiB/s (79.8kB/s)(5744KiB/73733msec) clat (msec): min=6, max=434, avg=41.16, stdev=46.73 lat (msec): min=6, max=434, avg=41.16, stdev=46.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 94], 95.00th=[ 144], | 99.00th=[ 245], 99.50th=[ 284], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 27, max= 254, per=29.31%, avg=94.97, stdev=59.12, samples=118 iops : min= 1, max= 15, avg= 5.15, stdev= 3.77, samples=118 write: IOPS=5, BW=88.8KiB/s (90.9kB/s)(6544KiB/73733msec); 0 zone resets clat (msec): min=36, max=591, avg=143.82, stdev=84.17 lat (msec): min=36, max=591, avg=143.82, stdev=84.17 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 96], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 241], 95.00th=[ 334], | 99.00th=[ 502], 99.50th=[ 531], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 30, max= 222, per=27.35%, avg=93.26, stdev=41.90, samples=137 iops : min= 1, max= 13, avg= 5.04, stdev= 2.73, samples=137 lat (msec) : 10=1.95%, 20=13.02%, 50=24.35%, 100=21.35%, 250=34.51% lat (msec) : 500=4.17%, 750=0.65% cpu : usr=0.04%, sys=1.48%, ctx=1379, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144469: Sat Jun 27 22:17:25 2026 read: IOPS=5, BW=88.7KiB/s (90.9kB/s)(6256KiB/70496msec) clat (msec): min=8, max=274, avg=35.66, stdev=35.04 lat (msec): min=8, max=274, avg=35.66, stdev=35.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 62], 95.00th=[ 113], | 99.00th=[ 209], 99.50th=[ 271], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 26, max= 383, per=31.75%, avg=102.86, stdev=73.62, samples=120 iops : min= 1, max= 23, avg= 5.63, stdev= 4.66, samples=120 write: IOPS=5, BW=85.6KiB/s (87.6kB/s)(6032KiB/70496msec); 0 zone resets clat (msec): min=29, max=665, avg=149.69, stdev=96.79 lat (msec): min=29, max=665, avg=149.71, stdev=96.79 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 190], 90.00th=[ 266], 95.00th=[ 376], | 99.00th=[ 535], 99.50th=[ 617], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 26, max= 220, per=25.89%, avg=88.27, stdev=41.66, samples=134 iops : min= 1, max= 13, avg= 4.71, stdev= 2.72, samples=134 lat (msec) : 10=1.04%, 20=16.15%, 50=27.08%, 100=19.14%, 250=31.12% lat (msec) : 500=4.56%, 750=0.91% cpu : usr=0.05%, sys=1.59%, ctx=1404, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144470: Sat Jun 27 22:17:25 2026 read: IOPS=5, BW=82.3KiB/s (84.3kB/s)(6032KiB/73264msec) clat (msec): min=6, max=278, avg=41.03, stdev=41.36 lat (msec): min=6, max=278, avg=41.04, stdev=41.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 90], 95.00th=[ 131], | 99.00th=[ 209], 99.50th=[ 251], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 285, per=29.12%, avg=94.35, stdev=60.07, samples=124 iops : min= 1, max= 17, avg= 5.11, stdev= 3.84, samples=124 write: IOPS=5, BW=85.4KiB/s (87.4kB/s)(6256KiB/73264msec); 0 zone resets clat (msec): min=43, max=682, avg=147.67, stdev=83.43 lat (msec): min=43, max=682, avg=147.68, stdev=83.43 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 114], 50.00th=[ 128], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 253], 95.00th=[ 317], | 99.00th=[ 439], 99.50th=[ 527], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 31, max= 220, per=25.75%, avg=87.81, stdev=41.07, samples=139 iops : min= 1, max= 13, avg= 4.69, stdev= 2.68, samples=139 lat (msec) : 10=2.08%, 20=14.19%, 50=22.79%, 100=20.57%, 250=34.90% lat (msec) : 500=5.21%, 750=0.26% cpu : usr=0.04%, sys=1.46%, ctx=1355, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=325KiB/s (333kB/s), 77.9KiB/s-88.7KiB/s (79.8kB/s-90.9kB/s), io=23.4MiB (24.5MB), run=70496-73733msec WRITE: bw=342KiB/s (350kB/s), 85.4KiB/s-88.8KiB/s (87.4kB/s-90.9kB/s), io=24.6MiB (25.8MB), run=70496-73733msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144488: Sat Jun 27 22:17:41 2026 read: IOPS=2, BW=2476KiB/s (2535kB/s)(7168KiB/2895msec) clat (usec): min=711, max=296678, avg=196700.10, stdev=99641.16 lat (usec): min=713, max=296679, avg=196701.58, stdev=99641.09 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[164627], | 30.00th=[185598], 40.00th=[185598], 50.00th=[198181], 60.00th=[248513], | 70.00th=[248513], 80.00th=[283116], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 4039, max= 4420, per=100.00%, avg=4229.50, stdev=269.41, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1769KiB/s (1811kB/s)(5120KiB/2895msec); 0 zone resets clat (msec): min=102, max=528, avg=284.65, stdev=178.70 lat (msec): min=102, max=528, avg=284.75, stdev=178.70 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1928, max= 4079, per=63.34%, avg=2680.67, stdev=1212.17, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=20.66%, ctx=271, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144489: Sat Jun 27 22:17:41 2026 read: IOPS=0, BW=302KiB/s (310kB/s)(2048KiB/6775msec) clat (usec): min=590, max=167130, avg=83860.37, stdev=117761.97 lat (usec): min=591, max=167132, avg=83862.11, stdev=117762.28 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 594], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 594], 60.00th=[166724], | 70.00th=[166724], 80.00th=[166724], 90.00th=[166724], 95.00th=[166724], | 99.00th=[166724], 99.50th=[166724], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 2043, max= 2048, per=67.69%, avg=2045.50, stdev= 3.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1511KiB/s (1548kB/s)(10.0MiB/6775msec); 0 zone resets clat (msec): min=162, max=3217, avg=656.50, stdev=943.92 lat (msec): min=163, max=3217, avg=656.98, stdev=943.71 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 167], | 30.00th=[ 180], 40.00th=[ 190], 50.00th=[ 236], 60.00th=[ 249], | 70.00th=[ 506], 80.00th=[ 592], 90.00th=[ 1062], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1921, max= 6131, per=86.11%, avg=3644.20, stdev=2270.50, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.21%, ctx=138, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144490: Sat Jun 27 22:17:41 2026 read: IOPS=1, BW=1102KiB/s (1128kB/s)(6144KiB/5576msec) clat (usec): min=448, max=2865.0k, avg=579364.72, stdev=1132526.42 lat (usec): min=449, max=2865.0k, avg=579365.83, stdev=1132526.08 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], | 20.00th=[ 482], 30.00th=[ 482], 40.00th=[ 2868], | 50.00th=[ 2868], 60.00th=[ 181404], 70.00th=[ 425722], | 80.00th=[ 425722], 90.00th=[2868904], 95.00th=[2868904], | 99.00th=[2868904], 99.50th=[2868904], 99.90th=[2868904], | 99.95th=[2868904], 99.99th=[2868904] bw ( KiB/s): min= 1928, max= 6144, per=100.00%, avg=3363.67, stdev=2408.27, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1102KiB/s (1128kB/s)(6144KiB/5576msec); 0 zone resets clat (msec): min=80, max=755, avg=328.99, stdev=274.60 lat (msec): min=80, max=755, avg=329.15, stdev=274.60 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 239], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1378, max= 2048, per=44.99%, avg=1903.80, stdev=294.12, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=16.67% lat (msec) : 4=8.33%, 100=16.67%, 250=25.00%, 500=8.33%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.21%, ctx=482, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144491: Sat Jun 27 22:17:41 2026 read: IOPS=1, BW=1592KiB/s (1630kB/s)(5120KiB/3216msec) clat (usec): min=418, max=160331, avg=76008.84, stdev=72063.33 lat (usec): min=419, max=160332, avg=76010.18, stdev=72063.50 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 420], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[105382], 60.00th=[105382], | 70.00th=[113771], 80.00th=[113771], 90.00th=[160433], 95.00th=[160433], | 99.00th=[160433], 99.50th=[160433], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 2039, max= 6047, per=100.00%, avg=4043.00, stdev=2834.08, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2229KiB/s (2282kB/s)(7168KiB/3216msec); 0 zone resets clat (msec): min=51, max=672, avg=384.47, stdev=264.49 lat (msec): min=51, max=672, avg=384.55, stdev=264.49 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 106], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 472], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 651], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1615, max= 4031, per=54.97%, avg=2326.40, stdev=967.93, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=16.58%, ctx=133, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3023KiB/s (3095kB/s), 302KiB/s-2476KiB/s (310kB/s-2535kB/s), io=20.0MiB (20.0MB), run=2895-6775msec WRITE: bw=4232KiB/s (4334kB/s), 1102KiB/s-2229KiB/s (1128kB/s-2282kB/s), io=28.0MiB (29.4MB), run=2895-6775msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144493: Sat Jun 27 22:17:42 2026 read: IOPS=1, BW=1170KiB/s (1198kB/s)(7168KiB/6127msec) clat (msec): min=94, max=397, avg=187.22, stdev=117.98 lat (msec): min=94, max=397, avg=187.22, stdev=117.98 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 103], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 140], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 309], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1917, max= 3813, per=86.46%, avg=2367.20, stdev=809.95, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=836KiB/s (856kB/s)(5120KiB/6127msec); 0 zone resets clat (msec): min=162, max=3144, avg=954.08, stdev=1238.26 lat (msec): min=162, max=3144, avg=954.25, stdev=1238.24 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1917, max= 4096, per=65.48%, avg=2509.75, stdev=1058.48, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.02%, ctx=74, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144494: Sat Jun 27 22:17:42 2026 read: IOPS=0, BW=276KiB/s (282kB/s)(2048KiB/7425msec) clat (msec): min=227, max=884, avg=555.59, stdev=464.49 lat (msec): min=227, max=884, avg=555.60, stdev=464.49 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1917, max= 1996, per=71.46%, avg=1956.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1379KiB/s (1412kB/s)(10.0MiB/7425msec); 0 zone resets clat (msec): min=176, max=3029, avg=602.36, stdev=865.18 lat (msec): min=176, max=3029, avg=602.46, stdev=865.18 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 190], | 30.00th=[ 224], 40.00th=[ 245], 50.00th=[ 262], 60.00th=[ 372], | 70.00th=[ 397], 80.00th=[ 506], 90.00th=[ 625], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1996, max= 4096, per=70.56%, avg=2704.67, stdev=1074.29, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=2.59%, ctx=84, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144495: Sat Jun 27 22:17:42 2026 read: IOPS=0, BW=900KiB/s (922kB/s)(6144KiB/6827msec) clat (msec): min=72, max=2818, avg=639.88, stdev=1072.66 lat (msec): min=72, max=2818, avg=639.88, stdev=1072.66 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 249], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1996, max= 4096, per=92.46%, avg=2531.50, stdev=1043.08, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=900KiB/s (922kB/s)(6144KiB/6827msec); 0 zone resets clat (msec): min=191, max=1062, avg=451.55, stdev=350.53 lat (msec): min=191, max=1062, avg=451.65, stdev=350.56 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 305], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1917, max= 3992, per=62.39%, avg=2391.60, stdev=895.71, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.94%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144496: Sat Jun 27 22:17:42 2026 read: IOPS=0, BW=685KiB/s (701kB/s)(5120KiB/7479msec) clat (msec): min=75, max=352, avg=195.41, stdev=113.10 lat (msec): min=75, max=352, avg=195.42, stdev=113.10 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2043, max= 3992, per=98.41%, avg=2694.33, stdev=1123.82, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=958KiB/s (981kB/s)(7168KiB/7479msec); 0 zone resets clat (msec): min=178, max=3190, avg=892.16, stdev=1066.66 lat (msec): min=178, max=3190, avg=892.28, stdev=1066.64 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 203], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 667], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 1036], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1917, max= 2048, per=52.40%, avg=2008.40, stdev=53.09, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.73%, ctx=131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2738KiB/s (2804kB/s), 276KiB/s-1170KiB/s (282kB/s-1198kB/s), io=20.0MiB (20.0MB), run=6127-7479msec WRITE: bw=3834KiB/s (3926kB/s), 836KiB/s-1379KiB/s (856kB/s-1412kB/s), io=28.0MiB (29.4MB), run=6127-7479msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144507: Sat Jun 27 22:17:55 2026 read: IOPS=1, BW=4927KiB/s (5045kB/s)(12.0MiB/2494msec) clat (msec): min=747, max=940, avg=812.43, stdev=110.78 lat (msec): min=747, max=940, avg=812.43, stdev=110.78 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.60%, ctx=366, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144509: Sat Jun 27 22:17:55 2026 read: IOPS=0, BW=1427KiB/s (1461kB/s)(4096KiB/2870msec) clat (nsec): min=619399k, max=619399k, avg=619398994.00, stdev= 0.00 lat (nsec): min=619401k, max=619401k, avg=619401017.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2854KiB/s (2923kB/s)(8192KiB/2870msec); 0 zone resets clat (msec): min=908, max=1246, avg=1077.51, stdev=238.95 lat (msec): min=908, max=1246, avg=1077.93, stdev=239.06 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7922, max= 7922, per=71.78%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.68%, ctx=238, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144511: Sat Jun 27 22:17:55 2026 write: IOPS=1, BW=4139KiB/s (4238kB/s)(12.0MiB/2969msec); 0 zone resets clat (msec): min=869, max=1080, avg=969.98, stdev=106.08 lat (msec): min=869, max=1081, avg=970.51, stdev=106.19 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7922, max= 8175, per=72.93%, avg=8048.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.62%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144512: Sat Jun 27 22:17:55 2026 write: IOPS=1, BW=5860KiB/s (6000kB/s)(12.0MiB/2097msec); 0 zone resets clat (msec): min=392, max=945, avg=679.32, stdev=277.31 lat (msec): min=392, max=946, avg=679.75, stdev=277.32 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8175, max= 8175, per=74.08%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=7.30%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5709KiB/s (5846kB/s), 1427KiB/s-4927KiB/s (1461kB/s-5045kB/s), io=16.0MiB (16.8MB), run=2494-2870msec WRITE: bw=10.8MiB/s (11.3MB/s), 2854KiB/s-5860KiB/s (2923kB/s-6000kB/s), io=32.0MiB (33.6MB), run=2097-2969msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144505: Sat Jun 27 22:17:56 2026 read: IOPS=2, BW=8847KiB/s (9059kB/s)(12.0MiB/1389msec) clat (msec): min=331, max=634, avg=447.68, stdev=163.78 lat (msec): min=331, max=634, avg=447.68, stdev=163.78 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 6370, max= 7984, per=100.00%, avg=7177.00, stdev=1141.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=8.57%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144506: Sat Jun 27 22:17:56 2026 read: IOPS=0, BW=1282KiB/s (1313kB/s)(4096KiB/3195msec) clat (nsec): min=1471.2M, max=1471.2M, avg=1471194564.00, stdev= 0.00 lat (nsec): min=1471.2M, max=1471.2M, avg=1471197544.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1469], 5.00th=[ 1469], 10.00th=[ 1469], 20.00th=[ 1469], | 30.00th=[ 1469], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2564KiB/s (2626kB/s)(8192KiB/3195msec); 0 zone resets clat (msec): min=494, max=1084, avg=789.64, stdev=416.83 lat (msec): min=495, max=1084, avg=790.01, stdev=416.79 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=80.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.70%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144508: Sat Jun 27 22:17:56 2026 write: IOPS=0, BW=3808KiB/s (3899kB/s)(12.0MiB/3227msec); 0 zone resets clat (msec): min=605, max=1316, avg=1038.67, stdev=380.07 lat (msec): min=606, max=1317, avg=1039.55, stdev=380.16 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8143, max= 8143, per=80.19%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.98%, ctx=33, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144510: Sat Jun 27 22:17:56 2026 write: IOPS=1, BW=4690KiB/s (4803kB/s)(12.0MiB/2620msec); 0 zone resets clat (msec): min=299, max=1181, avg=836.10, stdev=470.83 lat (msec): min=301, max=1184, avg=837.54, stdev=470.86 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8143, max= 8143, per=80.19%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.89%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5128KiB/s (5251kB/s), 1282KiB/s-8847KiB/s (1313kB/s-9059kB/s), io=16.0MiB (16.8MB), run=1389-3195msec WRITE: bw=9.92MiB/s (10.4MB/s), 2564KiB/s-4690KiB/s (2626kB/s-4803kB/s), io=32.0MiB (33.6MB), run=2620-3227msec