== sanity test 398b: DIO and buffer IO race ============== 11:32:23 (1775835143) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.33154 s, 21.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183016: Fri Apr 10 11:33:15 2026 read: IOPS=35, BW=141KiB/s (144kB/s)(5992KiB/42647msec) clat (usec): min=39, max=424611, avg=15360.13, stdev=13167.22 lat (usec): min=40, max=424612, avg=15360.84, stdev=13167.26 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 6587], 10.00th=[ 7701], 20.00th=[ 9241], | 30.00th=[ 10421], 40.00th=[ 11863], 50.00th=[ 13698], 60.00th=[ 15795], | 70.00th=[ 17957], 80.00th=[ 20055], 90.00th=[ 23987], 95.00th=[ 28181], | 99.00th=[ 42730], 99.50th=[ 50070], 99.90th=[ 84411], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 48, max= 207, per=25.49%, avg=139.93, stdev=31.33, samples=84 iops : min= 12, max= 51, avg=34.65, stdev= 7.84, samples=84 write: IOPS=36, BW=148KiB/s (151kB/s)(6296KiB/42647msec); 0 zone resets clat (usec): min=707, max=63398, avg=12443.99, stdev=9307.63 lat (usec): min=707, max=63398, avg=12446.83, stdev=9305.89 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 2278], 10.00th=[ 2704], 20.00th=[ 3359], | 30.00th=[ 5407], 40.00th=[ 8717], 50.00th=[10552], 60.00th=[13042], | 70.00th=[15926], 80.00th=[19530], 90.00th=[25297], 95.00th=[29754], | 99.00th=[41681], 99.50th=[47449], 99.90th=[53740], 99.95th=[63177], | 99.99th=[63177] bw ( KiB/s): min= 34, max= 224, per=25.46%, avg=146.40, stdev=36.80, samples=84 iops : min= 8, max= 56, avg=36.27, stdev= 9.23, samples=84 lat (usec) : 50=0.13%, 100=0.55%, 250=0.49%, 750=0.10%, 1000=0.16% lat (msec) : 2=1.20%, 4=11.46%, 10=22.92%, 20=43.36%, 50=19.24% lat (msec) : 100=0.36%, 500=0.03% cpu : usr=0.11%, sys=25.20%, ctx=9092, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183017: Fri Apr 10 11:33:15 2026 read: IOPS=34, BW=138KiB/s (141kB/s)(5940KiB/43098msec) clat (usec): min=81, max=386547, avg=15678.94, stdev=12692.98 lat (usec): min=82, max=386548, avg=15679.60, stdev=12693.01 clat percentiles (usec): | 1.00th=[ 106], 5.00th=[ 6587], 10.00th=[ 7898], 20.00th=[ 9241], | 30.00th=[ 10552], 40.00th=[ 11994], 50.00th=[ 13829], 60.00th=[ 15664], | 70.00th=[ 17957], 80.00th=[ 20579], 90.00th=[ 24773], 95.00th=[ 29754], | 99.00th=[ 47449], 99.50th=[ 55313], 99.90th=[ 67634], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 13, max= 208, per=24.96%, avg=137.04, stdev=35.95, samples=85 iops : min= 3, max= 52, avg=33.93, stdev= 9.04, samples=85 write: IOPS=36, BW=147KiB/s (151kB/s)(6348KiB/43098msec); 0 zone resets clat (usec): min=720, max=61748, avg=12454.72, stdev=9365.14 lat (usec): min=721, max=61748, avg=12455.57, stdev=9365.22 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2409], 10.00th=[ 2802], 20.00th=[ 3458], | 30.00th=[ 5997], 40.00th=[ 8717], 50.00th=[10290], 60.00th=[12780], | 70.00th=[15795], 80.00th=[19268], 90.00th=[25297], 95.00th=[30016], | 99.00th=[45351], 99.50th=[49021], 99.90th=[58983], 99.95th=[61604], | 99.99th=[61604] bw ( KiB/s): min= 41, max= 215, per=25.24%, avg=145.15, stdev=35.62, samples=85 iops : min= 10, max= 53, avg=35.96, stdev= 8.90, samples=85 lat (usec) : 100=0.36%, 250=0.68%, 500=0.03%, 750=0.03%, 1000=0.20% lat (msec) : 2=1.17%, 4=11.04%, 10=23.83%, 20=42.61%, 50=19.53% lat (msec) : 100=0.49%, 500=0.03% cpu : usr=0.08%, sys=25.39%, ctx=9214, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183018: Fri Apr 10 11:33:15 2026 read: IOPS=35, BW=141KiB/s (145kB/s)(6028KiB/42635msec) clat (usec): min=45, max=63721, avg=15003.34, stdev=7757.07 lat (usec): min=46, max=63721, avg=15004.16, stdev=7757.16 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 5997], 10.00th=[ 7504], 20.00th=[ 8979], | 30.00th=[10290], 40.00th=[11863], 50.00th=[13960], 60.00th=[16057], | 70.00th=[17957], 80.00th=[20055], 90.00th=[23725], 95.00th=[28705], | 99.00th=[40633], 99.50th=[43779], 99.90th=[61080], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 41, max= 231, per=25.73%, avg=141.26, stdev=33.00, samples=84 iops : min= 10, max= 57, avg=34.99, stdev= 8.28, samples=84 write: IOPS=36, BW=147KiB/s (150kB/s)(6260KiB/42635msec); 0 zone resets clat (usec): min=681, max=387941, avg=12762.84, stdev=13348.38 lat (usec): min=682, max=387943, avg=12763.77, stdev=13348.37 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2343], 10.00th=[ 2769], 20.00th=[ 3425], | 30.00th=[ 5932], 40.00th=[ 8586], 50.00th=[ 10552], 60.00th=[ 12780], | 70.00th=[ 15795], 80.00th=[ 20055], 90.00th=[ 25560], 95.00th=[ 29754], | 99.00th=[ 44827], 99.50th=[ 50594], 99.90th=[ 64226], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 55, max= 223, per=25.46%, avg=146.39, stdev=37.75, samples=84 iops : min= 13, max= 55, avg=36.26, stdev= 9.47, samples=84 lat (usec) : 50=0.03%, 100=0.68%, 250=0.94%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=1.17%, 4=10.51%, 10=23.99%, 20=42.35%, 50=19.60% lat (msec) : 100=0.39%, 500=0.03% cpu : usr=0.13%, sys=25.31%, ctx=9208, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183019: Fri Apr 10 11:33:15 2026 read: IOPS=34, BW=139KiB/s (142kB/s)(6052KiB/43679msec) clat (usec): min=47, max=66909, avg=15366.32, stdev=8150.56 lat (usec): min=48, max=66909, avg=15368.77, stdev=8149.17 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 6128], 10.00th=[ 7504], 20.00th=[ 8979], | 30.00th=[10552], 40.00th=[12125], 50.00th=[14091], 60.00th=[16188], | 70.00th=[17957], 80.00th=[20317], 90.00th=[25035], 95.00th=[31065], | 99.00th=[43779], 99.50th=[48497], 99.90th=[66323], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 28, max= 287, per=25.23%, avg=138.52, stdev=39.22, samples=87 iops : min= 7, max= 71, avg=34.30, stdev= 9.78, samples=87 write: IOPS=35, BW=143KiB/s (146kB/s)(6236KiB/43679msec); 0 zone resets clat (usec): min=729, max=388636, avg=13076.93, stdev=13760.97 lat (usec): min=730, max=388638, avg=13077.82, stdev=13760.94 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2311], 10.00th=[ 2737], 20.00th=[ 3458], | 30.00th=[ 5866], 40.00th=[ 8717], 50.00th=[ 10552], 60.00th=[ 12649], | 70.00th=[ 15795], 80.00th=[ 20317], 90.00th=[ 26608], 95.00th=[ 32375], | 99.00th=[ 42730], 99.50th=[ 53216], 99.90th=[ 69731], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 35, max= 287, per=24.82%, avg=142.74, stdev=40.10, samples=87 iops : min= 8, max= 71, avg=35.34, stdev=10.03, samples=87 lat (usec) : 50=0.03%, 100=0.59%, 250=0.81%, 750=0.03%, 1000=0.39% lat (msec) : 2=1.20%, 4=10.74%, 10=22.72%, 20=42.19%, 50=20.77% lat (msec) : 100=0.49%, 500=0.03% cpu : usr=0.12%, sys=24.91%, ctx=9223, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=550KiB/s (563kB/s), 138KiB/s-141KiB/s (141kB/s-145kB/s), io=23.4MiB (24.6MB), run=42635-43679msec WRITE: bw=576KiB/s (589kB/s), 143KiB/s-148KiB/s (146kB/s-151kB/s), io=24.6MiB (25.7MB), run=42635-43679msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183011: Fri Apr 10 11:33:21 2026 read: IOPS=30, BW=120KiB/s (123kB/s)(5992KiB/49877msec) clat (msec): min=2, max=596, avg=14.46, stdev=18.90 lat (msec): min=2, max=596, avg=14.46, stdev=18.90 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 31], 95.00th=[ 37], | 99.00th=[ 57], 99.50th=[ 63], 99.90th=[ 92], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 39, max= 408, per=25.23%, avg=120.86, stdev=82.51, samples=98 iops : min= 9, max= 102, avg=29.94, stdev=20.73, samples=98 write: IOPS=31, BW=126KiB/s (129kB/s)(6296KiB/49877msec); 0 zone resets clat (usec): min=4432, max=85495, avg=17826.26, stdev=12195.15 lat (usec): min=4432, max=85496, avg=17827.19, stdev=12195.15 clat percentiles (usec): | 1.00th=[ 5014], 5.00th=[ 5669], 10.00th=[ 6128], 20.00th=[ 7177], | 30.00th=[ 8455], 40.00th=[11207], 50.00th=[14484], 60.00th=[18220], | 70.00th=[22414], 80.00th=[27395], 90.00th=[34341], 95.00th=[40633], | 99.00th=[56886], 99.50th=[65799], 99.90th=[84411], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 48, max= 376, per=25.31%, avg=126.82, stdev=82.43, samples=98 iops : min= 12, max= 94, avg=31.43, stdev=20.70, samples=98 lat (msec) : 4=2.25%, 10=39.58%, 20=28.87%, 50=27.38%, 100=1.89% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=13.26%, ctx=5856, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183012: Fri Apr 10 11:33:21 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(5940KiB/50013msec) clat (msec): min=2, max=554, avg=14.37, stdev=18.25 lat (msec): min=2, max=554, avg=14.37, stdev=18.25 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 39], | 99.00th=[ 54], 99.50th=[ 62], 99.90th=[ 91], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 39, max= 416, per=24.87%, avg=119.14, stdev=84.01, samples=98 iops : min= 9, max= 104, avg=29.51, stdev=21.10, samples=98 write: IOPS=31, BW=127KiB/s (130kB/s)(6348KiB/50013msec); 0 zone resets clat (usec): min=4421, max=85833, avg=17962.28, stdev=12153.05 lat (usec): min=4422, max=85835, avg=17963.16, stdev=12153.11 clat percentiles (usec): | 1.00th=[ 5014], 5.00th=[ 5669], 10.00th=[ 6194], 20.00th=[ 7111], | 30.00th=[ 8291], 40.00th=[11207], 50.00th=[14615], 60.00th=[18482], | 70.00th=[22676], 80.00th=[28181], 90.00th=[34866], 95.00th=[41157], | 99.00th=[55313], 99.50th=[62129], 99.90th=[67634], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 16, max= 392, per=25.21%, avg=126.33, stdev=82.43, samples=98 iops : min= 4, max= 98, avg=31.31, stdev=20.71, samples=98 lat (msec) : 4=2.93%, 10=39.94%, 20=27.80%, 50=27.77%, 100=1.53% lat (msec) : 750=0.03% cpu : usr=0.12%, sys=13.28%, ctx=5792, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183013: Fri Apr 10 11:33:21 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6028KiB/49832msec) clat (usec): min=2309, max=99376, avg=14208.83, stdev=11514.52 lat (usec): min=2309, max=99377, avg=14209.62, stdev=11514.50 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 4015], 10.00th=[ 4359], 20.00th=[ 5014], | 30.00th=[ 6128], 40.00th=[ 8717], 50.00th=[10552], 60.00th=[12780], | 70.00th=[16188], 80.00th=[21890], 90.00th=[30540], 95.00th=[36963], | 99.00th=[54789], 99.50th=[61080], 99.90th=[90702], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 31, max= 392, per=25.47%, avg=122.00, stdev=84.12, samples=98 iops : min= 7, max= 98, avg=30.22, stdev=21.13, samples=98 write: IOPS=31, BW=126KiB/s (129kB/s)(6260KiB/49832msec); 0 zone resets clat (msec): min=4, max=559, avg=18.06, stdev=18.18 lat (msec): min=4, max=559, avg=18.06, stdev=18.18 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 28], 90.00th=[ 35], 95.00th=[ 41], | 99.00th=[ 57], 99.50th=[ 64], 99.90th=[ 87], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 39, max= 376, per=25.21%, avg=126.33, stdev=81.85, samples=98 iops : min= 9, max= 94, avg=31.31, stdev=20.57, samples=98 lat (msec) : 4=2.34%, 10=38.80%, 20=29.85%, 50=27.31%, 100=1.66% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=13.31%, ctx=5936, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183014: Fri Apr 10 11:33:21 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6052KiB/50120msec) clat (usec): min=2330, max=68618, avg=14029.95, stdev=11212.43 lat (usec): min=2331, max=68619, avg=14030.63, stdev=11212.42 clat percentiles (usec): | 1.00th=[ 2966], 5.00th=[ 3884], 10.00th=[ 4359], 20.00th=[ 4883], | 30.00th=[ 5866], 40.00th=[ 8160], 50.00th=[10290], 60.00th=[12911], | 70.00th=[16188], 80.00th=[21890], 90.00th=[30540], 95.00th=[37487], | 99.00th=[50594], 99.50th=[56886], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 47, max= 408, per=24.98%, avg=119.63, stdev=81.39, samples=98 iops : min= 11, max= 102, avg=29.63, stdev=20.45, samples=98 write: IOPS=31, BW=124KiB/s (127kB/s)(6236KiB/50120msec); 0 zone resets clat (msec): min=4, max=562, avg=18.43, stdev=18.70 lat (msec): min=4, max=562, avg=18.43, stdev=18.70 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 36], 95.00th=[ 43], | 99.00th=[ 57], 99.50th=[ 71], 99.90th=[ 85], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 47, max= 392, per=24.61%, avg=123.31, stdev=82.57, samples=98 iops : min= 11, max= 98, avg=30.55, stdev=20.74, samples=98 lat (msec) : 4=2.90%, 10=39.91%, 20=27.31%, 50=28.19%, 100=1.66% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=13.01%, ctx=5946, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=479KiB/s (491kB/s), 119KiB/s-121KiB/s (122kB/s-124kB/s), io=23.4MiB (24.6MB), run=49832-50120msec WRITE: bw=502KiB/s (514kB/s), 124KiB/s-127KiB/s (127kB/s-130kB/s), io=24.6MiB (25.7MB), run=49832-50120msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183048: Fri Apr 10 11:33:39 2026 read: IOPS=30, BW=482KiB/s (493kB/s)(5920KiB/12288msec) clat (usec): min=54, max=64018, avg=16575.45, stdev=8536.03 lat (usec): min=55, max=64019, avg=16576.19, stdev=8536.03 clat percentiles (usec): | 1.00th=[ 80], 5.00th=[ 118], 10.00th=[ 8586], 20.00th=[10421], | 30.00th=[12387], 40.00th=[13698], 50.00th=[15795], 60.00th=[17433], | 70.00th=[19792], 80.00th=[22414], 90.00th=[25822], 95.00th=[29492], | 99.00th=[48497], 99.50th=[56361], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 351, max= 701, per=25.13%, avg=475.67, stdev=94.88, samples=24 iops : min= 21, max= 43, avg=29.25, stdev= 5.88, samples=24 write: IOPS=32, BW=518KiB/s (531kB/s)(6368KiB/12288msec); 0 zone resets clat (usec): min=1604, max=50825, avg=15253.77, stdev=9722.97 lat (usec): min=1605, max=50827, avg=15255.13, stdev=9722.97 clat percentiles (usec): | 1.00th=[ 2311], 5.00th=[ 3720], 10.00th=[ 4359], 20.00th=[ 5997], | 30.00th=[ 8717], 40.00th=[11207], 50.00th=[13304], 60.00th=[16319], | 70.00th=[18744], 80.00th=[22676], 90.00th=[28967], 95.00th=[34341], | 99.00th=[45351], 99.50th=[49546], 99.90th=[50594], 99.95th=[50594], | 99.99th=[50594] bw ( KiB/s): min= 350, max= 637, per=25.95%, avg=516.92, stdev=87.72, samples=24 iops : min= 21, max= 39, avg=31.83, stdev= 5.55, samples=24 lat (usec) : 100=1.17%, 250=1.69% lat (msec) : 2=0.39%, 4=2.99%, 10=20.18%, 20=45.96%, 50=27.08% lat (msec) : 100=0.52% cpu : usr=0.13%, sys=26.59%, ctx=2855, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183049: Fri Apr 10 11:33:39 2026 read: IOPS=28, BW=454KiB/s (465kB/s)(5744KiB/12649msec) clat (usec): min=52, max=53324, avg=17828.18, stdev=8301.38 lat (usec): min=53, max=53325, avg=17830.86, stdev=8302.52 clat percentiles (usec): | 1.00th=[ 95], 5.00th=[ 7111], 10.00th=[ 9110], 20.00th=[11207], | 30.00th=[13566], 40.00th=[15139], 50.00th=[16909], 60.00th=[19006], | 70.00th=[20841], 80.00th=[23200], 90.00th=[27919], 95.00th=[33817], | 99.00th=[44827], 99.50th=[53216], 99.90th=[53216], 99.95th=[53216], | 99.99th=[53216] bw ( KiB/s): min= 284, max= 640, per=23.88%, avg=451.96, stdev=101.26, samples=25 iops : min= 17, max= 40, avg=27.72, stdev= 6.41, samples=25 write: IOPS=32, BW=517KiB/s (530kB/s)(6544KiB/12649msec); 0 zone resets clat (usec): min=2094, max=58738, avg=15058.30, stdev=9602.51 lat (usec): min=2096, max=58739, avg=15060.94, stdev=9602.51 clat percentiles (usec): | 1.00th=[ 3261], 5.00th=[ 3851], 10.00th=[ 4490], 20.00th=[ 5538], | 30.00th=[ 8291], 40.00th=[10552], 50.00th=[13304], 60.00th=[16057], | 70.00th=[18744], 80.00th=[23725], 90.00th=[28967], 95.00th=[32637], | 99.00th=[40109], 99.50th=[43779], 99.90th=[58983], 99.95th=[58983], | 99.99th=[58983] bw ( KiB/s): min= 319, max= 798, per=25.96%, avg=517.16, stdev=121.02, samples=25 iops : min= 19, max= 49, avg=31.80, stdev= 7.59, samples=25 lat (usec) : 100=0.65%, 250=0.78% lat (msec) : 2=0.13%, 4=3.39%, 10=22.14%, 20=43.10%, 50=29.43% lat (msec) : 100=0.39% cpu : usr=0.10%, sys=26.49%, ctx=3007, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183051: Fri Apr 10 11:33:39 2026 read: IOPS=32, BW=514KiB/s (526kB/s)(6256KiB/12177msec) clat (usec): min=39, max=47814, avg=16796.22, stdev=7760.55 lat (usec): min=40, max=47814, avg=16797.17, stdev=7760.62 clat percentiles (usec): | 1.00th=[ 84], 5.00th=[ 6390], 10.00th=[ 9241], 20.00th=[10683], | 30.00th=[12387], 40.00th=[14615], 50.00th=[15926], 60.00th=[17433], | 70.00th=[19792], 80.00th=[22152], 90.00th=[26084], 95.00th=[31589], | 99.00th=[40633], 99.50th=[43779], 99.90th=[47973], 99.95th=[47973], | 99.99th=[47973] bw ( KiB/s): min= 287, max= 672, per=27.29%, avg=516.62, stdev=107.49, samples=24 iops : min= 17, max= 42, avg=31.79, stdev= 6.76, samples=24 write: IOPS=30, BW=495KiB/s (507kB/s)(6032KiB/12177msec); 0 zone resets clat (usec): min=1413, max=54315, avg=14630.78, stdev=9414.09 lat (usec): min=1415, max=54315, avg=14632.27, stdev=9414.10 clat percentiles (usec): | 1.00th=[ 2073], 5.00th=[ 3687], 10.00th=[ 4424], 20.00th=[ 5669], | 30.00th=[ 8455], 40.00th=[10552], 50.00th=[13173], 60.00th=[15008], | 70.00th=[18220], 80.00th=[21365], 90.00th=[26870], 95.00th=[33817], | 99.00th=[44827], 99.50th=[52691], 99.90th=[54264], 99.95th=[54264], | 99.99th=[54264] bw ( KiB/s): min= 223, max= 638, per=24.63%, avg=490.67, stdev=103.90, samples=24 iops : min= 13, max= 39, avg=30.17, stdev= 6.72, samples=24 lat (usec) : 50=0.13%, 100=0.39%, 250=1.56% lat (msec) : 2=0.39%, 4=2.86%, 10=20.96%, 20=47.14%, 50=26.17% lat (msec) : 100=0.39% cpu : usr=0.11%, sys=26.78%, ctx=2972, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183053: Fri Apr 10 11:33:39 2026 read: IOPS=30, BW=491KiB/s (503kB/s)(6032KiB/12275msec) clat (usec): min=53, max=61273, avg=16730.46, stdev=9228.51 lat (usec): min=53, max=61274, avg=16731.24, stdev=9228.59 clat percentiles (usec): | 1.00th=[ 74], 5.00th=[ 127], 10.00th=[ 8586], 20.00th=[10552], | 30.00th=[11600], 40.00th=[13435], 50.00th=[15533], 60.00th=[17695], | 70.00th=[19268], 80.00th=[21890], 90.00th=[26608], 95.00th=[32900], | 99.00th=[52691], 99.50th=[53740], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 287, max= 704, per=25.79%, avg=488.21, stdev=89.89, samples=24 iops : min= 17, max= 44, avg=30.04, stdev= 5.69, samples=24 write: IOPS=31, BW=510KiB/s (522kB/s)(6256KiB/12275msec); 0 zone resets clat (usec): min=1234, max=49388, avg=15173.17, stdev=10334.00 lat (usec): min=1235, max=49389, avg=15174.70, stdev=10333.92 clat percentiles (usec): | 1.00th=[ 2008], 5.00th=[ 3458], 10.00th=[ 4228], 20.00th=[ 5735], | 30.00th=[ 8225], 40.00th=[10552], 50.00th=[12911], 60.00th=[15270], | 70.00th=[18482], 80.00th=[25035], 90.00th=[30278], 95.00th=[36963], | 99.00th=[42206], 99.50th=[44827], 99.90th=[49546], 99.95th=[49546], | 99.99th=[49546] bw ( KiB/s): min= 254, max= 704, per=25.36%, avg=505.25, stdev=106.28, samples=24 iops : min= 15, max= 44, avg=31.08, stdev= 6.77, samples=24 lat (usec) : 100=1.43%, 250=1.30%, 500=0.13% lat (msec) : 2=0.39%, 4=3.78%, 10=19.92%, 20=46.09%, 50=26.30% lat (msec) : 100=0.65% cpu : usr=0.15%, sys=26.28%, ctx=2867, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1894KiB/s (1939kB/s), 454KiB/s-514KiB/s (465kB/s-526kB/s), io=23.4MiB (24.5MB), run=12177-12649msec WRITE: bw=1992KiB/s (2040kB/s), 495KiB/s-518KiB/s (507kB/s-531kB/s), io=24.6MiB (25.8MB), run=12177-12649msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183046: Fri Apr 10 11:33:41 2026 read: IOPS=26, BW=420KiB/s (430kB/s)(5920KiB/14089msec) clat (usec): min=3626, max=64304, avg=15351.17, stdev=9975.37 lat (usec): min=3627, max=64305, avg=15351.83, stdev=9975.37 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5407], 10.00th=[ 5866], 20.00th=[ 7635], | 30.00th=[ 9241], 40.00th=[10814], 50.00th=[11994], 60.00th=[14091], | 70.00th=[16188], 80.00th=[21365], 90.00th=[31065], 95.00th=[36963], | 99.00th=[44303], 99.50th=[46400], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 223, max= 1120, per=23.67%, avg=401.67, stdev=186.26, samples=27 iops : min= 13, max= 70, avg=24.63, stdev=11.71, samples=27 write: IOPS=28, BW=452KiB/s (463kB/s)(6368KiB/14089msec); 0 zone resets clat (usec): min=4979, max=69276, avg=21076.09, stdev=12384.28 lat (usec): min=4980, max=69277, avg=21077.55, stdev=12384.27 clat percentiles (usec): | 1.00th=[ 5866], 5.00th=[ 7308], 10.00th=[ 8291], 20.00th=[ 9765], | 30.00th=[11600], 40.00th=[14091], 50.00th=[17433], 60.00th=[21890], | 70.00th=[26870], 80.00th=[31589], 90.00th=[39584], 95.00th=[45876], | 99.00th=[54789], 99.50th=[66323], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 287, max= 1120, per=24.36%, avg=435.11, stdev=188.04, samples=27 iops : min= 17, max= 70, avg=26.70, stdev=11.93, samples=27 lat (msec) : 4=0.26%, 10=27.86%, 20=38.28%, 50=32.42%, 100=1.17% cpu : usr=0.06%, sys=13.31%, ctx=1656, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183047: Fri Apr 10 11:33:41 2026 read: IOPS=25, BW=407KiB/s (417kB/s)(5744KiB/14109msec) clat (usec): min=3310, max=62902, avg=16432.00, stdev=11464.33 lat (usec): min=3311, max=62903, avg=16432.65, stdev=11464.32 clat percentiles (usec): | 1.00th=[ 3490], 5.00th=[ 4424], 10.00th=[ 5473], 20.00th=[ 7635], | 30.00th=[ 9110], 40.00th=[10683], 50.00th=[12387], 60.00th=[15533], | 70.00th=[19006], 80.00th=[24511], 90.00th=[32900], 95.00th=[42730], | 99.00th=[53740], 99.50th=[62653], 99.90th=[62653], 99.95th=[62653], | 99.99th=[62653] bw ( KiB/s): min= 191, max= 1120, per=24.07%, avg=408.50, stdev=199.17, samples=28 iops : min= 11, max= 70, avg=25.07, stdev=12.59, samples=28 write: IOPS=28, BW=464KiB/s (475kB/s)(6544KiB/14109msec); 0 zone resets clat (usec): min=4724, max=68989, avg=19921.30, stdev=12261.60 lat (usec): min=4726, max=68990, avg=19922.98, stdev=12261.65 clat percentiles (usec): | 1.00th=[ 6063], 5.00th=[ 6915], 10.00th=[ 7504], 20.00th=[ 9241], | 30.00th=[11207], 40.00th=[13566], 50.00th=[15795], 60.00th=[20317], | 70.00th=[24773], 80.00th=[31327], 90.00th=[36963], 95.00th=[42206], | 99.00th=[56886], 99.50th=[62653], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 255, max= 1248, per=25.89%, avg=462.46, stdev=251.68, samples=28 iops : min= 15, max= 78, avg=28.43, stdev=15.92, samples=28 lat (msec) : 4=1.43%, 10=27.60%, 20=36.07%, 50=33.07%, 100=1.82% cpu : usr=0.12%, sys=13.28%, ctx=1610, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183050: Fri Apr 10 11:33:41 2026 read: IOPS=27, BW=444KiB/s (455kB/s)(6256KiB/14083msec) clat (usec): min=3261, max=87196, avg=15700.10, stdev=11366.10 lat (usec): min=3261, max=87197, avg=15701.22, stdev=11365.90 clat percentiles (usec): | 1.00th=[ 3851], 5.00th=[ 4948], 10.00th=[ 5669], 20.00th=[ 7111], | 30.00th=[ 9110], 40.00th=[10421], 50.00th=[11600], 60.00th=[13698], | 70.00th=[17171], 80.00th=[23200], 90.00th=[32637], 95.00th=[40109], | 99.00th=[52167], 99.50th=[62653], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 254, max= 1504, per=25.71%, avg=436.26, stdev=262.99, samples=27 iops : min= 15, max= 94, avg=26.78, stdev=16.53, samples=27 write: IOPS=26, BW=428KiB/s (439kB/s)(6032KiB/14083msec); 0 zone resets clat (usec): min=5044, max=69467, avg=20862.79, stdev=13095.34 lat (usec): min=5045, max=69469, avg=20864.23, stdev=13095.36 clat percentiles (usec): | 1.00th=[ 5735], 5.00th=[ 6783], 10.00th=[ 7701], 20.00th=[ 9765], | 30.00th=[11863], 40.00th=[13566], 50.00th=[16450], 60.00th=[20579], | 70.00th=[25822], 80.00th=[31589], 90.00th=[39060], 95.00th=[47973], | 99.00th=[62129], 99.50th=[68682], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 191, max= 1056, per=22.90%, avg=408.96, stdev=180.88, samples=27 iops : min= 11, max= 66, avg=25.07, stdev=11.50, samples=27 lat (msec) : 4=0.65%, 10=27.99%, 20=38.80%, 50=30.08%, 100=2.47% cpu : usr=0.09%, sys=12.97%, ctx=1595, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183052: Fri Apr 10 11:33:41 2026 read: IOPS=27, BW=432KiB/s (443kB/s)(6032KiB/13955msec) clat (usec): min=3723, max=66037, avg=15224.34, stdev=10520.77 lat (usec): min=3724, max=66038, avg=15225.14, stdev=10520.63 clat percentiles (usec): | 1.00th=[ 4359], 5.00th=[ 4948], 10.00th=[ 5604], 20.00th=[ 7046], | 30.00th=[ 8848], 40.00th=[10421], 50.00th=[12125], 60.00th=[13698], | 70.00th=[15795], 80.00th=[22152], 90.00th=[30278], 95.00th=[36963], | 99.00th=[52691], 99.50th=[60556], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 223, max= 1248, per=24.80%, avg=420.89, stdev=234.41, samples=27 iops : min= 13, max= 78, avg=25.81, stdev=14.82, samples=27 write: IOPS=28, BW=448KiB/s (459kB/s)(6256KiB/13955msec); 0 zone resets clat (usec): min=4961, max=79585, avg=20834.27, stdev=13028.07 lat (usec): min=4963, max=79587, avg=20835.95, stdev=13028.19 clat percentiles (usec): | 1.00th=[ 5932], 5.00th=[ 6718], 10.00th=[ 7963], 20.00th=[10028], | 30.00th=[12125], 40.00th=[14353], 50.00th=[16909], 60.00th=[20317], | 70.00th=[24773], 80.00th=[31589], 90.00th=[40109], 95.00th=[46924], | 99.00th=[64750], 99.50th=[68682], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 287, max= 1216, per=24.68%, avg=440.85, stdev=200.72, samples=27 iops : min= 17, max= 76, avg=27.07, stdev=12.67, samples=27 lat (msec) : 4=0.26%, 10=28.13%, 20=39.32%, 50=29.82%, 100=2.47% cpu : usr=0.11%, sys=13.24%, ctx=1695, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1698KiB/s (1738kB/s), 407KiB/s-444KiB/s (417kB/s-455kB/s), io=23.4MiB (24.5MB), run=13955-14109msec WRITE: bw=1786KiB/s (1829kB/s), 428KiB/s-464KiB/s (439kB/s-475kB/s), io=24.6MiB (25.8MB), run=13955-14109msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183062: Fri Apr 10 11:33:49 2026 read: IOPS=2, BW=2972KiB/s (3043kB/s)(7168KiB/2412msec) clat (msec): min=99, max=747, avg=214.71, stdev=235.54 lat (msec): min=99, max=747, avg=214.71, stdev=235.54 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 136], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 148], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1946, max= 4096, per=47.30%, avg=2959.50, stdev=1166.52, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=2, BW=2123KiB/s (2174kB/s)(5120KiB/2412msec); 0 zone resets clat (msec): min=116, max=276, avg=177.76, stdev=59.91 lat (msec): min=116, max=276, avg=177.83, stdev=59.91 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1917, max= 5885, per=44.53%, avg=3901.00, stdev=2805.80, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=66.67%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=51.93%, ctx=1791, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183064: Fri Apr 10 11:33:49 2026 read: IOPS=0, BW=626KiB/s (641kB/s)(2048KiB/3273msec) clat (usec): min=652, max=106797, avg=53724.91, stdev=75056.40 lat (usec): min=653, max=106800, avg=53726.77, stdev=75057.32 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 652], | 30.00th=[ 652], 40.00th=[ 652], 50.00th=[ 652], 60.00th=[106431], | 70.00th=[106431], 80.00th=[106431], 90.00th=[106431], 95.00th=[106431], | 99.00th=[106431], 99.50th=[106431], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 1961, max= 1996, per=31.62%, avg=1978.50, stdev=24.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3129KiB/s (3204kB/s)(10.0MiB/3273msec); 0 zone resets clat (msec): min=124, max=802, avg=309.08, stdev=258.26 lat (msec): min=124, max=802, avg=309.15, stdev=258.24 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 130], | 30.00th=[ 144], 40.00th=[ 157], 50.00th=[ 159], 60.00th=[ 176], | 70.00th=[ 203], 80.00th=[ 502], 90.00th=[ 701], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2048, max= 6144, per=45.52%, avg=3987.50, stdev=1677.26, samples=4 iops : min= 2, max= 6, avg= 3.50, stdev= 1.73, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=36.09%, ctx=461, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183066: Fri Apr 10 11:33:49 2026 read: IOPS=2, BW=2299KiB/s (2355kB/s)(6144KiB/2672msec) clat (usec): min=388, max=184180, avg=80363.92, stdev=89899.33 lat (usec): min=389, max=184182, avg=80365.01, stdev=89899.47 clat percentiles (usec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 519], | 30.00th=[ 519], 40.00th=[ 586], 50.00th=[ 586], 60.00th=[123208], | 70.00th=[173016], 80.00th=[173016], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 2048, max= 7846, per=79.06%, avg=4947.00, stdev=4099.81, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2299KiB/s (2355kB/s)(6144KiB/2672msec); 0 zone resets clat (msec): min=65, max=1023, avg=354.55, stdev=338.24 lat (msec): min=65, max=1023, avg=354.61, stdev=338.25 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 279], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1917, max= 4096, per=34.26%, avg=3001.25, stdev=1227.00, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.04%, sys=30.21%, ctx=389, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183068: Fri Apr 10 11:33:49 2026 read: IOPS=1, BW=1780KiB/s (1822kB/s)(5120KiB/2877msec) clat (usec): min=498, max=222748, avg=110729.27, stdev=103920.68 lat (usec): min=500, max=222748, avg=110730.48, stdev=103920.56 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[149947], 60.00th=[149947], | 70.00th=[179307], 80.00th=[179307], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 3923, max= 4096, per=64.08%, avg=4009.50, stdev=122.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2491KiB/s (2551kB/s)(7168KiB/2877msec); 0 zone resets clat (msec): min=118, max=909, avg=326.40, stdev=279.46 lat (msec): min=118, max=909, avg=326.47, stdev=279.46 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 121], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 259], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 384], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1961, max= 3835, per=29.74%, avg=2605.00, stdev=1065.61, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=36.27%, ctx=470, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6257KiB/s (6407kB/s), 626KiB/s-2972KiB/s (641kB/s-3043kB/s), io=20.0MiB (20.0MB), run=2412-3273msec WRITE: bw=8760KiB/s (8970kB/s), 2123KiB/s-3129KiB/s (2174kB/s-3204kB/s), io=28.0MiB (29.4MB), run=2412-3273msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183061: Fri Apr 10 11:33:50 2026 read: IOPS=2, BW=2596KiB/s (2658kB/s)(7168KiB/2761msec) clat (msec): min=60, max=799, avg=217.71, stdev=258.37 lat (msec): min=60, max=799, avg=217.71, stdev=258.37 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 115], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 138], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 150], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1924, max= 3842, per=38.76%, avg=2371.40, stdev=823.59, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1854KiB/s (1899kB/s)(5120KiB/2761msec); 0 zone resets clat (msec): min=110, max=487, avg=240.98, stdev=149.29 lat (msec): min=111, max=487, avg=241.05, stdev=149.29 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1921, max= 6000, per=46.24%, avg=3960.50, stdev=2884.29, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=16.70%, ctx=110, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183063: Fri Apr 10 11:33:50 2026 read: IOPS=0, BW=612KiB/s (627kB/s)(2048KiB/3347msec) clat (usec): min=39343, max=99054, avg=69199.10, stdev=42221.94 lat (usec): min=39345, max=99055, avg=69200.30, stdev=42221.21 clat percentiles (usec): | 1.00th=[39584], 5.00th=[39584], 10.00th=[39584], 20.00th=[39584], | 30.00th=[39584], 40.00th=[39584], 50.00th=[39584], 60.00th=[99091], | 70.00th=[99091], 80.00th=[99091], 90.00th=[99091], 95.00th=[99091], | 99.00th=[99091], 99.50th=[99091], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 1950, max= 2048, per=32.67%, avg=1999.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=3059KiB/s (3133kB/s)(10.0MiB/3347msec); 0 zone resets clat (msec): min=59, max=947, avg=298.42, stdev=250.71 lat (msec): min=59, max=947, avg=298.50, stdev=250.72 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 128], | 30.00th=[ 146], 40.00th=[ 150], 50.00th=[ 251], 60.00th=[ 266], | 70.00th=[ 305], 80.00th=[ 359], 90.00th=[ 376], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2043, max= 4096, per=40.80%, avg=3495.25, stdev=973.81, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=22.77%, ctx=487, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183065: Fri Apr 10 11:33:50 2026 read: IOPS=1, BW=1924KiB/s (1970kB/s)(6144KiB/3194msec) clat (msec): min=38, max=389, avg=175.53, stdev=141.11 lat (msec): min=38, max=389, avg=175.53, stdev=141.11 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 77], 50.00th=[ 77], 60.00th=[ 224], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2000, max= 4096, per=54.15%, avg=3312.67, stdev=1143.87, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1924KiB/s (1970kB/s)(6144KiB/3194msec); 0 zone resets clat (msec): min=57, max=967, avg=349.22, stdev=373.39 lat (msec): min=57, max=967, avg=349.30, stdev=373.37 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 59], | 30.00th=[ 59], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 234], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2000, max= 3915, per=29.20%, avg=2501.50, stdev=942.58, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=12.75%, ctx=117, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183067: Fri Apr 10 11:33:50 2026 read: IOPS=1, BW=1848KiB/s (1893kB/s)(5120KiB/2770msec) clat (msec): min=57, max=470, avg=210.81, stdev=197.31 lat (msec): min=57, max=470, avg=210.81, stdev=197.31 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 87], 60.00th=[ 87], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 3842, max= 4000, per=64.09%, avg=3921.00, stdev=111.72, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2588KiB/s (2650kB/s)(7168KiB/2770msec); 0 zone resets clat (msec): min=39, max=869, avg=243.47, stdev=293.24 lat (msec): min=39, max=869, avg=243.55, stdev=293.23 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 54], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 138], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 321], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1928, max= 4096, per=29.38%, avg=2516.75, stdev=1053.90, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=16.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=15.13%, ctx=169, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6119KiB/s (6266kB/s), 612KiB/s-2596KiB/s (627kB/s-2658kB/s), io=20.0MiB (20.0MB), run=2761-3347msec WRITE: bw=8566KiB/s (8772kB/s), 1854KiB/s-3059KiB/s (1899kB/s-3133kB/s), io=28.0MiB (29.4MB), run=2761-3347msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183074: Fri Apr 10 11:33:57 2026 read: IOPS=2, BW=8982KiB/s (9198kB/s)(12.0MiB/1368msec) clat (msec): min=388, max=479, avg=437.66, stdev=45.60 lat (msec): min=388, max=479, avg=437.66, stdev=45.60 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7699, max= 8192, per=66.35%, avg=7945.50, stdev=348.60, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=52.23%, ctx=2363, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183075: Fri Apr 10 11:33:57 2026 read: IOPS=0, BW=3510KiB/s (3594kB/s)(4096KiB/1167msec) clat (nsec): min=443683k, max=443683k, avg=443683029.00, stdev= 0.00 lat (nsec): min=443684k, max=443684k, avg=443684210.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7699, max= 7699, per=64.29%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=7020KiB/s (7188kB/s)(8192KiB/1167msec); 0 zone resets clat (msec): min=292, max=374, avg=333.47, stdev=58.34 lat (msec): min=292, max=375, avg=333.75, stdev=58.36 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 8192, max= 8192, per=38.35%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.09%, sys=22.13%, ctx=686, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183076: Fri Apr 10 11:33:57 2026 write: IOPS=1, BW=8010KiB/s (8203kB/s)(12.0MiB/1534msec); 0 zone resets clat (msec): min=389, max=545, avg=492.48, stdev=89.12 lat (msec): min=389, max=545, avg=492.89, stdev=89.17 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min=16384, max=16384, per=76.70%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.13%, sys=31.38%, ctx=111, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183077: Fri Apr 10 11:33:57 2026 write: IOPS=2, BW=8943KiB/s (9158kB/s)(12.0MiB/1374msec); 0 zone resets clat (msec): min=140, max=986, avg=451.43, stdev=465.33 lat (msec): min=141, max=986, avg=452.03, stdev=465.03 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min=11702, max=11702, per=54.78%, avg=11702.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.04%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.7MiB/s (12.3MB/s), 3510KiB/s-8982KiB/s (3594kB/s-9198kB/s), io=16.0MiB (16.8MB), run=1167-1368msec WRITE: bw=20.9MiB/s (21.9MB/s), 7020KiB/s-8943KiB/s (7188kB/s-9158kB/s), io=32.0MiB (33.6MB), run=1167-1534msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183078: Fri Apr 10 11:33:57 2026 read: IOPS=1, BW=7398KiB/s (7576kB/s)(12.0MiB/1661msec) clat (msec): min=156, max=811, avg=547.78, stdev=345.83 lat (msec): min=156, max=811, avg=547.78, stdev=345.83 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8192, max= 8192, per=83.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=10.90%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183079: Fri Apr 10 11:33:57 2026 read: IOPS=0, BW=2465KiB/s (2524kB/s)(4096KiB/1662msec) clat (nsec): min=894076k, max=894076k, avg=894075972.00, stdev= 0.00 lat (nsec): min=894078k, max=894078k, avg=894078253.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=83.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4929KiB/s (5047kB/s)(8192KiB/1662msec); 0 zone resets clat (msec): min=106, max=625, avg=366.17, stdev=366.69 lat (msec): min=107, max=625, avg=366.46, stdev=366.69 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=12.10%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183080: Fri Apr 10 11:33:57 2026 write: IOPS=1, BW=7953KiB/s (8144kB/s)(12.0MiB/1545msec); 0 zone resets clat (msec): min=170, max=716, avg=510.33, stdev=296.90 lat (msec): min=170, max=716, avg=510.65, stdev=296.81 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 5475, max= 5475, per=27.77%, avg=5475.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.06%, sys=13.99%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183081: Fri Apr 10 11:33:57 2026 write: IOPS=2, BW=10.8MiB/s (11.3MB/s)(12.0MiB/1116msec); 0 zone resets clat (msec): min=124, max=818, avg=368.18, stdev=390.63 lat (msec): min=125, max=819, avg=368.49, stdev=390.59 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min=16062, max=16062, per=81.47%, avg=16062.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.09%, sys=20.09%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9858KiB/s (10.1MB/s), 2465KiB/s-7398KiB/s (2524kB/s-7576kB/s), io=16.0MiB (16.8MB), run=1661-1662msec WRITE: bw=19.3MiB/s (20.2MB/s), 4929KiB/s-10.8MiB/s (5047kB/s-11.3MB/s), io=32.0MiB (33.6MB), run=1116-1662msec