== sanity test 398b: DIO and buffer IO race ============== 13:33:58 (1772908438) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.54974 s, 19.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191425: Sat Mar 7 13:35:01 2026 read: IOPS=27, BW=110KiB/s (112kB/s)(5992KiB/54612msec) clat (usec): min=133, max=601872, avg=19685.48, stdev=18053.26 lat (usec): min=133, max=601874, avg=19685.98, stdev=18053.29 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 7767], 10.00th=[ 9241], 20.00th=[ 11207], | 30.00th=[ 13304], 40.00th=[ 15270], 50.00th=[ 17695], 60.00th=[ 20055], | 70.00th=[ 22676], 80.00th=[ 26346], 90.00th=[ 31589], 95.00th=[ 38011], | 99.00th=[ 49021], 99.50th=[ 54264], 99.90th=[107480], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 17, max= 192, per=25.04%, avg=109.68, stdev=31.66, samples=108 iops : min= 4, max= 48, avg=27.06, stdev= 7.96, samples=108 write: IOPS=28, BW=115KiB/s (118kB/s)(6296KiB/54612msec); 0 zone resets clat (usec): min=739, max=104463, avg=15941.57, stdev=12228.73 lat (usec): min=740, max=104463, avg=15942.17, stdev=12228.74 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 2704], 10.00th=[ 3359], 20.00th=[ 4490], | 30.00th=[ 7767], 40.00th=[ 10814], 50.00th=[ 13435], 60.00th=[ 16057], | 70.00th=[ 19530], 80.00th=[ 24773], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 53216], 99.50th=[ 60556], 99.90th=[ 67634], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 5, max= 207, per=25.16%, avg=115.46, stdev=34.03, samples=108 iops : min= 1, max= 51, avg=28.51, stdev= 8.53, samples=108 lat (usec) : 250=0.13%, 500=0.16%, 750=0.85%, 1000=0.72% lat (msec) : 2=1.01%, 4=6.80%, 10=15.82%, 20=40.07%, 50=33.07% lat (msec) : 100=1.27%, 250=0.07%, 750=0.03% cpu : usr=0.05%, sys=25.23%, ctx=9529, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191426: Sat Mar 7 13:35:01 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(5940KiB/54759msec) clat (usec): min=147, max=617772, avg=19789.39, stdev=18569.39 lat (usec): min=147, max=617773, avg=19789.96, stdev=18569.42 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 7963], 10.00th=[ 9241], 20.00th=[ 11076], | 30.00th=[ 12911], 40.00th=[ 15008], 50.00th=[ 17957], 60.00th=[ 20317], | 70.00th=[ 22938], 80.00th=[ 26608], 90.00th=[ 31589], 95.00th=[ 36963], | 99.00th=[ 55313], 99.50th=[ 65799], 99.90th=[ 73925], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 5, max= 200, per=24.78%, avg=108.52, stdev=32.78, samples=108 iops : min= 1, max= 50, avg=26.77, stdev= 8.24, samples=108 write: IOPS=28, BW=116KiB/s (119kB/s)(6348KiB/54759msec); 0 zone resets clat (usec): min=753, max=69340, avg=15964.02, stdev=12166.19 lat (usec): min=754, max=69341, avg=15964.64, stdev=12166.20 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 2343], 10.00th=[ 3228], 20.00th=[ 4228], | 30.00th=[ 7570], 40.00th=[10945], 50.00th=[13304], 60.00th=[16319], | 70.00th=[20317], 80.00th=[25560], 90.00th=[32900], 95.00th=[40109], | 99.00th=[53740], 99.50th=[61080], 99.90th=[66847], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 5, max= 207, per=25.21%, avg=115.70, stdev=34.78, samples=108 iops : min= 1, max= 51, avg=28.56, stdev= 8.74, samples=108 lat (usec) : 250=0.07%, 500=0.13%, 750=0.68%, 1000=0.81% lat (msec) : 2=1.24%, 4=7.94%, 10=14.49%, 20=38.90%, 50=33.98% lat (msec) : 100=1.73%, 750=0.03% cpu : usr=0.07%, sys=25.23%, ctx=9597, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191427: Sat Mar 7 13:35:01 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(6028KiB/54235msec) clat (usec): min=147, max=79877, avg=19151.10, stdev=10541.63 lat (usec): min=147, max=79877, avg=19153.29, stdev=10542.01 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 7570], 10.00th=[ 9372], 20.00th=[11207], | 30.00th=[13042], 40.00th=[15008], 50.00th=[17171], 60.00th=[19530], | 70.00th=[21890], 80.00th=[25297], 90.00th=[31327], 95.00th=[39060], | 99.00th=[57934], 99.50th=[63177], 99.90th=[78119], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 39, max= 192, per=25.71%, avg=112.61, stdev=30.84, samples=106 iops : min= 9, max= 48, avg=27.80, stdev= 7.75, samples=106 write: IOPS=28, BW=115KiB/s (118kB/s)(6260KiB/54235msec); 0 zone resets clat (usec): min=747, max=619175, avg=16189.93, stdev=19947.26 lat (usec): min=747, max=619176, avg=16190.88, stdev=19947.78 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 2474], 10.00th=[ 3195], 20.00th=[ 4047], | 30.00th=[ 6980], 40.00th=[ 10159], 50.00th=[ 12518], 60.00th=[ 15401], | 70.00th=[ 19792], 80.00th=[ 25560], 90.00th=[ 33424], 95.00th=[ 40109], | 99.00th=[ 58459], 99.50th=[ 69731], 99.90th=[ 83362], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 11, max= 191, per=25.21%, avg=115.69, stdev=35.84, samples=107 iops : min= 2, max= 47, avg=28.57, stdev= 9.02, samples=107 lat (usec) : 250=0.03%, 500=0.20%, 750=0.88%, 1000=0.85% lat (msec) : 2=1.07%, 4=8.43%, 10=14.94%, 20=40.04%, 50=31.41% lat (msec) : 100=2.12%, 750=0.03% cpu : usr=0.08%, sys=25.06%, ctx=9378, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191428: Sat Mar 7 13:35:01 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(6052KiB/54378msec) clat (usec): min=146, max=83949, avg=19535.44, stdev=10347.82 lat (usec): min=146, max=83949, avg=19536.01, stdev=10347.84 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 8094], 10.00th=[ 9503], 20.00th=[11338], | 30.00th=[13042], 40.00th=[15401], 50.00th=[17695], 60.00th=[20317], | 70.00th=[22938], 80.00th=[26084], 90.00th=[31851], 95.00th=[39060], | 99.00th=[56361], 99.50th=[60031], 99.90th=[69731], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 55, max= 168, per=25.70%, avg=112.55, stdev=26.14, samples=107 iops : min= 13, max= 42, avg=27.78, stdev= 6.60, samples=107 write: IOPS=28, BW=115KiB/s (117kB/s)(6236KiB/54378msec); 0 zone resets clat (usec): min=732, max=605475, avg=15891.98, stdev=19464.87 lat (usec): min=733, max=605476, avg=15892.58, stdev=19464.88 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 2802], 10.00th=[ 3359], 20.00th=[ 4228], | 30.00th=[ 6915], 40.00th=[ 10159], 50.00th=[ 12518], 60.00th=[ 15270], | 70.00th=[ 19792], 80.00th=[ 25035], 90.00th=[ 31589], 95.00th=[ 39060], | 99.00th=[ 55313], 99.50th=[ 65274], 99.90th=[112722], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 11, max= 200, per=24.99%, avg=114.71, stdev=34.17, samples=108 iops : min= 2, max= 50, avg=28.31, stdev= 8.57, samples=108 lat (usec) : 250=0.07%, 500=0.20%, 750=0.72%, 1000=0.81% lat (msec) : 2=0.85%, 4=7.94%, 10=15.53%, 20=38.18%, 50=33.95% lat (msec) : 100=1.69%, 250=0.03%, 750=0.03% cpu : usr=0.04%, sys=25.27%, ctx=9616, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=439KiB/s (449kB/s), 108KiB/s-111KiB/s (111kB/s-114kB/s), io=23.4MiB (24.6MB), run=54235-54759msec WRITE: bw=459KiB/s (470kB/s), 115KiB/s-116KiB/s (117kB/s-119kB/s), io=24.6MiB (25.7MB), run=54235-54759msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191420: Sat Mar 7 13:35:16 2026 read: IOPS=21, BW=85.5KiB/s (87.6kB/s)(5992KiB/70060msec) clat (msec): min=3, max=708, avg=20.77, stdev=22.22 lat (msec): min=3, max=708, avg=20.77, stdev=22.22 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 71], 99.50th=[ 75], 99.90th=[ 127], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 15, max= 232, per=24.97%, avg=85.38, stdev=43.10, samples=138 iops : min= 3, max= 58, avg=20.96, stdev=10.80, samples=138 write: IOPS=22, BW=89.9KiB/s (92.0kB/s)(6296KiB/70060msec); 0 zone resets clat (msec): min=4, max=129, avg=24.56, stdev=15.57 lat (msec): min=4, max=129, avg=24.56, stdev=15.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 55], | 99.00th=[ 81], 99.50th=[ 95], 99.90th=[ 113], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 8, max= 223, per=25.05%, avg=89.67, stdev=39.31, samples=138 iops : min= 2, max= 55, avg=22.03, stdev= 9.85, samples=138 lat (msec) : 4=0.13%, 10=13.18%, 20=42.81%, 50=38.61%, 100=5.01% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.06%, sys=15.69%, ctx=6927, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191421: Sat Mar 7 13:35:16 2026 read: IOPS=21, BW=84.9KiB/s (86.9kB/s)(5940KiB/69961msec) clat (msec): min=3, max=716, avg=20.78, stdev=22.74 lat (msec): min=3, max=716, avg=20.78, stdev=22.74 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 72], 99.50th=[ 82], 99.90th=[ 127], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8, max= 231, per=24.86%, avg=85.04, stdev=41.93, samples=138 iops : min= 2, max= 57, avg=20.87, stdev=10.48, samples=138 write: IOPS=22, BW=90.7KiB/s (92.9kB/s)(6348KiB/69961msec); 0 zone resets clat (msec): min=5, max=102, avg=24.44, stdev=14.98 lat (msec): min=5, max=102, avg=24.44, stdev=14.98 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 55], | 99.00th=[ 78], 99.50th=[ 87], 99.90th=[ 101], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 16, max= 216, per=25.36%, avg=90.78, stdev=40.56, samples=138 iops : min= 4, max= 54, avg=22.30, stdev=10.20, samples=138 lat (msec) : 4=0.03%, 10=12.60%, 20=43.72%, 50=38.15%, 100=5.40% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.07%, sys=15.73%, ctx=7111, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191422: Sat Mar 7 13:35:16 2026 read: IOPS=21, BW=86.3KiB/s (88.3kB/s)(6028KiB/69885msec) clat (msec): min=4, max=104, avg=20.13, stdev=13.02 lat (msec): min=4, max=104, avg=20.13, stdev=13.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 64], 99.50th=[ 73], 99.90th=[ 93], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 8, max= 256, per=25.31%, avg=86.54, stdev=41.04, samples=138 iops : min= 2, max= 64, avg=21.25, stdev=10.30, samples=138 write: IOPS=22, BW=89.6KiB/s (91.7kB/s)(6260KiB/69885msec); 0 zone resets clat (msec): min=6, max=721, avg=25.08, stdev=23.75 lat (msec): min=6, max=721, avg=25.08, stdev=23.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 56], | 99.00th=[ 85], 99.50th=[ 101], 99.90th=[ 124], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 15, max= 240, per=25.12%, avg=89.91, stdev=40.18, samples=138 iops : min= 3, max= 60, avg=22.09, stdev=10.07, samples=138 lat (msec) : 10=12.01%, 20=44.95%, 50=37.37%, 100=5.37%, 250=0.26% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=15.68%, ctx=7188, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191423: Sat Mar 7 13:35:16 2026 read: IOPS=21, BW=86.8KiB/s (88.8kB/s)(6052KiB/69749msec) clat (usec): min=3592, max=90019, avg=20256.57, stdev=12859.17 lat (usec): min=3592, max=90020, avg=20257.13, stdev=12859.14 clat percentiles (usec): | 1.00th=[ 6587], 5.00th=[ 8160], 10.00th=[ 8979], 20.00th=[10159], | 30.00th=[11600], 40.00th=[13435], 50.00th=[15795], 60.00th=[19006], | 70.00th=[22676], 80.00th=[28705], 90.00th=[39584], 95.00th=[46924], | 99.00th=[62653], 99.50th=[70779], 99.90th=[79168], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 8, max= 248, per=25.61%, avg=87.58, stdev=40.43, samples=136 iops : min= 2, max= 62, avg=21.50, stdev=10.13, samples=136 write: IOPS=22, BW=89.4KiB/s (91.6kB/s)(6236KiB/69749msec); 0 zone resets clat (msec): min=6, max=720, avg=24.89, stdev=23.05 lat (msec): min=6, max=720, avg=24.89, stdev=23.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 78], 99.50th=[ 91], 99.90th=[ 123], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 23, max= 223, per=25.07%, avg=89.74, stdev=38.01, samples=137 iops : min= 5, max= 55, avg=22.04, stdev= 9.53, samples=137 lat (msec) : 4=0.03%, 10=11.85%, 20=43.65%, 50=39.55%, 100=4.69% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.05%, sys=15.90%, ctx=6961, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=343KiB/s (351kB/s), 84.9KiB/s-86.8KiB/s (86.9kB/s-88.8kB/s), io=23.4MiB (24.6MB), run=69749-70060msec WRITE: bw=359KiB/s (367kB/s), 89.4KiB/s-90.7KiB/s (91.6kB/s-92.9kB/s), io=24.6MiB (25.7MB), run=69749-70060msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191458: Sat Mar 7 13:35:51 2026 read: IOPS=14, BW=228KiB/s (233kB/s)(5920KiB/25999msec) clat (usec): min=152, max=84135, avg=35247.29, stdev=14270.97 lat (usec): min=153, max=84136, avg=35247.93, stdev=14270.96 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[17433], 10.00th=[21103], 20.00th=[23987], | 30.00th=[26608], 40.00th=[30278], 50.00th=[33424], 60.00th=[36439], | 70.00th=[40633], 80.00th=[44827], 90.00th=[52167], 95.00th=[64226], | 99.00th=[77071], 99.50th=[83362], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 127, max= 381, per=24.64%, avg=225.96, stdev=60.02, samples=51 iops : min= 7, max= 23, avg=13.43, stdev= 3.78, samples=51 write: IOPS=15, BW=245KiB/s (251kB/s)(6368KiB/25999msec); 0 zone resets clat (usec): min=1331, max=131681, avg=32311.68, stdev=18256.14 lat (usec): min=1332, max=131681, avg=32312.80, stdev=18256.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 56], 95.00th=[ 69], | 99.00th=[ 86], 99.50th=[ 100], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 95, max= 448, per=25.40%, avg=245.14, stdev=73.06, samples=51 iops : min= 5, max= 28, avg=14.63, stdev= 4.66, samples=51 lat (usec) : 250=0.13%, 1000=0.13% lat (msec) : 2=1.04%, 4=0.13%, 10=3.26%, 20=13.93%, 50=67.58% lat (msec) : 100=13.67%, 250=0.13% cpu : usr=0.03%, sys=28.84%, ctx=3663, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191459: Sat Mar 7 13:35:51 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(5744KiB/25999msec) clat (usec): min=793, max=86688, avg=35784.80, stdev=14728.94 lat (usec): min=793, max=86689, avg=35785.41, stdev=14728.94 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[16909], 10.00th=[20055], 20.00th=[24511], | 30.00th=[26870], 40.00th=[30540], 50.00th=[33424], 60.00th=[36439], | 70.00th=[40633], 80.00th=[46400], 90.00th=[56361], 95.00th=[64750], | 99.00th=[79168], 99.50th=[85459], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 95, max= 384, per=24.10%, avg=221.00, stdev=72.10, samples=51 iops : min= 5, max= 24, avg=13.12, stdev= 4.58, samples=51 write: IOPS=15, BW=252KiB/s (258kB/s)(6544KiB/25999msec); 0 zone resets clat (msec): min=3, max=130, avg=31.83, stdev=17.13 lat (msec): min=3, max=130, avg=31.83, stdev=17.13 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 63], | 99.00th=[ 78], 99.50th=[ 91], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 95, max= 414, per=26.06%, avg=251.47, stdev=78.35, samples=51 iops : min= 5, max= 25, avg=15.02, stdev= 4.89, samples=51 lat (usec) : 1000=0.52% lat (msec) : 2=0.39%, 4=0.13%, 10=3.26%, 20=14.45%, 50=65.49% lat (msec) : 100=15.63%, 250=0.13% cpu : usr=0.05%, sys=29.32%, ctx=3703, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191460: Sat Mar 7 13:35:51 2026 read: IOPS=15, BW=241KiB/s (247kB/s)(6256KiB/25922msec) clat (usec): min=907, max=92591, avg=35745.25, stdev=15558.49 lat (usec): min=908, max=92591, avg=35746.09, stdev=15558.59 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[15795], 10.00th=[19006], 20.00th=[23200], | 30.00th=[27395], 40.00th=[31065], 50.00th=[34341], 60.00th=[38011], | 70.00th=[42206], 80.00th=[46400], 90.00th=[54789], 95.00th=[63177], | 99.00th=[86508], 99.50th=[92799], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 125, max= 383, per=26.45%, avg=242.55, stdev=65.15, samples=51 iops : min= 7, max= 23, avg=14.47, stdev= 4.05, samples=51 write: IOPS=14, BW=233KiB/s (238kB/s)(6032KiB/25922msec); 0 zone resets clat (usec): min=1262, max=95937, avg=31582.91, stdev=16531.43 lat (usec): min=1263, max=95942, avg=31584.12, stdev=16531.46 clat percentiles (usec): | 1.00th=[ 6456], 5.00th=[ 9634], 10.00th=[12649], 20.00th=[17171], | 30.00th=[21365], 40.00th=[25297], 50.00th=[28967], 60.00th=[32637], | 70.00th=[37487], 80.00th=[44303], 90.00th=[53216], 95.00th=[62129], | 99.00th=[82314], 99.50th=[93848], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 95, max= 384, per=24.02%, avg=231.76, stdev=71.75, samples=51 iops : min= 5, max= 24, avg=13.80, stdev= 4.55, samples=51 lat (usec) : 1000=0.78% lat (msec) : 2=1.04%, 4=0.26%, 10=2.60%, 20=14.32%, 50=66.93% lat (msec) : 100=14.06% cpu : usr=0.04%, sys=28.91%, ctx=3645, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191461: Sat Mar 7 13:35:51 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(6032KiB/26113msec) clat (usec): min=388, max=107583, avg=35618.03, stdev=16011.98 lat (usec): min=389, max=107583, avg=35619.20, stdev=16011.88 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 14484], 10.00th=[ 17433], 20.00th=[ 23725], | 30.00th=[ 27132], 40.00th=[ 30540], 50.00th=[ 33424], 60.00th=[ 37487], | 70.00th=[ 42206], 80.00th=[ 46924], 90.00th=[ 57410], 95.00th=[ 63701], | 99.00th=[ 86508], 99.50th=[101188], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 63, max= 352, per=24.87%, avg=228.06, stdev=63.77, samples=51 iops : min= 3, max= 22, avg=13.57, stdev= 4.06, samples=51 write: IOPS=14, BW=240KiB/s (245kB/s)(6256KiB/26113msec); 0 zone resets clat (msec): min=3, max=104, avg=32.05, stdev=17.22 lat (msec): min=3, max=104, avg=32.05, stdev=17.22 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 55], 95.00th=[ 63], | 99.00th=[ 86], 99.50th=[ 103], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 127, max= 480, per=24.60%, avg=237.41, stdev=76.21, samples=51 iops : min= 7, max= 30, avg=14.16, stdev= 4.81, samples=51 lat (usec) : 500=0.13%, 750=0.13%, 1000=0.26% lat (msec) : 2=0.78%, 4=0.26%, 10=2.99%, 20=15.76%, 50=65.10% lat (msec) : 100=13.93%, 250=0.65% cpu : usr=0.02%, sys=28.88%, ctx=3817, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=917KiB/s (939kB/s), 221KiB/s-241KiB/s (226kB/s-247kB/s), io=23.4MiB (24.5MB), run=25922-26113msec WRITE: bw=965KiB/s (988kB/s), 233KiB/s-252KiB/s (238kB/s-258kB/s), io=24.6MiB (25.8MB), run=25922-26113msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191453: Sat Mar 7 13:35:52 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(5920KiB/27086msec) clat (msec): min=5, max=109, avg=31.91, stdev=19.84 lat (msec): min=5, max=109, avg=31.91, stdev=19.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 63], 95.00th=[ 69], | 99.00th=[ 94], 99.50th=[ 102], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 95, max= 704, per=23.77%, avg=209.21, stdev=92.45, samples=53 iops : min= 5, max= 44, avg=12.51, stdev= 5.89, samples=53 write: IOPS=14, BW=235KiB/s (241kB/s)(6368KiB/27086msec); 0 zone resets clat (msec): min=6, max=122, avg=38.20, stdev=21.83 lat (msec): min=6, max=122, avg=38.21, stdev=21.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 56], 90.00th=[ 70], 95.00th=[ 83], | 99.00th=[ 103], 99.50th=[ 107], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 95, max= 736, per=24.54%, avg=227.26, stdev=90.29, samples=53 iops : min= 5, max= 46, avg=13.64, stdev= 5.75, samples=53 lat (msec) : 10=5.73%, 20=20.44%, 50=50.65%, 100=22.27%, 250=0.91% cpu : usr=0.04%, sys=16.74%, ctx=2406, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191454: Sat Mar 7 13:35:52 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(5744KiB/27192msec) clat (msec): min=3, max=117, avg=33.74, stdev=21.42 lat (msec): min=3, max=117, avg=33.74, stdev=21.42 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 67], 95.00th=[ 74], | 99.00th=[ 104], 99.50th=[ 107], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 63, max= 672, per=22.83%, avg=200.89, stdev=90.27, samples=53 iops : min= 3, max= 42, avg=12.00, stdev= 5.70, samples=53 write: IOPS=15, BW=241KiB/s (246kB/s)(6544KiB/27192msec); 0 zone resets clat (msec): min=5, max=133, avg=36.66, stdev=21.93 lat (msec): min=5, max=133, avg=36.67, stdev=21.93 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 13], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 64], 95.00th=[ 75], | 99.00th=[ 110], 99.50th=[ 125], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 126, max= 768, per=24.43%, avg=226.21, stdev=99.74, samples=53 iops : min= 7, max= 48, avg=13.58, stdev= 6.36, samples=53 lat (msec) : 4=0.91%, 10=5.60%, 20=19.92%, 50=52.73%, 100=18.75% lat (msec) : 250=2.08% cpu : usr=0.04%, sys=16.40%, ctx=2404, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191455: Sat Mar 7 13:35:52 2026 read: IOPS=14, BW=231KiB/s (236kB/s)(6256KiB/27110msec) clat (msec): min=5, max=112, avg=32.18, stdev=19.52 lat (msec): min=5, max=112, avg=32.18, stdev=19.52 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 10], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 58], 95.00th=[ 70], | 99.00th=[ 105], 99.50th=[ 108], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 63, max= 864, per=25.62%, avg=225.42, stdev=112.30, samples=53 iops : min= 3, max= 54, avg=13.53, stdev= 7.10, samples=53 write: IOPS=13, BW=223KiB/s (228kB/s)(6032KiB/27110msec); 0 zone resets clat (msec): min=7, max=136, avg=38.39, stdev=21.74 lat (msec): min=7, max=136, avg=38.39, stdev=21.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 47], 80.00th=[ 56], 90.00th=[ 68], 95.00th=[ 82], | 99.00th=[ 106], 99.50th=[ 126], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 95, max= 512, per=22.81%, avg=211.23, stdev=72.00, samples=53 iops : min= 5, max= 32, avg=12.64, stdev= 4.62, samples=53 lat (msec) : 10=5.21%, 20=21.48%, 50=51.30%, 100=20.70%, 250=1.30% cpu : usr=0.05%, sys=16.75%, ctx=2412, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191456: Sat Mar 7 13:35:52 2026 read: IOPS=13, BW=223KiB/s (229kB/s)(6032KiB/27021msec) clat (msec): min=6, max=108, avg=31.87, stdev=20.56 lat (msec): min=6, max=108, avg=31.87, stdev=20.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 67], 95.00th=[ 79], | 99.00th=[ 96], 99.50th=[ 100], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 63, max= 704, per=24.58%, avg=216.32, stdev=101.51, samples=53 iops : min= 3, max= 44, avg=12.96, stdev= 6.40, samples=53 write: IOPS=14, BW=232KiB/s (237kB/s)(6256KiB/27021msec); 0 zone resets clat (msec): min=8, max=124, avg=38.31, stdev=19.91 lat (msec): min=8, max=124, avg=38.31, stdev=19.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 67], 95.00th=[ 74], | 99.00th=[ 94], 99.50th=[ 103], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 63, max= 704, per=24.39%, avg=225.87, stdev=88.59, samples=53 iops : min= 3, max= 44, avg=13.57, stdev= 5.63, samples=53 lat (msec) : 10=4.82%, 20=20.83%, 50=52.73%, 100=21.22%, 250=0.39% cpu : usr=0.03%, sys=16.64%, ctx=2347, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=881KiB/s (902kB/s), 211KiB/s-231KiB/s (216kB/s-236kB/s), io=23.4MiB (24.5MB), run=27021-27192msec WRITE: bw=927KiB/s (949kB/s), 223KiB/s-241KiB/s (228kB/s-246kB/s), io=24.6MiB (25.8MB), run=27021-27192msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191470: Sat Mar 7 13:36:03 2026 read: IOPS=2, BW=2444KiB/s (2503kB/s)(7168KiB/2933msec) clat (msec): min=60, max=508, avg=178.10, stdev=166.28 lat (msec): min=60, max=508, avg=178.10, stdev=166.28 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 66], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 110], 60.00th=[ 112], | 70.00th=[ 112], 80.00th=[ 296], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1692, max= 4079, per=53.88%, avg=3223.67, stdev=1329.48, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1746KiB/s (1788kB/s)(5120KiB/2933msec); 0 zone resets clat (msec): min=88, max=663, avg=329.76, stdev=209.52 lat (msec): min=89, max=663, avg=329.82, stdev=209.53 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1950, max= 4047, per=31.98%, avg=2678.67, stdev=1185.85, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=16.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=14.67%, ctx=114, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191471: Sat Mar 7 13:36:03 2026 read: IOPS=0, BW=609KiB/s (623kB/s)(2048KiB/3364msec) clat (msec): min=79, max=248, avg=164.25, stdev=119.37 lat (msec): min=79, max=248, avg=164.25, stdev=119.37 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 81], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 1692, max= 1950, per=30.44%, avg=1821.00, stdev=182.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3044KiB/s (3117kB/s)(10.0MiB/3364msec); 0 zone resets clat (msec): min=64, max=579, avg=299.10, stdev=177.66 lat (msec): min=64, max=579, avg=299.17, stdev=177.65 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 126], | 30.00th=[ 132], 40.00th=[ 136], 50.00th=[ 288], 60.00th=[ 363], | 70.00th=[ 401], 80.00th=[ 414], 90.00th=[ 498], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1692, max= 6144, per=35.67%, avg=2987.83, stdev=1774.23, samples=6 iops : min= 1, max= 6, avg= 2.17, stdev= 2.04, samples=6 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=18.14%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191472: Sat Mar 7 13:36:03 2026 read: IOPS=1, BW=1825KiB/s (1869kB/s)(6144KiB/3366msec) clat (msec): min=70, max=541, avg=225.14, stdev=173.13 lat (msec): min=70, max=541, avg=225.14, stdev=173.13 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 199], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1950, max= 4047, per=42.14%, avg=2521.00, stdev=1018.29, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1825KiB/s (1869kB/s)(6144KiB/3366msec); 0 zone resets clat (msec): min=90, max=537, avg=326.81, stdev=165.50 lat (msec): min=90, max=537, avg=326.87, stdev=165.50 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 426], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1950, max= 3401, per=28.17%, avg=2359.50, stdev=695.74, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=18.42%, ctx=231, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191473: Sat Mar 7 13:36:03 2026 read: IOPS=1, BW=1496KiB/s (1532kB/s)(5120KiB/3423msec) clat (msec): min=59, max=609, avg=254.40, stdev=218.34 lat (msec): min=59, max=609, avg=254.41, stdev=218.34 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1950, max= 4096, per=44.96%, avg=2689.67, stdev=1218.47, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2094KiB/s (2144kB/s)(7168KiB/3423msec); 0 zone resets clat (msec): min=63, max=709, avg=304.42, stdev=239.17 lat (msec): min=63, max=709, avg=304.51, stdev=239.17 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 83], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 330], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 477], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1950, max= 4096, per=34.30%, avg=2873.00, stdev=1053.31, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=22.82%, ctx=371, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5983KiB/s (6127kB/s), 609KiB/s-2444KiB/s (623kB/s-2503kB/s), io=20.0MiB (20.0MB), run=2933-3423msec WRITE: bw=8376KiB/s (8577kB/s), 1746KiB/s-3044KiB/s (1788kB/s-3117kB/s), io=28.0MiB (29.4MB), run=2933-3423msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191474: Sat Mar 7 13:36:03 2026 read: IOPS=3, BW=3604KiB/s (3690kB/s)(7168KiB/1989msec) clat (usec): min=897, max=199588, avg=131465.68, stdev=63890.66 lat (usec): min=899, max=199588, avg=131466.81, stdev=63890.65 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[112722], | 30.00th=[133694], 40.00th=[133694], 50.00th=[141558], 60.00th=[162530], | 70.00th=[162530], 80.00th=[166724], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 1992, max= 5260, per=63.17%, avg=3758.33, stdev=1650.00, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2574KiB/s (2636kB/s)(5120KiB/1989msec); 0 zone resets clat (msec): min=137, max=377, avg=206.25, stdev=99.69 lat (msec): min=137, max=377, avg=206.30, stdev=99.67 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2011, max= 5976, per=47.94%, avg=3993.50, stdev=2803.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 1000=8.33% lat (msec) : 250=83.33%, 500=8.33% cpu : usr=0.10%, sys=62.27%, ctx=1050, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191475: Sat Mar 7 13:36:03 2026 read: IOPS=0, BW=595KiB/s (609kB/s)(2048KiB/3442msec) clat (usec): min=972, max=136087, avg=68530.15, stdev=95541.01 lat (usec): min=973, max=136089, avg=68531.26, stdev=95541.27 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 971], 10.00th=[ 971], 20.00th=[ 971], | 30.00th=[ 971], 40.00th=[ 971], 50.00th=[ 971], 60.00th=[135267], | 70.00th=[135267], 80.00th=[135267], 90.00th=[135267], 95.00th=[135267], | 99.00th=[135267], 99.50th=[135267], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 1753, max= 2011, per=31.63%, avg=1882.00, stdev=182.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2975KiB/s (3046kB/s)(10.0MiB/3442msec); 0 zone resets clat (msec): min=43, max=585, avg=320.84, stdev=184.51 lat (msec): min=43, max=586, avg=320.89, stdev=184.51 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 126], | 30.00th=[ 194], 40.00th=[ 226], 50.00th=[ 257], 60.00th=[ 338], | 70.00th=[ 405], 80.00th=[ 456], 90.00th=[ 575], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1992, max= 4023, per=33.88%, avg=2822.60, stdev=1095.99, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (usec) : 1000=8.33% lat (msec) : 50=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=46.12%, ctx=163, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191476: Sat Mar 7 13:36:03 2026 read: IOPS=2, BW=2458KiB/s (2517kB/s)(6144KiB/2500msec) clat (usec): min=896, max=445355, avg=132938.97, stdev=174559.45 lat (usec): min=897, max=445355, avg=132939.67, stdev=174559.41 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 938], | 30.00th=[ 938], 40.00th=[ 4113], 50.00th=[ 4113], 60.00th=[168821], | 70.00th=[179307], 80.00th=[179307], 90.00th=[446694], 95.00th=[446694], | 99.00th=[446694], 99.50th=[446694], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 3984, max= 4023, per=67.29%, avg=4003.50, stdev=27.58, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2458KiB/s (2517kB/s)(6144KiB/2500msec); 0 zone resets clat (msec): min=168, max=605, avg=268.14, stdev=167.69 lat (msec): min=168, max=605, avg=268.19, stdev=167.70 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 220], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1992, max= 4023, per=37.98%, avg=3164.00, stdev=1051.06, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 1000=16.67% lat (msec) : 10=8.33%, 250=58.33%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=44.86%, ctx=371, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191477: Sat Mar 7 13:36:03 2026 read: IOPS=2, BW=2116KiB/s (2166kB/s)(5120KiB/2420msec) clat (usec): min=808, max=175613, avg=35858.68, stdev=78125.54 lat (usec): min=808, max=175614, avg=35859.30, stdev=78125.41 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 807], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[ 963], 60.00th=[ 963], | 70.00th=[ 1037], 80.00th=[ 1037], 90.00th=[175113], 95.00th=[175113], | 99.00th=[175113], 99.50th=[175113], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2962KiB/s (3033kB/s)(7168KiB/2420msec); 0 zone resets clat (msec): min=173, max=466, avg=309.70, stdev=99.27 lat (msec): min=173, max=466, avg=309.76, stdev=99.27 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 209], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 334], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 372], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1753, max= 4023, per=29.35%, avg=2444.75, stdev=1058.70, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=25.00% lat (msec) : 2=8.33%, 250=25.00%, 500=41.67% cpu : usr=0.08%, sys=44.73%, ctx=167, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5950KiB/s (6093kB/s), 595KiB/s-3604KiB/s (609kB/s-3690kB/s), io=20.0MiB (20.0MB), run=1989-3442msec WRITE: bw=8330KiB/s (8530kB/s), 2458KiB/s-2975KiB/s (2517kB/s-3046kB/s), io=28.0MiB (29.4MB), run=1989-3442msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191483: Sat Mar 7 13:36:12 2026 read: IOPS=2, BW=9.78MiB/s (10.3MB/s)(12.0MiB/1227msec) clat (msec): min=182, max=710, avg=381.76, stdev=286.46 lat (msec): min=182, max=710, avg=381.76, stdev=286.46 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min=15633, max=15633, per=100.00%, avg=15633.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=23.57%, ctx=203, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191484: Sat Mar 7 13:36:12 2026 read: IOPS=0, BW=2037KiB/s (2086kB/s)(4096KiB/2011msec) clat (nsec): min=926993k, max=926993k, avg=926993122.00, stdev= 0.00 lat (nsec): min=926995k, max=926995k, avg=926994502.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4074KiB/s (4171kB/s)(8192KiB/2011msec); 0 zone resets clat (msec): min=374, max=613, avg=494.27, stdev=169.08 lat (msec): min=374, max=614, avg=494.55, stdev=169.10 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.02%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191485: Sat Mar 7 13:36:12 2026 write: IOPS=1, BW=6116KiB/s (6263kB/s)(12.0MiB/2009msec); 0 zone resets clat (msec): min=130, max=1407, avg=636.96, stdev=677.98 lat (msec): min=130, max=1407, avg=638.63, stdev=677.38 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7876, max= 7876, per=48.34%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.10%, sys=19.07%, ctx=97, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191486: Sat Mar 7 13:36:12 2026 write: IOPS=1, BW=7288KiB/s (7463kB/s)(12.0MiB/1686msec); 0 zone resets clat (msec): min=335, max=838, avg=534.63, stdev=267.64 lat (msec): min=335, max=839, avg=534.98, stdev=267.54 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7816, max= 8159, per=49.02%, avg=7987.50, stdev=242.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.16%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8147KiB/s (8343kB/s), 2037KiB/s-9.78MiB/s (2086kB/s-10.3MB/s), io=16.0MiB (16.8MB), run=1227-2011msec WRITE: bw=15.9MiB/s (16.7MB/s), 4074KiB/s-7288KiB/s (4171kB/s-7463kB/s), io=32.0MiB (33.6MB), run=1686-2011msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191488: Sat Mar 7 13:36:12 2026 read: IOPS=2, BW=9729KiB/s (9963kB/s)(12.0MiB/1263msec) clat (msec): min=397, max=437, avg=416.17, stdev=20.37 lat (msec): min=397, max=437, avg=416.17, stdev=20.37 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 8078, max= 8192, per=97.47%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=65.29%, ctx=2899, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191489: Sat Mar 7 13:36:12 2026 read: IOPS=0, BW=2087KiB/s (2137kB/s)(4096KiB/1963msec) clat (nsec): min=417777k, max=417777k, avg=417776869.00, stdev= 0.00 lat (nsec): min=417778k, max=417778k, avg=417777929.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 8159, max= 8159, per=97.76%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4173KiB/s (4273kB/s)(8192KiB/1963msec); 0 zone resets clat (msec): min=409, max=1108, avg=758.74, stdev=494.29 lat (msec): min=409, max=1108, avg=759.07, stdev=494.32 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.10%, sys=7.70%, ctx=902, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191490: Sat Mar 7 13:36:12 2026 write: IOPS=1, BW=7010KiB/s (7178kB/s)(12.0MiB/1753msec); 0 zone resets clat (msec): min=169, max=1337, avg=579.12, stdev=657.54 lat (msec): min=170, max=1337, avg=579.40, stdev=657.54 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8062, max= 8062, per=48.30%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.06%, sys=15.92%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191491: Sat Mar 7 13:36:12 2026 write: IOPS=1, BW=6884KiB/s (7049kB/s)(12.0MiB/1785msec); 0 zone resets clat (msec): min=424, max=723, avg=582.16, stdev=149.89 lat (msec): min=425, max=723, avg=582.39, stdev=149.92 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8062, max= 8192, per=48.69%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=17.43%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8346KiB/s (8547kB/s), 2087KiB/s-9729KiB/s (2137kB/s-9963kB/s), io=16.0MiB (16.8MB), run=1263-1963msec WRITE: bw=16.3MiB/s (17.1MB/s), 4173KiB/s-7010KiB/s (4273kB/s-7178kB/s), io=32.0MiB (33.6MB), run=1753-1963msec