== sanity test 398b: DIO and buffer IO race ============== 21:34:49 (1788917689) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.73887 s, 18.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183289: Tue Sep 8 21:35:41 2026 read: IOPS=34, BW=140KiB/s (143kB/s)(5992KiB/42815msec) clat (usec): min=45, max=651809, avg=15406.96, stdev=18120.53 lat (usec): min=45, max=651810, avg=15407.64, stdev=18120.53 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 6587], 10.00th=[ 7635], 20.00th=[ 9110], | 30.00th=[ 10421], 40.00th=[ 11863], 50.00th=[ 13566], 60.00th=[ 15401], | 70.00th=[ 17957], 80.00th=[ 20055], 90.00th=[ 23462], 95.00th=[ 27657], | 99.00th=[ 45351], 99.50th=[ 47973], 99.90th=[ 58983], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 15, max= 223, per=25.14%, avg=139.55, stdev=32.76, samples=85 iops : min= 3, max= 55, avg=34.53, stdev= 8.19, samples=85 write: IOPS=36, BW=147KiB/s (151kB/s)(6296KiB/42815msec); 0 zone resets clat (usec): min=651, max=65813, avg=12423.53, stdev=9578.15 lat (usec): min=652, max=65814, avg=12424.97, stdev=9578.93 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 2180], 10.00th=[ 2573], 20.00th=[ 3097], | 30.00th=[ 5014], 40.00th=[ 8586], 50.00th=[10421], 60.00th=[12518], | 70.00th=[16319], 80.00th=[20579], 90.00th=[25822], 95.00th=[30540], | 99.00th=[40633], 99.50th=[45876], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 63, max= 239, per=25.57%, avg=148.56, stdev=34.87, samples=84 iops : min= 15, max= 59, avg=36.79, stdev= 8.71, samples=84 lat (usec) : 50=0.07%, 100=0.42%, 250=0.52%, 750=0.13%, 1000=0.33% lat (msec) : 2=1.56%, 4=11.75%, 10=22.72%, 20=42.06%, 50=20.15% lat (msec) : 100=0.26%, 750=0.03% cpu : usr=0.15%, sys=24.59%, ctx=8511, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183292: Tue Sep 8 21:35:41 2026 read: IOPS=34, BW=138KiB/s (141kB/s)(5940KiB/43197msec) clat (usec): min=69, max=68941, avg=15002.19, stdev=7600.15 lat (usec): min=70, max=68941, avg=15003.37, stdev=7599.12 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 6652], 10.00th=[ 7767], 20.00th=[ 8979], | 30.00th=[10421], 40.00th=[11600], 50.00th=[13566], 60.00th=[15664], | 70.00th=[17957], 80.00th=[20055], 90.00th=[23462], 95.00th=[26870], | 99.00th=[42730], 99.50th=[46924], 99.90th=[66847], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 7, max= 208, per=24.70%, avg=137.09, stdev=32.29, samples=86 iops : min= 1, max= 52, avg=33.92, stdev= 8.10, samples=86 write: IOPS=36, BW=147KiB/s (150kB/s)(6348KiB/43197msec); 0 zone resets clat (usec): min=727, max=634345, avg=13069.83, stdev=18426.51 lat (usec): min=728, max=634345, avg=13070.64, stdev=18426.50 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2147], 10.00th=[ 2606], 20.00th=[ 3261], | 30.00th=[ 5342], 40.00th=[ 8979], 50.00th=[ 10683], 60.00th=[ 12780], | 70.00th=[ 15926], 80.00th=[ 20317], 90.00th=[ 27132], 95.00th=[ 31851], | 99.00th=[ 41157], 99.50th=[ 44303], 99.90th=[ 79168], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 264, per=25.15%, avg=146.12, stdev=38.12, samples=86 iops : min= 1, max= 66, avg=36.17, stdev= 9.53, samples=86 lat (usec) : 100=0.16%, 250=0.52%, 500=0.03%, 750=0.07%, 1000=0.23% lat (msec) : 2=1.92%, 4=10.97%, 10=23.27%, 20=42.22%, 50=20.35% lat (msec) : 100=0.23%, 750=0.03% cpu : usr=0.14%, sys=24.32%, ctx=8640, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183294: Tue Sep 8 21:35:41 2026 read: IOPS=34, BW=140KiB/s (143kB/s)(6028KiB/43141msec) clat (usec): min=51, max=56211, avg=15152.14, stdev=7780.56 lat (usec): min=51, max=56212, avg=15152.98, stdev=7780.58 clat percentiles (usec): | 1.00th=[ 91], 5.00th=[ 6521], 10.00th=[ 7701], 20.00th=[ 8979], | 30.00th=[10421], 40.00th=[11863], 50.00th=[13698], 60.00th=[15664], | 70.00th=[17957], 80.00th=[20579], 90.00th=[24511], 95.00th=[29754], | 99.00th=[41157], 99.50th=[45876], 99.90th=[52691], 99.95th=[56361], | 99.99th=[56361] bw ( KiB/s): min= 56, max= 232, per=25.45%, avg=141.26, stdev=30.79, samples=85 iops : min= 14, max= 58, avg=34.96, stdev= 7.68, samples=85 write: IOPS=36, BW=145KiB/s (149kB/s)(6260KiB/43141msec); 0 zone resets clat (usec): min=678, max=651761, avg=12859.69, stdev=18835.16 lat (usec): min=679, max=651762, avg=12860.57, stdev=18835.18 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2089], 10.00th=[ 2573], 20.00th=[ 3130], | 30.00th=[ 4948], 40.00th=[ 8225], 50.00th=[ 10290], 60.00th=[ 12780], | 70.00th=[ 16188], 80.00th=[ 20317], 90.00th=[ 26084], 95.00th=[ 30540], | 99.00th=[ 42206], 99.50th=[ 49021], 99.90th=[ 71828], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 64, max= 240, per=25.24%, avg=146.64, stdev=32.23, samples=85 iops : min= 16, max= 60, avg=36.31, stdev= 8.08, samples=85 lat (usec) : 100=0.75%, 250=0.49%, 750=0.07%, 1000=0.13% lat (msec) : 2=1.92%, 4=11.30%, 10=23.50%, 20=40.59%, 50=20.90% lat (msec) : 100=0.33%, 750=0.03% cpu : usr=0.14%, sys=24.10%, ctx=8568, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183295: Tue Sep 8 21:35:41 2026 read: IOPS=35, BW=140KiB/s (144kB/s)(6052KiB/43086msec) clat (usec): min=48, max=69385, avg=15148.21, stdev=7450.59 lat (usec): min=48, max=69386, avg=15148.89, stdev=7450.71 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 6915], 10.00th=[ 7963], 20.00th=[ 9372], | 30.00th=[10552], 40.00th=[11863], 50.00th=[13829], 60.00th=[15664], | 70.00th=[17957], 80.00th=[20317], 90.00th=[23987], 95.00th=[27395], | 99.00th=[40633], 99.50th=[47449], 99.90th=[58983], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 48, max= 208, per=25.45%, avg=141.23, stdev=30.63, samples=84 iops : min= 12, max= 52, avg=34.95, stdev= 7.64, samples=84 write: IOPS=36, BW=145KiB/s (148kB/s)(6236KiB/43086msec); 0 zone resets clat (usec): min=622, max=645503, avg=12820.82, stdev=18663.97 lat (usec): min=623, max=645504, avg=12821.62, stdev=18663.98 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 2089], 10.00th=[ 2573], 20.00th=[ 3228], | 30.00th=[ 5342], 40.00th=[ 8848], 50.00th=[ 10552], 60.00th=[ 12387], | 70.00th=[ 15401], 80.00th=[ 19792], 90.00th=[ 25822], 95.00th=[ 31327], | 99.00th=[ 41681], 99.50th=[ 46400], 99.90th=[ 66847], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 56, max= 224, per=25.13%, avg=145.99, stdev=31.24, samples=84 iops : min= 14, max= 56, avg=36.14, stdev= 7.81, samples=84 lat (usec) : 50=0.03%, 100=0.49%, 250=0.42%, 750=0.13%, 1000=0.33% lat (msec) : 2=1.89%, 4=11.07%, 10=21.22%, 20=44.14%, 50=19.92% lat (msec) : 100=0.33%, 750=0.03% cpu : usr=0.12%, sys=24.37%, ctx=8601, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=556KiB/s (569kB/s), 138KiB/s-140KiB/s (141kB/s-144kB/s), io=23.4MiB (24.6MB), run=42815-43197msec WRITE: bw=582KiB/s (596kB/s), 145KiB/s-147KiB/s (148kB/s-151kB/s), io=24.6MiB (25.7MB), run=42815-43197msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183290: Tue Sep 8 21:35:48 2026 read: IOPS=29, BW=120KiB/s (123kB/s)(5992KiB/50008msec) clat (msec): min=2, max=655, avg=14.45, stdev=20.08 lat (msec): min=2, max=655, avg=14.45, stdev=20.08 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 39], | 99.00th=[ 53], 99.50th=[ 59], 99.90th=[ 85], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 48, max= 416, per=25.15%, avg=120.47, stdev=81.06, samples=98 iops : min= 12, max= 104, avg=29.86, stdev=20.34, samples=98 write: IOPS=31, BW=126KiB/s (129kB/s)(6296KiB/50008msec); 0 zone resets clat (usec): min=4292, max=92559, avg=17911.00, stdev=12127.84 lat (usec): min=4293, max=92559, avg=17911.75, stdev=12127.87 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 5669], 10.00th=[ 6194], 20.00th=[ 7242], | 30.00th=[ 8586], 40.00th=[11469], 50.00th=[14484], 60.00th=[17957], | 70.00th=[22676], 80.00th=[27919], 90.00th=[34866], 95.00th=[40633], | 99.00th=[55313], 99.50th=[60031], 99.90th=[81265], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 40, max= 408, per=25.14%, avg=126.18, stdev=82.49, samples=98 iops : min= 10, max= 102, avg=31.29, stdev=20.72, samples=98 lat (msec) : 4=2.93%, 10=39.03%, 20=29.46%, 50=26.82%, 100=1.73% lat (msec) : 750=0.03% cpu : usr=0.11%, sys=11.03%, ctx=5096, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183291: Tue Sep 8 21:35:48 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(5940KiB/49940msec) clat (msec): min=2, max=640, avg=14.36, stdev=20.08 lat (msec): min=2, max=640, avg=14.36, stdev=20.08 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 39], | 99.00th=[ 57], 99.50th=[ 64], 99.90th=[ 82], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 16, max= 440, per=24.96%, avg=119.57, stdev=87.43, samples=98 iops : min= 4, max= 110, avg=29.63, stdev=21.96, samples=98 write: IOPS=31, BW=127KiB/s (130kB/s)(6348KiB/49940msec); 0 zone resets clat (usec): min=4096, max=96198, avg=17919.83, stdev=12442.39 lat (usec): min=4097, max=96198, avg=17920.63, stdev=12442.43 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 5473], 10.00th=[ 6128], 20.00th=[ 7177], | 30.00th=[ 8455], 40.00th=[11207], 50.00th=[14091], 60.00th=[18220], | 70.00th=[21890], 80.00th=[28181], 90.00th=[35914], 95.00th=[40633], | 99.00th=[56361], 99.50th=[66323], 99.90th=[78119], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 55, max= 400, per=25.36%, avg=127.32, stdev=83.51, samples=98 iops : min= 13, max= 100, avg=31.57, stdev=20.98, samples=98 lat (msec) : 4=3.81%, 10=39.84%, 20=27.60%, 50=26.82%, 100=1.89% lat (msec) : 750=0.03% cpu : usr=0.13%, sys=10.71%, ctx=5039, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183293: Tue Sep 8 21:35:48 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6028KiB/49909msec) clat (usec): min=2383, max=89111, avg=13741.26, stdev=11595.03 lat (usec): min=2383, max=89112, avg=13741.86, stdev=11595.04 clat percentiles (usec): | 1.00th=[ 3097], 5.00th=[ 3818], 10.00th=[ 4228], 20.00th=[ 4817], | 30.00th=[ 6194], 40.00th=[ 8455], 50.00th=[10028], 60.00th=[11731], | 70.00th=[14746], 80.00th=[20055], 90.00th=[30540], 95.00th=[37487], | 99.00th=[53740], 99.50th=[62653], 99.90th=[85459], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 40, max= 440, per=25.39%, avg=121.61, stdev=84.40, samples=98 iops : min= 10, max= 110, avg=30.14, stdev=21.19, samples=98 write: IOPS=31, BW=125KiB/s (128kB/s)(6260KiB/49909msec); 0 zone resets clat (msec): min=4, max=644, avg=18.55, stdev=20.19 lat (msec): min=4, max=644, avg=18.55, stdev=20.19 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 36], 95.00th=[ 43], | 99.00th=[ 58], 99.50th=[ 74], 99.90th=[ 82], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 47, max= 384, per=25.09%, avg=125.94, stdev=82.85, samples=98 iops : min= 11, max= 96, avg=31.22, stdev=20.81, samples=98 lat (msec) : 4=3.58%, 10=39.10%, 20=28.81%, 50=26.76%, 100=1.73% lat (msec) : 750=0.03% cpu : usr=0.12%, sys=10.98%, ctx=4949, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183296: Tue Sep 8 21:35:48 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6052KiB/50046msec) clat (usec): min=2102, max=69387, avg=13959.52, stdev=11652.62 lat (usec): min=2103, max=69388, avg=13960.08, stdev=11652.67 clat percentiles (usec): | 1.00th=[ 3064], 5.00th=[ 3720], 10.00th=[ 4146], 20.00th=[ 4883], | 30.00th=[ 5997], 40.00th=[ 8455], 50.00th=[10028], 60.00th=[11731], | 70.00th=[15008], 80.00th=[20841], 90.00th=[31851], 95.00th=[39584], | 99.00th=[52167], 99.50th=[60556], 99.90th=[65799], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 40, max= 432, per=25.24%, avg=120.88, stdev=82.92, samples=98 iops : min= 10, max= 108, avg=29.96, stdev=20.82, samples=98 write: IOPS=31, BW=125KiB/s (128kB/s)(6236KiB/50046msec); 0 zone resets clat (msec): min=4, max=645, avg=18.45, stdev=20.28 lat (msec): min=4, max=645, avg=18.45, stdev=20.28 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 35], 95.00th=[ 43], | 99.00th=[ 56], 99.50th=[ 70], 99.90th=[ 96], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 40, max= 400, per=24.84%, avg=124.70, stdev=85.26, samples=98 iops : min= 10, max= 100, avg=30.92, stdev=21.41, samples=98 lat (msec) : 4=3.84%, 10=39.52%, 20=27.70%, 50=26.99%, 100=1.92% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=10.84%, ctx=5018, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=480KiB/s (491kB/s), 119KiB/s-121KiB/s (122kB/s-124kB/s), io=23.4MiB (24.6MB), run=49909-50046msec WRITE: bw=502KiB/s (514kB/s), 125KiB/s-127KiB/s (128kB/s-130kB/s), io=24.6MiB (25.7MB), run=49909-50046msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183322: Tue Sep 8 21:36:06 2026 read: IOPS=30, BW=485KiB/s (496kB/s)(5920KiB/12210msec) clat (usec): min=50, max=60651, avg=16260.01, stdev=9121.33 lat (usec): min=51, max=60652, avg=16260.81, stdev=9121.28 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 120], 10.00th=[ 8029], 20.00th=[10028], | 30.00th=[11863], 40.00th=[13566], 50.00th=[15139], 60.00th=[17171], | 70.00th=[19006], 80.00th=[22152], 90.00th=[26346], 95.00th=[30802], | 99.00th=[54264], 99.50th=[57410], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 288, max= 608, per=25.36%, avg=484.67, stdev=81.78, samples=24 iops : min= 18, max= 38, avg=29.75, stdev= 5.08, samples=24 write: IOPS=32, BW=522KiB/s (534kB/s)(6368KiB/12210msec); 0 zone resets clat (usec): min=1195, max=63656, avg=15530.64, stdev=10466.09 lat (usec): min=1196, max=63657, avg=15531.83, stdev=10466.11 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 3752], 10.00th=[ 4293], 20.00th=[ 5473], | 30.00th=[ 8717], 40.00th=[11338], 50.00th=[13173], 60.00th=[15795], | 70.00th=[19006], 80.00th=[23725], 90.00th=[30016], 95.00th=[35914], | 99.00th=[46924], 99.50th=[61604], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 352, max= 704, per=26.02%, avg=523.17, stdev=112.68, samples=24 iops : min= 22, max= 44, avg=32.17, stdev= 7.01, samples=24 lat (usec) : 100=1.17%, 250=2.47% lat (msec) : 2=0.65%, 4=2.86%, 10=20.05%, 20=45.57%, 50=26.30% lat (msec) : 100=0.91% cpu : usr=0.07%, sys=27.29%, ctx=2595, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183323: Tue Sep 8 21:36:06 2026 read: IOPS=28, BW=462KiB/s (473kB/s)(5744KiB/12425msec) clat (usec): min=45, max=50420, avg=17396.06, stdev=8193.02 lat (usec): min=46, max=50420, avg=17396.68, stdev=8193.04 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 7898], 10.00th=[ 9241], 20.00th=[11076], | 30.00th=[13173], 40.00th=[14615], 50.00th=[16450], 60.00th=[18482], | 70.00th=[20317], 80.00th=[23200], 90.00th=[27919], 95.00th=[31589], | 99.00th=[45351], 99.50th=[49546], 99.90th=[50594], 99.95th=[50594], | 99.99th=[50594] bw ( KiB/s): min= 288, max= 670, per=24.29%, avg=464.25, stdev=96.81, samples=24 iops : min= 18, max= 41, avg=28.50, stdev= 6.00, samples=24 write: IOPS=32, BW=527KiB/s (539kB/s)(6544KiB/12425msec); 0 zone resets clat (usec): min=1964, max=107957, avg=15080.13, stdev=10951.34 lat (usec): min=1966, max=107959, avg=15081.45, stdev=10951.37 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 29], 95.00th=[ 34], | 99.00th=[ 48], 99.50th=[ 57], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 352, max= 733, per=26.03%, avg=523.37, stdev=95.05, samples=24 iops : min= 22, max= 45, avg=32.17, stdev= 5.90, samples=24 lat (usec) : 50=0.13%, 100=0.78%, 250=0.91%, 1000=0.13% lat (msec) : 2=0.13%, 4=3.52%, 10=21.35%, 20=44.66%, 50=27.86% lat (msec) : 100=0.39%, 250=0.13% cpu : usr=0.13%, sys=27.65%, ctx=2561, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183324: Tue Sep 8 21:36:06 2026 read: IOPS=31, BW=499KiB/s (511kB/s)(6256KiB/12529msec) clat (usec): min=62, max=52504, avg=17211.92, stdev=8910.11 lat (usec): min=62, max=52505, avg=17212.57, stdev=8910.14 clat percentiles (usec): | 1.00th=[ 95], 5.00th=[ 4015], 10.00th=[ 8586], 20.00th=[10683], | 30.00th=[12649], 40.00th=[13960], 50.00th=[15795], 60.00th=[17695], | 70.00th=[20055], 80.00th=[24249], 90.00th=[28443], 95.00th=[32900], | 99.00th=[49546], 99.50th=[50594], 99.90th=[52691], 99.95th=[52691], | 99.99th=[52691] bw ( KiB/s): min= 320, max= 701, per=25.80%, avg=493.08, stdev=113.53, samples=24 iops : min= 20, max= 43, avg=30.29, stdev= 6.96, samples=24 write: IOPS=30, BW=481KiB/s (493kB/s)(6032KiB/12529msec); 0 zone resets clat (usec): min=1236, max=101322, avg=15338.14, stdev=10986.25 lat (usec): min=1237, max=101324, avg=15339.55, stdev=10986.32 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 23], 90.00th=[ 29], 95.00th=[ 36], | 99.00th=[ 46], 99.50th=[ 69], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 253, max= 736, per=23.07%, avg=463.92, stdev=130.45, samples=24 iops : min= 15, max= 46, avg=28.46, stdev= 8.25, samples=24 lat (usec) : 100=0.52%, 250=1.95% lat (msec) : 2=0.39%, 4=3.26%, 10=21.09%, 20=42.84%, 50=29.30% lat (msec) : 100=0.52%, 250=0.13% cpu : usr=0.08%, sys=26.96%, ctx=2671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183325: Tue Sep 8 21:36:06 2026 read: IOPS=30, BW=484KiB/s (496kB/s)(6032KiB/12453msec) clat (usec): min=42, max=78059, avg=17163.57, stdev=9777.12 lat (usec): min=43, max=78060, avg=17164.19, stdev=9777.14 clat percentiles (usec): | 1.00th=[ 79], 5.00th=[ 127], 10.00th=[ 8455], 20.00th=[10552], | 30.00th=[12518], 40.00th=[14222], 50.00th=[15926], 60.00th=[17695], | 70.00th=[20055], 80.00th=[22938], 90.00th=[28181], 95.00th=[35390], | 99.00th=[50070], 99.50th=[51119], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 192, max= 736, per=25.01%, avg=478.00, stdev=129.53, samples=24 iops : min= 12, max= 46, avg=29.33, stdev= 8.05, samples=24 write: IOPS=31, BW=502KiB/s (514kB/s)(6256KiB/12453msec); 0 zone resets clat (usec): min=1554, max=67233, avg=15268.54, stdev=10212.10 lat (usec): min=1555, max=67234, avg=15269.72, stdev=10212.08 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 3556], 10.00th=[ 4293], 20.00th=[ 5211], | 30.00th=[ 8356], 40.00th=[11076], 50.00th=[13042], 60.00th=[16581], | 70.00th=[19530], 80.00th=[22676], 90.00th=[29230], 95.00th=[34866], | 99.00th=[44303], 99.50th=[47973], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 382, max= 704, per=24.89%, avg=500.58, stdev=83.63, samples=24 iops : min= 23, max= 44, avg=30.75, stdev= 5.41, samples=24 lat (usec) : 50=0.13%, 100=1.17%, 250=2.21% lat (msec) : 2=0.78%, 4=3.12%, 10=19.27%, 20=43.10%, 50=29.69% lat (msec) : 100=0.52% cpu : usr=0.11%, sys=26.65%, ctx=2545, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1912KiB/s (1958kB/s), 462KiB/s-499KiB/s (473kB/s-511kB/s), io=23.4MiB (24.5MB), run=12210-12529msec WRITE: bw=2011KiB/s (2060kB/s), 481KiB/s-527KiB/s (493kB/s-539kB/s), io=24.6MiB (25.8MB), run=12210-12529msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183317: Tue Sep 8 21:36:08 2026 read: IOPS=25, BW=415KiB/s (425kB/s)(5920KiB/14257msec) clat (usec): min=3074, max=79394, avg=16032.16, stdev=12301.26 lat (usec): min=3075, max=79395, avg=16032.86, stdev=12301.28 clat percentiles (usec): | 1.00th=[ 3654], 5.00th=[ 4817], 10.00th=[ 5538], 20.00th=[ 6521], | 30.00th=[ 8356], 40.00th=[ 9765], 50.00th=[11469], 60.00th=[13304], | 70.00th=[17433], 80.00th=[23725], 90.00th=[34866], 95.00th=[42206], | 99.00th=[54264], 99.50th=[64226], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 128, max= 1024, per=24.23%, avg=405.11, stdev=215.66, samples=28 iops : min= 8, max= 64, avg=24.86, stdev=13.60, samples=28 write: IOPS=27, BW=447KiB/s (457kB/s)(6368KiB/14257msec); 0 zone resets clat (usec): min=4486, max=78789, avg=20837.54, stdev=13297.38 lat (usec): min=4488, max=78790, avg=20839.08, stdev=13297.39 clat percentiles (usec): | 1.00th=[ 5866], 5.00th=[ 6783], 10.00th=[ 7767], 20.00th=[ 9110], | 30.00th=[11076], 40.00th=[13829], 50.00th=[17433], 60.00th=[20579], | 70.00th=[26084], 80.00th=[31065], 90.00th=[39060], 95.00th=[49021], | 99.00th=[61080], 99.50th=[65274], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 192, max= 1152, per=25.02%, avg=440.07, stdev=228.24, samples=28 iops : min= 12, max= 72, avg=27.04, stdev=14.29, samples=28 lat (msec) : 4=1.30%, 10=32.29%, 20=31.90%, 50=31.25%, 100=3.26% cpu : usr=0.11%, sys=11.43%, ctx=1325, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183318: Tue Sep 8 21:36:08 2026 read: IOPS=25, BW=404KiB/s (414kB/s)(5744KiB/14204msec) clat (usec): min=3510, max=55159, avg=16097.15, stdev=11251.95 lat (usec): min=3510, max=55159, avg=16097.99, stdev=11252.07 clat percentiles (usec): | 1.00th=[ 3884], 5.00th=[ 4883], 10.00th=[ 5735], 20.00th=[ 6783], | 30.00th=[ 8717], 40.00th=[10159], 50.00th=[11863], 60.00th=[14484], | 70.00th=[17957], 80.00th=[25560], 90.00th=[33817], 95.00th=[40109], | 99.00th=[50070], 99.50th=[54789], 99.90th=[55313], 99.95th=[55313], | 99.99th=[55313] bw ( KiB/s): min= 160, max= 1056, per=24.04%, avg=401.93, stdev=201.68, samples=28 iops : min= 10, max= 66, avg=24.68, stdev=12.69, samples=28 write: IOPS=28, BW=461KiB/s (472kB/s)(6544KiB/14204msec); 0 zone resets clat (msec): min=5, max=113, avg=20.55, stdev=13.67 lat (msec): min=5, max=113, avg=20.56, stdev=13.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 65], 99.50th=[ 80], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 223, max= 1152, per=25.96%, avg=456.71, stdev=255.27, samples=28 iops : min= 13, max= 72, avg=28.11, stdev=16.05, samples=28 lat (msec) : 4=0.78%, 10=31.25%, 20=33.33%, 50=32.29%, 100=2.21% lat (msec) : 250=0.13% cpu : usr=0.11%, sys=11.36%, ctx=1290, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183319: Tue Sep 8 21:36:08 2026 read: IOPS=27, BW=441KiB/s (452kB/s)(6256KiB/14188msec) clat (usec): min=3396, max=74554, avg=15616.91, stdev=11135.92 lat (usec): min=3397, max=74555, avg=15617.69, stdev=11135.91 clat percentiles (usec): | 1.00th=[ 4146], 5.00th=[ 5080], 10.00th=[ 5538], 20.00th=[ 6718], | 30.00th=[ 8356], 40.00th=[10028], 50.00th=[11863], 60.00th=[13960], | 70.00th=[17957], 80.00th=[24773], 90.00th=[30016], 95.00th=[36963], | 99.00th=[54789], 99.50th=[55313], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 192, max= 1280, per=26.42%, avg=441.68, stdev=249.89, samples=28 iops : min= 12, max= 80, avg=27.14, stdev=15.71, samples=28 write: IOPS=26, BW=425KiB/s (435kB/s)(6032KiB/14188msec); 0 zone resets clat (msec): min=5, max=113, avg=21.33, stdev=13.29 lat (msec): min=5, max=113, avg=21.33, stdev=13.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 59], 99.50th=[ 64], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 191, max= 1088, per=23.95%, avg=421.21, stdev=204.71, samples=28 iops : min= 11, max= 68, avg=25.86, stdev=12.84, samples=28 lat (msec) : 4=0.13%, 10=30.99%, 20=33.07%, 50=33.33%, 100=2.34% lat (msec) : 250=0.13% cpu : usr=0.14%, sys=11.58%, ctx=1334, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183320: Tue Sep 8 21:36:08 2026 read: IOPS=26, BW=421KiB/s (431kB/s)(6032KiB/14322msec) clat (usec): min=2901, max=74386, avg=15542.26, stdev=12344.35 lat (usec): min=2902, max=74387, avg=15543.02, stdev=12344.37 clat percentiles (usec): | 1.00th=[ 2999], 5.00th=[ 4293], 10.00th=[ 4948], 20.00th=[ 6128], | 30.00th=[ 7767], 40.00th=[ 9503], 50.00th=[11207], 60.00th=[13304], | 70.00th=[16581], 80.00th=[22938], 90.00th=[35390], 95.00th=[41681], | 99.00th=[55837], 99.50th=[59507], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 64, max= 1216, per=24.31%, avg=406.50, stdev=243.96, samples=28 iops : min= 4, max= 76, avg=24.96, stdev=15.24, samples=28 write: IOPS=27, BW=437KiB/s (447kB/s)(6256KiB/14322msec); 0 zone resets clat (usec): min=4714, max=80922, avg=21528.39, stdev=13512.01 lat (usec): min=4715, max=80923, avg=21529.94, stdev=13512.03 clat percentiles (usec): | 1.00th=[ 5014], 5.00th=[ 7046], 10.00th=[ 7832], 20.00th=[ 9241], | 30.00th=[11469], 40.00th=[14091], 50.00th=[17433], 60.00th=[22152], | 70.00th=[27132], 80.00th=[32900], 90.00th=[40633], 95.00th=[47973], | 99.00th=[59507], 99.50th=[62129], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 222, max= 1056, per=24.17%, avg=425.18, stdev=208.79, samples=28 iops : min= 13, max= 66, avg=26.11, stdev=13.21, samples=28 lat (msec) : 4=1.82%, 10=31.12%, 20=31.64%, 50=31.77%, 100=3.65% cpu : usr=0.08%, sys=11.11%, ctx=1284, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1672KiB/s (1713kB/s), 404KiB/s-441KiB/s (414kB/s-452kB/s), io=23.4MiB (24.5MB), run=14188-14322msec WRITE: bw=1760KiB/s (1802kB/s), 425KiB/s-461KiB/s (435kB/s-472kB/s), io=24.6MiB (25.8MB), run=14188-14322msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183333: Tue Sep 8 21:36:16 2026 read: IOPS=3, BW=3343KiB/s (3424kB/s)(7168KiB/2144msec) clat (usec): min=530, max=275808, avg=128151.04, stdev=80540.46 lat (usec): min=531, max=275809, avg=128152.21, stdev=80540.44 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[109577], | 30.00th=[113771], 40.00th=[113771], 50.00th=[125305], 60.00th=[129500], | 70.00th=[129500], 80.00th=[143655], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 3984, max= 5515, per=69.69%, avg=4749.50, stdev=1082.58, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2388KiB/s (2445kB/s)(5120KiB/2144msec); 0 zone resets clat (msec): min=202, max=255, avg=236.26, stdev=20.58 lat (msec): min=202, max=255, avg=236.32, stdev=20.57 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 1992, max= 5475, per=39.13%, avg=3733.50, stdev=2462.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=75.00%, 500=16.67% cpu : usr=0.00%, sys=52.64%, ctx=1184, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183334: Tue Sep 8 21:36:16 2026 read: IOPS=0, BW=682KiB/s (698kB/s)(2048KiB/3005msec) clat (msec): min=108, max=184, avg=146.09, stdev=53.63 lat (msec): min=108, max=184, avg=146.10, stdev=53.63 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 184], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 1851, max= 1988, per=28.17%, avg=1919.50, stdev=96.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3408KiB/s (3489kB/s)(10.0MiB/3005msec); 0 zone resets clat (msec): min=112, max=717, avg=268.28, stdev=195.04 lat (msec): min=112, max=717, avg=268.34, stdev=195.05 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 124], | 30.00th=[ 133], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 184], | 70.00th=[ 334], 80.00th=[ 393], 90.00th=[ 405], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1851, max= 5976, per=36.39%, avg=3471.50, stdev=1954.37, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 250=66.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=44.57%, ctx=680, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183335: Tue Sep 8 21:36:16 2026 read: IOPS=1, BW=2045KiB/s (2094kB/s)(6144KiB/3005msec) clat (msec): min=101, max=198, avg=139.39, stdev=37.23 lat (msec): min=101, max=198, avg=139.39, stdev=37.23 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 3976, max= 4071, per=59.04%, avg=4023.50, stdev=67.18, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2045KiB/s (2094kB/s)(6144KiB/3005msec); 0 zone resets clat (msec): min=118, max=741, avg=356.40, stdev=221.69 lat (msec): min=118, max=741, avg=356.45, stdev=221.69 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 363], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1825, max= 2035, per=20.32%, avg=1938.75, stdev=93.66, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=66.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=39.08%, ctx=1071, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183337: Tue Sep 8 21:36:16 2026 read: IOPS=2, BW=2226KiB/s (2280kB/s)(5120KiB/2300msec) clat (usec): min=408, max=153114, avg=71764.73, stdev=68801.36 lat (usec): min=410, max=153115, avg=71765.75, stdev=68801.09 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 408], 10.00th=[ 408], 20.00th=[ 408], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 90702], 60.00th=[ 90702], | 70.00th=[113771], 80.00th=[113771], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 1992, max= 5475, per=54.78%, avg=3733.50, stdev=2462.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=3, BW=3117KiB/s (3191kB/s)(7168KiB/2300msec); 0 zone resets clat (msec): min=127, max=427, avg=275.79, stdev=136.73 lat (msec): min=127, max=427, avg=275.85, stdev=136.70 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 132], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 255], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1825, max= 5976, per=35.68%, avg=3404.50, stdev=1989.86, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 500=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=45.59%, ctx=464, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6815KiB/s (6979kB/s), 682KiB/s-3343KiB/s (698kB/s-3424kB/s), io=20.0MiB (20.0MB), run=2144-3005msec WRITE: bw=9541KiB/s (9770kB/s), 2045KiB/s-3408KiB/s (2094kB/s-3489kB/s), io=28.0MiB (29.4MB), run=2144-3005msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183336: Tue Sep 8 21:36:16 2026 read: IOPS=2, BW=2659KiB/s (2723kB/s)(7168KiB/2696msec) clat (msec): min=45, max=594, avg=218.30, stdev=203.00 lat (msec): min=45, max=594, avg=218.31, stdev=203.00 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 57], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 144], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 380], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1892, max= 4096, per=45.56%, avg=3033.00, stdev=1229.10, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1899KiB/s (1945kB/s)(5120KiB/2696msec); 0 zone resets clat (msec): min=123, max=299, avg=221.22, stdev=65.44 lat (msec): min=123, max=299, avg=221.30, stdev=65.44 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2048, max= 6095, per=43.68%, avg=4071.50, stdev=2861.66, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.07%, sys=16.92%, ctx=116, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183338: Tue Sep 8 21:36:16 2026 read: IOPS=0, BW=666KiB/s (682kB/s)(2048KiB/3076msec) clat (msec): min=54, max=191, avg=122.78, stdev=97.09 lat (msec): min=54, max=191, avg=122.78, stdev=97.09 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 55], | 30.00th=[ 55], 40.00th=[ 55], 50.00th=[ 55], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 1899, max= 2031, per=29.52%, avg=1965.00, stdev=93.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3329KiB/s (3409kB/s)(10.0MiB/3076msec); 0 zone resets clat (msec): min=61, max=643, avg=277.53, stdev=220.61 lat (msec): min=61, max=644, avg=277.60, stdev=220.62 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 63], | 30.00th=[ 90], 40.00th=[ 130], 50.00th=[ 194], 60.00th=[ 255], | 70.00th=[ 300], 80.00th=[ 401], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2031, max= 8192, per=49.39%, avg=4603.75, stdev=3076.73, samples=4 iops : min= 1, max= 8, avg= 4.25, stdev= 3.30, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=23.06%, ctx=422, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183339: Tue Sep 8 21:36:16 2026 read: IOPS=2, BW=2196KiB/s (2249kB/s)(6144KiB/2798msec) clat (msec): min=47, max=327, avg=154.90, stdev=118.01 lat (msec): min=47, max=327, avg=154.91, stdev=118.01 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 80], 50.00th=[ 80], 60.00th=[ 128], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 4063, max= 4096, per=61.28%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2196KiB/s (2249kB/s)(6144KiB/2798msec); 0 zone resets clat (msec): min=99, max=758, avg=309.19, stdev=239.60 lat (msec): min=99, max=758, avg=309.26, stdev=239.60 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 262], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2031, max= 3737, per=27.95%, avg=2605.33, stdev=980.09, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=11.01%, ctx=116, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183340: Tue Sep 8 21:36:16 2026 read: IOPS=2, BW=2051KiB/s (2101kB/s)(5120KiB/2496msec) clat (msec): min=55, max=157, avg=86.34, stdev=42.47 lat (msec): min=55, max=157, avg=86.34, stdev=42.47 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 73], 60.00th=[ 73], | 70.00th=[ 91], 80.00th=[ 91], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 4063, max= 4096, per=61.28%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2872KiB/s (2941kB/s)(7168KiB/2496msec); 0 zone resets clat (msec): min=90, max=584, avg=292.86, stdev=161.55 lat (msec): min=90, max=584, avg=292.94, stdev=161.55 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 132], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 355], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1914, max= 4096, per=27.06%, avg=2522.25, stdev=1050.86, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=41.67%, 250=16.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=15.27%, ctx=142, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6658KiB/s (6818kB/s), 666KiB/s-2659KiB/s (682kB/s-2723kB/s), io=20.0MiB (20.0MB), run=2496-3076msec WRITE: bw=9321KiB/s (9545kB/s), 1899KiB/s-3329KiB/s (1945kB/s-3409kB/s), io=28.0MiB (29.4MB), run=2496-3076msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183346: Tue Sep 8 21:36:24 2026 read: IOPS=2, BW=9.89MiB/s (10.4MB/s)(12.0MiB/1213msec) clat (msec): min=391, max=397, avg=395.16, stdev= 3.29 lat (msec): min=391, max=397, avg=395.16, stdev= 3.29 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 6131, max= 8192, per=64.83%, avg=7161.50, stdev=1457.35, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.08%, sys=49.09%, ctx=2999, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183348: Tue Sep 8 21:36:24 2026 read: IOPS=0, BW=2762KiB/s (2828kB/s)(4096KiB/1483msec) clat (nsec): min=430581k, max=430581k, avg=430580589.00, stdev= 0.00 lat (nsec): min=430582k, max=430582k, avg=430581513.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 5542, max= 5542, per=50.17%, avg=5542.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5524KiB/s (5657kB/s)(8192KiB/1483msec); 0 zone resets clat (msec): min=478, max=509, avg=493.64, stdev=22.05 lat (msec): min=478, max=509, avg=493.91, stdev=22.01 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 8192, max= 8192, per=43.93%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=27.73%, ctx=1099, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183350: Tue Sep 8 21:36:24 2026 write: IOPS=1, BW=6994KiB/s (7162kB/s)(12.0MiB/1757msec); 0 zone resets clat (msec): min=163, max=913, avg=579.64, stdev=382.01 lat (msec): min=163, max=914, avg=579.91, stdev=382.01 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8159, max= 8192, per=43.84%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.77%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183352: Tue Sep 8 21:36:24 2026 write: IOPS=1, BW=7103KiB/s (7273kB/s)(12.0MiB/1730msec); 0 zone resets clat (msec): min=455, max=748, avg=567.07, stdev=158.45 lat (msec): min=455, max=748, avg=567.30, stdev=158.45 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 6068, max= 8159, per=38.14%, avg=7113.50, stdev=1478.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=15.04%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.8MiB/s (11.3MB/s), 2762KiB/s-9.89MiB/s (2828kB/s-10.4MB/s), io=16.0MiB (16.8MB), run=1213-1483msec WRITE: bw=18.2MiB/s (19.1MB/s), 5524KiB/s-7103KiB/s (5657kB/s-7273kB/s), io=32.0MiB (33.6MB), run=1483-1757msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183347: Tue Sep 8 21:36:24 2026 read: IOPS=2, BW=9752KiB/s (9986kB/s)(12.0MiB/1260msec) clat (msec): min=371, max=486, avg=415.63, stdev=61.69 lat (msec): min=371, max=486, avg=415.63, stdev=61.69 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 5919, max= 8192, per=80.66%, avg=7055.50, stdev=1607.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=21.13%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183349: Tue Sep 8 21:36:24 2026 read: IOPS=0, BW=2187KiB/s (2239kB/s)(4096KiB/1873msec) clat (nsec): min=1368.8M, max=1368.8M, avg=1368783060.00, stdev= 0.00 lat (nsec): min=1368.8M, max=1368.8M, avg=1368784994.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1368], 5.00th=[ 1368], 10.00th=[ 1368], 20.00th=[ 1368], | 30.00th=[ 1368], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8192, max= 8192, per=93.65%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4374KiB/s (4479kB/s)(8192KiB/1873msec); 0 zone resets clat (msec): min=193, max=290, avg=241.78, stdev=68.35 lat (msec): min=193, max=290, avg=242.03, stdev=68.36 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 8192, max= 8192, per=47.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.62%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183351: Tue Sep 8 21:36:24 2026 write: IOPS=1, BW=6536KiB/s (6693kB/s)(12.0MiB/1880msec); 0 zone resets clat (msec): min=118, max=1248, avg=618.66, stdev=576.23 lat (msec): min=118, max=1248, avg=618.93, stdev=576.21 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8192, max= 8192, per=47.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.25%, ctx=87, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183353: Tue Sep 8 21:36:24 2026 write: IOPS=1, BW=7590KiB/s (7772kB/s)(12.0MiB/1619msec); 0 zone resets clat (msec): min=126, max=1034, avg=525.15, stdev=464.18 lat (msec): min=126, max=1034, avg=525.39, stdev=464.16 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min=11314, max=11314, per=64.91%, avg=11314.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=17.37%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8747KiB/s (8957kB/s), 2187KiB/s-9752KiB/s (2239kB/s-9986kB/s), io=16.0MiB (16.8MB), run=1260-1873msec WRITE: bw=17.0MiB/s (17.8MB/s), 4374KiB/s-7590KiB/s (4479kB/s-7772kB/s), io=32.0MiB (33.6MB), run=1619-1880msec