== sanity test 398b: DIO and buffer IO race ============== 17:02:06 (1763157726) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.71819 s, 18.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182868: Fri Nov 14 17:03:10 2025 read: IOPS=27, BW=111KiB/s (113kB/s)(5992KiB/54092msec) clat (usec): min=209, max=1067.4k, avg=19960.95, stdev=28757.45 lat (usec): min=209, max=1067.4k, avg=19961.84, stdev=28757.51 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 8094], 10.00th=[ 9503], | 20.00th=[ 11469], 30.00th=[ 13435], 40.00th=[ 15533], | 50.00th=[ 17695], 60.00th=[ 20055], 70.00th=[ 22676], | 80.00th=[ 26346], 90.00th=[ 31327], 95.00th=[ 35914], | 99.00th=[ 52167], 99.50th=[ 58983], 99.90th=[ 105382], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 39, max= 216, per=25.52%, avg=112.56, stdev=26.88, samples=105 iops : min= 9, max= 54, avg=27.73, stdev= 6.79, samples=105 write: IOPS=29, BW=116KiB/s (119kB/s)(6296KiB/54092msec); 0 zone resets clat (usec): min=716, max=72214, avg=15197.73, stdev=11581.98 lat (usec): min=717, max=72214, avg=15198.87, stdev=11582.05 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 2474], 10.00th=[ 3064], 20.00th=[ 4555], | 30.00th=[ 7111], 40.00th=[10290], 50.00th=[12911], 60.00th=[15401], | 70.00th=[19006], 80.00th=[23462], 90.00th=[31327], 95.00th=[38011], | 99.00th=[53216], 99.50th=[58459], 99.90th=[69731], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 55, max= 191, per=25.57%, avg=118.12, stdev=32.89, samples=105 iops : min= 13, max= 47, avg=29.12, stdev= 8.31, samples=105 lat (usec) : 250=0.03%, 500=0.59%, 750=0.29%, 1000=0.26% lat (msec) : 2=1.20%, 4=7.29%, 10=16.47%, 20=40.17%, 50=32.36% lat (msec) : 100=1.27%, 250=0.03%, 2000=0.03% cpu : usr=0.14%, sys=25.82%, ctx=9372, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182869: Fri Nov 14 17:03:10 2025 read: IOPS=27, BW=109KiB/s (112kB/s)(5940KiB/54398msec) clat (usec): min=137, max=86579, avg=19509.01, stdev=9804.03 lat (usec): min=139, max=86580, avg=19509.88, stdev=9804.13 clat percentiles (usec): | 1.00th=[ 396], 5.00th=[ 7832], 10.00th=[ 9372], 20.00th=[11469], | 30.00th=[13435], 40.00th=[15664], 50.00th=[17957], 60.00th=[20317], | 70.00th=[22938], 80.00th=[26608], 90.00th=[31589], 95.00th=[37487], | 99.00th=[51119], 99.50th=[56886], 99.90th=[80217], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 6, max= 176, per=24.96%, avg=110.06, stdev=27.62, samples=107 iops : min= 1, max= 44, avg=27.11, stdev= 7.00, samples=107 write: IOPS=29, BW=117KiB/s (119kB/s)(6348KiB/54398msec); 0 zone resets clat (usec): min=736, max=1048.8k, avg=15869.94, stdev=28425.28 lat (usec): min=736, max=1048.8k, avg=15871.16, stdev=28425.36 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2507], 10.00th=[ 2999], | 20.00th=[ 4621], 30.00th=[ 7177], 40.00th=[ 10028], | 50.00th=[ 12780], 60.00th=[ 15270], 70.00th=[ 19006], | 80.00th=[ 24249], 90.00th=[ 31851], 95.00th=[ 37487], | 99.00th=[ 49546], 99.50th=[ 56361], 99.90th=[ 79168], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 55, max= 240, per=25.62%, avg=118.36, stdev=34.92, samples=106 iops : min= 13, max= 60, avg=29.19, stdev= 8.82, samples=106 lat (usec) : 250=0.10%, 500=0.52%, 750=0.23%, 1000=0.26% lat (msec) : 2=1.27%, 4=6.97%, 10=17.45%, 20=38.67%, 50=33.43% lat (msec) : 100=1.07%, 2000=0.03% cpu : usr=0.12%, sys=25.74%, ctx=9416, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182870: Fri Nov 14 17:03:10 2025 read: IOPS=27, BW=112KiB/s (114kB/s)(6028KiB/53955msec) clat (usec): min=83, max=75351, avg=19368.28, stdev=9874.90 lat (usec): min=83, max=75352, avg=19369.32, stdev=9874.93 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 7701], 10.00th=[ 9372], 20.00th=[11207], | 30.00th=[13435], 40.00th=[15533], 50.00th=[17433], 60.00th=[19792], | 70.00th=[22676], 80.00th=[26346], 90.00th=[32375], 95.00th=[37487], | 99.00th=[50594], 99.50th=[60031], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 47, max= 192, per=25.80%, avg=113.77, stdev=28.64, samples=105 iops : min= 11, max= 48, avg=28.04, stdev= 7.28, samples=105 write: IOPS=29, BW=116KiB/s (119kB/s)(6260KiB/53955msec); 0 zone resets clat (usec): min=879, max=1081.4k, avg=15665.96, stdev=29224.88 lat (usec): min=879, max=1081.4k, avg=15667.22, stdev=29224.94 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2540], 10.00th=[ 3032], | 20.00th=[ 4490], 30.00th=[ 6849], 40.00th=[ 10028], | 50.00th=[ 12649], 60.00th=[ 15270], 70.00th=[ 19268], | 80.00th=[ 23987], 90.00th=[ 30802], 95.00th=[ 38011], | 99.00th=[ 48497], 99.50th=[ 55313], 99.90th=[ 83362], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 40, max= 223, per=25.55%, avg=118.04, stdev=31.72, samples=105 iops : min= 10, max= 55, avg=29.10, stdev= 7.92, samples=105 lat (usec) : 100=0.03%, 250=0.03%, 500=0.39%, 750=0.33%, 1000=0.13% lat (msec) : 2=0.98%, 4=7.39%, 10=17.71%, 20=39.91%, 50=32.19% lat (msec) : 100=0.88%, 2000=0.03% cpu : usr=0.13%, sys=25.78%, ctx=9365, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182871: Fri Nov 14 17:03:10 2025 read: IOPS=28, BW=113KiB/s (116kB/s)(6052KiB/53650msec) clat (usec): min=186, max=96977, avg=18948.21, stdev=9984.29 lat (usec): min=187, max=96978, avg=18949.15, stdev=9984.40 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 7767], 10.00th=[ 9110], 20.00th=[11338], | 30.00th=[13304], 40.00th=[15139], 50.00th=[17433], 60.00th=[19530], | 70.00th=[21890], 80.00th=[25297], 90.00th=[30540], 95.00th=[35914], | 99.00th=[51643], 99.50th=[63701], 99.90th=[83362], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 175, per=25.94%, avg=114.41, stdev=25.22, samples=104 iops : min= 15, max= 43, avg=28.20, stdev= 6.42, samples=104 write: IOPS=29, BW=116KiB/s (119kB/s)(6236KiB/53650msec); 0 zone resets clat (usec): min=610, max=1064.4k, avg=15865.84, stdev=28975.13 lat (usec): min=610, max=1064.4k, avg=15866.95, stdev=28975.18 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 2540], 10.00th=[ 3032], | 20.00th=[ 4490], 30.00th=[ 6587], 40.00th=[ 10159], | 50.00th=[ 12518], 60.00th=[ 15533], 70.00th=[ 19268], | 80.00th=[ 24249], 90.00th=[ 31327], 95.00th=[ 38011], | 99.00th=[ 49546], 99.50th=[ 59507], 99.90th=[ 78119], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 13, max= 215, per=25.31%, avg=116.94, stdev=33.82, samples=105 iops : min= 3, max= 53, avg=28.84, stdev= 8.53, samples=105 lat (usec) : 250=0.03%, 500=0.75%, 750=0.33%, 1000=0.26% lat (msec) : 2=0.81%, 4=7.42%, 10=17.02%, 20=40.23%, 50=32.06% lat (msec) : 100=1.04%, 2000=0.03% cpu : usr=0.10%, sys=25.84%, ctx=9127, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=441KiB/s (452kB/s), 109KiB/s-113KiB/s (112kB/s-116kB/s), io=23.4MiB (24.6MB), run=53650-54398msec WRITE: bw=462KiB/s (473kB/s), 116KiB/s-117KiB/s (119kB/s-119kB/s), io=24.6MiB (25.7MB), run=53650-54398msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182864: Fri Nov 14 17:03:17 2025 read: IOPS=24, BW=97.8KiB/s (100kB/s)(5992KiB/61254msec) clat (msec): min=2, max=1062, avg=18.42, stdev=30.49 lat (msec): min=2, max=1062, avg=18.42, stdev=30.49 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 47], | 99.00th=[ 64], 99.50th=[ 72], 99.90th=[ 97], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 31, max= 376, per=25.37%, avg=99.43, stdev=70.96, samples=120 iops : min= 7, max= 94, avg=24.53, stdev=17.80, samples=120 write: IOPS=25, BW=103KiB/s (105kB/s)(6296KiB/61254msec); 0 zone resets clat (msec): min=3, max=122, avg=21.22, stdev=15.16 lat (msec): min=3, max=122, avg=21.22, stdev=15.16 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 69], 99.50th=[ 83], 99.90th=[ 111], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 31, max= 384, per=25.47%, avg=104.43, stdev=72.83, samples=120 iops : min= 7, max= 96, avg=25.78, stdev=18.28, samples=120 lat (msec) : 4=1.37%, 10=31.97%, 20=29.69%, 50=32.32%, 100=4.56% lat (msec) : 250=0.07%, 2000=0.03% cpu : usr=0.11%, sys=12.13%, ctx=5711, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182865: Fri Nov 14 17:03:17 2025 read: IOPS=24, BW=97.3KiB/s (99.7kB/s)(5940KiB/61031msec) clat (msec): min=2, max=1073, avg=17.47, stdev=30.50 lat (msec): min=2, max=1073, avg=17.47, stdev=30.50 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 64], 99.50th=[ 72], 99.90th=[ 96], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 16, max= 408, per=25.15%, avg=98.59, stdev=72.00, samples=119 iops : min= 4, max= 102, avg=24.32, stdev=18.07, samples=119 write: IOPS=26, BW=104KiB/s (107kB/s)(6348KiB/61031msec); 0 zone resets clat (msec): min=4, max=123, avg=21.95, stdev=15.57 lat (msec): min=4, max=123, avg=21.95, stdev=15.57 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 75], 99.50th=[ 85], 99.90th=[ 96], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 31, max= 360, per=25.62%, avg=105.03, stdev=70.51, samples=119 iops : min= 7, max= 90, avg=25.93, stdev=17.66, samples=119 lat (msec) : 4=1.14%, 10=31.74%, 20=30.73%, 50=31.87%, 100=4.46% lat (msec) : 250=0.03%, 2000=0.03% cpu : usr=0.09%, sys=11.98%, ctx=5685, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182866: Fri Nov 14 17:03:17 2025 read: IOPS=24, BW=98.8KiB/s (101kB/s)(6028KiB/60982msec) clat (usec): min=2578, max=88702, avg=16914.98, stdev=13085.14 lat (usec): min=2578, max=88703, avg=16915.92, stdev=13085.19 clat percentiles (usec): | 1.00th=[ 3654], 5.00th=[ 4424], 10.00th=[ 4883], 20.00th=[ 5800], | 30.00th=[ 7832], 40.00th=[10421], 50.00th=[12518], 60.00th=[15664], | 70.00th=[19792], 80.00th=[26608], 90.00th=[36439], 95.00th=[44303], | 99.00th=[58459], 99.50th=[64226], 99.90th=[76022], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 31, max= 383, per=25.53%, avg=100.06, stdev=72.72, samples=119 iops : min= 7, max= 95, avg=24.69, stdev=18.22, samples=119 write: IOPS=25, BW=103KiB/s (105kB/s)(6260KiB/60982msec); 0 zone resets clat (msec): min=3, max=1077, avg=22.51, stdev=30.75 lat (msec): min=3, max=1077, avg=22.51, stdev=30.75 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 70], 99.50th=[ 85], 99.90th=[ 120], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 39, max= 352, per=25.31%, avg=103.76, stdev=68.44, samples=119 iops : min= 9, max= 88, avg=25.61, stdev=17.15, samples=119 lat (msec) : 4=1.01%, 10=31.54%, 20=30.27%, 50=32.94%, 100=4.13% lat (msec) : 250=0.07%, 2000=0.03% cpu : usr=0.13%, sys=12.26%, ctx=5575, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182867: Fri Nov 14 17:03:17 2025 read: IOPS=24, BW=99.1KiB/s (101kB/s)(6052KiB/61071msec) clat (usec): min=2979, max=77510, avg=16828.69, stdev=13319.43 lat (usec): min=2979, max=77511, avg=16829.65, stdev=13319.49 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 4490], 10.00th=[ 4817], 20.00th=[ 5997], | 30.00th=[ 7963], 40.00th=[10290], 50.00th=[12518], 60.00th=[15401], | 70.00th=[19006], 80.00th=[25035], 90.00th=[37487], 95.00th=[45876], | 99.00th=[59507], 99.50th=[64226], 99.90th=[76022], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 23, max= 367, per=25.42%, avg=99.66, stdev=69.97, samples=119 iops : min= 5, max= 91, avg=24.59, stdev=17.54, samples=119 write: IOPS=25, BW=102KiB/s (105kB/s)(6236KiB/61071msec); 0 zone resets clat (msec): min=4, max=1069, avg=22.67, stdev=30.81 lat (msec): min=4, max=1069, avg=22.67, stdev=30.81 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 51], | 99.00th=[ 79], 99.50th=[ 88], 99.90th=[ 117], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 39, max= 416, per=25.13%, avg=103.03, stdev=71.29, samples=119 iops : min= 9, max= 104, avg=25.43, stdev=17.88, samples=119 lat (msec) : 4=1.43%, 10=32.23%, 20=29.10%, 50=33.14%, 100=3.97% lat (msec) : 250=0.10%, 2000=0.03% cpu : usr=0.13%, sys=12.12%, ctx=5631, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=392KiB/s (401kB/s), 97.3KiB/s-99.1KiB/s (99.7kB/s-101kB/s), io=23.4MiB (24.6MB), run=60982-61254msec WRITE: bw=410KiB/s (420kB/s), 102KiB/s-104KiB/s (105kB/s-107kB/s), io=24.6MiB (25.7MB), run=60982-61254msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182891: Fri Nov 14 17:03:42 2025 read: IOPS=18, BW=296KiB/s (303kB/s)(5920KiB/20009msec) clat (usec): min=222, max=74051, avg=26897.64, stdev=13499.06 lat (usec): min=223, max=74052, avg=26898.60, stdev=13499.07 clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 938], 10.00th=[13435], 20.00th=[16909], | 30.00th=[19006], 40.00th=[21627], 50.00th=[25035], 60.00th=[28967], | 70.00th=[32375], 80.00th=[37487], 90.00th=[43779], 95.00th=[50070], | 99.00th=[69731], 99.50th=[69731], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 190, max= 576, per=24.55%, avg=291.44, stdev=71.40, samples=39 iops : min= 11, max= 36, avg=17.46, stdev= 4.56, samples=39 write: IOPS=19, BW=318KiB/s (326kB/s)(6368KiB/20009msec); 0 zone resets clat (usec): min=1493, max=72902, avg=25160.29, stdev=15590.45 lat (usec): min=1496, max=72904, avg=25196.43, stdev=15608.15 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 6194], 10.00th=[ 7373], 20.00th=[ 9896], | 30.00th=[14484], 40.00th=[18744], 50.00th=[21627], 60.00th=[26608], | 70.00th=[31065], 80.00th=[39584], 90.00th=[48497], 95.00th=[55837], | 99.00th=[68682], 99.50th=[69731], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 128, max= 510, per=25.42%, avg=317.51, stdev=81.78, samples=39 iops : min= 8, max= 31, avg=19.10, stdev= 5.03, samples=39 lat (usec) : 250=0.26%, 500=0.91%, 750=0.52%, 1000=0.78% lat (msec) : 2=0.13%, 4=0.52%, 10=10.94%, 20=25.13%, 50=53.91% lat (msec) : 100=6.90% cpu : usr=0.08%, sys=29.53%, ctx=3052, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182892: Fri Nov 14 17:03:42 2025 read: IOPS=17, BW=285KiB/s (292kB/s)(5744KiB/20162msec) clat (usec): min=153, max=85111, avg=29150.70, stdev=12978.40 lat (usec): min=155, max=85112, avg=29151.69, stdev=12978.42 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[11731], 10.00th=[15139], 20.00th=[18482], | 30.00th=[22152], 40.00th=[25035], 50.00th=[28181], 60.00th=[31065], | 70.00th=[34866], 80.00th=[39060], 90.00th=[43779], 95.00th=[50070], | 99.00th=[67634], 99.50th=[81265], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 127, max= 447, per=23.92%, avg=283.97, stdev=81.82, samples=39 iops : min= 7, max= 27, avg=17.00, stdev= 5.14, samples=39 write: IOPS=20, BW=325KiB/s (332kB/s)(6544KiB/20162msec); 0 zone resets clat (usec): min=1955, max=94699, avg=23540.17, stdev=15118.40 lat (usec): min=1957, max=94701, avg=23542.10, stdev=15118.46 clat percentiles (usec): | 1.00th=[ 2933], 5.00th=[ 6325], 10.00th=[ 7570], 20.00th=[10552], | 30.00th=[13042], 40.00th=[16450], 50.00th=[20317], 60.00th=[24249], | 70.00th=[29230], 80.00th=[35390], 90.00th=[44303], 95.00th=[53740], | 99.00th=[64750], 99.50th=[70779], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 95, max= 526, per=25.35%, avg=316.56, stdev=96.00, samples=39 iops : min= 5, max= 32, avg=19.03, stdev= 6.03, samples=39 lat (usec) : 250=0.13%, 500=0.13%, 750=0.52%, 1000=0.26% lat (msec) : 2=0.52%, 4=0.78%, 10=8.72%, 20=26.95%, 50=56.25% lat (msec) : 100=5.73% cpu : usr=0.10%, sys=29.48%, ctx=3176, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182893: Fri Nov 14 17:03:42 2025 read: IOPS=20, BW=320KiB/s (328kB/s)(6256KiB/19546msec) clat (usec): min=445, max=73773, avg=27085.60, stdev=11342.60 lat (usec): min=446, max=73774, avg=27086.92, stdev=11342.61 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[11469], 10.00th=[14877], 20.00th=[17957], | 30.00th=[20579], 40.00th=[22938], 50.00th=[25560], 60.00th=[28181], | 70.00th=[32900], 80.00th=[36439], 90.00th=[40109], 95.00th=[44827], | 99.00th=[59507], 99.50th=[66847], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 159, max= 542, per=27.04%, avg=320.97, stdev=87.12, samples=38 iops : min= 9, max= 33, avg=19.32, stdev= 5.56, samples=38 write: IOPS=19, BW=309KiB/s (316kB/s)(6032KiB/19546msec); 0 zone resets clat (usec): min=3692, max=62785, avg=23569.07, stdev=13106.70 lat (usec): min=3695, max=62787, avg=23573.56, stdev=13106.52 clat percentiles (usec): | 1.00th=[ 5211], 5.00th=[ 7242], 10.00th=[ 8586], 20.00th=[11338], | 30.00th=[14615], 40.00th=[16909], 50.00th=[21365], 60.00th=[25560], | 70.00th=[30278], 80.00th=[35390], 90.00th=[43254], 95.00th=[47973], | 99.00th=[57410], 99.50th=[60031], 99.90th=[62653], 99.95th=[62653], | 99.99th=[62653] bw ( KiB/s): min= 128, max= 478, per=24.37%, avg=304.39, stdev=86.62, samples=38 iops : min= 8, max= 29, avg=18.29, stdev= 5.33, samples=38 lat (usec) : 500=0.26%, 750=0.78%, 1000=0.13% lat (msec) : 2=0.13%, 4=0.13%, 10=7.81%, 20=27.47%, 50=59.51% lat (msec) : 100=3.78% cpu : usr=0.14%, sys=30.08%, ctx=3163, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182894: Fri Nov 14 17:03:42 2025 read: IOPS=18, BW=302KiB/s (309kB/s)(6032KiB/19967msec) clat (usec): min=258, max=80546, avg=27493.55, stdev=14191.04 lat (usec): min=259, max=80547, avg=27497.86, stdev=14195.79 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 750], 10.00th=[13042], 20.00th=[16909], | 30.00th=[20317], 40.00th=[22938], 50.00th=[26346], 60.00th=[29754], | 70.00th=[32375], 80.00th=[38536], 90.00th=[45351], 95.00th=[55313], | 99.00th=[66323], 99.50th=[78119], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 63, max= 447, per=25.28%, avg=300.10, stdev=80.37, samples=39 iops : min= 3, max= 27, avg=18.00, stdev= 5.06, samples=39 write: IOPS=19, BW=313KiB/s (321kB/s)(6256KiB/19967msec); 0 zone resets clat (usec): min=1887, max=85986, avg=24409.57, stdev=14819.46 lat (usec): min=1889, max=85989, avg=24424.94, stdev=14807.37 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 6652], 10.00th=[ 7701], 20.00th=[11207], | 30.00th=[15008], 40.00th=[17957], 50.00th=[20055], 60.00th=[23987], | 70.00th=[30802], 80.00th=[37487], 90.00th=[45876], 95.00th=[53216], | 99.00th=[64226], 99.50th=[67634], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 160, max= 479, per=24.92%, avg=311.23, stdev=83.10, samples=39 iops : min= 10, max= 29, avg=18.72, stdev= 5.14, samples=39 lat (usec) : 500=0.52%, 750=1.69%, 1000=1.17% lat (msec) : 2=0.52%, 4=0.13%, 10=8.85%, 20=26.69%, 50=52.73% lat (msec) : 100=7.68% cpu : usr=0.14%, sys=29.59%, ctx=3253, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1188KiB/s (1216kB/s), 285KiB/s-320KiB/s (292kB/s-328kB/s), io=23.4MiB (24.5MB), run=19546-20162msec WRITE: bw=1250KiB/s (1280kB/s), 309KiB/s-325KiB/s (316kB/s-332kB/s), io=24.6MiB (25.8MB), run=19546-20162msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182896: Fri Nov 14 17:03:43 2025 read: IOPS=17, BW=277KiB/s (284kB/s)(5920KiB/21361msec) clat (usec): min=4635, max=94668, avg=24749.43, stdev=17250.31 lat (usec): min=4636, max=94668, avg=24750.84, stdev=17249.96 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 6915], 10.00th=[ 7767], 20.00th=[10945], | 30.00th=[14484], 40.00th=[16909], 50.00th=[19530], 60.00th=[22676], | 70.00th=[26870], 80.00th=[36439], 90.00th=[50594], 95.00th=[62653], | 99.00th=[76022], 99.50th=[88605], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 95, max= 896, per=24.35%, avg=270.55, stdev=158.76, samples=42 iops : min= 5, max= 56, avg=16.24, stdev=10.08, samples=42 write: IOPS=18, BW=298KiB/s (305kB/s)(6368KiB/21361msec); 0 zone resets clat (usec): min=5473, max=94139, avg=30514.02, stdev=18101.25 lat (usec): min=5474, max=94141, avg=30516.17, stdev=18101.42 clat percentiles (usec): | 1.00th=[ 6980], 5.00th=[ 8356], 10.00th=[ 9896], 20.00th=[14091], | 30.00th=[17957], 40.00th=[21103], 50.00th=[26870], 60.00th=[32637], | 70.00th=[37487], 80.00th=[45876], 90.00th=[56361], 95.00th=[66847], | 99.00th=[82314], 99.50th=[86508], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 158, max= 960, per=25.28%, avg=295.50, stdev=151.59, samples=42 iops : min= 9, max= 60, avg=17.79, stdev= 9.65, samples=42 lat (msec) : 10=13.41%, 20=32.03%, 50=42.06%, 100=12.50% cpu : usr=0.11%, sys=13.89%, ctx=1762, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182897: Fri Nov 14 17:03:43 2025 read: IOPS=16, BW=267KiB/s (273kB/s)(5744KiB/21545msec) clat (msec): min=2, max=118, avg=27.03, stdev=19.91 lat (msec): min=2, max=118, avg=27.03, stdev=19.91 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 63], | 99.00th=[ 87], 99.50th=[ 106], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 63, max= 1024, per=22.80%, avg=253.29, stdev=145.10, samples=42 iops : min= 3, max= 64, avg=15.14, stdev= 9.24, samples=42 write: IOPS=18, BW=304KiB/s (311kB/s)(6544KiB/21545msec); 0 zone resets clat (msec): min=3, max=101, avg=28.68, stdev=19.17 lat (msec): min=3, max=101, avg=28.68, stdev=19.17 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 47], 90.00th=[ 57], 95.00th=[ 65], | 99.00th=[ 81], 99.50th=[ 85], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 96, max= 1056, per=24.17%, avg=282.57, stdev=182.00, samples=42 iops : min= 6, max= 66, avg=17.00, stdev=11.50, samples=42 lat (msec) : 4=1.69%, 10=16.28%, 20=27.73%, 50=37.89%, 100=16.02% lat (msec) : 250=0.39% cpu : usr=0.07%, sys=13.10%, ctx=1727, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182898: Fri Nov 14 17:03:43 2025 read: IOPS=18, BW=292KiB/s (299kB/s)(6256KiB/21439msec) clat (msec): min=4, max=106, avg=24.94, stdev=17.67 lat (msec): min=4, max=106, avg=24.94, stdev=17.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 49], 95.00th=[ 63], | 99.00th=[ 85], 99.50th=[ 97], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 96, max= 1088, per=25.86%, avg=287.26, stdev=189.45, samples=42 iops : min= 6, max= 68, avg=17.29, stdev=11.95, samples=42 write: IOPS=17, BW=281KiB/s (288kB/s)(6032KiB/21439msec); 0 zone resets clat (usec): min=4999, max=88725, avg=30719.66, stdev=18790.96 lat (usec): min=5000, max=88728, avg=30722.12, stdev=18791.04 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 8094], 10.00th=[ 9634], 20.00th=[14484], | 30.00th=[17171], 40.00th=[20841], 50.00th=[25560], 60.00th=[32375], | 70.00th=[39060], 80.00th=[46924], 90.00th=[58983], 95.00th=[68682], | 99.00th=[84411], 99.50th=[85459], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 64, max= 768, per=23.11%, avg=270.12, stdev=119.16, samples=42 iops : min= 4, max= 48, avg=16.21, stdev= 7.63, samples=42 lat (msec) : 10=14.06%, 20=30.21%, 50=42.32%, 100=13.28%, 250=0.13% cpu : usr=0.13%, sys=13.74%, ctx=1726, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182899: Fri Nov 14 17:03:43 2025 read: IOPS=17, BW=282KiB/s (289kB/s)(6032KiB/21396msec) clat (usec): min=3578, max=84144, avg=25591.00, stdev=18046.89 lat (usec): min=3579, max=84145, avg=25592.03, stdev=18046.92 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 6849], 10.00th=[ 7898], 20.00th=[10421], | 30.00th=[13566], 40.00th=[15533], 50.00th=[20055], 60.00th=[25035], | 70.00th=[29754], 80.00th=[39060], 90.00th=[54789], 95.00th=[64750], | 99.00th=[79168], 99.50th=[82314], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 64, max= 1024, per=24.82%, avg=275.76, stdev=162.65, samples=42 iops : min= 4, max= 64, avg=16.57, stdev=10.33, samples=42 write: IOPS=18, BW=292KiB/s (299kB/s)(6256KiB/21396msec); 0 zone resets clat (msec): min=6, max=101, avg=29.77, stdev=18.69 lat (msec): min=6, max=101, avg=29.77, stdev=18.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 70], | 99.00th=[ 83], 99.50th=[ 87], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 126, max= 896, per=24.59%, avg=287.50, stdev=141.68, samples=42 iops : min= 7, max= 56, avg=17.29, stdev= 9.02, samples=42 lat (msec) : 4=0.13%, 10=14.32%, 20=29.56%, 50=41.80%, 100=14.06% lat (msec) : 250=0.13% cpu : usr=0.09%, sys=13.95%, ctx=1745, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1112KiB/s (1138kB/s), 267KiB/s-292KiB/s (273kB/s-299kB/s), io=23.4MiB (24.5MB), run=21361-21545msec WRITE: bw=1170KiB/s (1198kB/s), 281KiB/s-304KiB/s (288kB/s-311kB/s), io=24.6MiB (25.8MB), run=21361-21545msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182908: Fri Nov 14 17:03:53 2025 read: IOPS=2, BW=2494KiB/s (2554kB/s)(7168KiB/2874msec) clat (msec): min=43, max=252, avg=123.52, stdev=72.15 lat (msec): min=43, max=252, avg=123.52, stdev=72.15 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 56], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 114], 60.00th=[ 124], | 70.00th=[ 124], 80.00th=[ 178], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 2048, max= 4106, per=51.51%, avg=3366.67, stdev=1144.80, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1781KiB/s (1824kB/s)(5120KiB/2874msec); 0 zone resets clat (msec): min=79, max=724, avg=387.97, stdev=250.67 lat (msec): min=79, max=724, avg=388.05, stdev=250.67 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1921, max= 2048, per=21.83%, avg=1997.50, stdev=62.06, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=20.81%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182910: Fri Nov 14 17:03:53 2025 read: IOPS=0, BW=660KiB/s (676kB/s)(2048KiB/3104msec) clat (msec): min=190, max=381, avg=285.55, stdev=135.11 lat (msec): min=190, max=381, avg=285.55, stdev=135.11 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2007, max= 2031, per=30.89%, avg=2019.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3299KiB/s (3378kB/s)(10.0MiB/3104msec); 0 zone resets clat (msec): min=66, max=574, avg=251.77, stdev=179.05 lat (msec): min=67, max=575, avg=251.85, stdev=179.04 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 82], | 30.00th=[ 89], 40.00th=[ 108], 50.00th=[ 215], 60.00th=[ 249], | 70.00th=[ 255], 80.00th=[ 430], 90.00th=[ 456], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1935, max= 6095, per=39.40%, avg=3605.60, stdev=2193.47, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.06%, sys=18.88%, ctx=134, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182913: Fri Nov 14 17:03:53 2025 read: IOPS=1, BW=1976KiB/s (2024kB/s)(6144KiB/3109msec) clat (msec): min=50, max=293, avg=108.35, stdev=95.34 lat (msec): min=50, max=293, avg=108.35, stdev=95.34 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 53], | 30.00th=[ 53], 40.00th=[ 55], 50.00th=[ 55], 60.00th=[ 69], | 70.00th=[ 130], 80.00th=[ 130], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2031, max= 6144, per=52.05%, avg=3402.00, stdev=2374.64, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1976KiB/s (2024kB/s)(6144KiB/3109msec); 0 zone resets clat (msec): min=166, max=1038, avg=399.72, stdev=318.27 lat (msec): min=166, max=1038, avg=399.80, stdev=318.28 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 309], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1973, max= 4063, per=26.58%, avg=2432.60, stdev=911.94, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 100=33.33%, 250=16.67%, 500=41.67%, 2000=8.33% cpu : usr=0.03%, sys=19.59%, ctx=190, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182915: Fri Nov 14 17:03:53 2025 read: IOPS=1, BW=1634KiB/s (1673kB/s)(5120KiB/3133msec) clat (msec): min=39, max=417, avg=202.35, stdev=173.00 lat (msec): min=39, max=417, avg=202.35, stdev=173.00 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 40], | 30.00th=[ 70], 40.00th=[ 70], 50.00th=[ 129], 60.00th=[ 129], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 4096, max= 4096, per=62.67%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2288KiB/s (2343kB/s)(7168KiB/3133msec); 0 zone resets clat (msec): min=58, max=952, avg=294.65, stdev=312.39 lat (msec): min=58, max=952, avg=294.73, stdev=312.37 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 72], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 207], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 359], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1376, max= 5763, per=39.01%, avg=3569.50, stdev=3102.08, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=19.06%, ctx=238, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6537KiB/s (6694kB/s), 660KiB/s-2494KiB/s (676kB/s-2554kB/s), io=20.0MiB (20.0MB), run=2874-3133msec WRITE: bw=9152KiB/s (9371kB/s), 1781KiB/s-3299KiB/s (1824kB/s-3378kB/s), io=28.0MiB (29.4MB), run=2874-3133msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182909: Fri Nov 14 17:03:53 2025 read: IOPS=4, BW=4287KiB/s (4390kB/s)(7168KiB/1672msec) clat (usec): min=764, max=172851, avg=91463.61, stdev=65686.38 lat (usec): min=764, max=172852, avg=91464.66, stdev=65686.61 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[ 783], | 30.00th=[103285], 40.00th=[103285], 50.00th=[114820], 60.00th=[121111], | 70.00th=[121111], 80.00th=[127402], 90.00th=[173016], 95.00th=[173016], | 99.00th=[173016], 99.50th=[173016], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 1976, max= 5885, per=61.18%, avg=3910.67, stdev=1954.80, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=3062KiB/s (3136kB/s)(5120KiB/1672msec); 0 zone resets clat (msec): min=102, max=370, avg=198.84, stdev=102.81 lat (msec): min=103, max=371, avg=198.89, stdev=102.81 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1976, max= 5807, per=43.49%, avg=3891.50, stdev=2708.93, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 1000=16.67% lat (msec) : 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=62.54%, ctx=770, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182911: Fri Nov 14 17:03:53 2025 read: IOPS=0, BW=639KiB/s (655kB/s)(2048KiB/3204msec) clat (msec): min=138, max=469, avg=303.78, stdev=234.43 lat (msec): min=138, max=469, avg=303.78, stdev=234.43 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1976, max= 2048, per=31.48%, avg=2012.00, stdev=50.91, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3196KiB/s (3273kB/s)(10.0MiB/3204msec); 0 zone resets clat (msec): min=37, max=706, avg=253.78, stdev=183.82 lat (msec): min=37, max=706, avg=253.86, stdev=183.81 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 86], | 30.00th=[ 146], 40.00th=[ 180], 50.00th=[ 232], 60.00th=[ 264], | 70.00th=[ 275], 80.00th=[ 292], 90.00th=[ 326], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2031, max= 4096, per=38.98%, avg=3487.75, stdev=975.61, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.06%, sys=47.36%, ctx=555, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182912: Fri Nov 14 17:03:53 2025 read: IOPS=2, BW=2328KiB/s (2384kB/s)(6144KiB/2639msec) clat (usec): min=606, max=292975, avg=81050.79, stdev=128469.53 lat (usec): min=607, max=292976, avg=81051.61, stdev=128469.40 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 750], | 30.00th=[ 750], 40.00th=[ 922], 50.00th=[ 922], 60.00th=[ 1045], | 70.00th=[189793], 80.00th=[189793], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 3871, max= 6144, per=78.34%, avg=5007.50, stdev=1607.25, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2328KiB/s (2384kB/s)(6144KiB/2639msec); 0 zone resets clat (msec): min=152, max=1043, avg=355.61, stdev=344.72 lat (msec): min=152, max=1043, avg=355.66, stdev=344.75 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 239], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1935, max= 4096, per=26.81%, avg=2399.00, stdev=949.32, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 750=8.33%, 1000=16.67% lat (msec) : 2=8.33%, 250=41.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=38.63%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182914: Fri Nov 14 17:03:53 2025 read: IOPS=1, BW=1939KiB/s (1985kB/s)(5120KiB/2641msec) clat (usec): min=793, max=133814, avg=59519.97, stdev=66626.88 lat (usec): min=794, max=133815, avg=59520.90, stdev=66626.89 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 791], | 30.00th=[ 1123], 40.00th=[ 1123], 50.00th=[ 33817], 60.00th=[ 33817], | 70.00th=[128451], 80.00th=[128451], 90.00th=[133694], 95.00th=[133694], | 99.00th=[133694], 99.50th=[133694], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2714KiB/s (2779kB/s)(7168KiB/2641msec); 0 zone resets clat (msec): min=185, max=571, avg=327.42, stdev=129.75 lat (msec): min=185, max=571, avg=327.48, stdev=129.76 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 222], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 347], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 372], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1957, max= 3871, per=26.56%, avg=2376.60, stdev=836.24, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=44.92%, ctx=145, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6392KiB/s (6545kB/s), 639KiB/s-4287KiB/s (655kB/s-4390kB/s), io=20.0MiB (20.0MB), run=1672-3204msec WRITE: bw=8949KiB/s (9164kB/s), 2328KiB/s-3196KiB/s (2384kB/s-3273kB/s), io=28.0MiB (29.4MB), run=1672-3204msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182926: Fri Nov 14 17:04:02 2025 read: IOPS=2, BW=8853KiB/s (9065kB/s)(12.0MiB/1388msec) clat (msec): min=415, max=496, avg=453.42, stdev=40.94 lat (msec): min=415, max=496, avg=453.42, stdev=40.94 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 6113, max= 8192, per=76.58%, avg=7152.50, stdev=1470.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.07%, sys=51.84%, ctx=2648, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182927: Fri Nov 14 17:04:02 2025 read: IOPS=0, BW=2335KiB/s (2391kB/s)(4096KiB/1754msec) clat (nsec): min=472546k, max=472546k, avg=472545595.00, stdev= 0.00 lat (nsec): min=472548k, max=472548k, avg=472547502.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 5610, max= 5610, per=60.06%, avg=5610.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4670KiB/s (4783kB/s)(8192KiB/1754msec); 0 zone resets clat (msec): min=471, max=745, avg=608.39, stdev=193.78 lat (msec): min=471, max=745, avg=608.68, stdev=193.75 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8192, max= 8192, per=43.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=20.08%, ctx=946, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182928: Fri Nov 14 17:04:02 2025 write: IOPS=1, BW=7301KiB/s (7476kB/s)(12.0MiB/1683msec); 0 zone resets clat (msec): min=270, max=959, avg=555.58, stdev=359.58 lat (msec): min=270, max=959, avg=555.86, stdev=359.59 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8192, max= 8192, per=43.85%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=15.34%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182929: Fri Nov 14 17:04:02 2025 write: IOPS=1, BW=8100KiB/s (8295kB/s)(12.0MiB/1517msec); 0 zone resets clat (msec): min=399, max=566, avg=483.99, stdev=83.54 lat (msec): min=399, max=566, avg=484.26, stdev=83.52 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 5736, max= 8192, per=37.28%, avg=6964.00, stdev=1736.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=22.16%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9341KiB/s (9565kB/s), 2335KiB/s-8853KiB/s (2391kB/s-9065kB/s), io=16.0MiB (16.8MB), run=1388-1754msec WRITE: bw=18.2MiB/s (19.1MB/s), 4670KiB/s-8100KiB/s (4783kB/s-8295kB/s), io=32.0MiB (33.6MB), run=1517-1754msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182921: Fri Nov 14 17:04:02 2025 read: IOPS=2, BW=11.5MiB/s (12.0MB/s)(12.0MiB/1045msec) clat (msec): min=156, max=628, avg=323.46, stdev=264.68 lat (msec): min=156, max=628, avg=323.46, stdev=264.68 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min=15515, max=15515, per=100.00%, avg=15515.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 750=33.33% cpu : usr=0.00%, sys=25.77%, ctx=135, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182922: Fri Nov 14 17:04:02 2025 read: IOPS=0, BW=2017KiB/s (2065kB/s)(4096KiB/2031msec) clat (nsec): min=527944k, max=527944k, avg=527944123.00, stdev= 0.00 lat (nsec): min=527945k, max=527945k, avg=527945480.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7953, max= 7953, per=98.60%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4033KiB/s (4130kB/s)(8192KiB/2031msec); 0 zone resets clat (msec): min=274, max=1014, avg=644.47, stdev=522.96 lat (msec): min=274, max=1014, avg=644.68, stdev=523.08 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=20.44%, ctx=114, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182923: Fri Nov 14 17:04:02 2025 write: IOPS=1, BW=6107KiB/s (6254kB/s)(12.0MiB/2012msec); 0 zone resets clat (msec): min=251, max=1303, avg=646.71, stdev=572.88 lat (msec): min=251, max=1304, avg=647.00, stdev=572.93 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8159, max= 8159, per=50.57%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=14.87%, ctx=72, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182924: Fri Nov 14 17:04:02 2025 write: IOPS=1, BW=7892KiB/s (8082kB/s)(12.0MiB/1557msec); 0 zone resets clat (msec): min=342, max=761, avg=493.39, stdev=232.94 lat (msec): min=343, max=761, avg=493.66, stdev=232.92 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7757, max= 7953, per=48.69%, avg=7855.00, stdev=138.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=20.24%, ctx=102, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8067KiB/s (8261kB/s), 2017KiB/s-11.5MiB/s (2065kB/s-12.0MB/s), io=16.0MiB (16.8MB), run=1045-2031msec WRITE: bw=15.8MiB/s (16.5MB/s), 4033KiB/s-7892KiB/s (4130kB/s-8082kB/s), io=32.0MiB (33.6MB), run=1557-2031msec