== sanity test 398b: DIO and buffer IO race ============== 15:45:45 (1761248745) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.23973 s, 11.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148304: Thu Oct 23 15:47:30 2025 read: IOPS=16, BW=67.3KiB/s (68.9kB/s)(5992KiB/89076msec) clat (usec): min=111, max=531756, avg=29222.07, stdev=26324.78 lat (usec): min=111, max=531759, avg=29224.02, stdev=26324.88 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 167], 10.00th=[ 314], 20.00th=[ 13566], | 30.00th=[ 17433], 40.00th=[ 20579], 50.00th=[ 24249], 60.00th=[ 29492], | 70.00th=[ 36439], 80.00th=[ 43254], 90.00th=[ 54264], 95.00th=[ 66847], | 99.00th=[114820], 99.50th=[149947], 99.90th=[265290], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 128, per=25.29%, avg=66.77, stdev=24.74, samples=175 iops : min= 1, max= 32, avg=16.08, stdev= 6.25, samples=175 write: IOPS=17, BW=70.7KiB/s (72.4kB/s)(6296KiB/89076msec); 0 zone resets clat (usec): min=922, max=330994, avg=28688.53, stdev=31033.32 lat (usec): min=923, max=330996, avg=28690.59, stdev=31033.24 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1106], 10.00th=[ 1237], 20.00th=[ 2671], | 30.00th=[ 5932], 40.00th=[ 14353], 50.00th=[ 21627], 60.00th=[ 30016], | 70.00th=[ 38011], 80.00th=[ 47973], 90.00th=[ 64750], 95.00th=[ 80217], | 99.00th=[128451], 99.50th=[168821], 99.90th=[299893], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 148, per=25.38%, avg=70.31, stdev=24.93, samples=175 iops : min= 1, max= 37, avg=16.97, stdev= 6.31, samples=175 lat (usec) : 250=4.39%, 500=1.01%, 750=0.10%, 1000=0.20% lat (msec) : 2=8.82%, 4=4.13%, 10=6.74%, 20=17.48%, 50=41.24% lat (msec) : 100=13.93%, 250=1.76%, 500=0.16%, 750=0.03% cpu : usr=0.09%, sys=7.84%, ctx=6393, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148305: Thu Oct 23 15:47:30 2025 read: IOPS=16, BW=65.5KiB/s (67.1kB/s)(5940KiB/90698msec) clat (usec): min=82, max=483098, avg=28542.03, stdev=24836.78 lat (usec): min=83, max=483099, avg=28543.31, stdev=24836.86 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 169], 10.00th=[ 281], 20.00th=[ 13698], | 30.00th=[ 17433], 40.00th=[ 21103], 50.00th=[ 24773], 60.00th=[ 28967], | 70.00th=[ 34341], 80.00th=[ 41681], 90.00th=[ 54264], 95.00th=[ 64226], | 99.00th=[ 98042], 99.50th=[112722], 99.90th=[329253], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 5, max= 135, per=24.68%, avg=65.17, stdev=25.02, samples=179 iops : min= 1, max= 33, avg=15.67, stdev= 6.28, samples=179 write: IOPS=17, BW=69.0KiB/s (71.7kB/s)(6348KiB/90698msec); 0 zone resets clat (usec): min=958, max=255154, avg=30344.13, stdev=31144.42 lat (usec): min=959, max=255155, avg=30348.33, stdev=31146.24 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 2573], | 30.00th=[ 6652], 40.00th=[ 14353], 50.00th=[ 23200], 60.00th=[ 31327], | 70.00th=[ 40109], 80.00th=[ 51119], 90.00th=[ 70779], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[158335], 99.90th=[252707], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 5, max= 198, per=25.15%, avg=69.66, stdev=28.66, samples=179 iops : min= 1, max= 49, avg=16.81, stdev= 7.22, samples=179 lat (usec) : 100=0.03%, 250=4.56%, 500=0.75%, 750=0.13%, 1000=0.36% lat (msec) : 2=8.82%, 4=3.45%, 10=6.71%, 20=16.34%, 50=41.67% lat (msec) : 100=15.07%, 250=1.99%, 500=0.13% cpu : usr=0.10%, sys=7.81%, ctx=6490, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148306: Thu Oct 23 15:47:30 2025 read: IOPS=16, BW=67.0KiB/s (68.6kB/s)(6028KiB/89963msec) clat (usec): min=106, max=212038, avg=28935.80, stdev=21955.26 lat (usec): min=107, max=212039, avg=28943.97, stdev=21954.62 clat percentiles (usec): | 1.00th=[ 130], 5.00th=[ 159], 10.00th=[ 314], 20.00th=[ 13566], | 30.00th=[ 17433], 40.00th=[ 20841], 50.00th=[ 25560], 60.00th=[ 30016], | 70.00th=[ 35914], 80.00th=[ 43254], 90.00th=[ 54789], 95.00th=[ 66847], | 99.00th=[102237], 99.50th=[119014], 99.90th=[181404], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 142, per=25.39%, avg=67.03, stdev=27.19, samples=176 iops : min= 1, max= 35, avg=16.14, stdev= 6.82, samples=176 write: IOPS=17, BW=69.6KiB/s (71.3kB/s)(6260KiB/89963msec); 0 zone resets clat (usec): min=870, max=587857, avg=29538.55, stdev=34493.92 lat (usec): min=871, max=587859, avg=29543.31, stdev=34496.87 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1123], 10.00th=[ 1270], 20.00th=[ 2737], | 30.00th=[ 6259], 40.00th=[ 13173], 50.00th=[ 21890], 60.00th=[ 28705], | 70.00th=[ 36439], 80.00th=[ 49546], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[135267], 99.50th=[158335], 99.90th=[304088], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 11, max= 150, per=24.99%, avg=69.22, stdev=26.98, samples=177 iops : min= 2, max= 37, avg=16.70, stdev= 6.79, samples=177 lat (usec) : 250=4.26%, 500=1.04%, 750=0.26%, 1000=0.65% lat (msec) : 2=8.53%, 4=3.52%, 10=6.93%, 20=17.42%, 50=40.79% lat (msec) : 100=14.16%, 250=2.38%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=7.64%, ctx=6423, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148307: Thu Oct 23 15:47:30 2025 read: IOPS=16, BW=67.4KiB/s (68.0kB/s)(6052KiB/89826msec) clat (usec): min=99, max=347934, avg=28578.85, stdev=22256.88 lat (usec): min=100, max=347935, avg=28579.99, stdev=22256.90 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 159], 10.00th=[ 265], 20.00th=[ 14091], | 30.00th=[ 17957], 40.00th=[ 21103], 50.00th=[ 24511], 60.00th=[ 29492], | 70.00th=[ 35914], 80.00th=[ 42730], 90.00th=[ 52167], 95.00th=[ 62653], | 99.00th=[ 95945], 99.50th=[131597], 99.90th=[193987], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 15, max= 158, per=25.66%, avg=67.75, stdev=24.06, samples=175 iops : min= 3, max= 39, avg=16.31, stdev= 6.07, samples=175 write: IOPS=17, BW=69.4KiB/s (71.1kB/s)(6236KiB/89826msec); 0 zone resets clat (usec): min=874, max=632537, avg=29812.77, stdev=33722.84 lat (usec): min=875, max=632538, avg=29814.20, stdev=33722.82 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1106], 10.00th=[ 1205], 20.00th=[ 2606], | 30.00th=[ 6456], 40.00th=[ 14746], 50.00th=[ 22676], 60.00th=[ 30016], | 70.00th=[ 38536], 80.00th=[ 51119], 90.00th=[ 67634], 95.00th=[ 85459], | 99.00th=[126354], 99.50th=[145753], 99.90th=[346031], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 5, max= 167, per=24.87%, avg=68.89, stdev=24.78, samples=177 iops : min= 1, max= 41, avg=16.62, stdev= 6.21, samples=177 lat (usec) : 100=0.03%, 250=4.82%, 500=0.59%, 750=0.07%, 1000=0.75% lat (msec) : 2=8.27%, 4=3.74%, 10=5.99%, 20=17.42%, 50=41.80% lat (msec) : 100=14.58%, 250=1.86%, 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=7.74%, ctx=6441, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=265KiB/s (271kB/s), 65.5KiB/s-67.4KiB/s (67.1kB/s-68.0kB/s), io=23.4MiB (24.6MB), run=89076-90698msec WRITE: bw=277KiB/s (284kB/s), 69.4KiB/s-70.7KiB/s (71.1kB/s-72.4kB/s), io=24.6MiB (25.7MB), run=89076-90698msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148299: Thu Oct 23 15:49:39 2025 read: IOPS=6, BW=27.4KiB/s (28.0kB/s)(5992KiB/218989msec) clat (msec): min=4, max=616, avg=25.99, stdev=27.54 lat (msec): min=4, max=616, avg=26.00, stdev=27.54 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 53], 95.00th=[ 72], | 99.00th=[ 117], 99.50th=[ 144], 99.90th=[ 234], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 95, per=27.07%, avg=29.51, stdev=18.71, samples=394 iops : min= 1, max= 23, avg= 6.78, stdev= 4.71, samples=394 write: IOPS=7, BW=28.8KiB/s (29.4kB/s)(6296KiB/218989msec); 0 zone resets clat (msec): min=38, max=398, avg=114.23, stdev=47.74 lat (msec): min=38, max=398, avg=114.23, stdev=47.74 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 95], 50.00th=[ 104], 60.00th=[ 114], | 70.00th=[ 127], 80.00th=[ 144], 90.00th=[ 176], 95.00th=[ 213], | 99.00th=[ 271], 99.50th=[ 300], 99.90th=[ 380], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 55, per=24.74%, avg=28.21, stdev=10.77, samples=432 iops : min= 1, max= 13, avg= 6.44, stdev= 2.76, samples=432 lat (msec) : 10=5.96%, 20=22.59%, 50=15.53%, 100=27.38%, 250=27.51% lat (msec) : 500=1.01%, 750=0.03% cpu : usr=0.06%, sys=1.50%, ctx=5464, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148300: Thu Oct 23 15:49:39 2025 read: IOPS=6, BW=27.1KiB/s (27.7kB/s)(5940KiB/219503msec) clat (msec): min=5, max=571, avg=25.20, stdev=25.13 lat (msec): min=5, max=571, avg=25.20, stdev=25.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 50], 95.00th=[ 66], | 99.00th=[ 105], 99.50th=[ 128], 99.90th=[ 251], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 5, max= 111, per=26.97%, avg=29.39, stdev=19.50, samples=392 iops : min= 1, max= 27, avg= 6.74, stdev= 4.92, samples=392 write: IOPS=7, BW=28.9KiB/s (29.6kB/s)(6348KiB/219503msec); 0 zone resets clat (msec): min=39, max=440, avg=114.56, stdev=47.59 lat (msec): min=39, max=440, avg=114.57, stdev=47.58 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 116], | 70.00th=[ 129], 80.00th=[ 148], 90.00th=[ 178], 95.00th=[ 201], | 99.00th=[ 271], 99.50th=[ 317], 99.90th=[ 384], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 56, per=24.92%, avg=28.41, stdev=10.47, samples=432 iops : min= 1, max= 14, avg= 6.50, stdev= 2.69, samples=432 lat (msec) : 10=6.25%, 20=21.74%, 50=16.67%, 100=25.75%, 250=28.71% lat (msec) : 500=0.85%, 750=0.03% cpu : usr=0.04%, sys=1.47%, ctx=5331, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148301: Thu Oct 23 15:49:39 2025 read: IOPS=6, BW=27.5KiB/s (28.1kB/s)(6028KiB/219373msec) clat (msec): min=5, max=337, avg=26.95, stdev=25.92 lat (msec): min=5, max=337, avg=26.96, stdev=25.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 38], 90.00th=[ 57], 95.00th=[ 72], | 99.00th=[ 120], 99.50th=[ 144], 99.90th=[ 305], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 96, per=26.49%, avg=28.88, stdev=18.50, samples=405 iops : min= 1, max= 24, avg= 6.61, stdev= 4.65, samples=405 write: IOPS=7, BW=28.5KiB/s (29.2kB/s)(6260KiB/219373msec); 0 zone resets clat (msec): min=35, max=670, avg=114.06, stdev=49.58 lat (msec): min=35, max=670, avg=114.06, stdev=49.58 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 94], 50.00th=[ 104], 60.00th=[ 115], | 70.00th=[ 128], 80.00th=[ 144], 90.00th=[ 174], 95.00th=[ 203], | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 456], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 55, per=24.67%, avg=28.12, stdev=11.07, samples=431 iops : min= 1, max= 13, avg= 6.42, stdev= 2.84, samples=431 lat (msec) : 10=5.96%, 20=21.32%, 50=16.31%, 100=28.39%, 250=26.99% lat (msec) : 500=1.01%, 750=0.03% cpu : usr=0.05%, sys=1.50%, ctx=5442, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148302: Thu Oct 23 15:49:39 2025 read: IOPS=6, BW=27.7KiB/s (28.4kB/s)(6052KiB/218280msec) clat (msec): min=5, max=424, avg=25.89, stdev=25.99 lat (msec): min=5, max=424, avg=25.89, stdev=25.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 54], 95.00th=[ 69], | 99.00th=[ 115], 99.50th=[ 155], 99.90th=[ 338], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 110, per=27.10%, avg=29.54, stdev=19.00, samples=398 iops : min= 1, max= 27, avg= 6.79, stdev= 4.79, samples=398 write: IOPS=7, BW=28.6KiB/s (29.3kB/s)(6236KiB/218280msec); 0 zone resets clat (msec): min=34, max=720, avg=114.73, stdev=49.74 lat (msec): min=34, max=720, avg=114.73, stdev=49.74 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 116], | 70.00th=[ 131], 80.00th=[ 148], 90.00th=[ 178], 95.00th=[ 209], | 99.00th=[ 264], 99.50th=[ 317], 99.90th=[ 380], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 63, per=24.61%, avg=28.05, stdev=10.80, samples=431 iops : min= 1, max= 15, avg= 6.40, stdev= 2.77, samples=431 lat (msec) : 10=5.89%, 20=22.79%, 50=16.05%, 100=26.92%, 250=27.54% lat (msec) : 500=0.78%, 750=0.03% cpu : usr=0.05%, sys=1.51%, ctx=5416, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=109KiB/s (112kB/s), 27.1KiB/s-27.7KiB/s (27.7kB/s-28.4kB/s), io=23.4MiB (24.6MB), run=218280-219503msec WRITE: bw=115KiB/s (117kB/s), 28.5KiB/s-28.9KiB/s (29.2kB/s-29.6kB/s), io=24.6MiB (25.7MB), run=218280-219503msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148362: Thu Oct 23 15:50:13 2025 read: IOPS=15, BW=242KiB/s (248kB/s)(5920KiB/24481msec) clat (usec): min=96, max=166180, avg=34736.27, stdev=28420.87 lat (usec): min=96, max=166182, avg=34737.48, stdev=28420.81 clat percentiles (usec): | 1.00th=[ 123], 5.00th=[ 143], 10.00th=[ 163], 20.00th=[ 310], | 30.00th=[ 18220], 40.00th=[ 26084], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[133694], 99.50th=[149947], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 30, max= 540, per=26.36%, avg=243.00, stdev=95.64, samples=47 iops : min= 1, max= 33, avg=14.47, stdev= 6.03, samples=47 write: IOPS=16, BW=260KiB/s (266kB/s)(6368KiB/24481msec); 0 zone resets clat (usec): min=1216, max=224763, avg=29106.83, stdev=35264.64 lat (usec): min=1217, max=224768, avg=29108.78, stdev=35264.68 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1532], 10.00th=[ 1631], 20.00th=[ 2212], | 30.00th=[ 6783], 40.00th=[ 11731], 50.00th=[ 17171], 60.00th=[ 24249], | 70.00th=[ 33817], 80.00th=[ 46924], 90.00th=[ 70779], 95.00th=[ 93848], | 99.00th=[189793], 99.50th=[225444], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 62, max= 510, per=27.00%, avg=261.89, stdev=98.25, samples=47 iops : min= 3, max= 31, avg=15.70, stdev= 6.19, samples=47 lat (usec) : 100=0.13%, 250=8.98%, 500=0.91% lat (msec) : 2=10.29%, 4=2.21%, 10=8.07%, 20=13.02%, 50=33.98% lat (msec) : 100=19.27%, 250=3.12% cpu : usr=0.09%, sys=7.02%, ctx=1359, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148363: Thu Oct 23 15:50:13 2025 read: IOPS=14, BW=225KiB/s (231kB/s)(5744KiB/25496msec) clat (usec): min=108, max=274143, avg=35523.91, stdev=32571.58 lat (usec): min=108, max=274145, avg=35525.03, stdev=32571.65 clat percentiles (usec): | 1.00th=[ 116], 5.00th=[ 145], 10.00th=[ 163], 20.00th=[ 330], | 30.00th=[ 19006], 40.00th=[ 25560], 50.00th=[ 30278], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 54264], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[154141], 99.50th=[164627], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 46, max= 506, per=24.79%, avg=228.56, stdev=104.52, samples=48 iops : min= 2, max= 31, avg=13.56, stdev= 6.64, samples=48 write: IOPS=16, BW=257KiB/s (263kB/s)(6544KiB/25496msec); 0 zone resets clat (usec): min=1229, max=213775, avg=30980.38, stdev=36306.56 lat (usec): min=1231, max=213777, avg=30982.33, stdev=36306.69 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1483], 10.00th=[ 1565], 20.00th=[ 2180], | 30.00th=[ 5735], 40.00th=[ 10421], 50.00th=[ 17171], 60.00th=[ 27657], | 70.00th=[ 38536], 80.00th=[ 55313], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[170918], 99.50th=[179307], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 572, per=26.02%, avg=252.35, stdev=119.27, samples=49 iops : min= 1, max= 35, avg=15.08, stdev= 7.52, samples=49 lat (usec) : 250=8.98%, 500=0.39%, 750=0.13% lat (msec) : 2=10.68%, 4=3.12%, 10=8.59%, 20=11.46%, 50=33.59% lat (msec) : 100=18.88%, 250=4.04%, 500=0.13% cpu : usr=0.09%, sys=6.74%, ctx=1325, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148364: Thu Oct 23 15:50:13 2025 read: IOPS=15, BW=241KiB/s (247kB/s)(6256KiB/25958msec) clat (usec): min=96, max=331404, avg=37344.28, stdev=40785.81 lat (usec): min=96, max=331406, avg=37345.50, stdev=40785.75 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 139], 10.00th=[ 153], 20.00th=[ 190], | 30.00th=[ 14353], 40.00th=[ 22938], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 47973], 80.00th=[ 58983], 90.00th=[ 76022], 95.00th=[101188], | 99.00th=[252707], 99.50th=[274727], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 62, max= 473, per=26.02%, avg=239.86, stdev=104.73, samples=50 iops : min= 3, max= 29, avg=14.30, stdev= 6.64, samples=50 write: IOPS=14, BW=232KiB/s (238kB/s)(6032KiB/25958msec); 0 zone resets clat (usec): min=1293, max=241682, avg=30048.90, stdev=33845.41 lat (usec): min=1294, max=241683, avg=30050.89, stdev=33845.52 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1532], 10.00th=[ 1631], 20.00th=[ 2245], | 30.00th=[ 7635], 40.00th=[ 13566], 50.00th=[ 21365], 60.00th=[ 29492], | 70.00th=[ 37487], 80.00th=[ 49021], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[179307], 99.50th=[223347], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 60, max= 506, per=23.55%, avg=228.40, stdev=110.51, samples=50 iops : min= 3, max= 31, avg=13.56, stdev= 7.02, samples=50 lat (usec) : 100=0.26%, 250=10.81%, 500=0.39%, 750=0.26%, 1000=0.13% lat (msec) : 2=9.77%, 4=2.47%, 10=6.38%, 20=11.59%, 50=34.11% lat (msec) : 100=19.66%, 250=3.65%, 500=0.52% cpu : usr=0.09%, sys=6.75%, ctx=1420, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148365: Thu Oct 23 15:50:13 2025 read: IOPS=15, BW=243KiB/s (249kB/s)(6032KiB/24813msec) clat (usec): min=109, max=478131, avg=34695.99, stdev=35278.17 lat (usec): min=109, max=478132, avg=34697.09, stdev=35278.17 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 147], 10.00th=[ 161], 20.00th=[ 3851], | 30.00th=[ 20055], 40.00th=[ 25560], 50.00th=[ 31589], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[119014], 99.50th=[154141], 99.90th=[476054], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 64, max= 413, per=26.23%, avg=241.83, stdev=80.23, samples=48 iops : min= 4, max= 25, avg=14.42, stdev= 5.04, samples=48 write: IOPS=15, BW=252KiB/s (258kB/s)(6256KiB/24813msec); 0 zone resets clat (usec): min=1308, max=208220, avg=29789.71, stdev=31679.59 lat (usec): min=1311, max=208221, avg=29791.76, stdev=31679.50 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1483], 10.00th=[ 1614], 20.00th=[ 1876], | 30.00th=[ 6390], 40.00th=[ 13566], 50.00th=[ 19792], 60.00th=[ 29230], | 70.00th=[ 38011], 80.00th=[ 50594], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[149947], 99.50th=[168821], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 435, per=26.09%, avg=253.04, stdev=90.78, samples=48 iops : min= 1, max= 27, avg=15.12, stdev= 5.79, samples=48 lat (usec) : 250=8.59%, 500=0.65% lat (msec) : 2=10.42%, 4=3.39%, 10=6.12%, 20=11.20%, 50=38.93% lat (msec) : 100=17.45%, 250=3.12%, 500=0.13% cpu : usr=0.10%, sys=7.00%, ctx=1329, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=923KiB/s (945kB/s), 225KiB/s-243KiB/s (231kB/s-249kB/s), io=23.4MiB (24.5MB), run=24481-25958msec WRITE: bw=971KiB/s (994kB/s), 232KiB/s-260KiB/s (238kB/s-266kB/s), io=24.6MiB (25.8MB), run=24481-25958msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148357: Thu Oct 23 15:50:50 2025 read: IOPS=5, BW=94.6KiB/s (96.9kB/s)(5920KiB/62585msec) clat (msec): min=5, max=227, avg=30.91, stdev=32.10 lat (msec): min=5, max=227, avg=30.91, stdev=32.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 61], 95.00th=[ 94], | 99.00th=[ 192], 99.50th=[ 224], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 26, max= 403, per=26.59%, avg=100.77, stdev=67.93, samples=115 iops : min= 1, max= 25, avg= 5.54, stdev= 4.35, samples=115 write: IOPS=6, BW=102KiB/s (104kB/s)(6368KiB/62585msec); 0 zone resets clat (msec): min=41, max=447, avg=128.11, stdev=62.74 lat (msec): min=41, max=447, avg=128.11, stdev=62.74 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 102], 50.00th=[ 110], 60.00th=[ 123], | 70.00th=[ 142], 80.00th=[ 169], 90.00th=[ 209], 95.00th=[ 259], | 99.00th=[ 359], 99.50th=[ 368], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 26, max= 192, per=25.45%, avg=101.54, stdev=45.48, samples=123 iops : min= 1, max= 12, avg= 5.59, stdev= 2.91, samples=123 lat (msec) : 10=4.82%, 20=19.40%, 50=18.36%, 100=24.22%, 250=30.34% lat (msec) : 500=2.86% cpu : usr=0.05%, sys=1.49%, ctx=1379, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148358: Thu Oct 23 15:50:50 2025 read: IOPS=5, BW=90.0KiB/s (93.2kB/s)(5744KiB/63141msec) clat (msec): min=6, max=531, avg=33.79, stdev=41.76 lat (msec): min=6, max=531, avg=33.79, stdev=41.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 47], 90.00th=[ 75], 95.00th=[ 114], | 99.00th=[ 169], 99.50th=[ 209], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 30, max= 320, per=27.62%, avg=104.69, stdev=66.20, samples=107 iops : min= 1, max= 20, avg= 5.79, stdev= 4.22, samples=107 write: IOPS=6, BW=104KiB/s (106kB/s)(6544KiB/63141msec); 0 zone resets clat (msec): min=44, max=418, avg=124.34, stdev=55.97 lat (msec): min=44, max=418, avg=124.35, stdev=55.98 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 124], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 201], 95.00th=[ 228], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 26, max= 223, per=25.78%, avg=102.87, stdev=45.48, samples=124 iops : min= 1, max= 13, avg= 5.67, stdev= 2.91, samples=124 lat (msec) : 10=3.91%, 20=20.05%, 50=14.58%, 100=26.30%, 250=33.07% lat (msec) : 500=1.95%, 750=0.13% cpu : usr=0.03%, sys=1.46%, ctx=1384, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148359: Thu Oct 23 15:50:50 2025 read: IOPS=6, BW=102KiB/s (105kB/s)(6256KiB/61055msec) clat (msec): min=5, max=238, avg=31.20, stdev=34.79 lat (msec): min=5, max=238, avg=31.20, stdev=34.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 38], 90.00th=[ 66], 95.00th=[ 105], | 99.00th=[ 203], 99.50th=[ 215], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 26, max= 352, per=29.32%, avg=111.14, stdev=74.78, samples=111 iops : min= 1, max= 22, avg= 6.18, stdev= 4.75, samples=111 write: IOPS=6, BW=98.8KiB/s (101kB/s)(6032KiB/61055msec); 0 zone resets clat (msec): min=36, max=539, avg=129.43, stdev=64.22 lat (msec): min=36, max=539, avg=129.43, stdev=64.22 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 205], 95.00th=[ 255], | 99.00th=[ 384], 99.50th=[ 435], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 26, max= 223, per=24.84%, avg=99.13, stdev=45.82, samples=119 iops : min= 1, max= 13, avg= 5.43, stdev= 2.92, samples=119 lat (msec) : 10=4.04%, 20=23.44%, 50=17.19%, 100=22.01%, 250=30.86% lat (msec) : 500=2.34%, 750=0.13% cpu : usr=0.03%, sys=1.55%, ctx=1427, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148360: Thu Oct 23 15:50:50 2025 read: IOPS=6, BW=96.1KiB/s (98.4kB/s)(6032KiB/62747msec) clat (msec): min=5, max=223, avg=34.99, stdev=38.71 lat (msec): min=5, max=223, avg=34.99, stdev=38.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 46], 90.00th=[ 88], 95.00th=[ 138], | 99.00th=[ 178], 99.50th=[ 190], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 26, max= 346, per=27.10%, avg=102.69, stdev=66.85, samples=114 iops : min= 1, max= 21, avg= 5.67, stdev= 4.30, samples=114 write: IOPS=6, BW=99.7KiB/s (102kB/s)(6256KiB/62747msec); 0 zone resets clat (msec): min=35, max=535, avg=126.39, stdev=60.73 lat (msec): min=35, max=535, avg=126.40, stdev=60.73 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 123], | 70.00th=[ 138], 80.00th=[ 163], 90.00th=[ 207], 95.00th=[ 247], | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 29, max= 223, per=25.08%, avg=100.08, stdev=45.75, samples=122 iops : min= 1, max= 13, avg= 5.49, stdev= 2.90, samples=122 lat (msec) : 10=3.78%, 20=21.09%, 50=16.80%, 100=23.83%, 250=32.29% lat (msec) : 500=2.08%, 750=0.13% cpu : usr=0.05%, sys=1.49%, ctx=1462, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=379KiB/s (388kB/s), 90.0KiB/s-102KiB/s (93.2kB/s-105kB/s), io=23.4MiB (24.5MB), run=61055-63141msec WRITE: bw=399KiB/s (409kB/s), 98.8KiB/s-104KiB/s (101kB/s-106kB/s), io=24.6MiB (25.8MB), run=61055-63141msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148383: Thu Oct 23 15:51:05 2025 read: IOPS=1, BW=1913KiB/s (1959kB/s)(7168KiB/3747msec) clat (usec): min=582, max=609069, avg=188655.10, stdev=202389.49 lat (usec): min=583, max=609071, avg=188656.48, stdev=202389.88 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 25822], | 30.00th=[128451], 40.00th=[128451], 50.00th=[156238], 60.00th=[166724], | 70.00th=[166724], 80.00th=[233833], 90.00th=[608175], 95.00th=[608175], | 99.00th=[608175], 99.50th=[608175], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 1992, max= 5988, per=93.44%, avg=4017.00, stdev=1998.55, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1366KiB/s (1399kB/s)(5120KiB/3747msec); 0 zone resets clat (msec): min=122, max=1336, avg=418.99, stdev=515.90 lat (msec): min=122, max=1336, avg=419.08, stdev=515.91 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 3984, max= 4071, per=66.91%, avg=4027.50, stdev=61.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=66.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.76%, ctx=311, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148384: Thu Oct 23 15:51:05 2025 read: IOPS=0, BW=430KiB/s (440kB/s)(2048KiB/4763msec) clat (msec): min=82, max=1802, avg=942.39, stdev=1216.54 lat (msec): min=82, max=1802, avg=942.39, stdev=1216.54 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 1804], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1992, max= 2039, per=46.88%, avg=2015.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2150KiB/s (2202kB/s)(10.0MiB/4763msec); 0 zone resets clat (msec): min=106, max=1050, avg=276.04, stdev=277.22 lat (msec): min=106, max=1050, avg=276.14, stdev=277.20 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 124], | 30.00th=[ 142], 40.00th=[ 184], 50.00th=[ 207], 60.00th=[ 213], | 70.00th=[ 228], 80.00th=[ 243], 90.00th=[ 266], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1992, max= 5976, per=57.14%, avg=3439.25, stdev=1878.55, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 2000=16.67% cpu : usr=0.00%, sys=11.15%, ctx=226, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148385: Thu Oct 23 15:51:05 2025 read: IOPS=2, BW=2380KiB/s (2437kB/s)(6144KiB/2582msec) clat (usec): min=549, max=317439, avg=144903.72, stdev=127329.67 lat (usec): min=551, max=317441, avg=144905.00, stdev=127329.88 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[128451], 50.00th=[128451], 60.00th=[193987], | 70.00th=[229639], 80.00th=[229639], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 4071, max= 4079, per=94.79%, avg=4075.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2380KiB/s (2437kB/s)(6144KiB/2582msec); 0 zone resets clat (msec): min=64, max=486, avg=239.81, stdev=166.12 lat (msec): min=64, max=486, avg=239.89, stdev=166.14 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 279], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1996, max= 3112, per=39.58%, avg=2382.33, stdev=632.28, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=18.52%, ctx=114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148386: Thu Oct 23 15:51:05 2025 read: IOPS=1, BW=1582KiB/s (1620kB/s)(5120KiB/3237msec) clat (usec): min=485, max=725282, avg=190206.57, stdev=314362.87 lat (usec): min=486, max=725282, avg=190207.32, stdev=314362.72 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 586], 40.00th=[ 586], 50.00th=[ 734], 60.00th=[ 734], | 70.00th=[223347], 80.00th=[223347], 90.00th=[725615], 95.00th=[725615], | 99.00th=[725615], 99.50th=[725615], 99.90th=[725615], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 2035, max= 6119, per=94.84%, avg=4077.00, stdev=2887.82, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2214KiB/s (2268kB/s)(7168KiB/3237msec); 0 zone resets clat (msec): min=210, max=484, avg=321.92, stdev=94.62 lat (msec): min=210, max=484, avg=322.00, stdev=94.61 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 251], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 309], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 409], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1996, max= 2913, per=37.15%, avg=2236.00, stdev=451.67, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=12.64%, ctx=170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4300KiB/s (4403kB/s), 430KiB/s-2380KiB/s (440kB/s-2437kB/s), io=20.0MiB (20.0MB), run=2582-4763msec WRITE: bw=6020KiB/s (6164kB/s), 1366KiB/s-2380KiB/s (1399kB/s-2437kB/s), io=28.0MiB (29.4MB), run=2582-4763msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148388: Thu Oct 23 15:51:05 2025 read: IOPS=1, BW=1618KiB/s (1657kB/s)(7168KiB/4431msec) clat (msec): min=76, max=538, avg=247.17, stdev=173.98 lat (msec): min=76, max=538, avg=247.17, stdev=173.98 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 126], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 167], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 426], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1950, max= 4007, per=77.38%, avg=2996.00, stdev=1159.28, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1155KiB/s (1183kB/s)(5120KiB/4431msec); 0 zone resets clat (msec): min=334, max=944, avg=520.88, stdev=264.62 lat (msec): min=334, max=944, avg=520.98, stdev=264.60 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1914, max= 2003, per=35.98%, avg=1950.50, stdev=37.99, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=4.47%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148389: Thu Oct 23 15:51:05 2025 read: IOPS=0, BW=387KiB/s (397kB/s)(2048KiB/5289msec) clat (msec): min=137, max=1825, avg=981.30, stdev=1193.49 lat (msec): min=137, max=1825, avg=981.31, stdev=1193.49 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 1821], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 1973, max= 2000, per=51.30%, avg=1986.50, stdev=19.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1936KiB/s (1983kB/s)(10.0MiB/5289msec); 0 zone resets clat (msec): min=150, max=1031, avg=323.30, stdev=259.24 lat (msec): min=150, max=1031, avg=323.42, stdev=259.26 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 184], | 30.00th=[ 201], 40.00th=[ 215], 50.00th=[ 228], 60.00th=[ 251], | 70.00th=[ 271], 80.00th=[ 292], 90.00th=[ 414], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1914, max= 5919, per=65.79%, avg=3566.40, stdev=1665.92, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.79, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 2000=16.67% cpu : usr=0.04%, sys=3.80%, ctx=60, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148390: Thu Oct 23 15:51:05 2025 read: IOPS=1, BW=1229KiB/s (1259kB/s)(6144KiB/4999msec) clat (msec): min=117, max=418, avg=173.98, stdev=119.88 lat (msec): min=117, max=418, avg=173.98, stdev=119.88 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 130], | 70.00th=[ 134], 80.00th=[ 134], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1858, max= 3992, per=63.27%, avg=2450.00, stdev=1029.62, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1229KiB/s (1259kB/s)(6144KiB/4999msec); 0 zone resets clat (msec): min=186, max=1931, avg=651.20, stdev=661.01 lat (msec): min=186, max=1931, avg=651.30, stdev=661.00 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 514], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1858, max= 2023, per=36.28%, avg=1966.80, stdev=65.81, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.24%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148391: Thu Oct 23 15:51:05 2025 read: IOPS=0, BW=981KiB/s (1005kB/s)(5120KiB/5217msec) clat (msec): min=113, max=520, avg=320.34, stdev=149.46 lat (msec): min=113, max=520, avg=320.34, stdev=149.46 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1954, max= 3992, per=68.37%, avg=2647.33, stdev=1164.70, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1374KiB/s (1407kB/s)(7168KiB/5217msec); 0 zone resets clat (msec): min=157, max=1917, avg=508.35, stdev=631.55 lat (msec): min=158, max=1917, avg=508.81, stdev=631.45 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 192], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 234], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 481], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1858, max= 4047, per=45.67%, avg=2476.00, stdev=1049.46, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.04%, sys=2.82%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3872KiB/s (3965kB/s), 387KiB/s-1618KiB/s (397kB/s-1657kB/s), io=20.0MiB (20.0MB), run=4431-5289msec WRITE: bw=5421KiB/s (5551kB/s), 1155KiB/s-1936KiB/s (1183kB/s-1983kB/s), io=28.0MiB (29.4MB), run=4431-5289msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148402: Thu Oct 23 15:51:20 2025 read: IOPS=0, BW=3480KiB/s (3564kB/s)(12.0MiB/3531msec) clat (msec): min=689, max=2041, avg=1176.78, stdev=750.74 lat (msec): min=689, max=2041, avg=1176.79, stdev=750.74 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=12.12%, ctx=614, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148403: Thu Oct 23 15:51:20 2025 read: IOPS=0, BW=1605KiB/s (1644kB/s)(4096KiB/2552msec) clat (nsec): min=948650k, max=948650k, avg=948650056.00, stdev= 0.00 lat (nsec): min=948653k, max=948653k, avg=948653098.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3210KiB/s (3287kB/s)(8192KiB/2552msec); 0 zone resets clat (msec): min=626, max=966, avg=796.67, stdev=240.60 lat (msec): min=631, max=967, avg=799.19, stdev=237.56 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=5.29%, ctx=123, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148404: Thu Oct 23 15:51:20 2025 write: IOPS=0, BW=3039KiB/s (3112kB/s)(12.0MiB/4044msec); 0 zone resets clat (msec): min=1055, max=1650, avg=1344.62, stdev=297.70 lat (msec): min=1056, max=1653, avg=1345.85, stdev=298.87 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.10%, ctx=28, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148405: Thu Oct 23 15:51:20 2025 write: IOPS=0, BW=3234KiB/s (3311kB/s)(12.0MiB/3800msec); 0 zone resets clat (msec): min=894, max=1660, avg=1265.63, stdev=383.82 lat (msec): min=894, max=1661, avg=1266.27, stdev=383.72 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.21%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4640KiB/s (4751kB/s), 1605KiB/s-3480KiB/s (1644kB/s-3564kB/s), io=16.0MiB (16.8MB), run=2552-3531msec WRITE: bw=8103KiB/s (8297kB/s), 3039KiB/s-3234KiB/s (3112kB/s-3311kB/s), io=32.0MiB (33.6MB), run=2552-4044msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148397: Thu Oct 23 15:51:20 2025 read: IOPS=1, BW=5067KiB/s (5189kB/s)(12.0MiB/2425msec) clat (msec): min=696, max=931, avg=807.78, stdev=117.76 lat (msec): min=696, max=931, avg=807.78, stdev=117.76 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=3.47%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148398: Thu Oct 23 15:51:20 2025 read: IOPS=0, BW=1679KiB/s (1720kB/s)(4096KiB/2439msec) clat (nsec): min=337230k, max=337230k, avg=337229521.00, stdev= 0.00 lat (nsec): min=337232k, max=337232k, avg=337231914.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 5902, max= 5902, per=87.87%, avg=5902.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3359KiB/s (3439kB/s)(8192KiB/2439msec); 0 zone resets clat (msec): min=1005, max=1058, avg=1031.69, stdev=37.31 lat (msec): min=1005, max=1058, avg=1032.17, stdev=37.36 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.70%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148399: Thu Oct 23 15:51:20 2025 write: IOPS=0, BW=2658KiB/s (2722kB/s)(12.0MiB/4623msec); 0 zone resets clat (msec): min=1050, max=1792, avg=1540.36, stdev=424.53 lat (msec): min=1050, max=1792, avg=1540.74, stdev=424.57 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1787], 50.00th=[ 1787], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7831, max= 8175, per=100.00%, avg=8003.00, stdev=243.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.35%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148400: Thu Oct 23 15:51:20 2025 write: IOPS=1, BW=5099KiB/s (5221kB/s)(12.0MiB/2410msec); 0 zone resets clat (msec): min=551, max=1146, avg=800.85, stdev=308.73 lat (msec): min=556, max=1146, avg=802.78, stdev=307.05 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 6803, max= 8175, per=100.00%, avg=7489.00, stdev=970.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.40%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6718KiB/s (6879kB/s), 1679KiB/s-5067KiB/s (1720kB/s-5189kB/s), io=16.0MiB (16.8MB), run=2425-2439msec WRITE: bw=7088KiB/s (7258kB/s), 2658KiB/s-5099KiB/s (2722kB/s-5221kB/s), io=32.0MiB (33.6MB), run=2410-4623msec