== sanity test 398b: DIO and buffer IO race ============== 09:53:33 (1787579613) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.31816 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179810: Mon Aug 24 09:56:18 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(5992KiB/143869msec) clat (usec): min=40, max=979730, avg=53460.87, stdev=45510.52 lat (usec): min=41, max=979731, avg=53466.68, stdev=45511.37 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 12911], 10.00th=[ 19006], 20.00th=[ 25822], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[212861], 99.50th=[270533], 99.90th=[346031], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 102, per=25.59%, avg=41.46, stdev=17.85, samples=279 iops : min= 1, max= 25, avg= 9.70, stdev= 4.52, samples=279 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6296KiB/143869msec); 0 zone resets clat (usec): min=936, max=390045, avg=40390.23, stdev=42965.31 lat (usec): min=937, max=390046, avg=40395.97, stdev=42965.43 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1893], 20.00th=[ 4293], | 30.00th=[ 8717], 40.00th=[ 19268], 50.00th=[ 28443], 60.00th=[ 38536], | 70.00th=[ 50594], 80.00th=[ 70779], 90.00th=[ 98042], 95.00th=[121111], | 99.00th=[191890], 99.50th=[202376], 99.90th=[304088], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 112, per=25.53%, avg=43.40, stdev=21.11, samples=280 iops : min= 1, max= 28, avg=10.18, stdev= 5.34, samples=280 lat (usec) : 50=0.10%, 100=1.46%, 250=0.16%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.37%, 4=4.43%, 10=6.51%, 20=8.30%, 50=37.57% lat (msec) : 100=26.60%, 250=8.85%, 500=0.46%, 1000=0.03% cpu : usr=0.08%, sys=4.95%, ctx=6735, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179811: Mon Aug 24 09:56:18 2026 read: IOPS=10, BW=40.6KiB/s (41.5kB/s)(5940KiB/146437msec) clat (usec): min=38, max=805371, avg=54460.93, stdev=42626.65 lat (usec): min=38, max=805372, avg=54465.72, stdev=42624.87 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 13960], 10.00th=[ 20317], 20.00th=[ 25822], | 30.00th=[ 32900], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 63701], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[119014], | 99.00th=[200279], 99.50th=[238027], 99.90th=[387974], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 87, per=24.96%, avg=40.43, stdev=18.00, samples=284 iops : min= 1, max= 21, avg= 9.43, stdev= 4.52, samples=284 write: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6348KiB/146437msec); 0 zone resets clat (usec): min=1013, max=411461, avg=41140.13, stdev=45099.69 lat (usec): min=1014, max=411463, avg=41146.61, stdev=45100.40 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1336], 10.00th=[ 1827], 20.00th=[ 4555], | 30.00th=[ 9634], 40.00th=[ 19530], 50.00th=[ 28967], 60.00th=[ 38536], | 70.00th=[ 49021], 80.00th=[ 67634], 90.00th=[ 99091], 95.00th=[130548], | 99.00th=[210764], 99.50th=[233833], 99.90th=[295699], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 7, max= 111, per=25.37%, avg=43.14, stdev=19.74, samples=284 iops : min= 1, max= 27, avg=10.11, stdev= 4.97, samples=284 lat (usec) : 50=0.10%, 100=1.01%, 250=0.23%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.66%, 4=3.94%, 10=6.32%, 20=8.14%, 50=38.74% lat (msec) : 100=26.30%, 250=9.15%, 500=0.33%, 1000=0.03% cpu : usr=0.09%, sys=4.96%, ctx=6783, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179812: Mon Aug 24 09:56:18 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6028KiB/144927msec) clat (usec): min=38, max=334513, avg=53606.57, stdev=38167.23 lat (usec): min=39, max=334514, avg=53609.30, stdev=38168.20 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 10814], 10.00th=[ 18482], 20.00th=[ 25560], | 30.00th=[ 31589], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 53740], | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[183501], 99.50th=[238027], 99.90th=[320865], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 96, per=25.45%, avg=41.23, stdev=17.33, samples=283 iops : min= 1, max= 24, avg= 9.64, stdev= 4.37, samples=283 write: IOPS=10, BW=43.2KiB/s (44.2kB/s)(6260KiB/144927msec); 0 zone resets clat (usec): min=1029, max=832879, avg=40862.52, stdev=46609.40 lat (usec): min=1030, max=832880, avg=40866.52, stdev=46608.68 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1991], 20.00th=[ 4621], | 30.00th=[ 9372], 40.00th=[ 18482], 50.00th=[ 28443], 60.00th=[ 38536], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[125305], | 99.00th=[187696], 99.50th=[214959], 99.90th=[283116], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 111, per=25.20%, avg=42.85, stdev=21.09, samples=282 iops : min= 1, max= 27, avg=10.04, stdev= 5.32, samples=282 lat (usec) : 50=0.13%, 100=1.63%, 250=0.20%, 500=0.07%, 750=0.07% lat (msec) : 2=5.18%, 4=4.04%, 10=6.80%, 20=8.30%, 50=36.07% lat (msec) : 100=27.83%, 250=9.38%, 500=0.29%, 1000=0.03% cpu : usr=0.08%, sys=4.93%, ctx=6716, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179813: Mon Aug 24 09:56:18 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6052KiB/147327msec) clat (usec): min=35, max=328258, avg=51991.50, stdev=37156.96 lat (usec): min=36, max=328260, avg=51995.81, stdev=37157.04 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 11207], 10.00th=[ 18482], 20.00th=[ 25035], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 61604], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[187696], 99.50th=[208667], 99.90th=[320865], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 111, per=25.46%, avg=41.25, stdev=18.10, samples=284 iops : min= 1, max= 27, avg= 9.64, stdev= 4.56, samples=284 write: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6236KiB/147327msec); 0 zone resets clat (usec): min=956, max=850284, avg=43908.57, stdev=51051.21 lat (usec): min=957, max=850286, avg=43911.05, stdev=51051.18 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1336], 10.00th=[ 1909], 20.00th=[ 5014], | 30.00th=[ 10290], 40.00th=[ 21103], 50.00th=[ 30278], 60.00th=[ 40633], | 70.00th=[ 53740], 80.00th=[ 73925], 90.00th=[105382], 95.00th=[135267], | 99.00th=[206570], 99.50th=[246416], 99.90th=[497026], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 120, per=24.81%, avg=42.17, stdev=20.26, samples=286 iops : min= 1, max= 30, avg= 9.87, stdev= 5.12, samples=286 lat (usec) : 50=0.10%, 100=1.37%, 250=0.23%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.37%, 4=3.42%, 10=6.54%, 20=8.50%, 50=37.34% lat (msec) : 100=26.60%, 250=9.86%, 500=0.33%, 1000=0.03% cpu : usr=0.09%, sys=4.86%, ctx=6630, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 40.6KiB/s-41.6KiB/s (41.5kB/s-42.6kB/s), io=23.4MiB (24.6MB), run=143869-147327msec WRITE: bw=171KiB/s (175kB/s), 42.3KiB/s-43.8KiB/s (43.3kB/s-44.8kB/s), io=24.6MiB (25.7MB), run=143869-147327msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179805: Mon Aug 24 09:56:57 2026 read: IOPS=8, BW=32.2KiB/s (32.9kB/s)(5992KiB/186298msec) clat (msec): min=5, max=1014, avg=47.44, stdev=50.72 lat (msec): min=5, max=1014, avg=47.44, stdev=50.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 106], 95.00th=[ 140], | 99.00th=[ 232], 99.50th=[ 266], 99.90th=[ 376], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 6, max= 167, per=26.10%, avg=33.41, stdev=24.22, samples=348 iops : min= 1, max= 41, avg= 7.69, stdev= 6.10, samples=348 write: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6296KiB/186298msec); 0 zone resets clat (msec): min=10, max=522, avg=72.90, stdev=57.31 lat (msec): min=10, max=522, avg=72.90, stdev=57.31 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 66], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 138], 95.00th=[ 184], | 99.00th=[ 300], 99.50th=[ 334], 99.90th=[ 397], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 112, per=25.24%, avg=33.82, stdev=22.68, samples=361 iops : min= 1, max= 28, avg= 7.80, stdev= 5.73, samples=361 lat (msec) : 10=1.82%, 20=13.31%, 50=43.68%, 100=23.89%, 250=15.82% lat (msec) : 500=1.40%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.68%, ctx=4680, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179806: Mon Aug 24 09:56:57 2026 read: IOPS=7, BW=31.9KiB/s (32.6kB/s)(5940KiB/186472msec) clat (msec): min=5, max=848, avg=48.12, stdev=49.81 lat (msec): min=5, max=848, avg=48.12, stdev=49.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 69], 90.00th=[ 108], 95.00th=[ 144], | 99.00th=[ 243], 99.50th=[ 264], 99.90th=[ 351], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 6, max= 135, per=25.97%, avg=33.24, stdev=23.94, samples=346 iops : min= 1, max= 33, avg= 7.65, stdev= 6.03, samples=346 write: IOPS=8, BW=34.0KiB/s (34.9kB/s)(6348KiB/186472msec); 0 zone resets clat (msec): min=10, max=573, avg=72.16, stdev=55.00 lat (msec): min=10, max=573, avg=72.17, stdev=55.00 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 67], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 146], 95.00th=[ 184], | 99.00th=[ 275], 99.50th=[ 309], 99.90th=[ 422], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 103, per=25.59%, avg=34.29, stdev=21.93, samples=358 iops : min= 1, max= 25, avg= 7.92, stdev= 5.54, samples=358 lat (msec) : 10=1.53%, 20=12.63%, 50=44.66%, 100=24.32%, 250=15.63% lat (msec) : 500=1.17%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=1.67%, ctx=4793, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179807: Mon Aug 24 09:56:57 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(6028KiB/186681msec) clat (msec): min=6, max=360, avg=49.01, stdev=48.82 lat (msec): min=6, max=360, avg=49.01, stdev=48.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 52], 80.00th=[ 74], 90.00th=[ 111], 95.00th=[ 146], | 99.00th=[ 249], 99.50th=[ 275], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 150, per=25.55%, avg=32.70, stdev=24.76, samples=355 iops : min= 1, max= 37, avg= 7.51, stdev= 6.24, samples=355 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6260KiB/186681msec); 0 zone resets clat (msec): min=10, max=847, avg=71.78, stdev=60.73 lat (msec): min=10, max=847, avg=71.78, stdev=60.73 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 63], | 70.00th=[ 82], 80.00th=[ 105], 90.00th=[ 138], 95.00th=[ 174], | 99.00th=[ 305], 99.50th=[ 384], 99.90th=[ 460], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 117, per=25.42%, avg=34.06, stdev=23.13, samples=354 iops : min= 1, max= 29, avg= 7.86, stdev= 5.85, samples=354 lat (msec) : 10=1.76%, 20=13.28%, 50=43.98%, 100=24.09%, 250=15.30% lat (msec) : 500=1.56%, 1000=0.03% cpu : usr=0.06%, sys=1.76%, ctx=4860, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179808: Mon Aug 24 09:56:57 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6052KiB/186149msec) clat (msec): min=5, max=371, avg=47.36, stdev=47.21 lat (msec): min=5, max=371, avg=47.37, stdev=47.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 67], 90.00th=[ 105], 95.00th=[ 142], | 99.00th=[ 239], 99.50th=[ 292], 99.90th=[ 363], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 119, per=26.75%, avg=34.24, stdev=23.23, samples=342 iops : min= 1, max= 29, avg= 7.90, stdev= 5.86, samples=342 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6236KiB/186149msec); 0 zone resets clat (msec): min=13, max=864, avg=73.13, stdev=61.91 lat (msec): min=13, max=864, avg=73.14, stdev=61.91 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 82], 80.00th=[ 106], 90.00th=[ 144], 95.00th=[ 182], | 99.00th=[ 296], 99.50th=[ 363], 99.90th=[ 642], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 135, per=25.08%, avg=33.60, stdev=22.61, samples=358 iops : min= 1, max= 33, avg= 7.74, stdev= 5.70, samples=358 lat (msec) : 10=1.30%, 20=12.92%, 50=45.38%, 100=23.76%, 250=15.04% lat (msec) : 500=1.53%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.68%, ctx=4761, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (132kB/s), 31.9KiB/s-32.5KiB/s (32.6kB/s-33.3kB/s), io=23.4MiB (24.6MB), run=186149-186681msec WRITE: bw=135KiB/s (138kB/s), 33.5KiB/s-34.0KiB/s (34.3kB/s-34.9kB/s), io=24.6MiB (25.7MB), run=186149-186681msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179857: Mon Aug 24 09:57:45 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(5920KiB/36375msec) clat (usec): min=49, max=247846, avg=51865.51, stdev=33560.11 lat (usec): min=50, max=247847, avg=51866.96, stdev=33560.26 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 2606], 20.00th=[ 27919], | 30.00th=[ 32637], 40.00th=[ 39584], 50.00th=[ 46924], 60.00th=[ 56886], | 70.00th=[ 66323], 80.00th=[ 73925], 90.00th=[ 91751], 95.00th=[113771], | 99.00th=[156238], 99.50th=[162530], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 62, max= 349, per=24.69%, avg=162.49, stdev=61.17, samples=71 iops : min= 3, max= 21, avg= 9.38, stdev= 3.87, samples=71 write: IOPS=10, BW=175KiB/s (179kB/s)(6368KiB/36375msec); 0 zone resets clat (usec): min=1385, max=193669, avg=42704.58, stdev=40067.32 lat (usec): min=1387, max=193672, avg=42707.51, stdev=40067.63 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2966], 10.00th=[ 4293], 20.00th=[ 8356], | 30.00th=[ 13304], 40.00th=[ 20579], 50.00th=[ 31589], 60.00th=[ 41157], | 70.00th=[ 54789], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[126354], | 99.00th=[173016], 99.50th=[185598], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 30, max= 346, per=25.62%, avg=177.27, stdev=67.32, samples=70 iops : min= 1, max= 21, avg=10.31, stdev= 4.28, samples=70 lat (usec) : 50=0.13%, 100=3.52%, 250=0.39%, 500=0.39%, 750=0.13% lat (msec) : 2=1.30%, 4=2.99%, 10=8.59%, 20=8.98%, 50=34.64% lat (msec) : 100=30.47%, 250=8.46% cpu : usr=0.06%, sys=5.17%, ctx=1736, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179858: Mon Aug 24 09:57:45 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(5744KiB/34734msec) clat (usec): min=39, max=191840, avg=51418.38, stdev=32517.35 lat (usec): min=40, max=191841, avg=51420.96, stdev=32518.55 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 235], 20.00th=[ 26870], | 30.00th=[ 34341], 40.00th=[ 41157], 50.00th=[ 46400], 60.00th=[ 53740], | 70.00th=[ 63701], 80.00th=[ 77071], 90.00th=[ 93848], 95.00th=[111674], | 99.00th=[145753], 99.50th=[162530], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 345, per=25.19%, avg=165.76, stdev=65.52, samples=68 iops : min= 1, max= 21, avg= 9.59, stdev= 4.19, samples=68 write: IOPS=11, BW=188KiB/s (193kB/s)(6544KiB/34734msec); 0 zone resets clat (usec): min=1452, max=243622, avg=39359.71, stdev=41468.24 lat (usec): min=1454, max=243623, avg=39362.12, stdev=41468.25 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2540], 10.00th=[ 4047], 20.00th=[ 6849], | 30.00th=[ 10290], 40.00th=[ 16712], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 99091], 95.00th=[130548], | 99.00th=[187696], 99.50th=[200279], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 61, max= 351, per=27.04%, avg=187.10, stdev=70.59, samples=68 iops : min= 3, max= 21, avg=10.94, stdev= 4.44, samples=68 lat (usec) : 50=0.39%, 100=3.78%, 250=0.52% lat (msec) : 2=1.69%, 4=3.65%, 10=10.29%, 20=9.24%, 50=35.03% lat (msec) : 100=27.21%, 250=8.20% cpu : usr=0.08%, sys=5.79%, ctx=1722, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179859: Mon Aug 24 09:57:45 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(6256KiB/35357msec) clat (usec): min=54, max=207937, avg=52442.38, stdev=33839.06 lat (usec): min=55, max=207938, avg=52443.71, stdev=33839.06 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 75], 10.00th=[ 1598], 20.00th=[ 29492], | 30.00th=[ 36439], 40.00th=[ 43254], 50.00th=[ 48497], 60.00th=[ 54789], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 95945], 95.00th=[109577], | 99.00th=[173016], 99.50th=[202376], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 383, per=26.83%, avg=176.57, stdev=59.98, samples=69 iops : min= 1, max= 23, avg=10.28, stdev= 3.79, samples=69 write: IOPS=10, BW=171KiB/s (175kB/s)(6032KiB/35357msec); 0 zone resets clat (usec): min=1472, max=247041, avg=39149.18, stdev=39652.87 lat (usec): min=1474, max=247044, avg=39152.03, stdev=39652.72 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2057], 10.00th=[ 3163], 20.00th=[ 6063], | 30.00th=[ 9896], 40.00th=[ 17695], 50.00th=[ 26346], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 65799], 90.00th=[ 94897], 95.00th=[124257], | 99.00th=[162530], 99.50th=[179307], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 320, per=24.28%, avg=168.01, stdev=71.53, samples=69 iops : min= 1, max= 20, avg= 9.72, stdev= 4.55, samples=69 lat (usec) : 100=4.30%, 250=0.52%, 500=0.26% lat (msec) : 2=2.34%, 4=4.56%, 10=8.46%, 20=6.64%, 50=34.38% lat (msec) : 100=29.82%, 250=8.72% cpu : usr=0.09%, sys=5.70%, ctx=1727, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179860: Mon Aug 24 09:57:45 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(6032KiB/34906msec) clat (usec): min=42, max=211176, avg=50307.22, stdev=35593.17 lat (usec): min=42, max=211177, avg=50308.86, stdev=35593.19 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 94], 20.00th=[ 22152], | 30.00th=[ 31327], 40.00th=[ 41157], 50.00th=[ 46924], 60.00th=[ 54264], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[119014], | 99.00th=[156238], 99.50th=[210764], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 350, per=26.07%, avg=171.56, stdev=62.46, samples=68 iops : min= 1, max= 21, avg= 9.96, stdev= 3.91, samples=68 write: IOPS=11, BW=179KiB/s (184kB/s)(6256KiB/34906msec); 0 zone resets clat (usec): min=1608, max=218104, avg=40426.36, stdev=39647.62 lat (usec): min=1609, max=218106, avg=40429.10, stdev=39647.62 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2540], 10.00th=[ 3818], 20.00th=[ 6980], | 30.00th=[ 10552], 40.00th=[ 17433], 50.00th=[ 29492], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[166724], 99.50th=[217056], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 379, per=25.87%, avg=179.04, stdev=77.86, samples=68 iops : min= 1, max= 23, avg=10.44, stdev= 4.93, samples=68 lat (usec) : 50=0.13%, 100=4.82%, 250=1.17%, 500=0.13% lat (msec) : 2=1.17%, 4=4.56%, 10=9.38%, 20=9.11%, 50=30.86% lat (msec) : 100=30.21%, 250=8.46% cpu : usr=0.05%, sys=5.51%, ctx=1717, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=658KiB/s (674kB/s), 163KiB/s-177KiB/s (167kB/s-181kB/s), io=23.4MiB (24.5MB), run=34734-36375msec WRITE: bw=693KiB/s (709kB/s), 171KiB/s-188KiB/s (175kB/s-193kB/s), io=24.6MiB (25.8MB), run=34734-36375msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179862: Mon Aug 24 09:57:58 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5920KiB/48827msec) clat (msec): min=8, max=265, avg=50.50, stdev=43.96 lat (msec): min=8, max=265, avg=50.51, stdev=43.98 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 109], 95.00th=[ 144], | 99.00th=[ 230], 99.50th=[ 257], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 382, per=25.09%, avg=122.93, stdev=78.78, samples=94 iops : min= 1, max= 23, avg= 6.89, stdev= 5.01, samples=94 write: IOPS=8, BW=130KiB/s (134kB/s)(6368KiB/48828msec); 0 zone resets clat (msec): min=18, max=364, avg=75.54, stdev=50.94 lat (msec): min=18, max=364, avg=75.55, stdev=50.94 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 70], | 70.00th=[ 86], 80.00th=[ 110], 90.00th=[ 140], 95.00th=[ 180], | 99.00th=[ 275], 99.50th=[ 321], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 26, max= 319, per=25.77%, avg=132.98, stdev=76.56, samples=94 iops : min= 1, max= 19, avg= 7.52, stdev= 4.81, samples=94 lat (msec) : 10=0.65%, 20=7.42%, 50=45.83%, 100=27.47%, 250=17.84% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=1.87%, ctx=1251, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179863: Mon Aug 24 09:57:58 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(5744KiB/48615msec) clat (msec): min=7, max=186, avg=48.20, stdev=38.00 lat (msec): min=7, max=186, avg=48.20, stdev=38.00 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 108], 95.00th=[ 136], | 99.00th=[ 180], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 26, max= 410, per=25.18%, avg=123.37, stdev=83.05, samples=90 iops : min= 1, max= 25, avg= 6.92, stdev= 5.28, samples=90 write: IOPS=8, BW=135KiB/s (138kB/s)(6544KiB/48615msec); 0 zone resets clat (msec): min=15, max=368, avg=76.32, stdev=52.09 lat (msec): min=15, max=368, avg=76.32, stdev=52.09 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 89], 80.00th=[ 113], 90.00th=[ 146], 95.00th=[ 174], | 99.00th=[ 259], 99.50th=[ 279], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 351, per=26.05%, avg=134.40, stdev=77.08, samples=94 iops : min= 1, max= 21, avg= 7.62, stdev= 4.89, samples=94 lat (msec) : 10=0.65%, 20=8.59%, 50=45.05%, 100=26.82%, 250=18.23% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.66%, ctx=1212, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179864: Mon Aug 24 09:57:58 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(6256KiB/48411msec) clat (msec): min=8, max=282, avg=49.70, stdev=43.82 lat (msec): min=8, max=282, avg=49.70, stdev=43.82 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 106], 95.00th=[ 148], | 99.00th=[ 234], 99.50th=[ 264], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 501, per=26.67%, avg=130.66, stdev=93.43, samples=94 iops : min= 1, max= 31, avg= 7.37, stdev= 5.93, samples=94 write: IOPS=7, BW=125KiB/s (128kB/s)(6032KiB/48411msec); 0 zone resets clat (msec): min=15, max=335, avg=76.69, stdev=50.33 lat (msec): min=15, max=335, avg=76.72, stdev=50.36 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 74], | 70.00th=[ 90], 80.00th=[ 114], 90.00th=[ 146], 95.00th=[ 171], | 99.00th=[ 257], 99.50th=[ 313], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 339, per=24.03%, avg=124.01, stdev=67.57, samples=94 iops : min= 1, max= 21, avg= 6.97, stdev= 4.29, samples=94 lat (msec) : 10=0.52%, 20=9.77%, 50=44.79%, 100=27.73%, 250=16.28% lat (msec) : 500=0.91% cpu : usr=0.07%, sys=1.74%, ctx=1190, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179865: Mon Aug 24 09:57:58 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48795msec) clat (msec): min=7, max=305, avg=52.53, stdev=46.32 lat (msec): min=7, max=305, avg=52.54, stdev=46.32 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 60], 80.00th=[ 80], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 241], 99.50th=[ 251], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 28, max= 381, per=25.48%, avg=124.86, stdev=78.97, samples=94 iops : min= 1, max= 23, avg= 7.01, stdev= 4.97, samples=94 write: IOPS=8, BW=128KiB/s (131kB/s)(6256KiB/48795msec); 0 zone resets clat (msec): min=16, max=278, avg=74.05, stdev=47.93 lat (msec): min=16, max=278, avg=74.06, stdev=47.94 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 79], 80.00th=[ 108], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 249], 99.50th=[ 271], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 339, per=25.29%, avg=130.51, stdev=79.07, samples=94 iops : min= 1, max= 21, avg= 7.37, stdev= 5.03, samples=94 lat (msec) : 10=0.39%, 20=10.29%, 50=42.32%, 100=28.78%, 250=17.58% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.62%, ctx=1140, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=491KiB/s (502kB/s), 118KiB/s-129KiB/s (121kB/s-132kB/s), io=23.4MiB (24.5MB), run=48411-48827msec WRITE: bw=516KiB/s (528kB/s), 125KiB/s-135KiB/s (128kB/s-138kB/s), io=24.6MiB (25.8MB), run=48411-48828msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179880: Mon Aug 24 09:58:13 2026 read: IOPS=1, BW=1799KiB/s (1842kB/s)(7168KiB/3985msec) clat (msec): min=129, max=640, avg=263.93, stdev=182.13 lat (msec): min=129, max=640, avg=263.93, stdev=182.13 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 136], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 218], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 334], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1780, max= 3984, per=58.36%, avg=2366.00, stdev=910.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1285KiB/s (1316kB/s)(5120KiB/3985msec); 0 zone resets clat (msec): min=272, max=524, avg=378.04, stdev=131.00 lat (msec): min=272, max=524, avg=378.13, stdev=131.00 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1992, max= 3842, per=46.17%, avg=2620.33, stdev=1058.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=41.67%, 750=25.00% cpu : usr=0.08%, sys=5.32%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179881: Mon Aug 24 09:58:13 2026 read: IOPS=0, BW=405KiB/s (415kB/s)(2048KiB/5051msec) clat (msec): min=98, max=419, avg=258.96, stdev=226.43 lat (msec): min=98, max=419, avg=258.96, stdev=226.43 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1921, max= 2027, per=48.69%, avg=1974.00, stdev=74.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2027KiB/s (2076kB/s)(10.0MiB/5051msec); 0 zone resets clat (msec): min=121, max=1169, avg=449.57, stdev=338.24 lat (msec): min=121, max=1169, avg=449.76, stdev=338.22 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 155], | 30.00th=[ 157], 40.00th=[ 182], 50.00th=[ 330], 60.00th=[ 489], | 70.00th=[ 542], 80.00th=[ 558], 90.00th=[ 802], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1780, max= 4055, per=46.83%, avg=2657.83, stdev=1077.23, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=5.21%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179882: Mon Aug 24 09:58:13 2026 read: IOPS=1, BW=1394KiB/s (1428kB/s)(6144KiB/4406msec) clat (msec): min=125, max=542, avg=340.26, stdev=156.38 lat (msec): min=125, max=542, avg=340.26, stdev=156.38 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 414], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1921, max= 2043, per=49.40%, avg=2002.80, stdev=53.32, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1394KiB/s (1428kB/s)(6144KiB/4406msec); 0 zone resets clat (msec): min=102, max=993, avg=375.94, stdev=331.26 lat (msec): min=102, max=994, avg=376.02, stdev=331.28 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 388], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1976, max= 2968, per=38.88%, avg=2206.60, stdev=426.43, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.43%, ctx=99, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179883: Mon Aug 24 09:58:13 2026 read: IOPS=1, BW=1183KiB/s (1211kB/s)(5120KiB/4328msec) clat (msec): min=137, max=1228, avg=440.42, stdev=474.77 lat (msec): min=137, max=1228, avg=440.42, stdev=474.77 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 4023, max= 4079, per=99.93%, avg=4051.00, stdev=39.60, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1656KiB/s (1696kB/s)(7168KiB/4328msec); 0 zone resets clat (msec): min=132, max=740, avg=283.54, stdev=212.41 lat (msec): min=132, max=740, avg=283.62, stdev=212.40 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 150], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 211], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 330], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1799, max= 2737, per=37.54%, avg=2130.75, stdev=414.68, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=66.67%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.95%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4055KiB/s (4152kB/s), 405KiB/s-1799KiB/s (415kB/s-1842kB/s), io=20.0MiB (20.0MB), run=3985-5051msec WRITE: bw=5676KiB/s (5813kB/s), 1285KiB/s-2027KiB/s (1316kB/s-2076kB/s), io=28.0MiB (29.4MB), run=3985-5051msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179884: Mon Aug 24 09:58:13 2026 read: IOPS=2, BW=2343KiB/s (2399kB/s)(7168KiB/3059msec) clat (msec): min=105, max=371, avg=214.64, stdev=87.37 lat (msec): min=105, max=371, avg=214.64, stdev=87.37 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 150], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 199], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 279], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2011, max= 2985, per=55.42%, avg=2218.60, stdev=428.59, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1674KiB/s (1714kB/s)(5120KiB/3059msec); 0 zone resets clat (msec): min=136, max=379, avg=289.98, stdev=99.04 lat (msec): min=137, max=379, avg=290.05, stdev=99.04 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2031, max= 4047, per=48.30%, avg=2707.00, stdev=1160.49, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=41.67% cpu : usr=0.00%, sys=21.06%, ctx=221, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179885: Mon Aug 24 09:58:13 2026 read: IOPS=0, BW=400KiB/s (410kB/s)(2048KiB/5116msec) clat (msec): min=296, max=581, avg=439.42, stdev=201.60 lat (msec): min=296, max=581, avg=439.43, stdev=201.60 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1526, max= 2027, per=44.38%, avg=1776.50, stdev=354.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2002KiB/s (2050kB/s)(10.0MiB/5116msec); 0 zone resets clat (msec): min=89, max=1128, avg=391.47, stdev=307.75 lat (msec): min=89, max=1129, avg=391.58, stdev=307.82 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 163], | 30.00th=[ 188], 40.00th=[ 243], 50.00th=[ 255], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 523], 90.00th=[ 642], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2023, max= 4055, per=48.19%, avg=2700.33, stdev=1037.00, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=15.37%, ctx=179, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179886: Mon Aug 24 09:58:13 2026 read: IOPS=1, BW=1293KiB/s (1324kB/s)(6144KiB/4752msec) clat (usec): min=762, max=617649, avg=213982.36, stdev=226687.70 lat (usec): min=762, max=617650, avg=213983.60, stdev=226687.64 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[ 1172], | 30.00th=[ 1172], 40.00th=[185598], 50.00th=[185598], 60.00th=[214959], | 70.00th=[263193], 80.00th=[263193], 90.00th=[616563], 95.00th=[616563], | 99.00th=[616563], 99.50th=[616563], 99.90th=[616563], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 2015, max= 4063, per=84.38%, avg=3377.67, stdev=1180.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1293KiB/s (1324kB/s)(6144KiB/4752msec); 0 zone resets clat (msec): min=292, max=965, avg=513.47, stdev=306.12 lat (msec): min=292, max=965, avg=513.53, stdev=306.12 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 347], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1462, max= 2043, per=34.55%, avg=1936.17, stdev=232.38, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=14.44%, ctx=137, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179887: Mon Aug 24 09:58:13 2026 read: IOPS=1, BW=1284KiB/s (1314kB/s)(5120KiB/3989msec) clat (usec): min=1709, max=339827, avg=80917.41, stdev=146716.98 lat (usec): min=1711, max=339829, avg=80918.75, stdev=146717.02 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1713], 10.00th=[ 1713], 20.00th=[ 1713], | 30.00th=[ 2245], 40.00th=[ 2245], 50.00th=[ 2999], 60.00th=[ 2999], | 70.00th=[ 57934], 80.00th=[ 57934], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1797KiB/s (1840kB/s)(7168KiB/3989msec); 0 zone resets clat (msec): min=171, max=976, avg=461.15, stdev=304.08 lat (msec): min=171, max=976, avg=461.25, stdev=304.11 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 174], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 430], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 659], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 2011, max= 6047, per=50.53%, avg=2831.80, stdev=1797.39, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 2=8.33%, 4=16.67%, 100=8.33%, 250=25.00%, 500=16.67% lat (msec) : 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=15.55%, ctx=133, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4003KiB/s (4099kB/s), 400KiB/s-2343KiB/s (410kB/s-2399kB/s), io=20.0MiB (20.0MB), run=3059-5116msec WRITE: bw=5604KiB/s (5739kB/s), 1293KiB/s-2002KiB/s (1324kB/s-2050kB/s), io=28.0MiB (29.4MB), run=3059-5116msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179894: Mon Aug 24 09:58:29 2026 read: IOPS=0, BW=3583KiB/s (3668kB/s)(12.0MiB/3430msec) clat (msec): min=968, max=1139, avg=1043.12, stdev=87.29 lat (msec): min=968, max=1139, avg=1043.12, stdev=87.29 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7474, max= 8015, per=100.00%, avg=7744.50, stdev=382.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.06%, sys=13.44%, ctx=299, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179895: Mon Aug 24 09:58:29 2026 read: IOPS=0, BW=1176KiB/s (1205kB/s)(4096KiB/3482msec) clat (nsec): min=977880k, max=977880k, avg=977879663.00, stdev= 0.00 lat (nsec): min=977881k, max=977881k, avg=977880582.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7474, max= 7474, per=100.00%, avg=7474.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2353KiB/s (2409kB/s)(8192KiB/3482msec); 0 zone resets clat (msec): min=831, max=1545, avg=1188.11, stdev=504.79 lat (msec): min=833, max=1545, avg=1189.57, stdev=503.02 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8015, max= 8015, per=88.23%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.80%, ctx=140, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179896: Mon Aug 24 09:58:29 2026 write: IOPS=0, BW=3407KiB/s (3488kB/s)(12.0MiB/3607msec); 0 zone resets clat (msec): min=1025, max=1212, avg=1144.13, stdev=102.92 lat (msec): min=1026, max=1213, avg=1146.37, stdev=104.17 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7474, max= 8031, per=85.34%, avg=7752.50, stdev=393.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=7.90%, ctx=115, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179898: Mon Aug 24 09:58:29 2026 write: IOPS=0, BW=3966KiB/s (4062kB/s)(12.0MiB/3098msec); 0 zone resets clat (msec): min=314, max=2099, avg=921.24, stdev=1020.43 lat (msec): min=314, max=2099, avg=921.67, stdev=1020.53 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min=16253, max=16253, per=100.00%, avg=16253.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.26%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4705KiB/s (4818kB/s), 1176KiB/s-3583KiB/s (1205kB/s-3668kB/s), io=16.0MiB (16.8MB), run=3430-3482msec WRITE: bw=9085KiB/s (9303kB/s), 2353KiB/s-3966KiB/s (2409kB/s-4062kB/s), io=32.0MiB (33.6MB), run=3098-3607msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179897: Mon Aug 24 09:58:30 2026 read: IOPS=0, BW=2959KiB/s (3030kB/s)(12.0MiB/4153msec) clat (msec): min=394, max=2083, avg=1288.52, stdev=848.69 lat (msec): min=394, max=2083, avg=1288.53, stdev=848.69 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.01%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179899: Mon Aug 24 09:58:30 2026 read: IOPS=0, BW=1006KiB/s (1031kB/s)(4096KiB/4070msec) clat (nsec): min=1857.8M, max=1857.8M, avg=1857816123.00, stdev= 0.00 lat (nsec): min=1857.8M, max=1857.8M, avg=1857818176.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1854], 5.00th=[ 1854], 10.00th=[ 1854], 20.00th=[ 1854], | 30.00th=[ 1854], 40.00th=[ 1854], 50.00th=[ 1854], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2013KiB/s (2061kB/s)(8192KiB/4070msec); 0 zone resets clat (msec): min=259, max=1737, avg=998.16, stdev=1045.10 lat (msec): min=259, max=1737, avg=998.65, stdev=1045.06 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.15%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179900: Mon Aug 24 09:58:30 2026 write: IOPS=0, BW=3272KiB/s (3351kB/s)(12.0MiB/3755msec); 0 zone resets clat (msec): min=974, max=1594, avg=1183.26, stdev=356.04 lat (msec): min=975, max=1594, avg=1183.59, stdev=356.01 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.04%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179901: Mon Aug 24 09:58:30 2026 write: IOPS=0, BW=3531KiB/s (3616kB/s)(12.0MiB/3480msec); 0 zone resets clat (msec): min=301, max=2456, avg=1133.41, stdev=1158.30 lat (msec): min=301, max=2456, avg=1133.83, stdev=1158.36 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min=15937, max=15937, per=100.00%, avg=15937.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.31%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3945KiB/s (4040kB/s), 1006KiB/s-2959KiB/s (1031kB/s-3030kB/s), io=16.0MiB (16.8MB), run=4070-4153msec WRITE: bw=8051KiB/s (8244kB/s), 2013KiB/s-3531KiB/s (2061kB/s-3616kB/s), io=32.0MiB (33.6MB), run=3480-4070msec