== sanity test 398b: DIO and buffer IO race ============== 03:36:16 (1782632176) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.82645 s, 17.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160141: Sun Jun 28 03:37:30 2026 read: IOPS=23, BW=92.8KiB/s (94.0kB/s)(5992KiB/64597msec) clat (usec): min=37, max=144727, avg=23513.71, stdev=13093.27 lat (usec): min=37, max=144727, avg=23514.21, stdev=13093.27 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 7635], 10.00th=[ 9896], 20.00th=[ 13173], | 30.00th=[ 16188], 40.00th=[ 18482], 50.00th=[ 21365], 60.00th=[ 24773], | 70.00th=[ 28181], 80.00th=[ 32637], 90.00th=[ 39584], 95.00th=[ 45351], | 99.00th=[ 64750], 99.50th=[ 73925], 99.90th=[105382], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 19, max= 184, per=25.31%, avg=92.63, stdev=31.29, samples=128 iops : min= 4, max= 46, avg=22.68, stdev= 7.89, samples=128 write: IOPS=24, BW=97.5KiB/s (99.8kB/s)(6296KiB/64597msec); 0 zone resets clat (usec): min=820, max=653884, avg=18509.74, stdev=20878.34 lat (usec): min=821, max=653885, avg=18510.33, stdev=20878.34 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 3458], 10.00th=[ 4752], 20.00th=[ 6718], | 30.00th=[ 8717], 40.00th=[ 12125], 50.00th=[ 15401], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 28181], 90.00th=[ 35914], 95.00th=[ 42730], | 99.00th=[ 60556], 99.50th=[ 66847], 99.90th=[179307], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 39, max= 216, per=25.61%, avg=98.07, stdev=35.52, samples=127 iops : min= 9, max= 54, avg=24.04, stdev= 8.93, samples=127 lat (usec) : 50=0.07%, 100=0.20%, 250=1.04%, 500=0.10%, 1000=0.23% lat (msec) : 2=0.42%, 4=3.19%, 10=17.58%, 20=32.23%, 50=42.32% lat (msec) : 100=2.47%, 250=0.13%, 750=0.03% cpu : usr=0.05%, sys=29.73%, ctx=10858, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160142: Sun Jun 28 03:37:30 2026 read: IOPS=22, BW=91.3KiB/s (93.5kB/s)(5940KiB/65055msec) clat (usec): min=34, max=213918, avg=23308.47, stdev=13231.66 lat (usec): min=34, max=213920, avg=23309.01, stdev=13231.69 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 7832], 10.00th=[ 10159], 20.00th=[ 13698], | 30.00th=[ 16319], 40.00th=[ 19006], 50.00th=[ 21365], 60.00th=[ 24511], | 70.00th=[ 27395], 80.00th=[ 31589], 90.00th=[ 38011], 95.00th=[ 43779], | 99.00th=[ 66847], 99.50th=[ 73925], 99.90th=[105382], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 6, max= 184, per=24.85%, avg=90.95, stdev=32.20, samples=129 iops : min= 1, max= 46, avg=22.26, stdev= 8.13, samples=129 write: IOPS=24, BW=97.6KiB/s (99.9kB/s)(6348KiB/65055msec); 0 zone resets clat (usec): min=780, max=666840, avg=19046.21, stdev=21023.74 lat (usec): min=781, max=666840, avg=19046.78, stdev=21023.75 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 3654], 10.00th=[ 5014], 20.00th=[ 6652], | 30.00th=[ 9372], 40.00th=[ 12256], 50.00th=[ 15664], 60.00th=[ 19268], | 70.00th=[ 23462], 80.00th=[ 28967], 90.00th=[ 37487], 95.00th=[ 44303], | 99.00th=[ 58459], 99.50th=[ 67634], 99.90th=[ 84411], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 6, max= 264, per=25.34%, avg=97.05, stdev=38.61, samples=129 iops : min= 1, max= 66, avg=23.78, stdev= 9.70, samples=129 lat (usec) : 50=0.07%, 100=0.07%, 250=1.17%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=0.46%, 4=2.73%, 10=16.50%, 20=32.13%, 50=43.72% lat (msec) : 100=2.73%, 250=0.07%, 750=0.03% cpu : usr=0.04%, sys=29.85%, ctx=11014, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160143: Sun Jun 28 03:37:30 2026 read: IOPS=22, BW=91.0KiB/s (94.2kB/s)(6028KiB/65541msec) clat (usec): min=32, max=108502, avg=22774.76, stdev=12086.62 lat (usec): min=33, max=108503, avg=22775.32, stdev=12086.64 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 7504], 10.00th=[ 10028], 20.00th=[ 13960], | 30.00th=[ 16319], 40.00th=[ 18482], 50.00th=[ 20841], 60.00th=[ 23462], | 70.00th=[ 27132], 80.00th=[ 31327], 90.00th=[ 37487], 95.00th=[ 43254], | 99.00th=[ 61080], 99.50th=[ 73925], 99.90th=[103285], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 31, max= 168, per=25.25%, avg=92.40, stdev=28.71, samples=129 iops : min= 7, max= 42, avg=22.62, stdev= 7.26, samples=129 write: IOPS=23, BW=95.5KiB/s (97.8kB/s)(6260KiB/65541msec); 0 zone resets clat (usec): min=808, max=688242, avg=19825.03, stdev=21908.41 lat (usec): min=809, max=688243, avg=19826.51, stdev=21908.03 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 3621], 10.00th=[ 5145], 20.00th=[ 7046], | 30.00th=[ 9896], 40.00th=[ 13435], 50.00th=[ 16319], 60.00th=[ 20055], | 70.00th=[ 24773], 80.00th=[ 29492], 90.00th=[ 38011], 95.00th=[ 45351], | 99.00th=[ 67634], 99.50th=[ 76022], 99.90th=[ 94897], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 31, max= 207, per=25.07%, avg=96.00, stdev=35.55, samples=129 iops : min= 7, max= 51, avg=23.52, stdev= 8.98, samples=129 lat (usec) : 50=0.03%, 100=0.16%, 250=1.20%, 500=0.23%, 1000=0.36% lat (msec) : 2=0.33%, 4=2.96%, 10=15.01%, 20=33.04%, 50=43.59% lat (msec) : 100=2.99%, 250=0.07%, 750=0.03% cpu : usr=0.07%, sys=29.64%, ctx=10932, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160144: Sun Jun 28 03:37:30 2026 read: IOPS=23, BW=92.4KiB/s (94.6kB/s)(6052KiB/65530msec) clat (usec): min=32, max=100873, avg=23105.23, stdev=12283.78 lat (usec): min=33, max=100874, avg=23106.15, stdev=12284.13 clat percentiles (usec): | 1.00th=[ 172], 5.00th=[ 7963], 10.00th=[ 10290], 20.00th=[ 13435], | 30.00th=[ 15926], 40.00th=[ 18220], 50.00th=[ 21103], 60.00th=[ 24249], | 70.00th=[ 27919], 80.00th=[ 32375], 90.00th=[ 38011], 95.00th=[ 44827], | 99.00th=[ 58983], 99.50th=[ 67634], 99.90th=[ 99091], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 39, max= 168, per=25.37%, avg=92.84, stdev=30.12, samples=129 iops : min= 9, max= 42, avg=22.73, stdev= 7.59, samples=129 write: IOPS=23, BW=95.2KiB/s (97.4kB/s)(6236KiB/65530msec); 0 zone resets clat (usec): min=739, max=677817, avg=19477.84, stdev=21947.59 lat (usec): min=739, max=677819, avg=19478.46, stdev=21947.61 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 3294], 10.00th=[ 4490], 20.00th=[ 6652], | 30.00th=[ 9503], 40.00th=[ 12911], 50.00th=[ 16319], 60.00th=[ 20055], | 70.00th=[ 23987], 80.00th=[ 29230], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 61080], 99.50th=[ 81265], 99.90th=[152044], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 39, max= 199, per=24.90%, avg=95.38, stdev=33.31, samples=129 iops : min= 9, max= 49, avg=23.36, stdev= 8.40, samples=129 lat (usec) : 50=0.03%, 100=0.03%, 250=1.07%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=0.55%, 4=3.48%, 10=15.01%, 20=32.58%, 50=44.04% lat (msec) : 100=2.57%, 250=0.16%, 750=0.03% cpu : usr=0.06%, sys=29.63%, ctx=10920, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=366KiB/s (375kB/s), 91.3KiB/s-92.8KiB/s (93.5kB/s-94.0kB/s), io=23.4MiB (24.6MB), run=64597-65541msec WRITE: bw=384KiB/s (393kB/s), 95.2KiB/s-97.6KiB/s (97.4kB/s-99.9kB/s), io=24.6MiB (25.7MB), run=64597-65541msec fio: pid=160147, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=160146: Sun Jun 28 03:37:48 2026 read: IOPS=18, BW=72.6KiB/s (74.3kB/s)(5992KiB/82553msec) clat (msec): min=2, max=698, avg=18.99, stdev=23.63 lat (msec): min=2, max=698, avg=18.99, stdev=23.63 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 80], 99.50th=[ 91], 99.90th=[ 131], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 224, per=25.77%, avg=72.68, stdev=45.47, samples=163 iops : min= 1, max= 56, avg=17.80, stdev=11.50, samples=163 write: IOPS=19, BW=76.3KiB/s (78.1kB/s)(6296KiB/82553msec); 0 zone resets clat (msec): min=11, max=183, avg=34.28, stdev=19.30 lat (msec): min=11, max=183, avg=34.28, stdev=19.30 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 71], | 99.00th=[ 104], 99.50th=[ 118], 99.90th=[ 159], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 7, max= 184, per=25.89%, avg=76.36, stdev=42.68, samples=163 iops : min= 1, max= 46, avg=18.72, stdev=10.83, samples=163 lat (msec) : 4=4.33%, 10=13.87%, 20=27.12%, 50=43.52%, 100=10.45% lat (msec) : 250=0.68%, 750=0.03% cpu : usr=0.06%, sys=13.96%, ctx=7378, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=160147: Sun Jun 28 03:37:48 2026 read: IOPS=16, BW=67.8KiB/s (69.4kB/s)(5344KiB/78821msec) clat (msec): min=2, max=676, avg=20.93, stdev=24.82 lat (msec): min=2, max=676, avg=20.93, stdev=24.82 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 44], 95.00th=[ 57], | 99.00th=[ 81], 99.50th=[ 96], 99.90th=[ 111], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 240, per=24.01%, avg=67.72, stdev=43.81, samples=155 iops : min= 1, max= 60, avg=16.54, stdev=11.08, samples=155 write: IOPS=18, BW=72.1KiB/s (73.8kB/s)(5680KiB/78821msec); 0 zone resets clat (msec): min=11, max=260, avg=35.71, stdev=20.12 lat (msec): min=11, max=260, avg=35.71, stdev=20.12 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 49], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 103], 99.50th=[ 130], 99.90th=[ 157], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 23, max= 192, per=24.40%, avg=71.99, stdev=38.80, samples=155 iops : min= 5, max= 48, avg=17.61, stdev= 9.85, samples=155 lat (msec) : 4=4.43%, 10=11.39%, 20=24.52%, 50=46.32%, 100=12.55% lat (msec) : 250=0.69%, 500=0.04%, 750=0.04% cpu : usr=0.05%, sys=13.68%, ctx=6586, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1337,1420,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160148: Sun Jun 28 03:37:48 2026 read: IOPS=18, BW=72.8KiB/s (74.5kB/s)(6028KiB/82818msec) clat (msec): min=2, max=112, avg=19.69, stdev=16.56 lat (msec): min=2, max=112, avg=19.69, stdev=16.56 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 55], | 99.00th=[ 79], 99.50th=[ 86], 99.90th=[ 110], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 15, max= 256, per=25.76%, avg=72.63, stdev=43.91, samples=163 iops : min= 3, max= 64, avg=17.79, stdev=11.09, samples=163 write: IOPS=18, BW=75.6KiB/s (77.4kB/s)(6260KiB/82818msec); 0 zone resets clat (msec): min=10, max=682, avg=33.87, stdev=24.95 lat (msec): min=10, max=682, avg=33.87, stdev=24.95 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 100], 99.50th=[ 118], 99.90th=[ 255], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 23, max= 184, per=25.52%, avg=75.28, stdev=40.73, samples=163 iops : min= 5, max= 46, avg=18.45, stdev=10.35, samples=163 lat (msec) : 4=3.29%, 10=13.67%, 20=26.50%, 50=45.74%, 100=10.25% lat (msec) : 250=0.49%, 500=0.03%, 750=0.03% cpu : usr=0.05%, sys=14.01%, ctx=7522, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160149: Sun Jun 28 03:37:48 2026 read: IOPS=18, BW=72.0KiB/s (74.7kB/s)(6052KiB/82934msec) clat (msec): min=2, max=140, avg=19.04, stdev=16.59 lat (msec): min=2, max=140, avg=19.04, stdev=16.59 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 41], 95.00th=[ 53], | 99.00th=[ 81], 99.50th=[ 87], 99.90th=[ 121], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 8, max= 264, per=26.09%, avg=73.57, stdev=44.00, samples=163 iops : min= 2, max= 66, avg=18.02, stdev=11.16, samples=163 write: IOPS=18, BW=75.2KiB/s (76.0kB/s)(6236KiB/82934msec); 0 zone resets clat (msec): min=10, max=703, avg=34.62, stdev=25.80 lat (msec): min=10, max=703, avg=34.62, stdev=25.80 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 58], 95.00th=[ 72], | 99.00th=[ 100], 99.50th=[ 112], 99.90th=[ 257], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 23, max= 184, per=25.51%, avg=75.26, stdev=41.21, samples=164 iops : min= 5, max= 46, avg=18.45, stdev=10.46, samples=164 lat (msec) : 4=4.10%, 10=13.70%, 20=26.73%, 50=43.59%, 100=11.26% lat (msec) : 250=0.55%, 500=0.03%, 750=0.03% cpu : usr=0.05%, sys=13.96%, ctx=7437, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=282KiB/s (289kB/s), 67.8KiB/s-72.0KiB/s (69.4kB/s-74.7kB/s), io=22.9MiB (23.0MB), run=78821-82934msec WRITE: bw=295KiB/s (302kB/s), 72.1KiB/s-76.3KiB/s (73.8kB/s-78.1kB/s), io=23.9MiB (25.1MB), run=78821-82934msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160176: Sun Jun 28 03:38:14 2026 read: IOPS=17, BW=284KiB/s (291kB/s)(5920KiB/20840msec) clat (usec): min=31, max=104548, avg=28708.53, stdev=15612.08 lat (usec): min=31, max=104549, avg=28709.06, stdev=15612.08 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 192], 10.00th=[ 9241], 20.00th=[ 17171], | 30.00th=[ 21103], 40.00th=[ 24249], 50.00th=[ 27919], 60.00th=[ 31589], | 70.00th=[ 35390], 80.00th=[ 39584], 90.00th=[ 46400], 95.00th=[ 55837], | 99.00th=[ 74974], 99.50th=[ 76022], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 127, max= 577, per=24.75%, avg=281.85, stdev=91.81, samples=41 iops : min= 7, max= 36, avg=16.90, stdev= 5.78, samples=41 write: IOPS=19, BW=306KiB/s (313kB/s)(6368KiB/20840msec); 0 zone resets clat (usec): min=1011, max=79911, avg=25619.85, stdev=15595.47 lat (usec): min=1012, max=79912, avg=25621.21, stdev=15596.14 clat percentiles (usec): | 1.00th=[ 2442], 5.00th=[ 5866], 10.00th=[ 8848], 20.00th=[11076], | 30.00th=[14615], 40.00th=[18744], 50.00th=[22152], 60.00th=[27132], | 70.00th=[32375], 80.00th=[39060], 90.00th=[46400], 95.00th=[55313], | 99.00th=[78119], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 127, max= 604, per=25.32%, avg=303.59, stdev=100.75, samples=41 iops : min= 7, max= 37, avg=18.24, stdev= 6.37, samples=41 lat (usec) : 50=0.13%, 250=3.12%, 500=0.52%, 1000=0.13% lat (msec) : 2=0.39%, 4=0.65%, 10=7.94%, 20=22.66%, 50=56.90% lat (msec) : 100=7.42%, 250=0.13% cpu : usr=0.07%, sys=31.05%, ctx=3225, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160177: Sun Jun 28 03:38:14 2026 read: IOPS=17, BW=274KiB/s (281kB/s)(5744KiB/20964msec) clat (usec): min=142, max=108279, avg=29774.31, stdev=14902.57 lat (usec): min=142, max=108280, avg=29775.23, stdev=14902.97 clat percentiles (usec): | 1.00th=[ 174], 5.00th=[ 996], 10.00th=[ 14615], 20.00th=[ 19792], | 30.00th=[ 23462], 40.00th=[ 26608], 50.00th=[ 29492], 60.00th=[ 32113], | 70.00th=[ 35390], 80.00th=[ 39060], 90.00th=[ 44827], 95.00th=[ 54264], | 99.00th=[ 85459], 99.50th=[101188], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 128, max= 499, per=23.83%, avg=271.39, stdev=81.70, samples=41 iops : min= 8, max= 31, avg=16.24, stdev= 5.10, samples=41 write: IOPS=19, BW=312KiB/s (320kB/s)(6544KiB/20964msec); 0 zone resets clat (usec): min=1128, max=76627, avg=25017.89, stdev=14568.48 lat (usec): min=1129, max=76628, avg=25018.84, stdev=14568.51 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 5800], 10.00th=[ 8455], 20.00th=[11076], | 30.00th=[15533], 40.00th=[20055], 50.00th=[23462], 60.00th=[26608], | 70.00th=[31065], 80.00th=[37487], 90.00th=[44827], 95.00th=[52691], | 99.00th=[69731], 99.50th=[73925], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 126, max= 709, per=25.73%, avg=308.51, stdev=108.57, samples=41 iops : min= 7, max= 44, avg=18.56, stdev= 6.94, samples=41 lat (usec) : 250=1.95%, 500=0.26%, 1000=0.13% lat (msec) : 2=0.39%, 4=0.26%, 10=9.51%, 20=18.36%, 50=63.02% lat (msec) : 100=5.86%, 250=0.26% cpu : usr=0.06%, sys=31.54%, ctx=3234, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160178: Sun Jun 28 03:38:14 2026 read: IOPS=18, BW=298KiB/s (305kB/s)(6256KiB/21014msec) clat (usec): min=37, max=78508, avg=28514.80, stdev=14155.00 lat (usec): min=38, max=78508, avg=28515.40, stdev=14155.01 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 265], 10.00th=[12256], 20.00th=[17957], | 30.00th=[20841], 40.00th=[24511], 50.00th=[27657], 60.00th=[31065], | 70.00th=[34341], 80.00th=[39060], 90.00th=[44827], 95.00th=[53216], | 99.00th=[66323], 99.50th=[76022], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 126, max= 551, per=26.12%, avg=297.56, stdev=79.81, samples=41 iops : min= 7, max= 34, avg=17.88, stdev= 5.00, samples=41 write: IOPS=17, BW=287KiB/s (294kB/s)(6032KiB/21014msec); 0 zone resets clat (usec): min=1511, max=105563, avg=26061.37, stdev=16223.25 lat (usec): min=1511, max=105564, avg=26062.50, stdev=16223.32 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 71], 99.50th=[ 78], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 127, max= 683, per=23.46%, avg=281.29, stdev=103.45, samples=41 iops : min= 7, max= 42, avg=16.85, stdev= 6.45, samples=41 lat (usec) : 50=0.13%, 100=0.13%, 250=2.08%, 500=0.91% lat (msec) : 2=0.26%, 4=0.52%, 10=7.94%, 20=21.74%, 50=58.20% lat (msec) : 100=7.94%, 250=0.13% cpu : usr=0.03%, sys=30.50%, ctx=3319, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160179: Sun Jun 28 03:38:14 2026 read: IOPS=18, BW=291KiB/s (298kB/s)(6032KiB/20744msec) clat (usec): min=65, max=91968, avg=28594.10, stdev=16000.07 lat (usec): min=66, max=91969, avg=28594.64, stdev=16000.06 clat percentiles (usec): | 1.00th=[ 115], 5.00th=[ 217], 10.00th=[ 8291], 20.00th=[16909], | 30.00th=[20317], 40.00th=[24249], 50.00th=[28181], 60.00th=[31589], | 70.00th=[35390], 80.00th=[41157], 90.00th=[46924], 95.00th=[55313], | 99.00th=[77071], 99.50th=[88605], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 95, max= 580, per=25.31%, avg=288.27, stdev=86.91, samples=41 iops : min= 5, max= 36, avg=17.29, stdev= 5.50, samples=41 write: IOPS=18, BW=302KiB/s (309kB/s)(6256KiB/20744msec); 0 zone resets clat (usec): min=1376, max=94250, avg=25387.62, stdev=16566.21 lat (usec): min=1377, max=94252, avg=25390.58, stdev=16564.25 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 5342], 10.00th=[ 8455], 20.00th=[ 9765], | 30.00th=[13566], 40.00th=[18220], 50.00th=[22414], 60.00th=[26870], | 70.00th=[31851], 80.00th=[37487], 90.00th=[46924], 95.00th=[57410], | 99.00th=[78119], 99.50th=[84411], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 126, max= 660, per=25.05%, avg=300.34, stdev=109.29, samples=41 iops : min= 7, max= 41, avg=18.05, stdev= 6.89, samples=41 lat (usec) : 100=0.39%, 250=2.99%, 500=0.65%, 1000=0.13% lat (msec) : 2=0.52%, 4=0.91%, 10=10.81%, 20=19.79%, 50=55.86% lat (msec) : 100=7.94% cpu : usr=0.01%, sys=30.82%, ctx=3155, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1140KiB/s (1167kB/s), 274KiB/s-298KiB/s (281kB/s-305kB/s), io=23.4MiB (24.5MB), run=20744-21014msec WRITE: bw=1199KiB/s (1228kB/s), 287KiB/s-312KiB/s (294kB/s-320kB/s), io=24.6MiB (25.8MB), run=20744-21014msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160181: Sun Jun 28 03:38:18 2026 read: IOPS=14, BW=236KiB/s (242kB/s)(5920KiB/25096msec) clat (msec): min=3, max=134, avg=23.91, stdev=22.83 lat (msec): min=3, max=134, avg=23.92, stdev=22.83 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 13], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 28], 80.00th=[ 36], 90.00th=[ 56], 95.00th=[ 72], | 99.00th=[ 114], 99.50th=[ 122], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 63, max= 864, per=23.79%, avg=226.22, stdev=151.04, samples=49 iops : min= 3, max= 54, avg=13.63, stdev= 9.63, samples=49 write: IOPS=15, BW=254KiB/s (260kB/s)(6368KiB/25096msec); 0 zone resets clat (msec): min=13, max=149, avg=40.75, stdev=24.13 lat (msec): min=13, max=149, avg=40.75, stdev=24.13 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 74], 95.00th=[ 89], | 99.00th=[ 126], 99.50th=[ 144], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 31, max= 640, per=24.77%, avg=247.96, stdev=146.39, samples=49 iops : min= 1, max= 40, avg=15.00, stdev= 9.39, samples=49 lat (msec) : 4=4.04%, 10=13.02%, 20=17.84%, 50=44.53%, 100=18.49% lat (msec) : 250=2.08% cpu : usr=0.02%, sys=14.12%, ctx=2076, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160182: Sun Jun 28 03:38:18 2026 read: IOPS=14, BW=228KiB/s (234kB/s)(5744KiB/25169msec) clat (msec): min=3, max=155, avg=24.59, stdev=22.90 lat (msec): min=3, max=155, avg=24.60, stdev=22.90 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 14], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 42], 90.00th=[ 58], 95.00th=[ 74], | 99.00th=[ 95], 99.50th=[ 113], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 672, per=23.58%, avg=224.22, stdev=153.18, samples=49 iops : min= 1, max= 42, avg=13.51, stdev= 9.78, samples=49 write: IOPS=16, BW=260KiB/s (266kB/s)(6544KiB/25169msec); 0 zone resets clat (msec): min=11, max=127, avg=39.88, stdev=23.91 lat (msec): min=11, max=127, avg=39.88, stdev=23.91 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 55], 90.00th=[ 77], 95.00th=[ 93], | 99.00th=[ 121], 99.50th=[ 126], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 63, max= 672, per=25.00%, avg=250.20, stdev=147.89, samples=49 iops : min= 3, max= 42, avg=15.14, stdev= 9.46, samples=49 lat (msec) : 4=2.60%, 10=14.19%, 20=16.93%, 50=47.01%, 100=16.80% lat (msec) : 250=2.47% cpu : usr=0.05%, sys=14.13%, ctx=2040, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160183: Sun Jun 28 03:38:18 2026 read: IOPS=15, BW=250KiB/s (256kB/s)(6256KiB/24985msec) clat (msec): min=2, max=171, avg=24.45, stdev=23.07 lat (msec): min=2, max=171, avg=24.45, stdev=23.07 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 100], 99.50th=[ 130], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 62, max= 832, per=26.13%, avg=248.51, stdev=171.00, samples=49 iops : min= 3, max= 52, avg=15.04, stdev=10.88, samples=49 write: IOPS=15, BW=241KiB/s (247kB/s)(6032KiB/24985msec); 0 zone resets clat (msec): min=14, max=123, avg=40.84, stdev=22.71 lat (msec): min=14, max=123, avg=40.84, stdev=22.71 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 59], 90.00th=[ 75], 95.00th=[ 83], | 99.00th=[ 112], 99.50th=[ 116], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 63, max= 672, per=23.57%, avg=235.96, stdev=144.84, samples=49 iops : min= 3, max= 42, avg=14.24, stdev= 9.26, samples=49 lat (msec) : 4=2.21%, 10=15.49%, 20=18.88%, 50=42.58%, 100=18.88% lat (msec) : 250=1.95% cpu : usr=0.04%, sys=14.27%, ctx=2109, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160184: Sun Jun 28 03:38:18 2026 read: IOPS=15, BW=241KiB/s (247kB/s)(6032KiB/24981msec) clat (msec): min=2, max=123, avg=24.75, stdev=22.06 lat (msec): min=2, max=123, avg=24.75, stdev=22.06 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 51], 95.00th=[ 78], | 99.00th=[ 105], 99.50th=[ 120], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 31, max= 704, per=24.99%, avg=237.67, stdev=151.37, samples=49 iops : min= 1, max= 44, avg=14.35, stdev= 9.68, samples=49 write: IOPS=15, BW=250KiB/s (256kB/s)(6256KiB/24981msec); 0 zone resets clat (msec): min=13, max=158, avg=39.97, stdev=23.17 lat (msec): min=13, max=158, avg=39.97, stdev=23.17 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 45], 80.00th=[ 55], 90.00th=[ 70], 95.00th=[ 89], | 99.00th=[ 134], 99.50th=[ 146], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 63, max= 672, per=24.70%, avg=247.22, stdev=145.73, samples=49 iops : min= 3, max= 42, avg=14.96, stdev= 9.32, samples=49 lat (msec) : 4=2.08%, 10=13.93%, 20=17.71%, 50=48.18%, 100=16.02% lat (msec) : 250=2.08% cpu : usr=0.06%, sys=14.08%, ctx=1999, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=952KiB/s (974kB/s), 228KiB/s-250KiB/s (234kB/s-256kB/s), io=23.4MiB (24.5MB), run=24981-25169msec WRITE: bw=1001KiB/s (1025kB/s), 241KiB/s-260KiB/s (247kB/s-266kB/s), io=24.6MiB (25.8MB), run=24981-25169msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160193: Sun Jun 28 03:38:28 2026 read: IOPS=3, BW=3137KiB/s (3212kB/s)(7168KiB/2285msec) clat (usec): min=804, max=212293, avg=132396.50, stdev=65521.53 lat (usec): min=804, max=212294, avg=132397.54, stdev=65521.70 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[115868], | 30.00th=[128451], 40.00th=[128451], 50.00th=[152044], 60.00th=[156238], | 70.00th=[156238], 80.00th=[162530], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 1924, max= 5710, per=53.33%, avg=3840.00, stdev=1893.42, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2241KiB/s (2294kB/s)(5120KiB/2285msec); 0 zone resets clat (msec): min=213, max=370, avg=270.36, stdev=63.68 lat (msec): min=213, max=370, avg=270.40, stdev=63.68 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1943, max= 3849, per=25.92%, avg=2613.33, stdev=1071.41, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=51.27%, ctx=659, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160194: Sun Jun 28 03:38:28 2026 read: IOPS=0, BW=720KiB/s (737kB/s)(2048KiB/2844msec) clat (msec): min=140, max=240, avg=190.71, stdev=70.36 lat (msec): min=140, max=240, avg=190.71, stdev=70.36 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 241], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 1924, max= 1973, per=27.06%, avg=1948.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3601KiB/s (3687kB/s)(10.0MiB/2844msec); 0 zone resets clat (msec): min=94, max=643, avg=240.28, stdev=177.30 lat (msec): min=94, max=643, avg=240.34, stdev=177.29 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 111], | 30.00th=[ 112], 40.00th=[ 146], 50.00th=[ 163], 60.00th=[ 169], | 70.00th=[ 234], 80.00th=[ 284], 90.00th=[ 447], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1924, max= 5941, per=39.04%, avg=3935.50, stdev=2252.12, samples=4 iops : min= 1, max= 5, avg= 3.25, stdev= 2.06, samples=4 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=46.43%, ctx=504, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160195: Sun Jun 28 03:38:28 2026 read: IOPS=2, BW=2830KiB/s (2898kB/s)(6144KiB/2171msec) clat (usec): min=420, max=179326, avg=31813.85, stdev=72339.24 lat (usec): min=421, max=179326, avg=31814.61, stdev=72339.07 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 461], | 30.00th=[ 461], 40.00th=[ 474], 50.00th=[ 474], 60.00th=[ 1434], | 70.00th=[ 8717], 80.00th=[ 8717], 90.00th=[179307], 95.00th=[179307], | 99.00th=[179307], 99.50th=[179307], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 4096, max= 5774, per=68.53%, avg=4935.00, stdev=1186.53, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2830KiB/s (2898kB/s)(6144KiB/2171msec); 0 zone resets clat (msec): min=135, max=995, avg=328.25, stdev=330.77 lat (msec): min=135, max=995, avg=328.29, stdev=330.78 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 186], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 2048, max= 3930, per=32.49%, avg=3275.67, stdev=1063.96, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 500=25.00% lat (msec) : 2=8.33%, 10=8.33%, 250=41.67%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=39.22%, ctx=216, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160197: Sun Jun 28 03:38:28 2026 read: IOPS=2, BW=2314KiB/s (2369kB/s)(5120KiB/2213msec) clat (usec): min=398, max=175015, avg=82605.33, stdev=78800.96 lat (usec): min=399, max=175015, avg=82606.00, stdev=78800.77 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 400], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[108528], 60.00th=[108528], | 70.00th=[129500], 80.00th=[129500], 90.00th=[175113], 95.00th=[175113], | 99.00th=[175113], 99.50th=[175113], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3239KiB/s (3317kB/s)(7168KiB/2213msec); 0 zone resets clat (msec): min=146, max=480, avg=251.61, stdev=126.92 lat (msec): min=146, max=480, avg=251.65, stdev=126.92 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 150], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 215], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 363], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1899, max= 5829, per=38.28%, avg=3859.00, stdev=1965.02, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=66.67%, 500=16.67% cpu : usr=0.00%, sys=50.86%, ctx=701, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7201KiB/s (7374kB/s), 720KiB/s-3137KiB/s (737kB/s-3212kB/s), io=20.0MiB (20.0MB), run=2171-2844msec WRITE: bw=9.84MiB/s (10.3MB/s), 2241KiB/s-3601KiB/s (2294kB/s-3687kB/s), io=28.0MiB (29.4MB), run=2171-2844msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160196: Sun Jun 28 03:38:28 2026 read: IOPS=2, BW=2351KiB/s (2407kB/s)(7168KiB/3049msec) clat (msec): min=56, max=946, avg=274.91, stdev=308.28 lat (msec): min=56, max=946, avg=274.91, stdev=308.28 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 70], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 222], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 284], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1935, max= 4096, per=51.40%, avg=3310.33, stdev=1195.10, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1679KiB/s (1720kB/s)(5120KiB/3049msec); 0 zone resets clat (msec): min=161, max=327, avg=222.88, stdev=62.33 lat (msec): min=161, max=327, avg=222.92, stdev=62.32 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1950, max= 4087, per=33.48%, avg=3018.50, stdev=1511.09, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 1000=8.33% cpu : usr=0.00%, sys=13.88%, ctx=224, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160198: Sun Jun 28 03:38:28 2026 read: IOPS=0, BW=668KiB/s (684kB/s)(2048KiB/3064msec) clat (msec): min=136, max=448, avg=292.67, stdev=220.86 lat (msec): min=136, max=448, avg=292.67, stdev=220.86 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1976, max= 2043, per=31.20%, avg=2009.50, stdev=47.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3342KiB/s (3422kB/s)(10.0MiB/3064msec); 0 zone resets clat (msec): min=44, max=714, avg=243.95, stdev=229.60 lat (msec): min=44, max=715, avg=244.01, stdev=229.59 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 53], | 30.00th=[ 91], 40.00th=[ 112], 50.00th=[ 123], 60.00th=[ 174], | 70.00th=[ 271], 80.00th=[ 284], 90.00th=[ 584], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 4087, max= 8192, per=68.11%, avg=6141.00, stdev=2052.50, samples=3 iops : min= 3, max= 8, avg= 5.67, stdev= 2.52, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=15.02%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160199: Sun Jun 28 03:38:28 2026 read: IOPS=1, BW=2047KiB/s (2096kB/s)(6144KiB/3002msec) clat (msec): min=48, max=145, avg=84.91, stdev=43.81 lat (msec): min=48, max=145, avg=84.91, stdev=43.81 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 59], | 30.00th=[ 59], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 62], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 4087, max= 4087, per=63.46%, avg=4087.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2047KiB/s (2096kB/s)(6144KiB/3002msec); 0 zone resets clat (msec): min=48, max=1522, avg=406.08, stdev=565.34 lat (msec): min=48, max=1522, avg=406.13, stdev=565.34 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 207], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1950, max= 4087, per=29.68%, avg=2676.33, stdev=1221.85, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=16.67%, 100=33.33%, 250=33.33%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.66%, ctx=226, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160200: Sun Jun 28 03:38:28 2026 read: IOPS=1, BW=1610KiB/s (1649kB/s)(5120KiB/3180msec) clat (msec): min=13, max=181, avg=58.54, stdev=70.45 lat (msec): min=13, max=181, avg=58.54, stdev=70.45 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 14], 10.00th=[ 14], 20.00th=[ 14], | 30.00th=[ 19], 40.00th=[ 19], 50.00th=[ 26], 60.00th=[ 26], | 70.00th=[ 55], 80.00th=[ 55], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 4096, max= 4096, per=63.60%, avg=4096.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2254KiB/s (2308kB/s)(7168KiB/3180msec); 0 zone resets clat (msec): min=24, max=1384, avg=403.11, stdev=485.00 lat (msec): min=24, max=1384, avg=403.16, stdev=485.02 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 25], 10.00th=[ 25], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 27], 50.00th=[ 376], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 531], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1950, max= 2048, per=22.27%, avg=2008.25, stdev=46.35, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 20=16.67%, 50=33.33%, 100=8.33%, 250=8.33%, 500=16.67% lat (msec) : 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.17%, ctx=114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6440KiB/s (6595kB/s), 668KiB/s-2351KiB/s (684kB/s-2407kB/s), io=20.0MiB (20.0MB), run=3002-3180msec WRITE: bw=9016KiB/s (9233kB/s), 1679KiB/s-3342KiB/s (1720kB/s-3422kB/s), io=28.0MiB (29.4MB), run=3002-3180msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=160206: Sun Jun 28 03:38:36 2026 read: IOPS=1, BW=6711KiB/s (6872kB/s)(12.0MiB/1831msec) clat (msec): min=398, max=860, avg=594.72, stdev=238.57 lat (msec): min=398, max=860, avg=594.73, stdev=238.56 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7249, max= 8062, per=100.00%, avg=7655.50, stdev=574.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=52.51%, ctx=2110, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160207: Sun Jun 28 03:38:36 2026 read: IOPS=0, BW=1820KiB/s (1863kB/s)(4096KiB/2251msec) clat (nsec): min=399669k, max=399669k, avg=399668873.00, stdev= 0.00 lat (nsec): min=399670k, max=399670k, avg=399669993.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7262, max= 7262, per=99.78%, avg=7262.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3639KiB/s (3727kB/s)(8192KiB/2251msec); 0 zone resets clat (msec): min=459, max=1345, avg=902.41, stdev=626.49 lat (msec): min=459, max=1345, avg=902.68, stdev=626.49 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8062, max= 8062, per=55.38%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=18.00%, ctx=1071, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160208: Sun Jun 28 03:38:36 2026 write: IOPS=1, BW=5863KiB/s (6003kB/s)(12.0MiB/2096msec); 0 zone resets clat (msec): min=545, max=846, avg=681.84, stdev=152.68 lat (msec): min=545, max=847, avg=682.14, stdev=152.65 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7670, max= 8062, per=54.04%, avg=7866.00, stdev=277.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=25.44%, ctx=281, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160209: Sun Jun 28 03:38:36 2026 write: IOPS=2, BW=8451KiB/s (8654kB/s)(12.0MiB/1454msec); 0 zone resets clat (msec): min=157, max=980, avg=471.01, stdev=445.42 lat (msec): min=157, max=981, avg=471.29, stdev=445.40 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min=14576, max=14576, per=100.00%, avg=14576.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.07%, sys=21.75%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7279KiB/s (7453kB/s), 1820KiB/s-6711KiB/s (1863kB/s-6872kB/s), io=16.0MiB (16.8MB), run=1831-2251msec WRITE: bw=14.2MiB/s (14.9MB/s), 3639KiB/s-8451KiB/s (3727kB/s-8654kB/s), io=32.0MiB (33.6MB), run=1454-2251msec rand-rw: (groupid=0, jobs=1): err= 0: pid=160211: Sun Jun 28 03:38:36 2026 read: IOPS=1, BW=5563KiB/s (5696kB/s)(12.0MiB/2209msec) clat (msec): min=303, max=1266, avg=727.08, stdev=492.01 lat (msec): min=303, max=1266, avg=727.08, stdev=492.01 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=18.25%, ctx=92, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160212: Sun Jun 28 03:38:36 2026 read: IOPS=0, BW=1622KiB/s (1660kB/s)(4096KiB/2526msec) clat (nsec): min=785614k, max=785614k, avg=785614399.00, stdev= 0.00 lat (nsec): min=785615k, max=785615k, avg=785615246.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3243KiB/s (3321kB/s)(8192KiB/2526msec); 0 zone resets clat (msec): min=682, max=980, avg=831.42, stdev=210.72 lat (msec): min=682, max=980, avg=831.73, stdev=210.72 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8062, max= 8062, per=62.15%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=14.34%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160213: Sun Jun 28 03:38:36 2026 write: IOPS=1, BW=4919KiB/s (5037kB/s)(12.0MiB/2498msec); 0 zone resets clat (msec): min=229, max=1200, avg=818.25, stdev=517.59 lat (msec): min=229, max=1200, avg=818.55, stdev=517.53 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8062, max= 8062, per=62.15%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=14.46%, ctx=73, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=160214: Sun Jun 28 03:38:36 2026 write: IOPS=1, BW=6212KiB/s (6361kB/s)(12.0MiB/1978msec); 0 zone resets clat (msec): min=315, max=1013, avg=653.24, stdev=349.71 lat (msec): min=315, max=1014, avg=653.61, stdev=349.71 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8192, max= 8192, per=63.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=21.35%, ctx=86, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6486KiB/s (6642kB/s), 1622KiB/s-5563KiB/s (1660kB/s-5696kB/s), io=16.0MiB (16.8MB), run=2209-2526msec WRITE: bw=12.7MiB/s (13.3MB/s), 3243KiB/s-6212KiB/s (3321kB/s-6361kB/s), io=32.0MiB (33.6MB), run=1978-2526msec