== sanity test 398b: DIO and buffer IO race ============== 17:45:15 (1778622315) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.50132 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178927: Tue May 12 17:47:56 2026 read: IOPS=10, BW=43.7KiB/s (44.8kB/s)(5992KiB/137063msec) clat (usec): min=34, max=916657, avg=50514.62, stdev=38931.20 lat (usec): min=35, max=916657, avg=50516.67, stdev=38931.37 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 15139], 10.00th=[ 20317], 20.00th=[ 26346], | 30.00th=[ 31327], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 72877], 90.00th=[ 88605], 95.00th=[104334], | 99.00th=[152044], 99.50th=[196084], 99.90th=[341836], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 112, per=25.41%, avg=43.71, stdev=17.54, samples=267 iops : min= 1, max= 28, avg=10.27, stdev= 4.43, samples=267 write: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6296KiB/137063msec); 0 zone resets clat (usec): min=1005, max=279622, avg=38584.51, stdev=38743.55 lat (usec): min=1006, max=279624, avg=38586.82, stdev=38743.86 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1418], 10.00th=[ 2024], 20.00th=[ 4817], | 30.00th=[ 8848], 40.00th=[ 17171], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[160433], 99.50th=[196084], 99.90th=[270533], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 157, per=25.32%, avg=45.57, stdev=20.55, samples=269 iops : min= 1, max= 39, avg=10.72, stdev= 5.19, samples=269 lat (usec) : 50=0.16%, 100=1.50%, 750=0.03% lat (msec) : 2=4.98%, 4=4.07%, 10=7.55%, 20=8.24%, 50=38.74% lat (msec) : 100=27.64%, 250=6.90%, 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=4.65%, ctx=6729, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178928: Tue May 12 17:47:56 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(5940KiB/139205msec) clat (usec): min=35, max=261231, avg=50816.60, stdev=32620.49 lat (usec): min=35, max=261233, avg=50819.58, stdev=32620.74 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 12911], 10.00th=[ 18744], 20.00th=[ 25560], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[158335], 99.50th=[177210], 99.90th=[240124], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 96, per=24.59%, avg=42.29, stdev=17.63, samples=272 iops : min= 1, max= 24, avg= 9.91, stdev= 4.46, samples=272 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6348KiB/139205msec); 0 zone resets clat (usec): min=1154, max=975411, avg=39822.14, stdev=45968.69 lat (usec): min=1156, max=975412, avg=39826.21, stdev=45970.20 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1516], 10.00th=[ 2245], 20.00th=[ 5080], | 30.00th=[ 8848], 40.00th=[ 18744], 50.00th=[ 28705], 60.00th=[ 39584], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[166724], 99.50th=[214959], 99.90th=[299893], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 119, per=24.98%, avg=44.96, stdev=20.49, samples=273 iops : min= 1, max= 29, avg=10.58, stdev= 5.17, samples=273 lat (usec) : 50=0.20%, 100=1.60%, 250=0.07%, 500=0.10% lat (msec) : 2=4.52%, 4=3.81%, 10=8.30%, 20=7.98%, 50=37.14% lat (msec) : 100=28.48%, 250=7.65%, 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=4.68%, ctx=6800, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178929: Tue May 12 17:47:56 2026 read: IOPS=10, BW=43.6KiB/s (44.7kB/s)(6028KiB/138206msec) clat (usec): min=39, max=1010.1k, avg=51002.60, stdev=39322.86 lat (usec): min=40, max=1010.1k, avg=51022.19, stdev=39317.24 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 13566], 10.00th=[ 20317], | 20.00th=[ 26608], 30.00th=[ 31851], 40.00th=[ 38011], | 50.00th=[ 44827], 60.00th=[ 51643], 70.00th=[ 60031], | 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[ 107480], | 99.00th=[ 147850], 99.50th=[ 185598], 99.90th=[ 270533], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 95, per=25.25%, avg=43.43, stdev=17.13, samples=269 iops : min= 1, max= 23, avg=10.19, stdev= 4.32, samples=269 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6260KiB/138206msec); 0 zone resets clat (usec): min=1148, max=292520, avg=38799.39, stdev=39427.63 lat (usec): min=1149, max=292523, avg=38808.36, stdev=39424.73 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1467], 10.00th=[ 2147], 20.00th=[ 4490], | 30.00th=[ 8225], 40.00th=[ 17957], 50.00th=[ 29230], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[158335], 99.50th=[185598], 99.90th=[287310], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 111, per=24.94%, avg=44.90, stdev=18.93, samples=270 iops : min= 1, max= 27, avg=10.56, stdev= 4.77, samples=270 lat (usec) : 50=0.07%, 100=1.40%, 250=0.03%, 500=0.03%, 750=0.07% lat (msec) : 2=4.62%, 4=4.49%, 10=7.65%, 20=7.32%, 50=38.18% lat (msec) : 100=28.78%, 250=7.16%, 500=0.16%, 2000=0.03% cpu : usr=0.09%, sys=4.84%, ctx=6778, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178930: Tue May 12 17:47:56 2026 read: IOPS=10, BW=43.9KiB/s (44.0kB/s)(6052KiB/137767msec) clat (usec): min=36, max=313640, avg=50468.47, stdev=34132.21 lat (usec): min=36, max=313642, avg=50470.79, stdev=34133.36 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 10683], 10.00th=[ 18744], 20.00th=[ 25560], | 30.00th=[ 31327], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 90702], 95.00th=[110625], | 99.00th=[177210], 99.50th=[210764], 99.90th=[283116], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 111, per=25.29%, avg=43.49, stdev=16.44, samples=270 iops : min= 1, max= 27, avg=10.21, stdev= 4.14, samples=270 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6236KiB/137767msec); 0 zone resets clat (usec): min=991, max=959868, avg=38982.11, stdev=45905.40 lat (usec): min=992, max=959870, avg=38985.88, stdev=45906.84 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1434], 10.00th=[ 2278], 20.00th=[ 4817], | 30.00th=[ 8356], 40.00th=[ 16581], 50.00th=[ 26870], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[170918], 99.50th=[193987], 99.90th=[329253], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 118, per=24.83%, avg=44.70, stdev=20.83, samples=270 iops : min= 1, max= 29, avg=10.51, stdev= 5.25, samples=270 lat (usec) : 50=0.13%, 100=1.95%, 250=0.13%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.46%, 4=4.26%, 10=8.20%, 20=8.33%, 50=37.96% lat (msec) : 100=26.73%, 250=7.55%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.68%, ctx=6711, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=172KiB/s (177kB/s), 42.7KiB/s-43.9KiB/s (43.7kB/s-44.0kB/s), io=23.4MiB (24.6MB), run=137063-139205msec WRITE: bw=181KiB/s (185kB/s), 45.3KiB/s-45.9KiB/s (46.4kB/s-47.0kB/s), io=24.6MiB (25.7MB), run=137063-139205msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178932: Tue May 12 17:48:39 2026 read: IOPS=8, BW=33.0KiB/s (33.8kB/s)(5992KiB/181430msec) clat (msec): min=6, max=1019, avg=47.66, stdev=49.90 lat (msec): min=6, max=1019, avg=47.67, stdev=49.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 105], 95.00th=[ 138], | 99.00th=[ 220], 99.50th=[ 253], 99.90th=[ 300], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 126, per=25.54%, avg=33.71, stdev=23.44, samples=343 iops : min= 1, max= 31, avg= 7.76, stdev= 5.90, samples=343 write: IOPS=8, BW=34.7KiB/s (35.5kB/s)(6296KiB/181430msec); 0 zone resets clat (msec): min=12, max=382, avg=69.77, stdev=50.44 lat (msec): min=12, max=382, avg=69.77, stdev=50.44 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 106], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 245], 99.50th=[ 305], 99.90th=[ 355], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 127, per=25.15%, avg=34.70, stdev=22.47, samples=351 iops : min= 1, max= 31, avg= 8.00, stdev= 5.66, samples=351 lat (msec) : 10=1.46%, 20=12.34%, 50=44.99%, 100=24.93%, 250=15.53% lat (msec) : 500=0.72%, 2000=0.03% cpu : usr=0.06%, sys=1.89%, ctx=5004, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178933: Tue May 12 17:48:39 2026 read: IOPS=8, BW=32.0KiB/s (33.8kB/s)(5940KiB/180081msec) clat (msec): min=5, max=944, avg=46.88, stdev=48.94 lat (msec): min=5, max=944, avg=46.88, stdev=48.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 68], 90.00th=[ 99], 95.00th=[ 140], | 99.00th=[ 215], 99.50th=[ 243], 99.90th=[ 355], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 127, per=25.18%, avg=33.24, stdev=23.62, samples=347 iops : min= 1, max= 31, avg= 7.63, stdev= 5.95, samples=347 write: IOPS=8, BW=35.2KiB/s (36.1kB/s)(6348KiB/180081msec); 0 zone resets clat (msec): min=11, max=387, avg=69.49, stdev=48.96 lat (msec): min=11, max=387, avg=69.50, stdev=48.96 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 82], 80.00th=[ 103], 90.00th=[ 134], 95.00th=[ 163], | 99.00th=[ 249], 99.50th=[ 288], 99.90th=[ 351], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 103, per=25.25%, avg=34.84, stdev=22.17, samples=354 iops : min= 1, max= 25, avg= 8.04, stdev= 5.58, samples=354 lat (msec) : 10=1.24%, 20=13.22%, 50=44.66%, 100=25.46%, 250=14.75% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.05%, sys=1.94%, ctx=4968, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178934: Tue May 12 17:48:39 2026 read: IOPS=8, BW=33.4KiB/s (34.2kB/s)(6028KiB/180684msec) clat (msec): min=4, max=354, avg=48.01, stdev=42.44 lat (msec): min=4, max=354, avg=48.03, stdev=42.45 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 71], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 205], 99.50th=[ 218], 99.90th=[ 296], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 127, per=25.38%, avg=33.50, stdev=23.45, samples=349 iops : min= 1, max= 31, avg= 7.70, stdev= 5.89, samples=349 write: IOPS=8, BW=34.6KiB/s (35.5kB/s)(6260KiB/180684msec); 0 zone resets clat (msec): min=12, max=954, avg=69.07, stdev=54.49 lat (msec): min=12, max=954, avg=69.07, stdev=54.50 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 80], 80.00th=[ 102], 90.00th=[ 132], 95.00th=[ 167], | 99.00th=[ 241], 99.50th=[ 313], 99.90th=[ 435], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 103, per=25.02%, avg=34.53, stdev=22.32, samples=352 iops : min= 1, max= 25, avg= 7.96, stdev= 5.63, samples=352 lat (msec) : 10=1.20%, 20=12.79%, 50=44.43%, 100=25.49%, 250=15.46% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.05%, sys=1.94%, ctx=4938, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178935: Tue May 12 17:48:39 2026 read: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6052KiB/180591msec) clat (msec): min=5, max=296, avg=46.45, stdev=42.53 lat (msec): min=5, max=296, avg=46.46, stdev=42.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 67], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 209], 99.50th=[ 259], 99.90th=[ 292], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 135, per=25.68%, avg=33.90, stdev=24.04, samples=345 iops : min= 1, max= 33, avg= 7.80, stdev= 6.05, samples=345 write: IOPS=8, BW=34.5KiB/s (35.4kB/s)(6236KiB/180591msec); 0 zone resets clat (msec): min=13, max=980, avg=70.64, stdev=55.74 lat (msec): min=13, max=980, avg=70.64, stdev=55.74 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 82], 80.00th=[ 103], 90.00th=[ 140], 95.00th=[ 176], | 99.00th=[ 257], 99.50th=[ 309], 99.90th=[ 359], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 103, per=25.01%, avg=34.51, stdev=21.85, samples=349 iops : min= 1, max= 25, avg= 7.95, stdev= 5.50, samples=349 lat (msec) : 10=1.04%, 20=12.43%, 50=46.03%, 100=24.64%, 250=15.01% lat (msec) : 500=0.81%, 1000=0.03% cpu : usr=0.06%, sys=1.89%, ctx=4922, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=132KiB/s (136kB/s), 32.0KiB/s-33.5KiB/s (33.8kB/s-34.3kB/s), io=23.4MiB (24.6MB), run=180081-181430msec WRITE: bw=139KiB/s (142kB/s), 34.5KiB/s-35.2KiB/s (35.4kB/s-36.1kB/s), io=24.6MiB (25.7MB), run=180081-181430msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178976: Tue May 12 17:49:24 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5920KiB/35392msec) clat (usec): min=37, max=292717, avg=52315.04, stdev=37534.24 lat (usec): min=38, max=292719, avg=52323.04, stdev=37536.08 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 13829], 20.00th=[ 26084], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 45876], 60.00th=[ 52167], | 70.00th=[ 63177], 80.00th=[ 78119], 90.00th=[ 96994], 95.00th=[122160], | 99.00th=[191890], 99.50th=[223347], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 62, max= 508, per=25.13%, avg=165.88, stdev=66.67, samples=69 iops : min= 3, max= 31, avg= 9.57, stdev= 4.18, samples=69 write: IOPS=11, BW=180KiB/s (184kB/s)(6368KiB/35392msec); 0 zone resets clat (usec): min=1606, max=229881, avg=40070.25, stdev=40596.25 lat (usec): min=1607, max=229885, avg=40073.78, stdev=40595.42 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2638], 10.00th=[ 3884], 20.00th=[ 5932], | 30.00th=[ 10552], 40.00th=[ 17433], 50.00th=[ 26346], 60.00th=[ 39584], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[115868], | 99.00th=[185598], 99.50th=[193987], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 31, max= 440, per=25.88%, avg=179.61, stdev=81.14, samples=69 iops : min= 1, max= 27, avg=10.45, stdev= 5.13, samples=69 lat (usec) : 50=0.26%, 100=3.12%, 250=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.43%, 4=4.30%, 10=9.64%, 20=9.90%, 50=32.42% lat (msec) : 100=29.04%, 250=8.98%, 500=0.13% cpu : usr=0.06%, sys=5.63%, ctx=1823, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178977: Tue May 12 17:49:24 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5744KiB/36265msec) clat (usec): min=48, max=254493, avg=54154.51, stdev=37433.40 lat (usec): min=49, max=254495, avg=54155.95, stdev=37433.10 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 15926], 20.00th=[ 26870], | 30.00th=[ 32637], 40.00th=[ 39584], 50.00th=[ 49021], 60.00th=[ 57410], | 70.00th=[ 65274], 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[116917], | 99.00th=[210764], 99.50th=[250610], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 318, per=23.74%, avg=156.68, stdev=64.63, samples=71 iops : min= 1, max= 19, avg= 9.00, stdev= 4.06, samples=71 write: IOPS=11, BW=180KiB/s (185kB/s)(6544KiB/36265msec); 0 zone resets clat (usec): min=1499, max=276140, avg=40761.97, stdev=42624.72 lat (usec): min=1500, max=276143, avg=40767.01, stdev=42625.57 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2311], 10.00th=[ 3359], 20.00th=[ 7242], | 30.00th=[ 12649], 40.00th=[ 18744], 50.00th=[ 25822], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[133694], | 99.00th=[175113], 99.50th=[231736], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 418, per=25.71%, avg=178.41, stdev=90.25, samples=71 iops : min= 1, max= 26, avg=10.37, stdev= 5.71, samples=71 lat (usec) : 50=0.13%, 100=2.99%, 250=0.39%, 500=0.13% lat (msec) : 2=1.43%, 4=5.21%, 10=6.77%, 20=11.72%, 50=32.68% lat (msec) : 100=29.17%, 250=8.98%, 500=0.39% cpu : usr=0.07%, sys=5.52%, ctx=1747, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178978: Tue May 12 17:49:24 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(6256KiB/35573msec) clat (usec): min=37, max=327592, avg=51876.57, stdev=40541.60 lat (usec): min=38, max=327593, avg=51884.99, stdev=40542.11 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 82], 10.00th=[ 13304], 20.00th=[ 23987], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[124257], | 99.00th=[210764], 99.50th=[225444], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 414, per=26.71%, avg=176.26, stdev=82.78, samples=70 iops : min= 1, max= 25, avg=10.23, stdev= 5.23, samples=70 write: IOPS=10, BW=170KiB/s (174kB/s)(6032KiB/35573msec); 0 zone resets clat (usec): min=1669, max=282378, avg=40123.12, stdev=42856.36 lat (usec): min=1671, max=282381, avg=40131.09, stdev=42854.63 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2147], 10.00th=[ 3785], 20.00th=[ 7242], | 30.00th=[ 10683], 40.00th=[ 15664], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 66323], 90.00th=[103285], 95.00th=[125305], | 99.00th=[185598], 99.50th=[233833], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 383, per=24.20%, avg=167.91, stdev=81.26, samples=70 iops : min= 1, max= 23, avg= 9.70, stdev= 5.13, samples=70 lat (usec) : 50=0.39%, 100=3.26%, 250=0.65%, 1000=0.13% lat (msec) : 2=1.82%, 4=3.65%, 10=8.98%, 20=10.81%, 50=35.42% lat (msec) : 100=24.61%, 250=10.03%, 500=0.26% cpu : usr=0.05%, sys=5.44%, ctx=1815, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178979: Tue May 12 17:49:24 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36017msec) clat (usec): min=39, max=312123, avg=53449.20, stdev=44312.19 lat (usec): min=39, max=312126, avg=53450.80, stdev=44312.10 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 95], 20.00th=[ 22938], | 30.00th=[ 29754], 40.00th=[ 38536], 50.00th=[ 47449], 60.00th=[ 56886], | 70.00th=[ 65274], 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[126354], | 99.00th=[235930], 99.50th=[265290], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 381, per=25.61%, avg=169.04, stdev=75.75, samples=70 iops : min= 1, max= 23, avg= 9.77, stdev= 4.80, samples=70 write: IOPS=10, BW=174KiB/s (178kB/s)(6256KiB/36017msec); 0 zone resets clat (usec): min=1696, max=253199, avg=40150.66, stdev=41687.49 lat (usec): min=1700, max=253202, avg=40155.13, stdev=41685.60 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2212], 10.00th=[ 3195], 20.00th=[ 6456], | 30.00th=[ 9765], 40.00th=[ 15664], 50.00th=[ 25035], 60.00th=[ 38011], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[103285], 95.00th=[132645], | 99.00th=[175113], 99.50th=[193987], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 30, max= 480, per=25.40%, avg=176.27, stdev=88.78, samples=70 iops : min= 1, max= 30, avg=10.21, stdev= 5.62, samples=70 lat (usec) : 50=0.13%, 100=5.21%, 250=0.78%, 500=0.26% lat (msec) : 2=1.69%, 4=5.21%, 10=9.11%, 20=7.81%, 50=31.12% lat (msec) : 100=28.26%, 250=9.90%, 500=0.52% cpu : usr=0.07%, sys=5.10%, ctx=1747, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=660KiB/s (676kB/s), 158KiB/s-176KiB/s (162kB/s-180kB/s), io=23.4MiB (24.5MB), run=35392-36265msec WRITE: bw=695KiB/s (712kB/s), 170KiB/s-180KiB/s (174kB/s-185kB/s), io=24.6MiB (25.8MB), run=35392-36265msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178981: Tue May 12 17:49:44 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(5920KiB/53879msec) clat (msec): min=10, max=339, avg=56.32, stdev=42.86 lat (msec): min=10, max=339, avg=56.34, stdev=42.85 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 51], | 70.00th=[ 59], 80.00th=[ 79], 90.00th=[ 113], 95.00th=[ 138], | 99.00th=[ 215], 99.50th=[ 257], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 348, per=25.24%, avg=110.29, stdev=59.60, samples=105 iops : min= 1, max= 21, avg= 6.11, stdev= 3.79, samples=105 write: IOPS=7, BW=118KiB/s (121kB/s)(6368KiB/53879msec); 0 zone resets clat (msec): min=16, max=301, avg=82.82, stdev=49.99 lat (msec): min=16, max=301, avg=82.82, stdev=49.99 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 31], 10.00th=[ 37], 20.00th=[ 45], | 30.00th=[ 52], 40.00th=[ 62], 50.00th=[ 70], 60.00th=[ 81], | 70.00th=[ 95], 80.00th=[ 113], 90.00th=[ 148], 95.00th=[ 180], | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 23, max= 286, per=25.93%, avg=119.29, stdev=54.13, samples=105 iops : min= 1, max= 17, avg= 6.69, stdev= 3.39, samples=105 lat (msec) : 20=4.56%, 50=39.06%, 100=36.46%, 250=18.62%, 500=1.30% cpu : usr=0.05%, sys=1.79%, ctx=1217, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178982: Tue May 12 17:49:44 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(5744KiB/54714msec) clat (msec): min=9, max=321, avg=59.54, stdev=45.48 lat (msec): min=9, max=321, avg=59.54, stdev=45.48 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 86], 90.00th=[ 122], 95.00th=[ 155], | 99.00th=[ 224], 99.50th=[ 232], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 24, max= 320, per=24.68%, avg=107.85, stdev=62.83, samples=103 iops : min= 1, max= 20, avg= 5.96, stdev= 4.05, samples=103 write: IOPS=7, BW=120KiB/s (122kB/s)(6544KiB/54714msec); 0 zone resets clat (msec): min=15, max=368, avg=81.33, stdev=50.44 lat (msec): min=15, max=368, avg=81.34, stdev=50.47 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 45], | 30.00th=[ 52], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 78], | 70.00th=[ 90], 80.00th=[ 108], 90.00th=[ 159], 95.00th=[ 182], | 99.00th=[ 245], 99.50th=[ 271], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 30, max= 316, per=25.79%, avg=118.61, stdev=60.34, samples=106 iops : min= 1, max= 19, avg= 6.64, stdev= 3.78, samples=106 lat (msec) : 10=0.13%, 20=4.30%, 50=36.98%, 100=38.41%, 250=19.53% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.85%, ctx=1309, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178983: Tue May 12 17:49:44 2026 read: IOPS=7, BW=115KiB/s (117kB/s)(6256KiB/54581msec) clat (msec): min=10, max=225, avg=55.62, stdev=38.77 lat (msec): min=10, max=225, avg=55.62, stdev=38.77 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 52], | 70.00th=[ 61], 80.00th=[ 72], 90.00th=[ 109], 95.00th=[ 144], | 99.00th=[ 203], 99.50th=[ 220], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 30, max= 318, per=26.66%, avg=116.50, stdev=65.79, samples=105 iops : min= 1, max= 19, avg= 6.50, stdev= 4.17, samples=105 write: IOPS=6, BW=111KiB/s (113kB/s)(6032KiB/54581msec); 0 zone resets clat (msec): min=13, max=366, avg=86.92, stdev=55.44 lat (msec): min=13, max=366, avg=86.93, stdev=55.44 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 29], 10.00th=[ 35], 20.00th=[ 45], | 30.00th=[ 54], 40.00th=[ 62], 50.00th=[ 72], 60.00th=[ 85], | 70.00th=[ 97], 80.00th=[ 123], 90.00th=[ 161], 95.00th=[ 197], | 99.00th=[ 296], 99.50th=[ 334], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 254, per=23.99%, avg=110.36, stdev=50.16, samples=105 iops : min= 1, max= 15, avg= 6.10, stdev= 3.22, samples=105 lat (msec) : 20=5.47%, 50=37.24%, 100=37.24%, 250=19.14%, 500=0.91% cpu : usr=0.05%, sys=1.82%, ctx=1322, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178984: Tue May 12 17:49:44 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54742msec) clat (msec): min=12, max=299, avg=62.36, stdev=47.14 lat (msec): min=12, max=299, avg=62.36, stdev=47.14 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 67], 80.00th=[ 88], 90.00th=[ 127], 95.00th=[ 174], | 99.00th=[ 226], 99.50th=[ 279], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 318, per=25.78%, avg=112.67, stdev=61.64, samples=103 iops : min= 1, max= 19, avg= 6.26, stdev= 3.91, samples=103 write: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54742msec); 0 zone resets clat (msec): min=17, max=322, avg=79.69, stdev=47.45 lat (msec): min=17, max=322, avg=79.69, stdev=47.45 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 31], 10.00th=[ 36], 20.00th=[ 44], | 30.00th=[ 53], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 75], | 70.00th=[ 90], 80.00th=[ 110], 90.00th=[ 136], 95.00th=[ 182], | 99.00th=[ 259], 99.50th=[ 313], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 316, per=25.40%, avg=116.84, stdev=52.62, samples=103 iops : min= 1, max= 19, avg= 6.52, stdev= 3.33, samples=103 lat (msec) : 20=4.43%, 50=34.77%, 100=39.97%, 250=20.05%, 500=0.78% cpu : usr=0.05%, sys=1.84%, ctx=1235, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=438KiB/s (448kB/s), 105KiB/s-115KiB/s (108kB/s-117kB/s), io=23.4MiB (24.5MB), run=53879-54742msec WRITE: bw=460KiB/s (471kB/s), 111KiB/s-120KiB/s (113kB/s-122kB/s), io=24.6MiB (25.8MB), run=53879-54742msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178998: Tue May 12 17:49:59 2026 read: IOPS=2, BW=2679KiB/s (2743kB/s)(7168KiB/2676msec) clat (usec): min=917, max=289928, avg=190737.81, stdev=97928.53 lat (usec): min=919, max=289930, avg=190739.56, stdev=97928.38 clat percentiles (usec): | 1.00th=[ 914], 5.00th=[ 914], 10.00th=[ 914], 20.00th=[164627], | 30.00th=[166724], 40.00th=[166724], 50.00th=[191890], 60.00th=[242222], | 70.00th=[242222], 80.00th=[278922], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 1996, max= 3785, per=55.82%, avg=2815.00, stdev=929.75, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1913KiB/s (1959kB/s)(5120KiB/2676msec); 0 zone resets clat (msec): min=130, max=378, avg=254.49, stdev=98.70 lat (msec): min=130, max=378, avg=254.63, stdev=98.68 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1892, max= 3992, per=35.01%, avg=2472.00, stdev=1015.21, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=33.33% cpu : usr=0.04%, sys=17.91%, ctx=165, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178999: Tue May 12 17:49:59 2026 read: IOPS=0, BW=528KiB/s (541kB/s)(2048KiB/3880msec) clat (usec): min=1439, max=180480, avg=90960.00, stdev=126600.84 lat (usec): min=1440, max=180483, avg=90962.06, stdev=126602.05 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1434], 10.00th=[ 1434], 20.00th=[ 1434], | 30.00th=[ 1434], 40.00th=[ 1434], 50.00th=[ 1434], 60.00th=[181404], | 70.00th=[181404], 80.00th=[181404], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 1651, max= 1996, per=36.16%, avg=1823.50, stdev=243.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2639KiB/s (2703kB/s)(10.0MiB/3880msec); 0 zone resets clat (msec): min=104, max=889, avg=364.39, stdev=223.21 lat (msec): min=104, max=889, avg=364.69, stdev=223.28 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 199], | 30.00th=[ 226], 40.00th=[ 228], 50.00th=[ 257], 60.00th=[ 372], | 70.00th=[ 426], 80.00th=[ 443], 90.00th=[ 502], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1892, max= 4079, per=42.48%, avg=2999.33, stdev=1122.29, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 2=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=15.08%, ctx=139, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179000: Tue May 12 17:49:59 2026 read: IOPS=1, BW=1981KiB/s (2029kB/s)(6144KiB/3101msec) clat (usec): min=1860, max=386495, avg=101009.74, stdev=161223.47 lat (usec): min=1861, max=386497, avg=101010.99, stdev=161223.38 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 1860], 10.00th=[ 1860], 20.00th=[ 2737], | 30.00th=[ 2737], 40.00th=[ 4817], 50.00th=[ 4817], 60.00th=[ 5866], | 70.00th=[204473], 80.00th=[204473], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 1996, max= 5885, per=78.14%, avg=3940.50, stdev=2749.94, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1981KiB/s (2029kB/s)(6144KiB/3101msec); 0 zone resets clat (msec): min=153, max=1037, avg=404.25, stdev=331.53 lat (msec): min=153, max=1038, avg=404.36, stdev=331.54 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 292], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1726, max= 3923, per=36.32%, avg=2564.00, stdev=1187.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 4=8.33%, 10=16.67%, 250=25.00%, 500=33.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=14.26%, ctx=98, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179001: Tue May 12 17:49:59 2026 read: IOPS=1, BW=1261KiB/s (1291kB/s)(5120KiB/4061msec) clat (usec): min=936, max=726534, avg=233164.33, stdev=333785.60 lat (usec): min=937, max=726535, avg=233165.41, stdev=333785.90 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 938], 10.00th=[ 938], 20.00th=[ 938], | 30.00th=[ 955], 40.00th=[ 955], 50.00th=[ 1942], 60.00th=[ 1942], | 70.00th=[434111], 80.00th=[434111], 90.00th=[725615], 95.00th=[725615], | 99.00th=[725615], 99.50th=[725615], 99.90th=[725615], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1765KiB/s (1807kB/s)(7168KiB/4061msec); 0 zone resets clat (msec): min=108, max=636, avg=410.32, stdev=188.56 lat (msec): min=109, max=636, avg=410.62, stdev=188.64 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 224], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 472], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 550], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1831, max= 4079, per=38.77%, avg=2737.40, stdev=1097.81, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 1000=16.67% lat (msec) : 2=8.33%, 250=16.67%, 500=25.00%, 750=33.33% cpu : usr=0.00%, sys=10.99%, ctx=89, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5043KiB/s (5164kB/s), 528KiB/s-2679KiB/s (541kB/s-2743kB/s), io=20.0MiB (20.0MB), run=2676-4061msec WRITE: bw=7060KiB/s (7230kB/s), 1765KiB/s-2639KiB/s (1807kB/s-2703kB/s), io=28.0MiB (29.4MB), run=2676-4061msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179003: Tue May 12 17:50:00 2026 read: IOPS=1, BW=1703KiB/s (1744kB/s)(7168KiB/4209msec) clat (msec): min=114, max=802, avg=358.53, stdev=286.28 lat (msec): min=114, max=802, avg=358.53, stdev=286.28 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 142], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 157], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 659], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1950, max= 4000, per=54.28%, avg=2388.40, stdev=901.57, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1216KiB/s (1246kB/s)(5120KiB/4209msec); 0 zone resets clat (msec): min=183, max=574, avg=326.76, stdev=188.87 lat (msec): min=183, max=574, avg=326.88, stdev=188.89 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2039, max= 4071, per=54.42%, avg=3352.00, stdev=1138.81, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.44%, ctx=111, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179004: Tue May 12 17:50:00 2026 read: IOPS=0, BW=464KiB/s (475kB/s)(2048KiB/4412msec) clat (msec): min=234, max=674, avg=454.39, stdev=311.02 lat (msec): min=234, max=674, avg=454.40, stdev=311.02 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1950, max= 1973, per=44.58%, avg=1961.50, stdev=16.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2321KiB/s (2377kB/s)(10.0MiB/4412msec); 0 zone resets clat (msec): min=155, max=930, avg=338.30, stdev=283.81 lat (msec): min=155, max=931, avg=338.55, stdev=284.05 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 159], | 30.00th=[ 167], 40.00th=[ 176], 50.00th=[ 192], 60.00th=[ 205], | 70.00th=[ 300], 80.00th=[ 305], 90.00th=[ 802], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1957, max= 6107, per=52.09%, avg=3208.80, stdev=1841.47, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.05%, sys=3.76%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179005: Tue May 12 17:50:00 2026 read: IOPS=1, BW=1375KiB/s (1408kB/s)(6144KiB/4469msec) clat (msec): min=116, max=362, avg=174.75, stdev=93.56 lat (msec): min=116, max=362, avg=174.75, stdev=93.56 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 148], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1939, max= 4087, per=57.32%, avg=2522.00, stdev=1044.24, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1375KiB/s (1408kB/s)(6144KiB/4469msec); 0 zone resets clat (msec): min=191, max=898, avg=565.29, stdev=298.35 lat (msec): min=191, max=899, avg=565.52, stdev=298.30 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 659], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1928, max= 2043, per=32.58%, avg=2007.20, stdev=46.74, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=58.33%, 500=8.33%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=3.54%, ctx=74, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179006: Tue May 12 17:50:00 2026 read: IOPS=1, BW=1100KiB/s (1127kB/s)(5120KiB/4654msec) clat (msec): min=77, max=423, avg=225.01, stdev=151.83 lat (msec): min=77, max=423, avg=225.01, stdev=151.83 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1973, max= 4071, per=61.30%, avg=2697.33, stdev=1190.22, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1540KiB/s (1577kB/s)(7168KiB/4654msec); 0 zone resets clat (msec): min=109, max=1422, avg=488.38, stdev=495.34 lat (msec): min=110, max=1422, avg=488.51, stdev=495.34 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 121], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 165], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 751], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1950, max= 6144, per=57.41%, avg=3536.50, stdev=2004.57, samples=4 iops : min= 1, max= 6, avg= 2.75, stdev= 2.36, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=6.06%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4401KiB/s (4506kB/s), 464KiB/s-1703KiB/s (475kB/s-1744kB/s), io=20.0MiB (20.0MB), run=4209-4654msec WRITE: bw=6161KiB/s (6309kB/s), 1216KiB/s-2321KiB/s (1246kB/s-2377kB/s), io=28.0MiB (29.4MB), run=4209-4654msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179018: Tue May 12 17:50:17 2026 read: IOPS=1, BW=4959KiB/s (5078kB/s)(12.0MiB/2478msec) clat (msec): min=529, max=1077, avg=788.91, stdev=275.22 lat (msec): min=529, max=1077, avg=788.91, stdev=275.22 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.92%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179019: Tue May 12 17:50:17 2026 read: IOPS=0, BW=1358KiB/s (1391kB/s)(4096KiB/3016msec) clat (nsec): min=1610.7M, max=1610.7M, avg=1610716687.00, stdev= 0.00 lat (nsec): min=1610.7M, max=1610.7M, avg=1610719669.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1620], 5.00th=[ 1620], 10.00th=[ 1620], 20.00th=[ 1620], | 30.00th=[ 1620], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2716KiB/s (2781kB/s)(8192KiB/3016msec); 0 zone resets clat (msec): min=393, max=985, avg=689.49, stdev=418.63 lat (msec): min=393, max=985, avg=689.81, stdev=418.78 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.15%, ctx=45, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179020: Tue May 12 17:50:17 2026 write: IOPS=0, BW=3662KiB/s (3749kB/s)(12.0MiB/3356msec); 0 zone resets clat (msec): min=335, max=2112, avg=1117.76, stdev=907.25 lat (msec): min=335, max=2112, avg=1118.26, stdev=907.25 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 7922, max= 8000, per=81.53%, avg=7961.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.27%, ctx=25, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179021: Tue May 12 17:50:17 2026 write: IOPS=1, BW=4504KiB/s (4613kB/s)(12.0MiB/2728msec); 0 zone resets clat (msec): min=520, max=1300, avg=883.56, stdev=392.77 lat (msec): min=520, max=1302, avg=884.46, stdev=393.60 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7922, max= 8143, per=82.27%, avg=8032.50, stdev=156.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.75%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5432KiB/s (5563kB/s), 1358KiB/s-4959KiB/s (1391kB/s-5078kB/s), io=16.0MiB (16.8MB), run=2478-3016msec WRITE: bw=9764KiB/s (9998kB/s), 2716KiB/s-4504KiB/s (2781kB/s-4613kB/s), io=32.0MiB (33.6MB), run=2728-3356msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179013: Tue May 12 17:50:17 2026 read: IOPS=0, BW=3765KiB/s (3855kB/s)(12.0MiB/3264msec) clat (msec): min=891, max=1466, avg=1087.44, stdev=327.93 lat (msec): min=891, max=1466, avg=1087.44, stdev=327.93 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.61%, ctx=255, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179014: Tue May 12 17:50:17 2026 read: IOPS=0, BW=887KiB/s (908kB/s)(4096KiB/4620msec) clat (nsec): min=1604.7M, max=1604.7M, avg=1604706546.00, stdev= 0.00 lat (nsec): min=1604.7M, max=1604.7M, avg=1604709081.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1603], 5.00th=[ 1603], 10.00th=[ 1603], 20.00th=[ 1603], | 30.00th=[ 1603], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1773KiB/s (1816kB/s)(8192KiB/4620msec); 0 zone resets clat (msec): min=326, max=2681, avg=1504.04, stdev=1664.70 lat (msec): min=327, max=2685, avg=1506.10, stdev=1667.29 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 2668], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.88%, ctx=138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179015: Tue May 12 17:50:17 2026 write: IOPS=1, BW=5948KiB/s (6090kB/s)(12.0MiB/2066msec); 0 zone resets clat (msec): min=315, max=1093, avg=640.20, stdev=404.35 lat (msec): min=316, max=1098, avg=643.61, stdev=406.37 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 6086, max= 8175, per=100.00%, avg=7130.50, stdev=1477.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.38%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179016: Tue May 12 17:50:17 2026 write: IOPS=0, BW=3528KiB/s (3613kB/s)(12.0MiB/3483msec); 0 zone resets clat (msec): min=455, max=1923, avg=1157.61, stdev=736.06 lat (msec): min=459, max=1925, avg=1159.80, stdev=735.07 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 5944, max= 8126, per=99.20%, avg=7035.00, stdev=1542.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.21%, ctx=48, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3546KiB/s (3631kB/s), 887KiB/s-3765KiB/s (908kB/s-3855kB/s), io=16.0MiB (16.8MB), run=3264-4620msec WRITE: bw=7093KiB/s (7263kB/s), 1773KiB/s-5948KiB/s (1816kB/s-6090kB/s), io=32.0MiB (33.6MB), run=2066-4620msec