== sanity test 398b: DIO and buffer IO race ============== 08:02:05 (1775131325) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.36785 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181904: Thu Apr 2 08:04:17 2026 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(5992KiB/110824msec) clat (usec): min=33, max=1038.0k, avg=41702.45, stdev=36755.80 lat (usec): min=33, max=1038.0k, avg=41706.20, stdev=36756.87 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10552], 10.00th=[ 16319], | 20.00th=[ 21627], 30.00th=[ 26084], 40.00th=[ 30802], | 50.00th=[ 35914], 60.00th=[ 42206], 70.00th=[ 49021], | 80.00th=[ 57410], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[ 139461], 99.50th=[ 166724], 99.90th=[ 204473], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 8, max= 109, per=25.05%, avg=53.86, stdev=18.16, samples=218 iops : min= 2, max= 27, avg=12.81, stdev= 4.58, samples=218 write: IOPS=14, BW=56.8KiB/s (58.2kB/s)(6296KiB/110824msec); 0 zone resets clat (usec): min=736, max=185671, avg=30375.46, stdev=30481.81 lat (usec): min=736, max=185672, avg=30379.46, stdev=30479.81 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 1450], 20.00th=[ 3425], | 30.00th=[ 6718], 40.00th=[ 15008], 50.00th=[ 23200], 60.00th=[ 30540], | 70.00th=[ 39584], 80.00th=[ 52167], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[137364], 99.50th=[154141], 99.90th=[183501], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 7, max= 125, per=25.25%, avg=56.81, stdev=23.59, samples=217 iops : min= 1, max= 31, avg=13.55, stdev= 5.96, samples=217 lat (usec) : 50=0.23%, 100=1.73%, 750=0.07%, 1000=0.16% lat (msec) : 2=7.06%, 4=4.17%, 10=6.58%, 20=11.75%, 50=43.52% lat (msec) : 100=21.35%, 250=3.35%, 2000=0.03% cpu : usr=0.10%, sys=5.44%, ctx=6440, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181905: Thu Apr 2 08:04:17 2026 read: IOPS=13, BW=53.2KiB/s (54.5kB/s)(5940KiB/111617msec) clat (usec): min=50, max=252271, avg=41401.32, stdev=27382.09 lat (usec): min=51, max=252273, avg=41402.79, stdev=27382.13 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 10290], 10.00th=[ 15795], 20.00th=[ 21627], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 57410], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[135267], 99.50th=[191890], 99.90th=[227541], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 6, max= 110, per=24.56%, avg=52.81, stdev=19.39, samples=219 iops : min= 1, max= 27, avg=12.55, stdev= 4.92, samples=219 write: IOPS=14, BW=56.9KiB/s (58.2kB/s)(6348KiB/111617msec); 0 zone resets clat (usec): min=922, max=906104, avg=31257.70, stdev=38065.77 lat (usec): min=924, max=906106, avg=31264.47, stdev=38063.39 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 1745], 20.00th=[ 4015], | 30.00th=[ 7832], 40.00th=[ 15401], 50.00th=[ 21890], 60.00th=[ 29754], | 70.00th=[ 39584], 80.00th=[ 53216], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[139461], 99.50th=[160433], 99.90th=[223347], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 6, max= 157, per=25.08%, avg=56.42, stdev=23.69, samples=219 iops : min= 1, max= 39, avg=13.46, stdev= 5.97, samples=219 lat (usec) : 100=1.66%, 250=0.03%, 1000=0.10% lat (msec) : 2=5.70%, 4=4.69%, 10=7.58%, 20=12.57%, 50=42.51% lat (msec) : 100=21.61%, 250=3.48%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=5.44%, ctx=6591, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181906: Thu Apr 2 08:04:17 2026 read: IOPS=13, BW=54.7KiB/s (56.0kB/s)(6028KiB/110136msec) clat (usec): min=29, max=205338, avg=40362.79, stdev=26355.19 lat (usec): min=29, max=205340, avg=40365.65, stdev=26353.97 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10421], 10.00th=[ 15008], 20.00th=[ 21103], | 30.00th=[ 25297], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[139461], 99.50th=[162530], 99.90th=[196084], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 7, max= 103, per=25.35%, avg=54.50, stdev=18.14, samples=216 iops : min= 1, max= 25, avg=12.97, stdev= 4.58, samples=216 write: IOPS=14, BW=56.8KiB/s (58.2kB/s)(6260KiB/110136msec); 0 zone resets clat (usec): min=958, max=1019.9k, avg=31169.59, stdev=39717.46 lat (usec): min=959, max=1019.9k, avg=31172.32, stdev=39717.48 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1565], | 20.00th=[ 3425], 30.00th=[ 6915], 40.00th=[ 14746], | 50.00th=[ 22414], 60.00th=[ 29754], 70.00th=[ 40109], | 80.00th=[ 53740], 90.00th=[ 72877], 95.00th=[ 92799], | 99.00th=[ 137364], 99.50th=[ 156238], 99.90th=[ 200279], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 167, per=25.16%, avg=56.62, stdev=24.79, samples=216 iops : min= 1, max= 41, avg=13.50, stdev= 6.26, samples=216 lat (usec) : 50=0.23%, 100=1.50%, 250=0.16%, 500=0.07%, 1000=0.10% lat (msec) : 2=6.58%, 4=4.59%, 10=7.19%, 20=11.95%, 50=43.39% lat (msec) : 100=20.96%, 250=3.26%, 2000=0.03% cpu : usr=0.09%, sys=5.53%, ctx=6619, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181907: Thu Apr 2 08:04:17 2026 read: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6052KiB/111633msec) clat (usec): min=35, max=237090, avg=40895.80, stdev=25820.91 lat (usec): min=35, max=237091, avg=40902.45, stdev=25822.35 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11731], 10.00th=[ 16450], 20.00th=[ 21627], | 30.00th=[ 26346], 40.00th=[ 31065], 50.00th=[ 36439], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[129500], 99.50th=[154141], 99.90th=[225444], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 119, per=25.32%, avg=54.45, stdev=19.48, samples=217 iops : min= 1, max= 29, avg=12.96, stdev= 4.90, samples=217 write: IOPS=13, BW=55.9KiB/s (57.2kB/s)(6236KiB/111633msec); 0 zone resets clat (usec): min=1016, max=957356, avg=31563.93, stdev=38880.38 lat (usec): min=1018, max=957359, avg=31567.80, stdev=38878.91 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1483], 20.00th=[ 3621], | 30.00th=[ 6783], 40.00th=[ 14484], 50.00th=[ 23200], 60.00th=[ 31065], | 70.00th=[ 40633], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[135267], 99.50th=[154141], 99.90th=[179307], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 15, max= 135, per=24.88%, avg=55.99, stdev=20.75, samples=217 iops : min= 3, max= 33, avg=13.35, stdev= 5.24, samples=217 lat (usec) : 50=0.33%, 100=1.37%, 250=0.07%, 500=0.03%, 750=0.07% lat (msec) : 2=6.45%, 4=4.39%, 10=7.36%, 20=11.33%, 50=43.42% lat (msec) : 100=21.91%, 250=3.26%, 1000=0.03% cpu : usr=0.09%, sys=5.69%, ctx=6644, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=215KiB/s (220kB/s), 53.2KiB/s-54.7KiB/s (54.5kB/s-56.0kB/s), io=23.4MiB (24.6MB), run=110136-111633msec WRITE: bw=225KiB/s (231kB/s), 55.9KiB/s-56.9KiB/s (57.2kB/s-58.2kB/s), io=24.6MiB (25.7MB), run=110136-111633msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181909: Thu Apr 2 08:04:57 2026 read: IOPS=9, BW=39.0KiB/s (40.9kB/s)(5992KiB/149843msec) clat (msec): min=5, max=1016, avg=38.77, stdev=41.98 lat (msec): min=5, max=1016, avg=38.77, stdev=41.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 110], | 99.00th=[ 169], 99.50th=[ 199], 99.90th=[ 257], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 135, per=25.53%, avg=40.08, stdev=25.81, samples=291 iops : min= 1, max= 33, avg= 9.37, stdev= 6.50, samples=291 write: IOPS=10, BW=42.0KiB/s (43.0kB/s)(6296KiB/149843msec); 0 zone resets clat (msec): min=8, max=273, avg=58.05, stdev=37.85 lat (msec): min=8, max=273, avg=58.05, stdev=37.85 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 70], 80.00th=[ 83], 90.00th=[ 109], 95.00th=[ 131], | 99.00th=[ 190], 99.50th=[ 218], 99.90th=[ 271], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 134, per=25.28%, avg=41.71, stdev=24.99, samples=294 iops : min= 1, max= 33, avg= 9.78, stdev= 6.28, samples=294 lat (msec) : 10=2.60%, 20=17.35%, 50=45.21%, 100=25.00%, 250=9.64% lat (msec) : 500=0.16%, 2000=0.03% cpu : usr=0.06%, sys=2.19%, ctx=4907, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181910: Thu Apr 2 08:04:57 2026 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(5940KiB/151260msec) clat (msec): min=4, max=936, avg=39.11, stdev=40.64 lat (msec): min=4, max=936, avg=39.11, stdev=40.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 83], 95.00th=[ 109], | 99.00th=[ 171], 99.50th=[ 188], 99.90th=[ 255], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 151, per=25.33%, avg=39.77, stdev=26.87, samples=291 iops : min= 1, max= 37, avg= 9.30, stdev= 6.75, samples=291 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6348KiB/151260msec); 0 zone resets clat (msec): min=8, max=273, avg=58.49, stdev=39.33 lat (msec): min=8, max=273, avg=58.49, stdev=39.33 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 86], 90.00th=[ 110], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 232], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 135, per=25.25%, avg=41.67, stdev=24.77, samples=297 iops : min= 1, max= 33, avg= 9.77, stdev= 6.22, samples=297 lat (msec) : 10=3.06%, 20=16.93%, 50=45.44%, 100=24.87%, 250=9.57% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=2.18%, ctx=5019, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181911: Thu Apr 2 08:04:57 2026 read: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6028KiB/152031msec) clat (msec): min=5, max=278, avg=39.06, stdev=34.21 lat (msec): min=5, max=278, avg=39.06, stdev=34.21 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 83], 95.00th=[ 114], | 99.00th=[ 167], 99.50th=[ 192], 99.90th=[ 247], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 159, per=25.02%, avg=39.28, stdev=25.39, samples=298 iops : min= 1, max= 39, avg= 9.17, stdev= 6.37, samples=298 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6260KiB/152031msec); 0 zone resets clat (msec): min=9, max=942, avg=59.30, stdev=46.13 lat (msec): min=9, max=942, avg=59.30, stdev=46.13 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 117], 95.00th=[ 138], | 99.00th=[ 209], 99.50th=[ 230], 99.90th=[ 326], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 158, per=24.71%, avg=40.78, stdev=25.00, samples=298 iops : min= 1, max= 39, avg= 9.54, stdev= 6.29, samples=298 lat (msec) : 10=2.31%, 20=17.06%, 50=46.52%, 100=23.76%, 250=10.16% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=2.14%, ctx=4909, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181912: Thu Apr 2 08:04:57 2026 read: IOPS=10, BW=40.0KiB/s (41.0kB/s)(6052KiB/151116msec) clat (msec): min=5, max=298, avg=39.51, stdev=34.06 lat (msec): min=5, max=298, avg=39.52, stdev=34.06 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 83], 95.00th=[ 109], | 99.00th=[ 167], 99.50th=[ 192], 99.90th=[ 271], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 150, per=26.04%, avg=40.88, stdev=25.27, samples=289 iops : min= 1, max= 37, avg= 9.57, stdev= 6.35, samples=289 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6236KiB/151116msec); 0 zone resets clat (msec): min=10, max=957, avg=58.38, stdev=44.55 lat (msec): min=10, max=957, avg=58.38, stdev=44.55 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 85], 90.00th=[ 110], 95.00th=[ 136], | 99.00th=[ 199], 99.50th=[ 241], 99.90th=[ 284], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 127, per=24.99%, avg=41.24, stdev=24.34, samples=295 iops : min= 1, max= 31, avg= 9.66, stdev= 6.12, samples=295 lat (msec) : 10=2.15%, 20=16.63%, 50=46.39%, 100=25.49%, 250=9.11% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=2.16%, ctx=4979, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (162kB/s), 39.3KiB/s-40.0KiB/s (40.2kB/s-41.0kB/s), io=23.4MiB (24.6MB), run=149843-152031msec WRITE: bw=165KiB/s (169kB/s), 41.2KiB/s-42.0KiB/s (42.2kB/s-43.0kB/s), io=24.6MiB (25.7MB), run=149843-152031msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181955: Thu Apr 2 08:05:49 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(5920KiB/39376msec) clat (usec): min=38, max=309909, avg=55496.73, stdev=38402.26 lat (usec): min=38, max=309911, avg=55573.47, stdev=38453.91 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 19792], 20.00th=[ 28705], | 30.00th=[ 37487], 40.00th=[ 42206], 50.00th=[ 49021], 60.00th=[ 55837], | 70.00th=[ 64750], 80.00th=[ 78119], 90.00th=[100140], 95.00th=[124257], | 99.00th=[187696], 99.50th=[291505], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 30, max= 313, per=25.79%, avg=149.83, stdev=62.27, samples=77 iops : min= 1, max= 19, avg= 8.60, stdev= 3.95, samples=77 write: IOPS=10, BW=162KiB/s (166kB/s)(6368KiB/39376msec); 0 zone resets clat (usec): min=1574, max=207701, avg=46047.67, stdev=41996.32 lat (usec): min=1575, max=207703, avg=46050.84, stdev=41996.45 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2073], 10.00th=[ 3752], 20.00th=[ 7898], | 30.00th=[ 16188], 40.00th=[ 25822], 50.00th=[ 35914], 60.00th=[ 44827], | 70.00th=[ 55837], 80.00th=[ 83362], 90.00th=[107480], 95.00th=[127402], | 99.00th=[196084], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 22, max= 377, per=26.93%, avg=164.51, stdev=70.12, samples=76 iops : min= 1, max= 23, avg= 9.53, stdev= 4.49, samples=76 lat (usec) : 50=0.26%, 100=3.52% lat (msec) : 2=2.08%, 4=3.26%, 10=6.51%, 20=6.38%, 50=37.24% lat (msec) : 100=29.30%, 250=11.20%, 500=0.26% cpu : usr=0.07%, sys=4.86%, ctx=1760, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181956: Thu Apr 2 08:05:49 2026 read: IOPS=8, BW=139KiB/s (143kB/s)(5744KiB/41194msec) clat (usec): min=51, max=248935, avg=59288.20, stdev=36300.35 lat (usec): min=52, max=248937, avg=59289.72, stdev=36300.40 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 570], 10.00th=[ 23462], 20.00th=[ 33817], | 30.00th=[ 40109], 40.00th=[ 46400], 50.00th=[ 52691], 60.00th=[ 60556], | 70.00th=[ 69731], 80.00th=[ 81265], 90.00th=[105382], 95.00th=[137364], | 99.00th=[173016], 99.50th=[221250], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 21, max= 344, per=24.14%, avg=140.25, stdev=59.70, samples=79 iops : min= 1, max= 21, avg= 8.00, stdev= 3.80, samples=79 write: IOPS=9, BW=159KiB/s (163kB/s)(6544KiB/41194msec); 0 zone resets clat (usec): min=1486, max=246827, avg=47316.95, stdev=45805.30 lat (usec): min=1489, max=246828, avg=47321.46, stdev=45804.75 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1991], 10.00th=[ 3720], 20.00th=[ 8979], | 30.00th=[ 14484], 40.00th=[ 24511], 50.00th=[ 33424], 60.00th=[ 45876], | 70.00th=[ 58459], 80.00th=[ 82314], 90.00th=[109577], 95.00th=[131597], | 99.00th=[206570], 99.50th=[233833], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 21, max= 444, per=25.71%, avg=157.08, stdev=84.75, samples=80 iops : min= 1, max= 27, avg= 9.06, stdev= 5.34, samples=80 lat (usec) : 100=2.21%, 750=0.26% lat (msec) : 2=2.73%, 4=2.73%, 10=6.12%, 20=8.33%, 50=32.55% lat (msec) : 100=33.33%, 250=11.72% cpu : usr=0.04%, sys=4.70%, ctx=1765, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181957: Thu Apr 2 08:05:49 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(6256KiB/40084msec) clat (usec): min=50, max=367594, avg=57474.53, stdev=40501.55 lat (usec): min=51, max=367595, avg=57479.15, stdev=40500.64 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 21103], 20.00th=[ 28181], | 30.00th=[ 36439], 40.00th=[ 44303], 50.00th=[ 52167], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 80217], 90.00th=[103285], 95.00th=[125305], | 99.00th=[179307], 99.50th=[329253], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 31, max= 351, per=26.99%, avg=156.83, stdev=71.09, samples=78 iops : min= 1, max= 21, avg= 9.04, stdev= 4.46, samples=78 write: IOPS=9, BW=150KiB/s (154kB/s)(6032KiB/40084msec); 0 zone resets clat (usec): min=1604, max=292373, avg=46518.62, stdev=45735.44 lat (usec): min=1606, max=292376, avg=46523.00, stdev=45736.83 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2278], 10.00th=[ 4178], 20.00th=[ 8029], | 30.00th=[ 13829], 40.00th=[ 25035], 50.00th=[ 33424], 60.00th=[ 45876], | 70.00th=[ 60031], 80.00th=[ 74974], 90.00th=[109577], 95.00th=[135267], | 99.00th=[217056], 99.50th=[267387], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 285, per=24.65%, avg=150.64, stdev=61.63, samples=77 iops : min= 1, max= 17, avg= 8.64, stdev= 3.89, samples=77 lat (usec) : 100=3.39%, 250=0.13% lat (msec) : 2=1.95%, 4=2.73%, 10=7.29%, 20=7.29%, 50=32.42% lat (msec) : 100=33.46%, 250=10.81%, 500=0.52% cpu : usr=0.08%, sys=4.50%, ctx=1676, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181958: Thu Apr 2 08:05:49 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39132msec) clat (usec): min=46, max=261553, avg=59797.29, stdev=39917.17 lat (usec): min=48, max=261555, avg=59798.87, stdev=39917.20 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 76], 10.00th=[ 22414], 20.00th=[ 31851], | 30.00th=[ 40109], 40.00th=[ 46924], 50.00th=[ 53740], 60.00th=[ 60556], | 70.00th=[ 69731], 80.00th=[ 80217], 90.00th=[ 99091], 95.00th=[132645], | 99.00th=[212861], 99.50th=[242222], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 30, max= 346, per=26.25%, avg=152.53, stdev=64.07, samples=76 iops : min= 1, max= 21, avg= 8.76, stdev= 4.07, samples=76 write: IOPS=9, BW=160KiB/s (164kB/s)(6256KiB/39132msec); 0 zone resets clat (usec): min=1556, max=232530, avg=41605.95, stdev=41351.15 lat (usec): min=1557, max=232533, avg=41608.90, stdev=41351.08 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1909], 10.00th=[ 2835], 20.00th=[ 7242], | 30.00th=[ 11731], 40.00th=[ 20055], 50.00th=[ 29492], 60.00th=[ 39584], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[103285], 95.00th=[128451], | 99.00th=[193987], 99.50th=[200279], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 377, per=26.00%, avg=158.88, stdev=68.08, samples=76 iops : min= 1, max= 23, avg= 9.17, stdev= 4.31, samples=76 lat (usec) : 50=0.26%, 100=2.73%, 250=0.26%, 750=0.13% lat (msec) : 2=3.12%, 4=4.04%, 10=5.47%, 20=8.59%, 50=32.42% lat (msec) : 100=32.68%, 250=10.16%, 500=0.13% cpu : usr=0.08%, sys=4.91%, ctx=1706, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=581KiB/s (595kB/s), 139KiB/s-156KiB/s (143kB/s-160kB/s), io=23.4MiB (24.5MB), run=39132-41194msec WRITE: bw=612KiB/s (626kB/s), 150KiB/s-162KiB/s (154kB/s-166kB/s), io=24.6MiB (25.8MB), run=39132-41194msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181951: Thu Apr 2 08:06:01 2026 read: IOPS=6, BW=112KiB/s (114kB/s)(5920KiB/53073msec) clat (msec): min=8, max=234, avg=55.82, stdev=44.85 lat (msec): min=8, max=234, avg=55.82, stdev=44.85 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 85], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 226], 99.50th=[ 228], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 318, per=25.86%, avg=116.12, stdev=71.88, samples=99 iops : min= 1, max= 19, avg= 6.42, stdev= 4.55, samples=99 write: IOPS=7, BW=120KiB/s (123kB/s)(6368KiB/53073msec); 0 zone resets clat (msec): min=18, max=341, avg=81.07, stdev=56.98 lat (msec): min=18, max=341, avg=81.09, stdev=56.98 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 63], 60.00th=[ 73], | 70.00th=[ 92], 80.00th=[ 113], 90.00th=[ 165], 95.00th=[ 205], | 99.00th=[ 292], 99.50th=[ 330], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 22, max= 380, per=25.33%, avg=119.54, stdev=68.91, samples=104 iops : min= 1, max= 23, avg= 6.64, stdev= 4.34, samples=104 lat (msec) : 10=0.78%, 20=6.64%, 50=40.49%, 100=31.51%, 250=19.53% lat (msec) : 500=1.04% cpu : usr=0.03%, sys=1.74%, ctx=1249, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181952: Thu Apr 2 08:06:01 2026 read: IOPS=6, BW=108KiB/s (110kB/s)(5744KiB/53328msec) clat (msec): min=6, max=296, avg=56.15, stdev=46.45 lat (msec): min=6, max=296, avg=56.16, stdev=46.45 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 89], 90.00th=[ 123], 95.00th=[ 159], | 99.00th=[ 207], 99.50th=[ 275], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 22, max= 443, per=25.45%, avg=114.26, stdev=79.12, samples=97 iops : min= 1, max= 27, avg= 6.30, stdev= 5.00, samples=97 write: IOPS=7, BW=123KiB/s (126kB/s)(6544KiB/53328msec); 0 zone resets clat (msec): min=14, max=332, avg=80.17, stdev=57.84 lat (msec): min=14, max=332, avg=80.18, stdev=57.83 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 90], 80.00th=[ 116], 90.00th=[ 148], 95.00th=[ 215], | 99.00th=[ 284], 99.50th=[ 296], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 22, max= 351, per=25.97%, avg=122.58, stdev=71.93, samples=102 iops : min= 1, max= 21, avg= 6.83, stdev= 4.53, samples=102 lat (msec) : 10=0.78%, 20=7.55%, 50=40.36%, 100=30.60%, 250=18.88% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.79%, ctx=1282, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181953: Thu Apr 2 08:06:01 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/53042msec) clat (msec): min=8, max=284, avg=56.64, stdev=43.30 lat (msec): min=8, max=284, avg=56.64, stdev=43.30 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 81], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 211], 99.50th=[ 253], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 352, per=27.66%, avg=124.19, stdev=81.99, samples=99 iops : min= 1, max= 22, avg= 6.92, stdev= 5.19, samples=99 write: IOPS=7, BW=114KiB/s (116kB/s)(6032KiB/53042msec); 0 zone resets clat (msec): min=13, max=307, avg=80.84, stdev=56.44 lat (msec): min=13, max=307, avg=80.85, stdev=56.43 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 39], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 93], 80.00th=[ 120], 90.00th=[ 161], 95.00th=[ 192], | 99.00th=[ 271], 99.50th=[ 292], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 411, per=24.13%, avg=113.91, stdev=68.21, samples=103 iops : min= 1, max= 25, avg= 6.28, stdev= 4.33, samples=103 lat (msec) : 10=0.13%, 20=6.90%, 50=40.62%, 100=31.77%, 250=19.27% lat (msec) : 500=1.30% cpu : usr=0.06%, sys=1.85%, ctx=1334, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181954: Thu Apr 2 08:06:01 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(6032KiB/53199msec) clat (msec): min=6, max=274, avg=56.79, stdev=46.91 lat (msec): min=6, max=274, avg=56.80, stdev=46.91 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 82], 90.00th=[ 126], 95.00th=[ 169], | 99.00th=[ 220], 99.50th=[ 247], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 380, per=26.69%, avg=119.86, stdev=74.59, samples=97 iops : min= 1, max= 23, avg= 6.65, stdev= 4.68, samples=97 write: IOPS=7, BW=118KiB/s (120kB/s)(6256KiB/53199msec); 0 zone resets clat (msec): min=14, max=343, avg=79.74, stdev=55.81 lat (msec): min=14, max=343, avg=79.74, stdev=55.81 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 75], | 70.00th=[ 96], 80.00th=[ 115], 90.00th=[ 146], 95.00th=[ 184], | 99.00th=[ 296], 99.50th=[ 313], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 23, max= 320, per=24.88%, avg=117.42, stdev=70.28, samples=103 iops : min= 1, max= 20, avg= 6.50, stdev= 4.48, samples=103 lat (msec) : 10=0.39%, 20=7.29%, 50=41.93%, 100=28.78%, 250=20.05% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.79%, ctx=1275, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=449KiB/s (460kB/s), 108KiB/s-118KiB/s (110kB/s-121kB/s), io=23.4MiB (24.5MB), run=53042-53328msec WRITE: bw=473KiB/s (484kB/s), 114KiB/s-123KiB/s (116kB/s-126kB/s), io=24.6MiB (25.8MB), run=53042-53328msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181974: Thu Apr 2 08:06:21 2026 read: IOPS=1, BW=1191KiB/s (1219kB/s)(7168KiB/6019msec) clat (msec): min=96, max=336, avg=168.11, stdev=84.74 lat (msec): min=96, max=336, avg=168.11, stdev=84.74 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 102], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 215], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2043, max= 5128, per=100.00%, avg=3721.00, stdev=1560.25, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=0, BW=851KiB/s (871kB/s)(5120KiB/6019msec); 0 zone resets clat (msec): min=120, max=3711, avg=930.93, stdev=1556.06 lat (msec): min=120, max=3711, avg=931.73, stdev=1555.73 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1996, max= 4055, per=85.98%, avg=2698.00, stdev=1175.43, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=2.36%, ctx=65, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181975: Thu Apr 2 08:06:21 2026 read: IOPS=0, BW=225KiB/s (230kB/s)(2048KiB/9106msec) clat (msec): min=161, max=451, avg=306.31, stdev=205.46 lat (msec): min=161, max=451, avg=306.31, stdev=205.46 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1735, max= 2003, per=83.40%, avg=1869.00, stdev=189.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1125KiB/s (1152kB/s)(10.0MiB/9106msec); 0 zone resets clat (msec): min=91, max=4361, avg=843.27, stdev=1422.49 lat (msec): min=96, max=4361, avg=844.82, stdev=1421.85 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 133], | 30.00th=[ 144], 40.00th=[ 159], 50.00th=[ 213], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 334], 90.00th=[ 2433], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 2003, max= 4087, per=99.40%, avg=3119.20, stdev=1027.90, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, >=2000=16.67% cpu : usr=0.02%, sys=2.35%, ctx=81, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181976: Thu Apr 2 08:06:21 2026 read: IOPS=0, BW=693KiB/s (710kB/s)(6144KiB/8866msec) clat (msec): min=72, max=347, avg=155.55, stdev=102.46 lat (msec): min=72, max=347, avg=155.55, stdev=102.46 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 122], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1996, max= 4055, per=100.00%, avg=2529.25, stdev=1017.33, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=693KiB/s (710kB/s)(6144KiB/8866msec); 0 zone resets clat (msec): min=109, max=3400, avg=1297.58, stdev=1624.86 lat (msec): min=111, max=3401, avg=1297.95, stdev=1624.62 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 405], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1996, max= 3657, per=77.27%, avg=2424.75, stdev=821.70, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, >=2000=16.67% cpu : usr=0.00%, sys=1.43%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181977: Thu Apr 2 08:06:21 2026 read: IOPS=0, BW=560KiB/s (574kB/s)(5120KiB/9135msec) clat (msec): min=68, max=248, avg=156.53, stdev=74.22 lat (msec): min=68, max=248, avg=156.53, stdev=74.22 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 99], 40.00th=[ 99], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 4055, max= 4087, per=100.00%, avg=4071.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=785KiB/s (804kB/s)(7168KiB/9135msec); 0 zone resets clat (msec): min=126, max=3734, avg=1171.97, stdev=1516.48 lat (msec): min=126, max=3734, avg=1172.09, stdev=1516.47 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 184], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 288], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 2970], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 1744, max= 3992, per=77.93%, avg=2445.50, stdev=1039.44, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.24%, ctx=64, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2242KiB/s (2296kB/s), 225KiB/s-1191KiB/s (230kB/s-1219kB/s), io=20.0MiB (20.0MB), run=6019-9135msec WRITE: bw=3139KiB/s (3214kB/s), 693KiB/s-1125KiB/s (710kB/s-1152kB/s), io=28.0MiB (29.4MB), run=6019-9135msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181979: Thu Apr 2 08:06:21 2026 read: IOPS=0, BW=909KiB/s (931kB/s)(7168KiB/7884msec) clat (usec): min=420, max=3697.9k, avg=1049687.62, stdev=1654846.44 lat (usec): min=421, max=3697.9k, avg=1049689.38, stdev=1654846.57 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], | 20.00th=[ 1795], 30.00th=[ 2089], 40.00th=[ 2089], | 50.00th=[ 173016], 60.00th=[ 252707], 70.00th=[ 252707], | 80.00th=[3204449], 90.00th=[3707765], 95.00th=[3707765], | 99.00th=[3707765], 99.50th=[3707765], 99.90th=[3707765], | 99.95th=[3707765], 99.99th=[3707765] bw ( KiB/s): min= 1921, max= 6144, per=100.00%, avg=3366.67, stdev=2405.92, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=0, BW=649KiB/s (665kB/s)(5120KiB/7884msec); 0 zone resets clat (msec): min=57, max=149, avg=106.65, stdev=37.81 lat (msec): min=57, max=149, avg=106.78, stdev=37.79 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 103], 60.00th=[ 103], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=16.67%, 250=33.33%, 500=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=5.65%, ctx=761, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181980: Thu Apr 2 08:06:21 2026 read: IOPS=0, BW=243KiB/s (249kB/s)(2048KiB/8421msec) clat (msec): min=164, max=311, avg=238.20, stdev=103.80 lat (msec): min=164, max=311, avg=238.20, stdev=103.80 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1706, max= 2043, per=77.08%, avg=1874.50, stdev=238.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1216KiB/s (1245kB/s)(10.0MiB/8421msec); 0 zone resets clat (msec): min=106, max=3678, avg=794.06, stdev=1198.29 lat (msec): min=106, max=3678, avg=794.17, stdev=1198.29 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 184], 50.00th=[ 190], 60.00th=[ 264], | 70.00th=[ 363], 80.00th=[ 600], 90.00th=[ 2232], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 1885, max= 4087, per=88.90%, avg=3026.00, stdev=1157.38, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, >=2000=16.67% cpu : usr=0.04%, sys=6.16%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181981: Thu Apr 2 08:06:21 2026 read: IOPS=0, BW=747KiB/s (765kB/s)(6144KiB/8227msec) clat (usec): min=519, max=297891, avg=148967.91, stdev=120591.02 lat (usec): min=521, max=297892, avg=148969.21, stdev=120590.87 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 8979], | 30.00th=[ 8979], 40.00th=[170918], 50.00th=[170918], 60.00th=[179307], | 70.00th=[235930], 80.00th=[235930], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 2015, max= 4071, per=100.00%, avg=3369.67, stdev=1173.42, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=747KiB/s (765kB/s)(6144KiB/8227msec); 0 zone resets clat (msec): min=127, max=3620, avg=1221.55, stdev=1564.02 lat (msec): min=127, max=3620, avg=1221.65, stdev=1564.04 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 313], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1885, max= 4031, per=84.37%, avg=2872.00, stdev=1073.97, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=41.67%, 500=25.00%, >=2000=16.67% cpu : usr=0.00%, sys=4.66%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181982: Thu Apr 2 08:06:21 2026 read: IOPS=0, BW=613KiB/s (628kB/s)(5120KiB/8354msec) clat (usec): min=874, max=209312, avg=75652.24, stdev=102631.32 lat (usec): min=876, max=209313, avg=75653.55, stdev=102631.32 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 873], 10.00th=[ 873], 20.00th=[ 873], | 30.00th=[ 1188], 40.00th=[ 1188], 50.00th=[ 2769], 60.00th=[ 2769], | 70.00th=[164627], 80.00th=[164627], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 4023, max= 4071, per=100.00%, avg=4047.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=858KiB/s (879kB/s)(7168KiB/8354msec); 0 zone resets clat (msec): min=124, max=3653, avg=1138.44, stdev=1483.45 lat (msec): min=124, max=3653, avg=1138.54, stdev=1483.43 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 188], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 279], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 2903], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1799, max= 3771, per=70.72%, avg=2407.25, stdev=915.76, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=33.33%, 500=16.67%, 750=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=4.49%, ctx=69, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2432KiB/s (2490kB/s), 243KiB/s-909KiB/s (249kB/s-931kB/s), io=20.0MiB (20.0MB), run=7884-8421msec WRITE: bw=3405KiB/s (3487kB/s), 649KiB/s-1216KiB/s (665kB/s-1245kB/s), io=28.0MiB (29.4MB), run=7884-8421msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181995: Thu Apr 2 08:06:37 2026 read: IOPS=1, BW=4460KiB/s (4567kB/s)(12.0MiB/2755msec) clat (msec): min=820, max=863, avg=844.57, stdev=22.20 lat (msec): min=820, max=863, avg=844.57, stdev=22.20 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.98%, ctx=321, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181996: Thu Apr 2 08:06:37 2026 read: IOPS=0, BW=1511KiB/s (1547kB/s)(4096KiB/2711msec) clat (nsec): min=764492k, max=764492k, avg=764491950.00, stdev= 0.00 lat (nsec): min=764494k, max=764494k, avg=764494296.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3022KiB/s (3094kB/s)(8192KiB/2711msec); 0 zone resets clat (msec): min=888, max=919, avg=904.29, stdev=21.77 lat (msec): min=889, max=932, avg=911.03, stdev=30.75 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8159, max= 8159, per=78.69%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=5.61%, ctx=136, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181997: Thu Apr 2 08:06:37 2026 write: IOPS=0, BW=3889KiB/s (3982kB/s)(12.0MiB/3160msec); 0 zone resets clat (msec): min=218, max=1867, avg=996.42, stdev=828.56 lat (msec): min=220, max=1871, avg=998.54, stdev=829.59 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8094, max= 8159, per=78.37%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.07%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181998: Thu Apr 2 08:06:37 2026 write: IOPS=1, BW=4901KiB/s (5019kB/s)(12.0MiB/2507msec); 0 zone resets clat (msec): min=508, max=1282, avg=789.69, stdev=428.01 lat (msec): min=508, max=1282, avg=790.55, stdev=427.67 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8094, max= 8159, per=78.37%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.31%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5947KiB/s (6090kB/s), 1511KiB/s-4460KiB/s (1547kB/s-4567kB/s), io=16.0MiB (16.8MB), run=2711-2755msec WRITE: bw=10.1MiB/s (10.6MB/s), 3022KiB/s-4901KiB/s (3094kB/s-5019kB/s), io=32.0MiB (33.6MB), run=2507-3160msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181991: Thu Apr 2 08:06:37 2026 read: IOPS=1, BW=7516KiB/s (7696kB/s)(12.0MiB/1635msec) clat (msec): min=281, max=852, avg=503.06, stdev=306.19 lat (msec): min=281, max=852, avg=503.06, stdev=306.19 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 5618, max= 8175, per=100.00%, avg=6896.50, stdev=1808.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.06%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181992: Thu Apr 2 08:06:37 2026 read: IOPS=0, BW=1190KiB/s (1219kB/s)(4096KiB/3441msec) clat (nsec): min=970700k, max=970700k, avg=970699836.00, stdev= 0.00 lat (nsec): min=970703k, max=970703k, avg=970703094.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2381KiB/s (2438kB/s)(8192KiB/3441msec); 0 zone resets clat (msec): min=387, max=1729, avg=1058.35, stdev=949.31 lat (msec): min=389, max=1730, avg=1060.01, stdev=947.86 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 7937, max= 7937, per=83.35%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.86%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181993: Thu Apr 2 08:06:37 2026 write: IOPS=0, BW=3951KiB/s (4046kB/s)(12.0MiB/3110msec); 0 zone resets clat (msec): min=431, max=1777, avg=965.46, stdev=714.76 lat (msec): min=432, max=1778, avg=966.01, stdev=714.98 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8143, max= 8175, per=85.69%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.15%, ctx=61, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181994: Thu Apr 2 08:06:37 2026 write: IOPS=1, BW=5044KiB/s (5165kB/s)(12.0MiB/2436msec); 0 zone resets clat (msec): min=327, max=1174, avg=735.27, stdev=424.46 lat (msec): min=327, max=1174, avg=735.64, stdev=424.52 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 5527, max= 8143, per=71.78%, avg=6835.00, stdev=1849.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.82%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4761KiB/s (4876kB/s), 1190KiB/s-7516KiB/s (1219kB/s-7696kB/s), io=16.0MiB (16.8MB), run=1635-3441msec WRITE: bw=9523KiB/s (9751kB/s), 2381KiB/s-5044KiB/s (2438kB/s-5165kB/s), io=32.0MiB (33.6MB), run=2436-3441msec