== sanity test 398b: DIO and buffer IO race ============== 05:47:38 (1779875258) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.96427 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=185256: Wed May 27 05:49:49 2026 read: IOPS=13, BW=54.3KiB/s (55.6kB/s)(5992KiB/110440msec) clat (usec): min=33, max=709093, avg=41260.98, stdev=31114.24 lat (usec): min=34, max=709094, avg=41267.06, stdev=31113.63 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 11731], 10.00th=[ 16581], 20.00th=[ 22152], | 30.00th=[ 25822], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 48497], 80.00th=[ 56886], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[135267], 99.50th=[149947], 99.90th=[333448], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 15, max= 111, per=25.47%, avg=54.00, stdev=19.00, samples=217 iops : min= 3, max= 27, avg=12.84, stdev= 4.76, samples=217 write: IOPS=14, BW=57.0KiB/s (58.4kB/s)(6296KiB/110440msec); 0 zone resets clat (usec): min=1013, max=224005, avg=30807.76, stdev=31666.09 lat (usec): min=1013, max=224006, avg=30813.36, stdev=31667.92 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 1909], 20.00th=[ 3752], | 30.00th=[ 7308], 40.00th=[ 15533], 50.00th=[ 22152], 60.00th=[ 29230], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[156238], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 119, per=25.55%, avg=56.72, stdev=22.05, samples=217 iops : min= 1, max= 29, avg=13.53, stdev= 5.56, samples=217 lat (usec) : 50=0.46%, 100=1.20%, 250=0.20%, 750=0.13% lat (msec) : 2=5.57%, 4=5.01%, 10=7.55%, 20=11.62%, 50=43.91% lat (msec) : 100=20.93%, 250=3.35%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.77%, ctx=6903, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185257: Wed May 27 05:49:49 2026 read: IOPS=13, BW=52.9KiB/s (54.2kB/s)(5940KiB/112248msec) clat (usec): min=49, max=811144, avg=41328.04, stdev=32908.28 lat (usec): min=49, max=811145, avg=41331.70, stdev=32908.22 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 12911], 10.00th=[ 16057], 20.00th=[ 21103], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[145753], 99.50th=[164627], 99.90th=[227541], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 110, per=24.83%, avg=52.65, stdev=19.24, samples=220 iops : min= 1, max= 27, avg=12.51, stdev= 4.83, samples=220 write: IOPS=14, BW=56.6KiB/s (57.9kB/s)(6348KiB/112248msec); 0 zone resets clat (usec): min=1121, max=276865, avg=31963.37, stdev=32376.21 lat (usec): min=1122, max=276867, avg=31968.35, stdev=32376.49 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1450], 10.00th=[ 2089], 20.00th=[ 4113], | 30.00th=[ 8225], 40.00th=[ 17433], 50.00th=[ 24511], 60.00th=[ 31327], | 70.00th=[ 40633], 80.00th=[ 53216], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[164627], 99.90th=[261096], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 158, per=25.33%, avg=56.23, stdev=21.99, samples=220 iops : min= 1, max= 39, avg=13.40, stdev= 5.54, samples=220 lat (usec) : 50=0.07%, 100=1.40%, 250=0.10%, 750=0.03% lat (msec) : 2=4.92%, 4=5.05%, 10=6.84%, 20=12.66%, 50=43.46% lat (msec) : 100=22.27%, 250=3.09%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.76%, ctx=6899, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185258: Wed May 27 05:49:49 2026 read: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6028KiB/113049msec) clat (usec): min=34, max=294199, avg=41635.69, stdev=26774.87 lat (usec): min=34, max=294200, avg=41638.21, stdev=26774.91 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11600], 10.00th=[ 16319], 20.00th=[ 21890], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 57410], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[131597], 99.50th=[152044], 99.90th=[187696], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 15, max= 117, per=25.01%, avg=53.01, stdev=18.96, samples=222 iops : min= 3, max= 29, avg=12.59, stdev= 4.76, samples=222 write: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6260KiB/113049msec); 0 zone resets clat (usec): min=1079, max=831702, avg=32043.91, stdev=37288.13 lat (usec): min=1081, max=831706, avg=32048.06, stdev=37291.76 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1385], 10.00th=[ 2040], 20.00th=[ 4047], | 30.00th=[ 7373], 40.00th=[ 14615], 50.00th=[ 22938], 60.00th=[ 31065], | 70.00th=[ 41681], 80.00th=[ 54264], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[133694], 99.50th=[156238], 99.90th=[214959], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 15, max= 119, per=24.90%, avg=55.27, stdev=21.93, samples=221 iops : min= 3, max= 29, avg=13.16, stdev= 5.53, samples=221 lat (usec) : 50=0.33%, 100=1.46%, 250=0.13% lat (msec) : 2=4.98%, 4=5.18%, 10=7.58%, 20=11.85%, 50=42.25% lat (msec) : 100=22.72%, 250=3.45%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.63%, ctx=6916, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185259: Wed May 27 05:49:49 2026 read: IOPS=13, BW=54.7KiB/s (55.0kB/s)(6052KiB/110668msec) clat (usec): min=34, max=236119, avg=39616.50, stdev=25068.09 lat (usec): min=34, max=236120, avg=39619.44, stdev=25066.48 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 2147], 10.00th=[ 15533], 20.00th=[ 20579], | 30.00th=[ 25560], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[119014], 99.50th=[139461], 99.90th=[221250], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 15, max= 119, per=25.79%, avg=54.67, stdev=18.47, samples=216 iops : min= 3, max= 29, avg=13.02, stdev= 4.65, samples=216 write: IOPS=14, BW=56.3KiB/s (57.7kB/s)(6236KiB/110668msec); 0 zone resets clat (usec): min=1037, max=825029, avg=32445.00, stdev=38027.07 lat (usec): min=1038, max=825031, avg=32455.27, stdev=38022.66 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1385], 10.00th=[ 2212], 20.00th=[ 3818], | 30.00th=[ 7242], 40.00th=[ 16581], 50.00th=[ 23725], 60.00th=[ 31589], | 70.00th=[ 41681], 80.00th=[ 54789], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[129500], 99.50th=[173016], 99.90th=[333448], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 125, per=25.24%, avg=56.02, stdev=20.58, samples=217 iops : min= 1, max= 31, avg=13.35, stdev= 5.18, samples=217 lat (usec) : 50=0.36%, 100=1.89%, 250=0.10%, 500=0.03% lat (msec) : 2=4.39%, 4=6.32%, 10=6.74%, 20=11.91%, 50=43.00% lat (msec) : 100=22.10%, 250=3.06%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.82%, ctx=6862, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=212KiB/s (218kB/s), 52.9KiB/s-54.7KiB/s (54.2kB/s-55.0kB/s), io=23.4MiB (24.6MB), run=110440-113049msec WRITE: bw=222KiB/s (228kB/s), 55.4KiB/s-57.0KiB/s (56.7kB/s-58.4kB/s), io=24.6MiB (25.7MB), run=110440-113049msec rand-rw: (groupid=0, jobs=1): err= 0: pid=185251: Wed May 27 05:50:26 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(5992KiB/150114msec) clat (msec): min=5, max=803, avg=38.86, stdev=38.03 lat (msec): min=5, max=803, avg=38.86, stdev=38.03 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 108], | 99.00th=[ 157], 99.50th=[ 182], 99.90th=[ 300], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 134, per=25.32%, avg=40.27, stdev=25.93, samples=290 iops : min= 1, max= 33, avg= 9.43, stdev= 6.49, samples=290 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6296KiB/150114msec); 0 zone resets clat (msec): min=9, max=270, avg=58.12, stdev=39.92 lat (msec): min=9, max=270, avg=58.13, stdev=39.92 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 207], 99.50th=[ 222], 99.90th=[ 245], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 118, per=24.89%, avg=41.57, stdev=23.55, samples=295 iops : min= 1, max= 29, avg= 9.75, stdev= 5.89, samples=295 lat (msec) : 10=2.41%, 20=16.05%, 50=48.34%, 100=23.34%, 250=9.77% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.05%, sys=2.33%, ctx=5022, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185252: Wed May 27 05:50:26 2026 read: IOPS=9, BW=39.9KiB/s (40.8kB/s)(5940KiB/148902msec) clat (msec): min=5, max=899, avg=38.42, stdev=39.57 lat (msec): min=5, max=899, avg=38.43, stdev=39.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 104], | 99.00th=[ 165], 99.50th=[ 190], 99.90th=[ 305], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 143, per=25.27%, avg=40.18, stdev=27.07, samples=289 iops : min= 1, max= 35, avg= 9.40, stdev= 6.78, samples=289 write: IOPS=10, BW=42.6KiB/s (43.7kB/s)(6348KiB/148902msec); 0 zone resets clat (msec): min=10, max=422, avg=57.62, stdev=41.04 lat (msec): min=10, max=422, avg=57.62, stdev=41.04 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 213], 99.50th=[ 232], 99.90th=[ 342], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 118, per=25.46%, avg=42.52, stdev=23.40, samples=292 iops : min= 1, max= 29, avg= 9.98, stdev= 5.85, samples=292 lat (msec) : 10=2.15%, 20=16.67%, 50=48.27%, 100=23.76%, 250=8.92% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=2.40%, ctx=5036, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185253: Wed May 27 05:50:26 2026 read: IOPS=10, BW=40.3KiB/s (41.2kB/s)(6028KiB/149670msec) clat (msec): min=5, max=273, avg=38.56, stdev=33.12 lat (msec): min=5, max=273, avg=38.56, stdev=33.12 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 110], | 99.00th=[ 163], 99.50th=[ 192], 99.90th=[ 247], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 135, per=25.28%, avg=40.20, stdev=25.15, samples=292 iops : min= 1, max= 33, avg= 9.41, stdev= 6.31, samples=292 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6260KiB/149670msec); 0 zone resets clat (msec): min=9, max=926, avg=58.24, stdev=45.96 lat (msec): min=9, max=926, avg=58.24, stdev=45.96 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 110], 95.00th=[ 133], | 99.00th=[ 199], 99.50th=[ 234], 99.90th=[ 351], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 111, per=25.04%, avg=41.81, stdev=24.60, samples=292 iops : min= 1, max= 27, avg= 9.81, stdev= 6.14, samples=292 lat (msec) : 10=1.89%, 20=16.21%, 50=49.25%, 100=22.79%, 250=9.64% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=2.28%, ctx=5008, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185254: Wed May 27 05:50:26 2026 read: IOPS=10, BW=40.5KiB/s (41.4kB/s)(6052KiB/149616msec) clat (msec): min=5, max=296, avg=38.01, stdev=31.86 lat (msec): min=5, max=296, avg=38.01, stdev=31.86 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 85], 95.00th=[ 109], | 99.00th=[ 150], 99.50th=[ 163], 99.90th=[ 234], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 128, per=26.15%, avg=41.58, stdev=25.16, samples=284 iops : min= 1, max= 32, avg= 9.76, stdev= 6.30, samples=284 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6236KiB/149616msec); 0 zone resets clat (msec): min=9, max=913, avg=58.83, stdev=46.76 lat (msec): min=9, max=913, avg=58.83, stdev=46.76 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 241], 99.90th=[ 418], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=41.65, stdev=23.72, samples=292 iops : min= 1, max= 29, avg= 9.76, stdev= 5.93, samples=292 lat (msec) : 10=2.28%, 20=17.35%, 50=47.49%, 100=22.59%, 250=10.06% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=2.38%, ctx=5055, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=160KiB/s (164kB/s), 39.9KiB/s-40.5KiB/s (40.8kB/s-41.4kB/s), io=23.4MiB (24.6MB), run=148902-150114msec WRITE: bw=167KiB/s (171kB/s), 41.7KiB/s-42.6KiB/s (42.7kB/s-43.7kB/s), io=24.6MiB (25.7MB), run=148902-150114msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=185307: Wed May 27 05:51:05 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(5920KiB/29881msec) clat (usec): min=41, max=250300, avg=44492.60, stdev=31795.69 lat (usec): min=41, max=250302, avg=44493.90, stdev=31795.77 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 955], 20.00th=[ 21627], | 30.00th=[ 26084], 40.00th=[ 32900], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 65799], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[152044], 99.50th=[168821], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 60, max= 383, per=25.63%, avg=197.60, stdev=74.46, samples=58 iops : min= 3, max= 23, avg=11.57, stdev= 4.65, samples=58 write: IOPS=13, BW=213KiB/s (218kB/s)(6368KiB/29881msec); 0 zone resets clat (usec): min=1672, max=286795, avg=33621.91, stdev=34031.33 lat (usec): min=1674, max=286798, avg=33632.15, stdev=34027.64 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2507], 10.00th=[ 3163], 20.00th=[ 6456], | 30.00th=[ 10814], 40.00th=[ 16909], 50.00th=[ 24773], 60.00th=[ 31851], | 70.00th=[ 42730], 80.00th=[ 55313], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[177210], 99.50th=[210764], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 441, per=26.31%, avg=213.67, stdev=95.93, samples=58 iops : min= 1, max= 27, avg=12.59, stdev= 6.06, samples=58 lat (usec) : 50=0.52%, 100=3.26%, 250=0.65%, 750=0.13%, 1000=0.26% lat (msec) : 2=1.69%, 4=5.34%, 10=8.20%, 20=11.46%, 50=39.58% lat (msec) : 100=24.09%, 250=4.56%, 500=0.26% cpu : usr=0.08%, sys=6.43%, ctx=1838, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185308: Wed May 27 05:51:05 2026 read: IOPS=11, BW=191KiB/s (196kB/s)(5744KiB/30051msec) clat (usec): min=47, max=188875, avg=43006.96, stdev=27778.19 lat (usec): min=48, max=188876, avg=43007.98, stdev=27778.18 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 17171], 20.00th=[ 23462], | 30.00th=[ 27395], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 91751], | 99.00th=[120062], 99.50th=[181404], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 376, per=24.88%, avg=191.80, stdev=81.89, samples=59 iops : min= 1, max= 23, avg=11.20, stdev= 5.16, samples=59 write: IOPS=13, BW=218KiB/s (223kB/s)(6544KiB/30051msec); 0 zone resets clat (usec): min=1628, max=201194, avg=35644.52, stdev=34545.97 lat (usec): min=1630, max=201195, avg=35646.75, stdev=34546.12 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2376], 10.00th=[ 4080], 20.00th=[ 6980], | 30.00th=[ 11863], 40.00th=[ 19268], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 43779], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[108528], | 99.00th=[164627], 99.50th=[181404], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 63, max= 383, per=26.70%, avg=216.83, stdev=83.38, samples=59 iops : min= 3, max= 23, avg=12.78, stdev= 5.28, samples=59 lat (usec) : 50=0.13%, 100=2.99%, 250=0.39%, 750=0.13% lat (msec) : 2=1.69%, 4=3.52%, 10=9.11%, 20=10.42%, 50=42.97% lat (msec) : 100=23.70%, 250=4.95% cpu : usr=0.06%, sys=6.42%, ctx=1819, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185309: Wed May 27 05:51:05 2026 read: IOPS=12, BW=202KiB/s (206kB/s)(6256KiB/31032msec) clat (usec): min=39, max=279751, avg=44742.06, stdev=37667.28 lat (usec): min=40, max=279752, avg=44744.43, stdev=37667.14 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 61], 10.00th=[ 129], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 43254], | 70.00th=[ 49546], 80.00th=[ 62653], 90.00th=[ 83362], 95.00th=[110625], | 99.00th=[196084], 99.50th=[274727], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 62, max= 448, per=26.14%, avg=201.52, stdev=83.21, samples=61 iops : min= 3, max= 28, avg=11.80, stdev= 5.31, samples=61 write: IOPS=12, BW=194KiB/s (199kB/s)(6032KiB/31032msec); 0 zone resets clat (usec): min=1509, max=160354, avg=35751.61, stdev=33397.78 lat (usec): min=1512, max=160356, avg=35753.80, stdev=33397.62 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2376], 10.00th=[ 3589], 20.00th=[ 6194], | 30.00th=[ 9765], 40.00th=[ 17433], 50.00th=[ 26084], 60.00th=[ 35914], | 70.00th=[ 47973], 80.00th=[ 61604], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[141558], 99.50th=[145753], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 31, max= 574, per=23.76%, avg=192.92, stdev=96.10, samples=61 iops : min= 1, max= 35, avg=11.28, stdev= 6.07, samples=61 lat (usec) : 50=0.13%, 100=4.56%, 250=0.78%, 500=0.13% lat (msec) : 2=2.21%, 4=3.78%, 10=9.11%, 20=9.64%, 50=40.76% lat (msec) : 100=22.66%, 250=5.99%, 500=0.26% cpu : usr=0.05%, sys=5.58%, ctx=1831, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185310: Wed May 27 05:51:05 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29073msec) clat (usec): min=48, max=193088, avg=41705.28, stdev=29371.07 lat (usec): min=49, max=193089, avg=41706.32, stdev=29371.11 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 111], 20.00th=[ 20317], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[143655], 99.50th=[177210], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 412, per=26.78%, avg=206.47, stdev=85.47, samples=57 iops : min= 1, max= 25, avg=12.12, stdev= 5.32, samples=57 write: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29073msec); 0 zone resets clat (usec): min=1608, max=291272, avg=33954.40, stdev=36072.60 lat (usec): min=1610, max=291274, avg=33957.15, stdev=36072.35 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2147], 10.00th=[ 3294], 20.00th=[ 5538], | 30.00th=[ 9503], 40.00th=[ 16319], 50.00th=[ 23725], 60.00th=[ 32637], | 70.00th=[ 42730], 80.00th=[ 54789], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[189793], 99.50th=[200279], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 61, max= 447, per=26.62%, avg=216.18, stdev=86.68, samples=57 iops : min= 3, max= 27, avg=12.74, stdev= 5.43, samples=57 lat (usec) : 50=0.26%, 100=4.17%, 250=1.04%, 1000=0.13% lat (msec) : 2=2.34%, 4=5.21%, 10=8.59%, 20=11.59%, 50=39.45% lat (msec) : 100=22.79%, 250=4.30%, 500=0.13% cpu : usr=0.05%, sys=5.82%, ctx=1684, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=772KiB/s (790kB/s), 191KiB/s-207KiB/s (196kB/s-212kB/s), io=23.4MiB (24.5MB), run=29073-31032msec WRITE: bw=812KiB/s (832kB/s), 194KiB/s-218KiB/s (199kB/s-223kB/s), io=24.6MiB (25.8MB), run=29073-31032msec rand-rw: (groupid=0, jobs=1): err= 0: pid=185302: Wed May 27 05:51:17 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(5920KiB/43200msec) clat (msec): min=7, max=272, avg=45.42, stdev=36.64 lat (msec): min=7, max=272, avg=45.43, stdev=36.63 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 91], 95.00th=[ 123], | 99.00th=[ 199], 99.50th=[ 228], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 371, per=24.89%, avg=137.37, stdev=80.77, samples=84 iops : min= 1, max= 23, avg= 7.83, stdev= 5.15, samples=84 write: IOPS=9, BW=147KiB/s (151kB/s)(6368KiB/43200msec); 0 zone resets clat (msec): min=14, max=286, avg=66.01, stdev=44.46 lat (msec): min=14, max=286, avg=66.02, stdev=44.47 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 75], 80.00th=[ 100], 90.00th=[ 128], 95.00th=[ 155], | 99.00th=[ 239], 99.50th=[ 268], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 384, per=25.56%, avg=148.49, stdev=79.19, samples=84 iops : min= 1, max= 24, avg= 8.52, stdev= 5.07, samples=84 lat (msec) : 10=0.13%, 20=10.16%, 50=49.61%, 100=26.30%, 250=13.28% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=2.13%, ctx=1184, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185303: Wed May 27 05:51:17 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(5744KiB/43112msec) clat (msec): min=8, max=237, avg=46.28, stdev=37.32 lat (msec): min=8, max=237, avg=46.28, stdev=37.32 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 53], 80.00th=[ 70], 90.00th=[ 96], 95.00th=[ 116], | 99.00th=[ 203], 99.50th=[ 209], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 412, per=24.68%, avg=136.23, stdev=80.75, samples=83 iops : min= 1, max= 25, avg= 7.76, stdev= 5.16, samples=83 write: IOPS=9, BW=152KiB/s (155kB/s)(6544KiB/43112msec); 0 zone resets clat (msec): min=17, max=353, avg=64.63, stdev=43.25 lat (msec): min=17, max=353, avg=64.64, stdev=43.25 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 88], 90.00th=[ 114], 95.00th=[ 157], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 350, per=26.30%, avg=152.81, stdev=76.14, samples=84 iops : min= 1, max= 21, avg= 8.81, stdev= 4.85, samples=84 lat (msec) : 10=0.13%, 20=11.07%, 50=46.09%, 100=30.86%, 250=11.46% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=2.19%, ctx=1217, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185304: Wed May 27 05:51:17 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(6256KiB/43347msec) clat (msec): min=7, max=340, avg=46.99, stdev=40.08 lat (msec): min=7, max=340, avg=46.99, stdev=40.08 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 65], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 275], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 415, per=27.09%, avg=149.56, stdev=92.01, samples=82 iops : min= 1, max= 25, avg= 8.60, stdev= 5.83, samples=82 write: IOPS=8, BW=139KiB/s (142kB/s)(6032KiB/43347msec); 0 zone resets clat (msec): min=16, max=289, avg=65.89, stdev=43.53 lat (msec): min=16, max=289, avg=65.89, stdev=43.53 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 124], 95.00th=[ 165], | 99.00th=[ 220], 99.50th=[ 271], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 317, per=23.46%, avg=136.29, stdev=70.61, samples=85 iops : min= 1, max= 19, avg= 7.76, stdev= 4.51, samples=85 lat (msec) : 10=0.65%, 20=11.46%, 50=47.40%, 100=27.08%, 250=12.89% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=2.09%, ctx=1271, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185305: Wed May 27 05:51:17 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43143msec) clat (msec): min=6, max=324, avg=46.86, stdev=39.27 lat (msec): min=6, max=324, avg=46.86, stdev=39.26 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 73], 90.00th=[ 102], 95.00th=[ 125], | 99.00th=[ 197], 99.50th=[ 209], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 379, per=26.03%, avg=143.68, stdev=81.30, samples=82 iops : min= 1, max= 23, avg= 8.23, stdev= 5.17, samples=82 write: IOPS=9, BW=145KiB/s (148kB/s)(6256KiB/43143msec); 0 zone resets clat (msec): min=16, max=353, avg=64.88, stdev=44.97 lat (msec): min=16, max=353, avg=64.88, stdev=44.97 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 59], | 70.00th=[ 70], 80.00th=[ 93], 90.00th=[ 122], 95.00th=[ 144], | 99.00th=[ 275], 99.50th=[ 292], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 320, per=25.24%, avg=146.64, stdev=78.34, samples=84 iops : min= 1, max= 20, avg= 8.42, stdev= 4.98, samples=84 lat (msec) : 10=0.91%, 20=11.20%, 50=47.14%, 100=27.21%, 250=12.76% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=2.11%, ctx=1221, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=553KiB/s (566kB/s), 133KiB/s-144KiB/s (136kB/s-148kB/s), io=23.4MiB (24.5MB), run=43112-43347msec WRITE: bw=581KiB/s (595kB/s), 139KiB/s-152KiB/s (142kB/s-155kB/s), io=24.6MiB (25.8MB), run=43112-43347msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=185322: Wed May 27 05:51:30 2026 read: IOPS=1, BW=1463KiB/s (1498kB/s)(7168KiB/4901msec) clat (usec): min=596, max=3433.3k, avg=566524.74, stdev=1266211.53 lat (usec): min=598, max=3433.3k, avg=566526.12, stdev=1266211.42 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], | 20.00th=[ 1156], 30.00th=[ 56361], 40.00th=[ 56361], | 50.00th=[ 147850], 60.00th=[ 152044], 70.00th=[ 152044], | 80.00th=[ 175113], 90.00th=[3439330], 95.00th=[3439330], | 99.00th=[3439330], 99.50th=[3439330], 99.90th=[3439330], | 99.95th=[3439330], 99.99th=[3439330] bw ( KiB/s): min= 2043, max= 6107, per=100.00%, avg=3670.00, stdev=2149.67, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1045KiB/s (1070kB/s)(5120KiB/4901msec); 0 zone resets clat (msec): min=108, max=243, avg=172.23, stdev=53.76 lat (msec): min=108, max=243, avg=172.30, stdev=53.72 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 2035, max= 6131, per=80.06%, avg=4083.00, stdev=2896.31, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=66.67%, >=2000=8.33% cpu : usr=0.00%, sys=10.02%, ctx=453, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185323: Wed May 27 05:51:30 2026 read: IOPS=0, BW=364KiB/s (373kB/s)(2048KiB/5621msec) clat (msec): min=198, max=3007, avg=1602.85, stdev=1986.22 lat (msec): min=198, max=3007, avg=1602.85, stdev=1986.22 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 3004], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1446, max= 2043, per=47.89%, avg=1744.50, stdev=422.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1822KiB/s (1865kB/s)(10.0MiB/5621msec); 0 zone resets clat (msec): min=87, max=520, avg=235.84, stdev=123.03 lat (msec): min=87, max=520, avg=235.93, stdev=123.01 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 110], | 30.00th=[ 150], 40.00th=[ 190], 50.00th=[ 218], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 292], 90.00th=[ 296], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2019, max= 4087, per=69.69%, avg=3554.00, stdev=1023.78, samples=4 iops : min= 1, max= 3, avg= 2.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=14.45%, ctx=459, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185324: Wed May 27 05:51:30 2026 read: IOPS=1, BW=1334KiB/s (1366kB/s)(6144KiB/4605msec) clat (usec): min=580, max=217067, avg=118085.68, stdev=82968.82 lat (usec): min=582, max=217068, avg=118086.79, stdev=82968.81 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 85459], | 30.00th=[ 85459], 40.00th=[ 90702], 50.00th=[ 90702], 60.00th=[103285], | 70.00th=[210764], 80.00th=[210764], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 2011, max= 6131, per=100.00%, avg=4071.00, stdev=2913.28, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1334KiB/s (1366kB/s)(6144KiB/4605msec); 0 zone resets clat (msec): min=100, max=2433, avg=640.18, stdev=898.24 lat (msec): min=100, max=2433, avg=640.24, stdev=898.23 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 257], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 2011, max= 2888, per=44.00%, avg=2244.25, stdev=429.38, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.99%, ctx=218, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185325: Wed May 27 05:51:30 2026 read: IOPS=0, BW=983KiB/s (1007kB/s)(5120KiB/5208msec) clat (msec): min=3, max=222, avg=152.00, stdev=89.87 lat (msec): min=3, max=222, avg=152.00, stdev=89.87 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 2019, max= 6131, per=100.00%, avg=4075.00, stdev=2907.62, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1376KiB/s (1409kB/s)(7168KiB/5208msec); 0 zone resets clat (msec): min=154, max=2361, avg=630.64, stdev=783.45 lat (msec): min=154, max=2361, avg=632.49, stdev=782.42 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 174], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 372], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 651], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1391, max= 4087, per=56.59%, avg=2886.00, stdev=1376.09, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 4=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=12.27%, ctx=131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3643KiB/s (3731kB/s), 364KiB/s-1463KiB/s (373kB/s-1498kB/s), io=20.0MiB (20.0MB), run=4605-5621msec WRITE: bw=5101KiB/s (5223kB/s), 1045KiB/s-1822KiB/s (1070kB/s-1865kB/s), io=28.0MiB (29.4MB), run=4605-5621msec rand-rw: (groupid=0, jobs=1): err= 0: pid=185327: Wed May 27 05:51:31 2026 read: IOPS=1, BW=1186KiB/s (1214kB/s)(7168KiB/6046msec) clat (msec): min=91, max=2580, avg=595.23, stdev=891.58 lat (msec): min=91, max=2580, avg=595.23, stdev=891.58 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 111], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 288], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 550], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1726, max= 4087, per=71.55%, avg=2423.50, stdev=1116.74, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=847KiB/s (867kB/s)(5120KiB/6046msec); 0 zone resets clat (msec): min=124, max=500, avg=313.48, stdev=168.55 lat (msec): min=124, max=500, avg=313.58, stdev=168.56 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2011, max= 4039, per=56.83%, avg=2695.00, stdev=1164.00, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=4.42%, ctx=186, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185328: Wed May 27 05:51:31 2026 read: IOPS=0, BW=360KiB/s (369kB/s)(2048KiB/5684msec) clat (msec): min=577, max=2685, avg=1631.60, stdev=1490.51 lat (msec): min=577, max=2685, avg=1631.60, stdev=1490.50 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 2702], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1838, max= 2043, per=57.29%, avg=1940.50, stdev=144.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1802KiB/s (1845kB/s)(10.0MiB/5684msec); 0 zone resets clat (msec): min=63, max=537, avg=211.32, stdev=159.87 lat (msec): min=68, max=537, avg=211.96, stdev=159.34 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 84], | 30.00th=[ 100], 40.00th=[ 125], 50.00th=[ 144], 60.00th=[ 159], | 70.00th=[ 194], 80.00th=[ 266], 90.00th=[ 443], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 4023, max= 6144, per=96.36%, avg=4569.25, stdev=1050.02, samples=4 iops : min= 3, max= 6, avg= 3.75, stdev= 1.50, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.31%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185329: Wed May 27 05:51:31 2026 read: IOPS=0, BW=1023KiB/s (1048kB/s)(6144KiB/6006msec) clat (msec): min=78, max=2949, avg=648.73, stdev=1133.95 lat (msec): min=78, max=2949, avg=648.73, stdev=1133.95 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 218], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2019, max= 4023, per=79.57%, avg=2695.00, stdev=1150.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=1023KiB/s (1048kB/s)(6144KiB/6006msec); 0 zone resets clat (msec): min=83, max=591, avg=312.75, stdev=190.67 lat (msec): min=83, max=591, avg=312.85, stdev=190.63 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 288], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1838, max= 4071, per=55.67%, avg=2640.00, stdev=1242.30, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.60%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185330: Wed May 27 05:51:31 2026 read: IOPS=0, BW=857KiB/s (878kB/s)(5120KiB/5973msec) clat (msec): min=101, max=2678, avg=743.08, stdev=1087.91 lat (msec): min=101, max=2678, avg=743.08, stdev=1087.91 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 2011, max= 4039, per=79.65%, avg=2697.67, stdev=1161.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1200KiB/s (1229kB/s)(7168KiB/5973msec); 0 zone resets clat (msec): min=75, max=779, avg=280.74, stdev=241.24 lat (msec): min=76, max=779, avg=280.92, stdev=241.23 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 105], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 268], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 338], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1838, max= 4096, per=52.61%, avg=2495.00, stdev=1070.94, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.47%, ctx=135, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3387KiB/s (3469kB/s), 360KiB/s-1186KiB/s (369kB/s-1214kB/s), io=20.0MiB (20.0MB), run=5684-6046msec WRITE: bw=4742KiB/s (4856kB/s), 847KiB/s-1802KiB/s (867kB/s-1845kB/s), io=28.0MiB (29.4MB), run=5684-6046msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=185336: Wed May 27 05:51:45 2026 read: IOPS=0, BW=2333KiB/s (2389kB/s)(12.0MiB/5267msec) clat (msec): min=692, max=3461, avg=1662.91, stdev=1558.82 lat (msec): min=692, max=3461, avg=1662.92, stdev=1558.82 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.70%, ctx=274, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185337: Wed May 27 05:51:45 2026 read: IOPS=0, BW=817KiB/s (837kB/s)(4096KiB/5014msec) clat (nsec): min=3235.2M, max=3235.2M, avg=3235196395.00, stdev= 0.00 lat (nsec): min=3235.2M, max=3235.2M, avg=3235198902.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3239], 5.00th=[ 3239], 10.00th=[ 3239], 20.00th=[ 3239], | 30.00th=[ 3239], 40.00th=[ 3239], 50.00th=[ 3239], 60.00th=[ 3239], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1634KiB/s (1673kB/s)(8192KiB/5014msec); 0 zone resets clat (msec): min=603, max=951, avg=777.41, stdev=246.22 lat (msec): min=605, max=951, avg=778.84, stdev=244.77 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.13%, ctx=545, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185338: Wed May 27 05:51:45 2026 write: IOPS=0, BW=2788KiB/s (2855kB/s)(12.0MiB/4407msec); 0 zone resets clat (msec): min=455, max=3050, avg=1390.61, stdev=1440.99 lat (msec): min=456, max=3052, avg=1391.57, stdev=1442.01 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 7984, max= 8126, per=100.00%, avg=8055.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.50%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185339: Wed May 27 05:51:45 2026 write: IOPS=0, BW=2702KiB/s (2767kB/s)(12.0MiB/4548msec); 0 zone resets clat (msec): min=231, max=3693, avg=1500.13, stdev=1907.48 lat (msec): min=232, max=3693, avg=1500.75, stdev=1907.15 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 3708], 80.00th=[ 3708], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min=15845, max=15845, per=100.00%, avg=15845.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.97%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3111KiB/s (3185kB/s), 817KiB/s-2333KiB/s (837kB/s-2389kB/s), io=16.0MiB (16.8MB), run=5014-5267msec WRITE: bw=6535KiB/s (6692kB/s), 1634KiB/s-2788KiB/s (1673kB/s-2855kB/s), io=32.0MiB (33.6MB), run=4407-5014msec rand-rw: (groupid=0, jobs=1): err= 0: pid=185342: Wed May 27 05:51:46 2026 read: IOPS=0, BW=2296KiB/s (2351kB/s)(12.0MiB/5353msec) clat (msec): min=273, max=3877, avg=1734.75, stdev=1896.33 lat (msec): min=273, max=3877, avg=1734.76, stdev=1896.33 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=2.02%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185343: Wed May 27 05:51:46 2026 read: IOPS=0, BW=766KiB/s (785kB/s)(4096KiB/5345msec) clat (nsec): min=3525.6M, max=3525.6M, avg=3525627173.00, stdev= 0.00 lat (nsec): min=3525.6M, max=3525.6M, avg=3525629317.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3540], 5.00th=[ 3540], 10.00th=[ 3540], 20.00th=[ 3540], | 30.00th=[ 3540], 40.00th=[ 3540], 50.00th=[ 3540], 60.00th=[ 3540], | 70.00th=[ 3540], 80.00th=[ 3540], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1533KiB/s (1569kB/s)(8192KiB/5345msec); 0 zone resets clat (msec): min=821, max=918, avg=870.13, stdev=68.55 lat (msec): min=822, max=918, avg=870.73, stdev=68.18 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.02%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185344: Wed May 27 05:51:46 2026 write: IOPS=0, BW=2148KiB/s (2199kB/s)(12.0MiB/5721msec); 0 zone resets clat (msec): min=211, max=4645, avg=1874.11, stdev=2415.60 lat (msec): min=212, max=4645, avg=1874.56, stdev=2415.64 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 7846, max= 8175, per=100.00%, avg=8010.50, stdev=232.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.48%, ctx=38, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185345: Wed May 27 05:51:46 2026 write: IOPS=0, BW=2364KiB/s (2421kB/s)(12.0MiB/5198msec); 0 zone resets clat (msec): min=557, max=3023, avg=1705.36, stdev=1241.92 lat (msec): min=557, max=3024, avg=1705.67, stdev=1241.93 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 7953, max= 8159, per=100.00%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.73%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3061KiB/s (3134kB/s), 766KiB/s-2296KiB/s (785kB/s-2351kB/s), io=16.0MiB (16.8MB), run=5345-5353msec WRITE: bw=5728KiB/s (5865kB/s), 1533KiB/s-2364KiB/s (1569kB/s-2421kB/s), io=32.0MiB (33.6MB), run=5198-5721msec