== sanity test 398b: DIO and buffer IO race ============== 04:47:59 (1773737279) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.6275 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149185: Tue Mar 17 04:51:11 2026 read: IOPS=8, BW=35.1KiB/s (35.9kB/s)(5992KiB/170930msec) clat (usec): min=29, max=1132.8k, avg=53721.12, stdev=55327.94 lat (usec): min=29, max=1132.8k, avg=53726.72, stdev=55329.70 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 77], | 20.00th=[ 22152], 30.00th=[ 29754], 40.00th=[ 36963], | 50.00th=[ 43779], 60.00th=[ 52691], 70.00th=[ 62129], | 80.00th=[ 77071], 90.00th=[ 104334], 95.00th=[ 132645], | 99.00th=[ 225444], 99.50th=[ 254804], 99.90th=[ 826278], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 111, per=26.09%, avg=36.26, stdev=19.64, samples=320 iops : min= 1, max= 27, avg= 8.41, stdev= 4.94, samples=320 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6296KiB/170930msec); 0 zone resets clat (usec): min=884, max=941456, avg=57211.85, stdev=66344.60 lat (usec): min=885, max=941458, avg=57214.10, stdev=66344.61 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1565], 20.00th=[ 5538], | 30.00th=[ 13566], 40.00th=[ 25560], 50.00th=[ 39584], 60.00th=[ 53740], | 70.00th=[ 71828], 80.00th=[ 94897], 90.00th=[135267], 95.00th=[177210], | 99.00th=[270533], 99.50th=[316670], 99.90th=[616563], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 135, per=25.48%, avg=37.20, stdev=19.30, samples=328 iops : min= 1, max= 33, avg= 8.65, stdev= 4.86, samples=328 lat (usec) : 50=1.01%, 100=4.39%, 250=0.13%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=6.18%, 4=2.44%, 10=5.40%, 20=7.32%, 50=29.98% lat (msec) : 100=28.19%, 250=13.51%, 500=0.91%, 750=0.07%, 1000=0.07% lat (msec) : 2000=0.03% cpu : usr=0.06%, sys=4.49%, ctx=6205, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149186: Tue Mar 17 04:51:11 2026 read: IOPS=8, BW=35.0KiB/s (35.9kB/s)(5940KiB/169565msec) clat (usec): min=35, max=480682, avg=55073.40, stdev=45707.56 lat (usec): min=35, max=480684, avg=55074.71, stdev=45707.58 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 80], 20.00th=[ 22676], | 30.00th=[ 30278], 40.00th=[ 36963], 50.00th=[ 44303], 60.00th=[ 54264], | 70.00th=[ 66847], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[141558], | 99.00th=[212861], 99.50th=[233833], 99.90th=[383779], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 101, per=25.86%, avg=35.95, stdev=18.32, samples=320 iops : min= 1, max= 25, avg= 8.33, stdev= 4.61, samples=320 write: IOPS=9, BW=37.4KiB/s (38.3kB/s)(6348KiB/169565msec); 0 zone resets clat (usec): min=816, max=1288.0k, avg=55046.55, stdev=70417.27 lat (usec): min=817, max=1288.0k, avg=55050.56, stdev=70416.89 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1287], 10.00th=[ 1401], | 20.00th=[ 4015], 30.00th=[ 9372], 40.00th=[ 21627], | 50.00th=[ 38011], 60.00th=[ 53740], 70.00th=[ 70779], | 80.00th=[ 91751], 90.00th=[ 129500], 95.00th=[ 168821], | 99.00th=[ 287310], 99.50th=[ 346031], 99.90th=[ 834667], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 7, max= 103, per=25.70%, avg=37.53, stdev=19.39, samples=328 iops : min= 1, max= 25, avg= 8.73, stdev= 4.90, samples=328 lat (usec) : 50=0.65%, 100=4.39%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=7.23%, 4=3.19%, 10=5.53%, 20=6.80%, 50=28.42% lat (msec) : 100=28.29%, 250=14.13%, 500=0.98%, 1000=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.34%, ctx=6164, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149187: Tue Mar 17 04:51:11 2026 read: IOPS=8, BW=35.0KiB/s (35.8kB/s)(6028KiB/172184msec) clat (usec): min=38, max=851084, avg=52233.80, stdev=49196.83 lat (usec): min=39, max=851086, avg=52235.12, stdev=49196.84 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 93], 20.00th=[ 20579], | 30.00th=[ 27919], 40.00th=[ 34341], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 62653], 80.00th=[ 78119], 90.00th=[101188], 95.00th=[129500], | 99.00th=[221250], 99.50th=[283116], 99.90th=[434111], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 111, per=25.40%, avg=35.31, stdev=20.23, samples=330 iops : min= 1, max= 27, avg= 8.17, stdev= 5.11, samples=330 write: IOPS=9, BW=36.4KiB/s (37.2kB/s)(6260KiB/172184msec); 0 zone resets clat (usec): min=748, max=1034.0k, avg=59457.56, stdev=69834.57 lat (usec): min=748, max=1034.0k, avg=59459.41, stdev=69834.67 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1467], | 20.00th=[ 5669], 30.00th=[ 12780], 40.00th=[ 26084], | 50.00th=[ 41157], 60.00th=[ 57934], 70.00th=[ 76022], | 80.00th=[ 99091], 90.00th=[ 139461], 95.00th=[ 183501], | 99.00th=[ 304088], 99.50th=[ 346031], 99.90th=[ 583009], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 119, per=25.15%, avg=36.71, stdev=19.64, samples=330 iops : min= 1, max= 29, avg= 8.52, stdev= 4.94, samples=330 lat (usec) : 50=1.04%, 100=3.97%, 250=0.39%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=6.54%, 4=2.05%, 10=4.95%, 20=8.24%, 50=29.69% lat (msec) : 100=27.38%, 250=14.03%, 500=1.11%, 750=0.13%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.05%, sys=4.25%, ctx=6197, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149188: Tue Mar 17 04:51:11 2026 read: IOPS=8, BW=35.7KiB/s (36.6kB/s)(6052KiB/169370msec) clat (usec): min=31, max=1081.6k, avg=53956.45, stdev=54168.18 lat (usec): min=32, max=1081.6k, avg=53959.50, stdev=54168.16 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 75], | 20.00th=[ 21365], 30.00th=[ 28967], 40.00th=[ 35914], | 50.00th=[ 43779], 60.00th=[ 53216], 70.00th=[ 63701], | 80.00th=[ 78119], 90.00th=[ 104334], 95.00th=[ 131597], | 99.00th=[ 244319], 99.50th=[ 333448], 99.90th=[ 505414], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 102, per=26.31%, avg=36.57, stdev=19.82, samples=321 iops : min= 1, max= 25, avg= 8.49, stdev= 5.00, samples=321 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6236KiB/169370msec); 0 zone resets clat (usec): min=934, max=1146.7k, avg=56010.32, stdev=67597.20 lat (usec): min=935, max=1146.7k, avg=56012.18, stdev=67597.09 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1303], 10.00th=[ 1450], | 20.00th=[ 5145], 30.00th=[ 11207], 40.00th=[ 23462], | 50.00th=[ 39060], 60.00th=[ 53216], 70.00th=[ 69731], | 80.00th=[ 93848], 90.00th=[ 131597], 95.00th=[ 175113], | 99.00th=[ 274727], 99.50th=[ 295699], 99.90th=[ 574620], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 102, per=25.57%, avg=37.33, stdev=18.81, samples=324 iops : min= 1, max= 25, avg= 8.68, stdev= 4.74, samples=324 lat (usec) : 50=0.75%, 100=4.65%, 250=0.36%, 500=0.13%, 1000=0.03% lat (msec) : 2=6.71%, 4=2.34%, 10=5.76%, 20=7.23%, 50=29.46% lat (msec) : 100=28.29%, 250=13.02%, 500=1.11%, 750=0.10%, 2000=0.07% cpu : usr=0.07%, sys=4.15%, ctx=6083, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=139KiB/s (143kB/s), 35.0KiB/s-35.7KiB/s (35.8kB/s-36.6kB/s), io=23.4MiB (24.6MB), run=169370-172184msec WRITE: bw=146KiB/s (150kB/s), 36.4KiB/s-37.4KiB/s (37.2kB/s-38.3kB/s), io=24.6MiB (25.7MB), run=169370-172184msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149181: Tue Mar 17 04:54:22 2026 read: IOPS=4, BW=16.6KiB/s (16.0kB/s)(5992KiB/361329msec) clat (msec): min=5, max=858, avg=44.31, stdev=56.41 lat (msec): min=5, max=858, avg=44.31, stdev=56.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 56], 90.00th=[ 101], 95.00th=[ 140], | 99.00th=[ 251], 99.50th=[ 347], 99.90th=[ 558], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 6, max= 87, per=31.83%, avg=21.01, stdev=14.64, samples=548 iops : min= 1, max= 21, avg= 4.62, stdev= 3.69, samples=548 write: IOPS=4, BW=17.4KiB/s (17.8kB/s)(6296KiB/361329msec); 0 zone resets clat (msec): min=38, max=1075, avg=187.11, stdev=110.70 lat (msec): min=38, max=1075, avg=187.11, stdev=110.70 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 85], 20.00th=[ 104], | 30.00th=[ 121], 40.00th=[ 138], 50.00th=[ 159], 60.00th=[ 184], | 70.00th=[ 211], 80.00th=[ 253], 90.00th=[ 326], 95.00th=[ 405], | 99.00th=[ 592], 99.50th=[ 684], 99.90th=[ 978], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 4, max= 63, per=25.74%, avg=17.76, stdev= 9.41, samples=675 iops : min= 1, max= 15, avg= 3.80, stdev= 2.41, samples=675 lat (msec) : 10=1.79%, 20=14.36%, 50=21.91%, 100=15.20%, 250=35.68% lat (msec) : 500=9.93%, 750=1.01%, 1000=0.10%, 2000=0.03% cpu : usr=0.03%, sys=0.99%, ctx=5268, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149182: Tue Mar 17 04:54:22 2026 read: IOPS=4, BW=16.4KiB/s (16.8kB/s)(5940KiB/363042msec) clat (msec): min=5, max=916, avg=43.24, stdev=56.66 lat (msec): min=5, max=916, avg=43.24, stdev=56.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 54], 90.00th=[ 96], 95.00th=[ 146], | 99.00th=[ 253], 99.50th=[ 351], 99.90th=[ 584], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 103, per=32.14%, avg=21.21, stdev=15.06, samples=537 iops : min= 1, max= 25, avg= 4.67, stdev= 3.79, samples=537 write: IOPS=4, BW=17.5KiB/s (17.9kB/s)(6348KiB/363042msec); 0 zone resets clat (msec): min=39, max=1435, avg=188.02, stdev=116.06 lat (msec): min=39, max=1435, avg=188.02, stdev=116.06 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 83], 20.00th=[ 104], | 30.00th=[ 118], 40.00th=[ 134], 50.00th=[ 155], 60.00th=[ 182], | 70.00th=[ 211], 80.00th=[ 257], 90.00th=[ 342], 95.00th=[ 414], | 99.00th=[ 575], 99.50th=[ 667], 99.90th=[ 793], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 6, max= 55, per=25.78%, avg=17.79, stdev= 9.53, samples=678 iops : min= 1, max= 13, avg= 3.81, stdev= 2.44, samples=678 lat (msec) : 10=2.64%, 20=14.65%, 50=20.67%, 100=15.56%, 250=34.96% lat (msec) : 500=10.22%, 750=1.17%, 1000=0.10%, 2000=0.03% cpu : usr=0.03%, sys=1.01%, ctx=5270, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149183: Tue Mar 17 04:54:22 2026 read: IOPS=4, BW=16.7KiB/s (17.1kB/s)(6028KiB/361975msec) clat (msec): min=5, max=1636, avg=45.74, stdev=69.25 lat (msec): min=5, max=1636, avg=45.74, stdev=69.25 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 59], 90.00th=[ 102], 95.00th=[ 144], | 99.00th=[ 279], 99.50th=[ 435], 99.90th=[ 617], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 4, max= 111, per=31.33%, avg=20.68, stdev=14.72, samples=559 iops : min= 1, max= 27, avg= 4.54, stdev= 3.70, samples=559 write: IOPS=4, BW=17.3KiB/s (17.7kB/s)(6260KiB/361975msec); 0 zone resets clat (msec): min=38, max=1022, avg=186.97, stdev=109.74 lat (msec): min=38, max=1022, avg=186.97, stdev=109.74 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 74], 10.00th=[ 85], 20.00th=[ 105], | 30.00th=[ 121], 40.00th=[ 136], 50.00th=[ 155], 60.00th=[ 180], | 70.00th=[ 211], 80.00th=[ 257], 90.00th=[ 334], 95.00th=[ 401], | 99.00th=[ 575], 99.50th=[ 617], 99.90th=[ 877], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 55, per=25.96%, avg=17.91, stdev= 9.36, samples=666 iops : min= 1, max= 13, avg= 3.84, stdev= 2.40, samples=666 lat (msec) : 10=2.41%, 20=14.39%, 50=20.87%, 100=15.53%, 250=35.22% lat (msec) : 500=10.48%, 750=0.98%, 1000=0.07%, 2000=0.07% cpu : usr=0.03%, sys=1.00%, ctx=5171, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149184: Tue Mar 17 04:54:22 2026 read: IOPS=4, BW=16.8KiB/s (17.2kB/s)(6052KiB/361141msec) clat (msec): min=5, max=1453, avg=44.00, stdev=64.54 lat (msec): min=5, max=1453, avg=44.00, stdev=64.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 96], 95.00th=[ 136], | 99.00th=[ 247], 99.50th=[ 347], 99.90th=[ 634], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 6, max= 88, per=32.29%, avg=21.31, stdev=14.85, samples=545 iops : min= 1, max= 22, avg= 4.70, stdev= 3.74, samples=545 write: IOPS=4, BW=17.3KiB/s (17.7kB/s)(6236KiB/361141msec); 0 zone resets clat (msec): min=42, max=1133, avg=188.68, stdev=111.74 lat (msec): min=42, max=1133, avg=188.68, stdev=111.74 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 88], 20.00th=[ 107], | 30.00th=[ 121], 40.00th=[ 138], 50.00th=[ 159], 60.00th=[ 180], | 70.00th=[ 211], 80.00th=[ 262], 90.00th=[ 342], 95.00th=[ 401], | 99.00th=[ 600], 99.50th=[ 659], 99.90th=[ 1070], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 4, max= 55, per=25.42%, avg=17.54, stdev= 9.44, samples=676 iops : min= 1, max= 13, avg= 3.75, stdev= 2.43, samples=676 lat (msec) : 10=2.57%, 20=14.84%, 50=20.51%, 100=15.63%, 250=34.96% lat (msec) : 500=10.32%, 750=1.04%, 1000=0.03%, 2000=0.10% cpu : usr=0.03%, sys=0.98%, ctx=5269, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=66.1KiB/s (67.7kB/s), 16.4KiB/s-16.8KiB/s (16.8kB/s-17.2kB/s), io=23.4MiB (24.6MB), run=361141-363042msec WRITE: bw=69.2KiB/s (70.9kB/s), 17.3KiB/s-17.5KiB/s (17.7kB/s-17.9kB/s), io=24.6MiB (25.7MB), run=361141-363042msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149259: Tue Mar 17 04:55:00 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(5920KiB/26716msec) clat (usec): min=30, max=170776, avg=35664.11, stdev=29308.60 lat (usec): min=30, max=170777, avg=35691.41, stdev=29289.52 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 72], | 30.00th=[ 20317], 40.00th=[ 26608], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 48497], 80.00th=[ 58459], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[115868], 99.50th=[133694], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 29, max= 502, per=25.81%, avg=223.04, stdev=99.03, samples=52 iops : min= 1, max= 31, avg=13.21, stdev= 6.24, samples=52 write: IOPS=14, BW=238KiB/s (244kB/s)(6368KiB/26716msec); 0 zone resets clat (usec): min=1177, max=320693, avg=33094.26, stdev=40036.13 lat (usec): min=1179, max=320695, avg=33109.32, stdev=40027.03 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1811], 10.00th=[ 2114], 20.00th=[ 4490], | 30.00th=[ 6980], 40.00th=[ 10159], 50.00th=[ 17433], 60.00th=[ 26084], | 70.00th=[ 38011], 80.00th=[ 57410], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[179307], 99.50th=[196084], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 478, per=26.39%, avg=239.90, stdev=106.41, samples=52 iops : min= 1, max= 29, avg=14.27, stdev= 6.70, samples=52 lat (usec) : 50=1.95%, 100=9.11%, 250=0.65%, 750=0.13%, 1000=0.13% lat (msec) : 2=4.69%, 4=4.56%, 10=11.72%, 20=9.24%, 50=31.90% lat (msec) : 100=20.96%, 250=4.82%, 500=0.13% cpu : usr=0.09%, sys=5.85%, ctx=1285, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149260: Tue Mar 17 04:55:00 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(5744KiB/27644msec) clat (usec): min=37, max=244279, avg=40250.05, stdev=34047.63 lat (usec): min=37, max=244281, avg=40251.16, stdev=34047.65 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 60], 20.00th=[ 78], | 30.00th=[ 23725], 40.00th=[ 31065], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[231736], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 63, max= 416, per=24.61%, avg=212.66, stdev=91.56, samples=53 iops : min= 3, max= 26, avg=12.57, stdev= 5.81, samples=53 write: IOPS=14, BW=237KiB/s (242kB/s)(6544KiB/27644msec); 0 zone resets clat (usec): min=1123, max=167787, avg=31988.22, stdev=35259.25 lat (usec): min=1125, max=167790, avg=31994.41, stdev=35256.91 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1795], 10.00th=[ 1958], 20.00th=[ 4490], | 30.00th=[ 6980], 40.00th=[ 10028], 50.00th=[ 18220], 60.00th=[ 27395], | 70.00th=[ 41157], 80.00th=[ 58459], 90.00th=[ 85459], 95.00th=[109577], | 99.00th=[147850], 99.50th=[164627], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 63, max= 468, per=25.97%, avg=236.06, stdev=87.10, samples=54 iops : min= 3, max= 29, avg=14.04, stdev= 5.59, samples=54 lat (usec) : 50=1.17%, 100=8.98%, 250=0.26%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=5.86%, 4=4.56%, 10=11.20%, 20=8.46%, 50=29.95% lat (msec) : 100=23.83%, 250=5.34% cpu : usr=0.10%, sys=5.98%, ctx=1355, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149261: Tue Mar 17 04:55:00 2026 read: IOPS=14, BW=226KiB/s (231kB/s)(6256KiB/27703msec) clat (usec): min=29, max=193452, avg=36638.26, stdev=30077.01 lat (usec): min=29, max=193453, avg=36640.42, stdev=30077.22 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 75], | 30.00th=[ 20317], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 86508], | 99.00th=[117965], 99.50th=[160433], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 62, max= 477, per=26.85%, avg=231.94, stdev=90.27, samples=53 iops : min= 3, max= 29, avg=13.77, stdev= 5.65, samples=53 write: IOPS=13, BW=218KiB/s (223kB/s)(6032KiB/27703msec); 0 zone resets clat (usec): min=1328, max=319846, avg=34266.84, stdev=41323.52 lat (usec): min=1329, max=319848, avg=34269.11, stdev=41323.74 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1729], 10.00th=[ 1942], 20.00th=[ 3884], | 30.00th=[ 6521], 40.00th=[ 10421], 50.00th=[ 18482], 60.00th=[ 28967], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 87557], 95.00th=[103285], | 99.00th=[177210], 99.50th=[287310], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 22, max= 476, per=24.26%, avg=220.49, stdev=88.24, samples=53 iops : min= 1, max= 29, avg=13.09, stdev= 5.55, samples=53 lat (usec) : 50=1.56%, 100=10.55%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=5.47%, 4=5.21%, 10=8.46%, 20=8.07%, 50=31.77% lat (msec) : 100=24.48%, 250=3.26%, 500=0.26% cpu : usr=0.08%, sys=6.15%, ctx=1337, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149263: Tue Mar 17 04:55:00 2026 read: IOPS=14, BW=236KiB/s (242kB/s)(6032KiB/25558msec) clat (usec): min=31, max=236236, avg=35573.40, stdev=31068.33 lat (usec): min=32, max=236238, avg=35574.59, stdev=31068.34 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 69], | 30.00th=[ 19268], 40.00th=[ 27132], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 47973], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 85459], | 99.00th=[127402], 99.50th=[128451], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 62, max= 512, per=27.40%, avg=236.78, stdev=102.18, samples=49 iops : min= 3, max= 32, avg=14.08, stdev= 6.43, samples=49 write: IOPS=15, BW=245KiB/s (251kB/s)(6256KiB/25558msec); 0 zone resets clat (usec): min=1530, max=363049, avg=30178.56, stdev=36028.14 lat (usec): min=1531, max=363051, avg=30186.67, stdev=36025.10 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1844], 10.00th=[ 2245], 20.00th=[ 4424], | 30.00th=[ 7898], 40.00th=[ 10421], 50.00th=[ 17433], 60.00th=[ 25560], | 70.00th=[ 34341], 80.00th=[ 51643], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[149947], 99.50th=[202376], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 61, max= 509, per=26.98%, avg=245.27, stdev=104.25, samples=49 iops : min= 3, max= 31, avg=14.61, stdev= 6.60, samples=49 lat (usec) : 50=1.69%, 100=11.20%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=4.30%, 4=5.47%, 10=10.55%, 20=7.94%, 50=34.51% lat (msec) : 100=19.92%, 250=3.52%, 500=0.13% cpu : usr=0.13%, sys=6.56%, ctx=1302, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=865KiB/s (885kB/s), 208KiB/s-236KiB/s (213kB/s-242kB/s), io=23.4MiB (24.5MB), run=25558-27703msec WRITE: bw=910KiB/s (931kB/s), 218KiB/s-245KiB/s (223kB/s-251kB/s), io=24.6MiB (25.8MB), run=25558-27703msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149258: Tue Mar 17 04:55:50 2026 read: IOPS=4, BW=77.4KiB/s (79.2kB/s)(5920KiB/76523msec) clat (msec): min=8, max=229, avg=37.43, stdev=34.11 lat (msec): min=8, max=229, avg=37.43, stdev=34.11 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 87], 95.00th=[ 116], | 99.00th=[ 167], 99.50th=[ 197], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 30, max= 319, per=29.64%, avg=91.60, stdev=56.86, samples=127 iops : min= 1, max= 19, avg= 4.93, stdev= 3.60, samples=127 write: IOPS=5, BW=83.2KiB/s (85.2kB/s)(6368KiB/76523msec); 0 zone resets clat (msec): min=51, max=429, avg=157.20, stdev=68.08 lat (msec): min=51, max=429, avg=157.21, stdev=68.08 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 80], 10.00th=[ 89], 20.00th=[ 105], | 30.00th=[ 116], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 203], 90.00th=[ 264], 95.00th=[ 300], | 99.00th=[ 388], 99.50th=[ 409], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 23, max= 160, per=25.59%, avg=83.42, stdev=33.76, samples=150 iops : min= 1, max= 10, avg= 4.43, stdev= 2.16, samples=150 lat (msec) : 10=0.91%, 20=15.36%, 50=22.66%, 100=15.49%, 250=39.06% lat (msec) : 500=6.51% cpu : usr=0.03%, sys=1.24%, ctx=1379, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149262: Tue Mar 17 04:55:50 2026 read: IOPS=4, BW=74.3KiB/s (76.1kB/s)(5744KiB/77278msec) clat (msec): min=7, max=241, avg=38.90, stdev=33.61 lat (msec): min=7, max=241, avg=38.91, stdev=33.61 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 88], 95.00th=[ 113], | 99.00th=[ 157], 99.50th=[ 230], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 24, max= 319, per=28.31%, avg=87.48, stdev=58.07, samples=128 iops : min= 1, max= 19, avg= 4.70, stdev= 3.67, samples=128 write: IOPS=5, BW=84.7KiB/s (86.7kB/s)(6544KiB/77278msec); 0 zone resets clat (msec): min=49, max=516, avg=154.13, stdev=68.36 lat (msec): min=49, max=516, avg=154.14, stdev=68.36 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 78], 10.00th=[ 86], 20.00th=[ 101], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 203], 90.00th=[ 243], 95.00th=[ 279], | 99.00th=[ 372], 99.50th=[ 489], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 24, max= 160, per=26.36%, avg=85.95, stdev=34.87, samples=149 iops : min= 1, max= 10, avg= 4.60, stdev= 2.24, samples=149 lat (msec) : 10=0.39%, 20=13.02%, 50=22.79%, 100=17.32%, 250=41.80% lat (msec) : 500=4.56%, 750=0.13% cpu : usr=0.03%, sys=1.23%, ctx=1427, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149264: Tue Mar 17 04:55:50 2026 read: IOPS=5, BW=83.8KiB/s (85.8kB/s)(6256KiB/74651msec) clat (msec): min=7, max=250, avg=36.92, stdev=33.12 lat (msec): min=7, max=250, avg=36.92, stdev=33.12 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 75], 95.00th=[ 99], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 30, max= 320, per=31.22%, avg=96.48, stdev=62.18, samples=128 iops : min= 1, max= 20, avg= 5.27, stdev= 3.97, samples=128 write: IOPS=5, BW=80.8KiB/s (82.7kB/s)(6032KiB/74651msec); 0 zone resets clat (msec): min=44, max=485, avg=158.79, stdev=72.41 lat (msec): min=44, max=485, avg=158.79, stdev=72.41 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 75], 10.00th=[ 89], 20.00th=[ 103], | 30.00th=[ 114], 40.00th=[ 128], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 207], 90.00th=[ 255], 95.00th=[ 305], | 99.00th=[ 388], 99.50th=[ 460], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 24, max= 160, per=25.02%, avg=81.56, stdev=33.02, samples=145 iops : min= 1, max= 10, avg= 4.32, stdev= 2.13, samples=145 lat (msec) : 10=1.69%, 20=15.89%, 50=23.44%, 100=16.80%, 250=36.46% lat (msec) : 500=5.73% cpu : usr=0.04%, sys=1.21%, ctx=1339, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149265: Tue Mar 17 04:55:50 2026 read: IOPS=4, BW=78.7KiB/s (80.6kB/s)(6032KiB/76637msec) clat (msec): min=7, max=250, avg=37.88, stdev=34.54 lat (msec): min=7, max=250, avg=37.89, stdev=34.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 71], 95.00th=[ 122], | 99.00th=[ 184], 99.50th=[ 220], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 287, per=29.76%, avg=91.95, stdev=59.07, samples=128 iops : min= 1, max= 17, avg= 4.98, stdev= 3.76, samples=128 write: IOPS=5, BW=81.6KiB/s (83.6kB/s)(6256KiB/76637msec); 0 zone resets clat (msec): min=45, max=470, avg=158.57, stdev=68.44 lat (msec): min=45, max=470, avg=158.58, stdev=68.44 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 79], 10.00th=[ 87], 20.00th=[ 104], | 30.00th=[ 118], 40.00th=[ 129], 50.00th=[ 142], 60.00th=[ 157], | 70.00th=[ 180], 80.00th=[ 211], 90.00th=[ 249], 95.00th=[ 292], | 99.00th=[ 422], 99.50th=[ 468], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 23, max= 190, per=25.08%, avg=81.75, stdev=34.79, samples=150 iops : min= 1, max= 11, avg= 4.33, stdev= 2.25, samples=150 lat (msec) : 10=1.56%, 20=13.41%, 50=25.13%, 100=14.71%, 250=40.10% lat (msec) : 500=5.08% cpu : usr=0.04%, sys=1.22%, ctx=1273, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=310KiB/s (317kB/s), 74.3KiB/s-83.8KiB/s (76.1kB/s-85.8kB/s), io=23.4MiB (24.5MB), run=74651-77278msec WRITE: bw=326KiB/s (334kB/s), 80.8KiB/s-84.7KiB/s (82.7kB/s-86.7kB/s), io=24.6MiB (25.8MB), run=74651-77278msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149285: Tue Mar 17 04:56:17 2026 read: IOPS=0, BW=723KiB/s (740kB/s)(7168KiB/9915msec) clat (usec): min=766, max=4678.6k, avg=961961.83, stdev=1654536.41 lat (usec): min=767, max=4678.6k, avg=961963.05, stdev=1654536.30 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], | 20.00th=[ 299893], 30.00th=[ 304088], 40.00th=[ 304088], | 50.00th=[ 304088], 60.00th=[ 375391], 70.00th=[ 375391], | 80.00th=[ 775947], 90.00th=[4664067], 95.00th=[4664067], | 99.00th=[4664067], 99.50th=[4664067], 99.90th=[4664067], | 99.95th=[4664067], 99.99th=[4664067] bw ( KiB/s): min= 1408, max= 2031, per=100.00%, avg=1854.50, stdev=240.97, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=516KiB/s (529kB/s)(5120KiB/9915msec); 0 zone resets clat (msec): min=168, max=1203, avg=584.24, stdev=394.43 lat (msec): min=168, max=1203, avg=584.31, stdev=394.42 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1924, max= 2019, per=79.76%, avg=1978.75, stdev=39.98, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=8.33%, 500=41.67%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=4.93%, ctx=429, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149288: Tue Mar 17 04:56:17 2026 read: IOPS=0, BW=177KiB/s (182kB/s)(2048KiB/11552msec) clat (msec): min=357, max=554, avg=456.13, stdev=139.00 lat (msec): min=357, max=554, avg=456.14, stdev=139.00 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1747, max= 1961, per=100.00%, avg=1854.00, stdev=151.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=886KiB/s (908kB/s)(10.0MiB/11552msec); 0 zone resets clat (msec): min=150, max=5541, avg=1003.52, stdev=1633.81 lat (msec): min=150, max=5541, avg=1003.72, stdev=1633.78 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 230], | 30.00th=[ 268], 40.00th=[ 317], 50.00th=[ 355], 60.00th=[ 380], | 70.00th=[ 518], 80.00th=[ 1099], 90.00th=[ 1183], 95.00th=[ 5537], | 99.00th=[ 5537], 99.50th=[ 5537], 99.90th=[ 5537], 99.95th=[ 5537], | 99.99th=[ 5537] bw ( KiB/s): min= 1709, max= 4031, per=89.47%, avg=2219.71, stdev=810.28, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, 2000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=4.53%, ctx=192, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149291: Tue Mar 17 04:56:17 2026 read: IOPS=0, BW=656KiB/s (672kB/s)(6144KiB/9367msec) clat (usec): min=308, max=652281, avg=188434.19, stdev=266302.99 lat (usec): min=308, max=652281, avg=188435.22, stdev=266302.84 clat percentiles (usec): | 1.00th=[ 310], 5.00th=[ 310], 10.00th=[ 310], 20.00th=[ 490], | 30.00th=[ 490], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[119014], | 70.00th=[358613], 80.00th=[358613], 90.00th=[650118], 95.00th=[650118], | 99.00th=[650118], 99.50th=[650118], 99.90th=[650118], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 1747, max= 4039, per=100.00%, avg=2425.50, stdev=1080.61, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=656KiB/s (672kB/s)(6144KiB/9367msec); 0 zone resets clat (msec): min=323, max=4973, avg=1267.92, stdev=1836.60 lat (msec): min=323, max=4974, avg=1268.08, stdev=1836.55 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 485], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 1747, max= 2048, per=78.73%, avg=1953.40, stdev=119.79, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=8.33%, 500=41.67%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.18%, ctx=113, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149292: Tue Mar 17 04:56:17 2026 read: IOPS=0, BW=476KiB/s (488kB/s)(5120KiB/10751msec) clat (usec): min=581, max=689338, avg=394302.83, stdev=355859.44 lat (usec): min=582, max=689340, avg=394303.87, stdev=355859.39 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 11863], 40.00th=[ 11863], 50.00th=[599786], 60.00th=[599786], | 70.00th=[666895], 80.00th=[666895], 90.00th=[692061], 95.00th=[692061], | 99.00th=[692061], 99.50th=[692061], 99.90th=[692061], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 1747, max= 3878, per=100.00%, avg=2516.33, stdev=1182.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=667KiB/s (683kB/s)(7168KiB/10751msec); 0 zone resets clat (msec): min=201, max=4621, avg=1161.76, stdev=1558.06 lat (msec): min=202, max=4621, avg=1161.86, stdev=1558.04 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 296], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 609], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 1011], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 1709, max= 2031, per=78.32%, avg=1943.00, stdev=117.72, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=8.33%, 500=16.67%, 750=33.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=4.03%, ctx=119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1773KiB/s (1815kB/s), 177KiB/s-723KiB/s (182kB/s-740kB/s), io=20.0MiB (20.0MB), run=9367-11552msec WRITE: bw=2482KiB/s (2542kB/s), 516KiB/s-886KiB/s (529kB/s-908kB/s), io=28.0MiB (29.4MB), run=9367-11552msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149286: Tue Mar 17 04:56:17 2026 read: IOPS=0, BW=748KiB/s (766kB/s)(7168KiB/9588msec) clat (msec): min=120, max=4265, avg=826.40, stdev=1523.20 lat (msec): min=120, max=4265, avg=826.40, stdev=1523.20 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 126], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 215], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 485], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 1861, max= 3938, per=100.00%, avg=2650.00, stdev=948.16, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=534KiB/s (547kB/s)(5120KiB/9588msec); 0 zone resets clat (msec): min=455, max=1331, avg=749.58, stdev=362.76 lat (msec): min=455, max=1331, avg=749.68, stdev=362.75 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1973, max= 2027, per=82.85%, avg=2008.40, stdev=22.33, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.16%, ctx=54, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149287: Tue Mar 17 04:56:17 2026 read: IOPS=0, BW=183KiB/s (187kB/s)(2048KiB/11219msec) clat (msec): min=140, max=848, avg=494.53, stdev=500.52 lat (msec): min=140, max=848, avg=494.53, stdev=500.52 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1442, max= 1793, per=93.44%, avg=1617.50, stdev=248.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=913KiB/s (935kB/s)(10.0MiB/11219msec); 0 zone resets clat (msec): min=246, max=5148, avg=1003.55, stdev=1500.87 lat (msec): min=247, max=5148, avg=1003.63, stdev=1500.86 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 296], | 30.00th=[ 317], 40.00th=[ 401], 50.00th=[ 498], 60.00th=[ 502], | 70.00th=[ 527], 80.00th=[ 584], 90.00th=[ 1519], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 1861, max= 4055, per=92.80%, avg=2249.38, stdev=732.27, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 250=16.67%, 500=33.33%, 750=25.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.32%, ctx=70, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149289: Tue Mar 17 04:56:17 2026 read: IOPS=0, BW=520KiB/s (532kB/s)(6144KiB/11826msec) clat (msec): min=139, max=1225, avg=454.25, stdev=398.02 lat (msec): min=139, max=1225, avg=454.25, stdev=398.02 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 435], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1865, max= 2019, per=100.00%, avg=1974.40, stdev=63.76, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=520KiB/s (532kB/s)(6144KiB/11826msec); 0 zone resets clat (msec): min=328, max=5054, avg=1446.53, stdev=1802.97 lat (msec): min=329, max=5055, avg=1446.66, stdev=1802.95 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 1099], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 5067], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 1793, max= 2019, per=80.58%, avg=1953.20, stdev=95.14, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=16.67%, 500=41.67%, 750=8.33%, 2000=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=1.46%, ctx=68, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149290: Tue Mar 17 04:56:17 2026 read: IOPS=0, BW=492KiB/s (504kB/s)(5120KiB/10409msec) clat (msec): min=182, max=947, avg=393.95, stdev=320.78 lat (msec): min=182, max=947, avg=393.95, stdev=320.78 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1793, max= 4000, per=100.00%, avg=2551.33, stdev=1255.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=689KiB/s (705kB/s)(7168KiB/10409msec); 0 zone resets clat (msec): min=305, max=5342, avg=1157.88, stdev=1855.13 lat (msec): min=305, max=5342, avg=1158.64, stdev=1854.79 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 347], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 384], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 869], 90.00th=[ 5336], 95.00th=[ 5336], | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], | 99.99th=[ 5336] bw ( KiB/s): min= 1484, max= 4087, per=95.44%, avg=2313.40, stdev=1016.42, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.55%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1732KiB/s (1773kB/s), 183KiB/s-748KiB/s (187kB/s-766kB/s), io=20.0MiB (20.0MB), run=9588-11826msec WRITE: bw=2424KiB/s (2483kB/s), 520KiB/s-913KiB/s (532kB/s-935kB/s), io=28.0MiB (29.4MB), run=9588-11826msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149300: Tue Mar 17 04:56:35 2026 read: IOPS=0, BW=3628KiB/s (3715kB/s)(12.0MiB/3387msec) clat (msec): min=1015, max=1159, avg=1099.87, stdev=75.23 lat (msec): min=1015, max=1159, avg=1099.87, stdev=75.23 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7787, max= 8126, per=100.00%, avg=7956.50, stdev=239.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=8.92%, ctx=201, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149301: Tue Mar 17 04:56:35 2026 read: IOPS=0, BW=1029KiB/s (1054kB/s)(4096KiB/3981msec) clat (nsec): min=1070.3M, max=1070.3M, avg=1070256520.00, stdev= 0.00 lat (nsec): min=1070.3M, max=1070.3M, avg=1070260010.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2058KiB/s (2107kB/s)(8192KiB/3981msec); 0 zone resets clat (msec): min=876, max=1780, avg=1328.54, stdev=639.40 lat (msec): min=876, max=1781, avg=1328.89, stdev=639.39 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.31%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149302: Tue Mar 17 04:56:35 2026 write: IOPS=0, BW=3015KiB/s (3088kB/s)(12.0MiB/4075msec); 0 zone resets clat (msec): min=492, max=1872, avg=1276.35, stdev=709.03 lat (msec): min=492, max=1874, avg=1277.17, stdev=709.58 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.44%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149304: Tue Mar 17 04:56:35 2026 write: IOPS=1, BW=4477KiB/s (4584kB/s)(12.0MiB/2745msec); 0 zone resets clat (msec): min=474, max=1225, avg=817.50, stdev=380.09 lat (msec): min=474, max=1228, avg=818.84, stdev=381.15 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8047, max= 8078, per=100.00%, avg=8062.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.15%, sys=6.67%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4116KiB/s (4214kB/s), 1029KiB/s-3628KiB/s (1054kB/s-3715kB/s), io=16.0MiB (16.8MB), run=3387-3981msec WRITE: bw=8041KiB/s (8234kB/s), 2058KiB/s-4477KiB/s (2107kB/s-4584kB/s), io=32.0MiB (33.6MB), run=2745-4075msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149303: Tue Mar 17 04:56:36 2026 read: IOPS=1, BW=7070KiB/s (7240kB/s)(12.0MiB/1738msec) clat (msec): min=368, max=731, avg=494.36, stdev=205.11 lat (msec): min=368, max=731, avg=494.36, stdev=205.11 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 6330, max= 8143, per=100.00%, avg=7236.50, stdev=1281.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=5.18%, ctx=39, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149305: Tue Mar 17 04:56:36 2026 read: IOPS=0, BW=851KiB/s (871kB/s)(4096KiB/4814msec) clat (nsec): min=1719.2M, max=1719.2M, avg=1719236336.00, stdev= 0.00 lat (nsec): min=1719.2M, max=1719.2M, avg=1719239312.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1702KiB/s (1743kB/s)(8192KiB/4814msec); 0 zone resets clat (msec): min=710, max=2157, avg=1433.99, stdev=1022.52 lat (msec): min=711, max=2157, avg=1434.29, stdev=1022.61 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.10%, sys=2.49%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149306: Tue Mar 17 04:56:36 2026 write: IOPS=0, BW=2584KiB/s (2646kB/s)(12.0MiB/4756msec); 0 zone resets clat (msec): min=508, max=2005, avg=1503.26, stdev=861.23 lat (msec): min=509, max=2005, avg=1503.61, stdev=861.28 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 1989], 50.00th=[ 1989], 60.00th=[ 1989], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 7892, max= 7922, per=100.00%, avg=7907.00, stdev=21.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.61%, ctx=44, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149307: Tue Mar 17 04:56:36 2026 write: IOPS=0, BW=4005KiB/s (4101kB/s)(12.0MiB/3068msec); 0 zone resets clat (msec): min=445, max=1373, avg=986.27, stdev=482.49 lat (msec): min=446, max=1373, avg=986.69, stdev=482.57 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7953, max= 7984, per=100.00%, avg=7968.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.60%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3403KiB/s (3485kB/s), 851KiB/s-7070KiB/s (871kB/s-7240kB/s), io=16.0MiB (16.8MB), run=1738-4814msec WRITE: bw=6807KiB/s (6970kB/s), 1702KiB/s-4005KiB/s (1743kB/s-4101kB/s), io=32.0MiB (33.6MB), run=3068-4814msec