== sanity test 398b: DIO and buffer IO race ============== 05:32:42 (1773739962) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.94102 s, 10.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183501: Tue Mar 17 05:35:18 2026 read: IOPS=10, BW=43.8KiB/s (44.8kB/s)(5992KiB/136906msec) clat (usec): min=47, max=279369, avg=51508.72, stdev=34980.51 lat (usec): min=48, max=279370, avg=51510.74, stdev=34980.89 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 12125], 10.00th=[ 19006], 20.00th=[ 25822], | 30.00th=[ 31851], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[179307], 99.50th=[189793], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 95, per=25.00%, avg=43.51, stdev=17.24, samples=268 iops : min= 1, max= 23, avg=10.22, stdev= 4.37, samples=268 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6296KiB/136906msec); 0 zone resets clat (usec): min=1007, max=309362, avg=37837.35, stdev=38301.83 lat (usec): min=1009, max=309364, avg=37851.72, stdev=38306.60 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1467], 10.00th=[ 1975], 20.00th=[ 4883], | 30.00th=[ 8586], 40.00th=[ 17695], 50.00th=[ 27657], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 65274], 90.00th=[ 90702], 95.00th=[113771], | 99.00th=[156238], 99.50th=[179307], 99.90th=[250610], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=45.51, stdev=21.73, samples=269 iops : min= 1, max= 27, avg=10.72, stdev= 5.49, samples=269 lat (usec) : 50=0.10%, 100=1.73%, 250=0.07%, 750=0.03% lat (msec) : 2=5.18%, 4=3.84%, 10=7.62%, 20=8.63%, 50=38.25% lat (msec) : 100=26.40%, 250=8.04%, 500=0.13% cpu : usr=0.08%, sys=5.13%, ctx=6584, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183502: Tue Mar 17 05:35:18 2026 read: IOPS=10, BW=43.7KiB/s (44.7kB/s)(5940KiB/136006msec) clat (usec): min=42, max=375577, avg=50511.00, stdev=33241.61 lat (usec): min=43, max=375578, avg=50512.37, stdev=33241.66 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 12518], 10.00th=[ 19268], 20.00th=[ 25560], | 30.00th=[ 31065], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 51119], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[107480], | 99.00th=[166724], 99.50th=[183501], 99.90th=[274727], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 103, per=24.81%, avg=43.16, stdev=17.39, samples=268 iops : min= 1, max= 25, avg=10.13, stdev= 4.41, samples=268 write: IOPS=11, BW=46.7KiB/s (47.8kB/s)(6348KiB/136006msec); 0 zone resets clat (usec): min=1100, max=359766, avg=38297.66, stdev=40920.60 lat (usec): min=1102, max=359769, avg=38300.23, stdev=40920.52 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1385], 10.00th=[ 1680], 20.00th=[ 4490], | 30.00th=[ 8356], 40.00th=[ 16909], 50.00th=[ 26608], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 64750], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[179307], 99.50th=[223347], 99.90th=[325059], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 116, per=25.47%, avg=46.36, stdev=21.64, samples=267 iops : min= 1, max= 29, avg=10.94, stdev= 5.47, samples=267 lat (usec) : 50=0.20%, 100=1.73%, 250=0.03%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.12%, 4=3.52%, 10=7.65%, 20=8.04%, 50=37.76% lat (msec) : 100=27.15%, 250=7.55%, 500=0.16% cpu : usr=0.08%, sys=5.08%, ctx=6484, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183503: Tue Mar 17 05:35:18 2026 read: IOPS=10, BW=43.7KiB/s (44.8kB/s)(6028KiB/137786msec) clat (usec): min=40, max=326889, avg=50384.87, stdev=34889.72 lat (usec): min=40, max=326890, avg=50386.52, stdev=34889.75 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12256], 10.00th=[ 18482], 20.00th=[ 24249], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[173016], 99.50th=[196084], 99.90th=[278922], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 111, per=25.12%, avg=43.71, stdev=18.31, samples=269 iops : min= 1, max= 27, avg=10.28, stdev= 4.64, samples=269 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6260KiB/137786msec); 0 zone resets clat (usec): min=918, max=393239, avg=39410.79, stdev=41633.67 lat (usec): min=919, max=393241, avg=39415.05, stdev=41632.45 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1385], 10.00th=[ 1827], 20.00th=[ 4621], | 30.00th=[ 9110], 40.00th=[ 19530], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 66323], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[177210], 99.50th=[200279], 99.90th=[350225], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 143, per=24.75%, avg=45.04, stdev=21.83, samples=271 iops : min= 1, max= 35, avg=10.61, stdev= 5.51, samples=271 lat (usec) : 50=0.13%, 100=1.50%, 250=0.23%, 1000=0.13% lat (msec) : 2=5.50%, 4=3.52%, 10=7.03%, 20=8.33%, 50=38.57% lat (msec) : 100=26.60%, 250=8.24%, 500=0.23% cpu : usr=0.07%, sys=5.05%, ctx=6447, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183504: Tue Mar 17 05:35:18 2026 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6052KiB/137477msec) clat (usec): min=34, max=280048, avg=49827.07, stdev=32170.09 lat (usec): min=35, max=280050, avg=49828.73, stdev=32170.06 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9372], 10.00th=[ 18482], 20.00th=[ 25297], | 30.00th=[ 31327], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 60556], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[154141], 99.50th=[181404], 99.90th=[227541], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 103, per=25.17%, avg=43.80, stdev=18.16, samples=269 iops : min= 1, max= 25, avg=10.29, stdev= 4.57, samples=269 write: IOPS=11, BW=45.4KiB/s (46.4kB/s)(6236KiB/137478msec); 0 zone resets clat (usec): min=885, max=376777, avg=39728.90, stdev=42241.99 lat (usec): min=885, max=376781, avg=39731.24, stdev=42241.47 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1385], 10.00th=[ 1598], 20.00th=[ 4228], | 30.00th=[ 8979], 40.00th=[ 18220], 50.00th=[ 28181], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[181404], 99.50th=[202376], 99.90th=[346031], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 111, per=24.85%, avg=45.24, stdev=20.81, samples=268 iops : min= 1, max= 27, avg=10.65, stdev= 5.25, samples=268 lat (usec) : 50=0.39%, 100=1.66%, 250=0.20%, 750=0.03%, 1000=0.07% lat (msec) : 2=6.28%, 4=3.22%, 10=6.38%, 20=9.18%, 50=37.66% lat (msec) : 100=26.82%, 250=7.91%, 500=0.20% cpu : usr=0.08%, sys=5.02%, ctx=6569, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.7KiB/s-44.0KiB/s (44.7kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=136006-137786msec WRITE: bw=182KiB/s (187kB/s), 45.4KiB/s-46.7KiB/s (46.4kB/s-47.8kB/s), io=24.6MiB (25.7MB), run=136006-137786msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183495: Tue Mar 17 05:36:01 2026 read: IOPS=8, BW=33.7KiB/s (34.5kB/s)(5992KiB/177803msec) clat (msec): min=5, max=599, avg=46.06, stdev=43.84 lat (msec): min=5, max=599, avg=46.06, stdev=43.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 65], 90.00th=[ 103], 95.00th=[ 132], | 99.00th=[ 197], 99.50th=[ 222], 99.90th=[ 405], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 143, per=26.19%, avg=34.57, stdev=24.50, samples=337 iops : min= 1, max= 35, avg= 7.99, stdev= 6.16, samples=337 write: IOPS=8, BW=35.4KiB/s (36.3kB/s)(6296KiB/177803msec); 0 zone resets clat (msec): min=10, max=422, avg=68.84, stdev=48.92 lat (msec): min=10, max=422, avg=68.85, stdev=48.93 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 65], | 70.00th=[ 85], 80.00th=[ 105], 90.00th=[ 133], 95.00th=[ 165], | 99.00th=[ 245], 99.50th=[ 266], 99.90th=[ 355], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 111, per=25.43%, avg=35.35, stdev=22.83, samples=346 iops : min= 1, max= 27, avg= 8.18, stdev= 5.74, samples=346 lat (msec) : 10=1.99%, 20=13.74%, 50=43.39%, 100=24.45%, 250=15.92% lat (msec) : 500=0.49%, 750=0.03% cpu : usr=0.06%, sys=2.01%, ctx=4955, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183496: Tue Mar 17 05:36:01 2026 read: IOPS=8, BW=32.9KiB/s (33.7kB/s)(5940KiB/180588msec) clat (msec): min=5, max=819, avg=46.03, stdev=47.31 lat (msec): min=5, max=819, avg=46.03, stdev=47.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 101], 95.00th=[ 138], | 99.00th=[ 205], 99.50th=[ 234], 99.90th=[ 405], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 150, per=25.94%, avg=34.24, stdev=24.94, samples=336 iops : min= 1, max= 37, avg= 7.90, stdev= 6.28, samples=336 write: IOPS=8, BW=35.2KiB/s (35.0kB/s)(6348KiB/180588msec); 0 zone resets clat (msec): min=11, max=467, avg=70.44, stdev=52.87 lat (msec): min=11, max=467, avg=70.45, stdev=52.87 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 169], | 99.00th=[ 268], 99.50th=[ 321], 99.90th=[ 397], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 111, per=25.23%, avg=35.07, stdev=22.78, samples=350 iops : min= 1, max= 27, avg= 8.11, stdev= 5.71, samples=350 lat (msec) : 10=1.82%, 20=13.87%, 50=43.00%, 100=25.59%, 250=14.91% lat (msec) : 500=0.78%, 1000=0.03% cpu : usr=0.06%, sys=2.12%, ctx=5042, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183497: Tue Mar 17 05:36:01 2026 read: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6028KiB/179245msec) clat (msec): min=5, max=326, avg=46.21, stdev=42.24 lat (msec): min=5, max=326, avg=46.21, stdev=42.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 105], 95.00th=[ 133], | 99.00th=[ 203], 99.50th=[ 239], 99.90th=[ 284], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 135, per=25.96%, avg=34.27, stdev=23.99, samples=342 iops : min= 1, max= 33, avg= 7.92, stdev= 6.03, samples=342 write: IOPS=8, BW=34.9KiB/s (35.8kB/s)(6260KiB/179245msec); 0 zone resets clat (msec): min=9, max=849, avg=69.77, stdev=54.47 lat (msec): min=9, max=849, avg=69.78, stdev=54.47 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 251], 99.50th=[ 330], 99.90th=[ 422], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 6, max= 119, per=24.95%, avg=34.68, stdev=23.55, samples=351 iops : min= 1, max= 29, avg= 8.01, stdev= 5.91, samples=351 lat (msec) : 10=1.89%, 20=13.09%, 50=44.40%, 100=24.45%, 250=15.43% lat (msec) : 500=0.72%, 1000=0.03% cpu : usr=0.06%, sys=2.10%, ctx=5068, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183498: Tue Mar 17 05:36:01 2026 read: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6052KiB/180809msec) clat (msec): min=5, max=394, avg=45.78, stdev=44.43 lat (msec): min=5, max=394, avg=45.78, stdev=44.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 103], 95.00th=[ 142], | 99.00th=[ 215], 99.50th=[ 253], 99.90th=[ 347], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 135, per=26.28%, avg=34.68, stdev=24.97, samples=339 iops : min= 1, max= 33, avg= 8.02, stdev= 6.27, samples=339 write: IOPS=8, BW=34.5KiB/s (35.3kB/s)(6236KiB/180809msec); 0 zone resets clat (msec): min=11, max=834, avg=71.27, stdev=55.46 lat (msec): min=11, max=834, avg=71.27, stdev=55.46 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 109], 90.00th=[ 140], 95.00th=[ 171], | 99.00th=[ 262], 99.50th=[ 309], 99.90th=[ 472], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 112, per=25.04%, avg=34.80, stdev=23.16, samples=348 iops : min= 1, max= 28, avg= 8.05, stdev= 5.82, samples=348 lat (msec) : 10=2.08%, 20=14.03%, 50=43.55%, 100=23.60%, 250=15.89% lat (msec) : 500=0.81%, 1000=0.03% cpu : usr=0.06%, sys=2.03%, ctx=5049, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=133KiB/s (136kB/s), 32.9KiB/s-33.7KiB/s (33.7kB/s-34.5kB/s), io=23.4MiB (24.6MB), run=177803-180809msec WRITE: bw=139KiB/s (142kB/s), 34.5KiB/s-35.4KiB/s (35.3kB/s-36.3kB/s), io=24.6MiB (25.7MB), run=177803-180809msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183550: Tue Mar 17 05:36:55 2026 read: IOPS=9, BW=154KiB/s (157kB/s)(5920KiB/38526msec) clat (usec): min=38, max=210715, avg=56161.33, stdev=38933.69 lat (usec): min=39, max=210717, avg=56171.44, stdev=38932.93 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 67], 10.00th=[ 101], 20.00th=[ 26608], | 30.00th=[ 35390], 40.00th=[ 43254], 50.00th=[ 49546], 60.00th=[ 59507], | 70.00th=[ 70779], 80.00th=[ 83362], 90.00th=[106431], 95.00th=[137364], | 99.00th=[162530], 99.50th=[191890], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 288, per=25.28%, avg=151.44, stdev=72.38, samples=75 iops : min= 1, max= 18, avg= 8.65, stdev= 4.59, samples=75 write: IOPS=10, BW=165KiB/s (169kB/s)(6368KiB/38526msec); 0 zone resets clat (usec): min=1601, max=225361, avg=43647.00, stdev=43768.40 lat (usec): min=1601, max=225364, avg=43651.04, stdev=43767.44 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2040], 10.00th=[ 3654], 20.00th=[ 7308], | 30.00th=[ 11338], 40.00th=[ 16909], 50.00th=[ 27919], 60.00th=[ 40109], | 70.00th=[ 54264], 80.00th=[ 81265], 90.00th=[105382], 95.00th=[137364], | 99.00th=[191890], 99.50th=[204473], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 447, per=26.44%, avg=166.54, stdev=76.66, samples=74 iops : min= 1, max= 27, avg= 9.61, stdev= 4.82, samples=74 lat (usec) : 50=0.65%, 100=4.04%, 250=1.04%, 500=0.26% lat (msec) : 2=2.60%, 4=2.86%, 10=8.59%, 20=9.24%, 50=29.56% lat (msec) : 100=28.65%, 250=12.50% cpu : usr=0.05%, sys=5.02%, ctx=1668, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183551: Tue Mar 17 05:36:55 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5744KiB/39958msec) clat (usec): min=43, max=321037, avg=55581.34, stdev=40631.47 lat (usec): min=43, max=321039, avg=55585.54, stdev=40631.46 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 62], 10.00th=[ 83], 20.00th=[ 28181], | 30.00th=[ 35390], 40.00th=[ 43254], 50.00th=[ 51119], 60.00th=[ 57934], | 70.00th=[ 68682], 80.00th=[ 79168], 90.00th=[103285], 95.00th=[121111], | 99.00th=[189793], 99.50th=[246416], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 30, max= 320, per=24.07%, avg=144.18, stdev=65.97, samples=77 iops : min= 1, max= 20, avg= 8.19, stdev= 4.19, samples=77 write: IOPS=10, BW=164KiB/s (168kB/s)(6544KiB/39958msec); 0 zone resets clat (usec): min=1494, max=281576, avg=48592.10, stdev=48387.32 lat (usec): min=1497, max=281580, avg=48608.74, stdev=48396.08 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1893], 10.00th=[ 3294], 20.00th=[ 7242], | 30.00th=[ 14746], 40.00th=[ 23462], 50.00th=[ 34866], 60.00th=[ 46924], | 70.00th=[ 62653], 80.00th=[ 84411], 90.00th=[109577], 95.00th=[145753], | 99.00th=[217056], 99.50th=[238027], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 28, max= 410, per=25.78%, avg=162.41, stdev=79.12, samples=78 iops : min= 1, max= 25, avg= 9.33, stdev= 5.00, samples=78 lat (usec) : 50=0.26%, 100=5.21%, 250=0.26% lat (msec) : 2=3.39%, 4=3.52%, 10=6.51%, 20=7.29%, 50=29.95% lat (msec) : 100=31.64%, 250=11.59%, 500=0.39% cpu : usr=0.07%, sys=5.15%, ctx=1689, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183552: Tue Mar 17 05:36:55 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38777msec) clat (usec): min=38, max=347123, avg=54468.04, stdev=40801.66 lat (usec): min=39, max=347124, avg=54491.47, stdev=40804.35 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 25035], | 30.00th=[ 34341], 40.00th=[ 42206], 50.00th=[ 50594], 60.00th=[ 60031], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[101188], 95.00th=[116917], | 99.00th=[185598], 99.50th=[270533], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 413, per=27.27%, avg=163.36, stdev=66.62, samples=75 iops : min= 1, max= 25, avg= 9.41, stdev= 4.22, samples=75 write: IOPS=9, BW=156KiB/s (159kB/s)(6032KiB/38777msec); 0 zone resets clat (usec): min=1464, max=395708, avg=45601.33, stdev=48857.74 lat (usec): min=1467, max=395710, avg=45604.33, stdev=48857.64 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2008], 10.00th=[ 3851], 20.00th=[ 6259], | 30.00th=[ 11207], 40.00th=[ 20317], 50.00th=[ 31065], 60.00th=[ 41681], | 70.00th=[ 55313], 80.00th=[ 73925], 90.00th=[111674], 95.00th=[143655], | 99.00th=[189793], 99.50th=[256902], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 30, max= 416, per=24.62%, avg=155.08, stdev=79.23, samples=75 iops : min= 1, max= 26, avg= 8.87, stdev= 5.04, samples=75 lat (usec) : 50=0.78%, 100=5.60%, 250=1.17%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.47%, 4=2.99%, 10=8.33%, 20=7.16%, 50=28.39% lat (msec) : 100=30.99%, 250=11.33%, 500=0.52% cpu : usr=0.09%, sys=4.94%, ctx=1629, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183553: Tue Mar 17 05:36:55 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37952msec) clat (usec): min=41, max=235680, avg=54585.07, stdev=37643.47 lat (usec): min=41, max=235681, avg=54590.21, stdev=37638.40 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 64], 10.00th=[ 87], 20.00th=[ 27395], | 30.00th=[ 36439], 40.00th=[ 43779], 50.00th=[ 50594], 60.00th=[ 57410], | 70.00th=[ 66323], 80.00th=[ 82314], 90.00th=[101188], 95.00th=[120062], | 99.00th=[198181], 99.50th=[225444], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 31, max= 341, per=26.65%, avg=159.62, stdev=80.74, samples=73 iops : min= 1, max= 21, avg= 9.18, stdev= 5.16, samples=73 write: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37952msec); 0 zone resets clat (usec): min=1601, max=292498, avg=43280.21, stdev=44650.96 lat (usec): min=1604, max=292500, avg=43306.96, stdev=44659.34 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1958], 10.00th=[ 3326], 20.00th=[ 7767], | 30.00th=[ 12911], 40.00th=[ 20317], 50.00th=[ 29492], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 70779], 90.00th=[105382], 95.00th=[130548], | 99.00th=[204473], 99.50th=[246416], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 378, per=26.19%, avg=164.99, stdev=78.33, samples=74 iops : min= 1, max= 23, avg= 9.51, stdev= 4.98, samples=74 lat (usec) : 50=0.26%, 100=5.34%, 250=0.52% lat (msec) : 2=2.86%, 4=3.39%, 10=6.51%, 20=8.59%, 50=30.60% lat (msec) : 100=30.73%, 250=11.07%, 500=0.13% cpu : usr=0.07%, sys=5.18%, ctx=1657, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=599KiB/s (614kB/s), 144KiB/s-161KiB/s (147kB/s-165kB/s), io=23.4MiB (24.5MB), run=37952-39958msec WRITE: bw=631KiB/s (646kB/s), 156KiB/s-165KiB/s (159kB/s-169kB/s), io=24.6MiB (25.8MB), run=37952-39958msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183545: Tue Mar 17 05:37:08 2026 read: IOPS=6, BW=112KiB/s (114kB/s)(5920KiB/52987msec) clat (msec): min=5, max=357, avg=56.05, stdev=57.02 lat (msec): min=5, max=357, avg=56.06, stdev=57.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 72], 90.00th=[ 125], 95.00th=[ 178], | 99.00th=[ 292], 99.50th=[ 313], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 29, max= 447, per=25.32%, avg=114.44, stdev=81.96, samples=100 iops : min= 1, max= 27, avg= 6.35, stdev= 5.17, samples=100 write: IOPS=7, BW=120KiB/s (123kB/s)(6368KiB/52987msec); 0 zone resets clat (msec): min=12, max=424, avg=80.58, stdev=59.63 lat (msec): min=12, max=424, avg=80.60, stdev=59.62 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 80], | 70.00th=[ 94], 80.00th=[ 115], 90.00th=[ 165], 95.00th=[ 197], | 99.00th=[ 296], 99.50th=[ 380], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 411, per=25.57%, avg=121.48, stdev=80.92, samples=102 iops : min= 1, max= 25, avg= 6.80, stdev= 5.13, samples=102 lat (msec) : 10=1.17%, 20=10.42%, 50=39.97%, 100=28.13%, 250=18.10% lat (msec) : 500=2.21% cpu : usr=0.04%, sys=1.78%, ctx=1239, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183546: Tue Mar 17 05:37:08 2026 read: IOPS=6, BW=109KiB/s (111kB/s)(5744KiB/52938msec) clat (msec): min=7, max=294, avg=54.82, stdev=51.95 lat (msec): min=7, max=294, avg=54.82, stdev=51.95 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 79], 90.00th=[ 129], 95.00th=[ 159], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 415, per=25.82%, avg=116.71, stdev=81.06, samples=96 iops : min= 1, max= 25, avg= 6.50, stdev= 5.09, samples=96 write: IOPS=7, BW=124KiB/s (127kB/s)(6544KiB/52938msec); 0 zone resets clat (msec): min=15, max=506, avg=81.12, stdev=58.37 lat (msec): min=15, max=506, avg=81.12, stdev=58.37 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 52], 50.00th=[ 64], 60.00th=[ 79], | 70.00th=[ 99], 80.00th=[ 121], 90.00th=[ 165], 95.00th=[ 188], | 99.00th=[ 243], 99.50th=[ 259], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 28, max= 477, per=25.86%, avg=122.83, stdev=85.68, samples=104 iops : min= 1, max= 29, avg= 6.88, stdev= 5.41, samples=104 lat (msec) : 10=0.65%, 20=10.16%, 50=40.89%, 100=25.91%, 250=21.09% lat (msec) : 500=1.17%, 750=0.13% cpu : usr=0.03%, sys=1.82%, ctx=1205, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183547: Tue Mar 17 05:37:08 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(6256KiB/52565msec) clat (msec): min=6, max=394, avg=55.48, stdev=53.19 lat (msec): min=6, max=394, avg=55.48, stdev=53.19 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 63], 80.00th=[ 86], 90.00th=[ 118], 95.00th=[ 159], | 99.00th=[ 255], 99.50th=[ 363], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 29, max= 670, per=27.18%, avg=122.87, stdev=102.54, samples=100 iops : min= 1, max= 41, avg= 6.87, stdev= 6.43, samples=100 write: IOPS=7, BW=115KiB/s (118kB/s)(6032KiB/52565msec); 0 zone resets clat (msec): min=15, max=315, avg=81.42, stdev=55.94 lat (msec): min=15, max=315, avg=81.43, stdev=55.94 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 66], 60.00th=[ 75], | 70.00th=[ 96], 80.00th=[ 122], 90.00th=[ 169], 95.00th=[ 197], | 99.00th=[ 262], 99.50th=[ 288], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 351, per=24.75%, avg=117.58, stdev=76.15, samples=100 iops : min= 1, max= 21, avg= 6.55, stdev= 4.81, samples=100 lat (msec) : 10=1.17%, 20=12.11%, 50=38.15%, 100=27.86%, 250=19.40% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.79%, ctx=1293, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183548: Tue Mar 17 05:37:08 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/52053msec) clat (msec): min=7, max=292, avg=53.68, stdev=46.80 lat (msec): min=7, max=292, avg=53.68, stdev=46.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 84], 90.00th=[ 112], 95.00th=[ 155], | 99.00th=[ 234], 99.50th=[ 288], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 28, max= 478, per=26.21%, avg=118.47, stdev=87.16, samples=99 iops : min= 1, max= 29, avg= 6.61, stdev= 5.49, samples=99 write: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52053msec); 0 zone resets clat (msec): min=14, max=328, avg=80.88, stdev=59.07 lat (msec): min=14, max=328, avg=80.89, stdev=59.07 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 63], 60.00th=[ 77], | 70.00th=[ 91], 80.00th=[ 116], 90.00th=[ 163], 95.00th=[ 218], | 99.00th=[ 296], 99.50th=[ 305], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 415, per=25.30%, avg=120.18, stdev=84.32, samples=102 iops : min= 1, max= 25, avg= 6.72, stdev= 5.30, samples=102 lat (msec) : 10=1.04%, 20=10.68%, 50=39.45%, 100=29.04%, 250=18.10% lat (msec) : 500=1.69% cpu : usr=0.06%, sys=1.82%, ctx=1269, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=452KiB/s (463kB/s), 109KiB/s-119KiB/s (111kB/s-122kB/s), io=23.4MiB (24.5MB), run=52053-52987msec WRITE: bw=476KiB/s (487kB/s), 115KiB/s-124KiB/s (118kB/s-127kB/s), io=24.6MiB (25.8MB), run=52053-52987msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183568: Tue Mar 17 05:37:22 2026 read: IOPS=1, BW=1647KiB/s (1687kB/s)(7168KiB/4352msec) clat (msec): min=90, max=987, avg=314.09, stdev=315.39 lat (msec): min=90, max=987, avg=314.09, stdev=315.39 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 125], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 176], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 376], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1943, max= 4096, per=55.31%, avg=2413.20, stdev=941.61, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=1, BW=1176KiB/s (1205kB/s)(5120KiB/4352msec); 0 zone resets clat (msec): min=190, max=646, avg=398.41, stdev=217.93 lat (msec): min=190, max=646, avg=398.49, stdev=217.92 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2019, max= 4071, per=44.41%, avg=2712.67, stdev=1176.44, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.65%, ctx=87, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183569: Tue Mar 17 05:37:22 2026 read: IOPS=0, BW=436KiB/s (447kB/s)(2048KiB/4694msec) clat (msec): min=138, max=218, avg=178.65, stdev=56.26 lat (msec): min=138, max=218, avg=178.65, stdev=56.26 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1889, max= 2019, per=44.79%, avg=1954.00, stdev=91.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2182KiB/s (2234kB/s)(10.0MiB/4694msec); 0 zone resets clat (msec): min=114, max=876, avg=418.40, stdev=252.53 lat (msec): min=115, max=876, avg=418.52, stdev=252.52 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 203], | 30.00th=[ 243], 40.00th=[ 313], 50.00th=[ 334], 60.00th=[ 342], | 70.00th=[ 363], 80.00th=[ 625], 90.00th=[ 768], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2019, max= 4055, per=42.36%, avg=2587.57, stdev=946.02, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=6.46%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183570: Tue Mar 17 05:37:22 2026 read: IOPS=1, BW=1615KiB/s (1653kB/s)(6144KiB/3805msec) clat (msec): min=100, max=339, avg=201.06, stdev=97.60 lat (msec): min=100, max=339, avg=201.06, stdev=97.60 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 236], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2019, max= 3886, per=57.21%, avg=2496.00, stdev=926.74, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1615KiB/s (1653kB/s)(6144KiB/3805msec); 0 zone resets clat (msec): min=128, max=932, avg=428.78, stdev=376.28 lat (msec): min=128, max=932, avg=428.87, stdev=376.26 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 275], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1943, max= 3864, per=40.46%, avg=2471.50, stdev=929.47, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 1000=16.67% cpu : usr=0.03%, sys=5.05%, ctx=70, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183571: Tue Mar 17 05:37:22 2026 read: IOPS=1, BW=1192KiB/s (1220kB/s)(5120KiB/4297msec) clat (msec): min=113, max=634, avg=330.96, stdev=216.96 lat (msec): min=113, max=634, avg=330.96, stdev=216.96 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 4023, max= 4071, per=92.76%, avg=4047.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1668KiB/s (1708kB/s)(7168KiB/4297msec); 0 zone resets clat (msec): min=158, max=783, avg=364.59, stdev=223.27 lat (msec): min=158, max=783, avg=364.68, stdev=223.24 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 215], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 245], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 506], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1368, max= 4087, per=38.65%, avg=2360.50, stdev=1189.00, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.10%, ctx=103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4363KiB/s (4468kB/s), 436KiB/s-1647KiB/s (447kB/s-1687kB/s), io=20.0MiB (20.0MB), run=3805-4694msec WRITE: bw=6108KiB/s (6255kB/s), 1176KiB/s-2182KiB/s (1205kB/s-2234kB/s), io=28.0MiB (29.4MB), run=3805-4694msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183573: Tue Mar 17 05:37:23 2026 read: IOPS=2, BW=2128KiB/s (2179kB/s)(7168KiB/3369msec) clat (usec): min=628, max=348333, avg=234342.78, stdev=118769.15 lat (usec): min=629, max=348335, avg=234344.45, stdev=118769.19 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[196084], | 30.00th=[202376], 40.00th=[202376], 50.00th=[258999], 60.00th=[299893], | 70.00th=[299893], 80.00th=[333448], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 1780, max= 4023, per=59.12%, avg=2699.25, stdev=1015.12, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1520KiB/s (1556kB/s)(5120KiB/3369msec); 0 zone resets clat (msec): min=228, max=458, avg=329.84, stdev=111.17 lat (msec): min=228, max=464, avg=331.16, stdev=112.97 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2043, max= 3737, per=40.82%, avg=2609.33, stdev=976.59, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=66.67% cpu : usr=0.00%, sys=18.74%, ctx=429, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183574: Tue Mar 17 05:37:23 2026 read: IOPS=0, BW=457KiB/s (468kB/s)(2048KiB/4485msec) clat (msec): min=238, max=246, avg=242.46, stdev= 6.19 lat (msec): min=238, max=246, avg=242.46, stdev= 6.19 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 1762, max= 1780, per=38.79%, avg=1771.00, stdev=12.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2283KiB/s (2338kB/s)(10.0MiB/4485msec); 0 zone resets clat (msec): min=87, max=675, avg=392.15, stdev=176.38 lat (msec): min=87, max=675, avg=392.45, stdev=176.50 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 209], | 30.00th=[ 279], 40.00th=[ 296], 50.00th=[ 372], 60.00th=[ 477], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 518], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1868, max= 4031, per=41.83%, avg=2674.00, stdev=1050.18, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=15.19%, ctx=185, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183575: Tue Mar 17 05:37:23 2026 read: IOPS=1, BW=1533KiB/s (1570kB/s)(6144KiB/4007msec) clat (usec): min=672, max=259081, avg=118497.40, stdev=115409.52 lat (usec): min=673, max=259083, avg=118498.83, stdev=115409.58 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 4228], | 30.00th=[ 4228], 40.00th=[ 43779], 50.00th=[ 43779], 60.00th=[187696], | 70.00th=[217056], 80.00th=[217056], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 1780, max= 6144, per=71.48%, avg=3264.00, stdev=2494.54, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1533KiB/s (1570kB/s)(6144KiB/4007msec); 0 zone resets clat (msec): min=202, max=1208, avg=534.97, stdev=440.30 lat (msec): min=202, max=1209, avg=535.26, stdev=440.16 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 347], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1868, max= 4096, per=48.58%, avg=3105.00, stdev=1134.19, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 50=8.33%, 250=33.33%, 500=25.00%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=14.00%, ctx=158, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183576: Tue Mar 17 05:37:23 2026 read: IOPS=1, BW=1219KiB/s (1248kB/s)(5120KiB/4200msec) clat (usec): min=555, max=346031, avg=106649.68, stdev=155890.15 lat (usec): min=557, max=346033, avg=106650.97, stdev=155890.40 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 635], 40.00th=[ 635], 50.00th=[ 725], 60.00th=[ 725], | 70.00th=[185598], 80.00th=[185598], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 1780, max= 6095, per=86.24%, avg=3937.50, stdev=3051.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1707KiB/s (1748kB/s)(7168KiB/4200msec); 0 zone resets clat (msec): min=138, max=1286, avg=512.40, stdev=416.88 lat (msec): min=138, max=1287, avg=512.73, stdev=417.33 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 167], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 321], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 793], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1659, max= 2031, per=29.25%, avg=1869.80, stdev=156.87, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=25.00% lat (msec) : 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.12%, ctx=99, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4566KiB/s (4676kB/s), 457KiB/s-2128KiB/s (468kB/s-2179kB/s), io=20.0MiB (20.0MB), run=3369-4485msec WRITE: bw=6393KiB/s (6546kB/s), 1520KiB/s-2283KiB/s (1556kB/s-2338kB/s), io=28.0MiB (29.4MB), run=3369-4485msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183582: Tue Mar 17 05:37:39 2026 read: IOPS=0, BW=3421KiB/s (3503kB/s)(12.0MiB/3592msec) clat (msec): min=660, max=1643, avg=1090.04, stdev=503.03 lat (msec): min=660, max=1643, avg=1090.04, stdev=503.03 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.65%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183583: Tue Mar 17 05:37:39 2026 read: IOPS=0, BW=1013KiB/s (1038kB/s)(4096KiB/4042msec) clat (nsec): min=1066.9M, max=1066.9M, avg=1066862919.00, stdev= 0.00 lat (nsec): min=1066.9M, max=1066.9M, avg=1066864689.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2027KiB/s (2075kB/s)(8192KiB/4042msec); 0 zone resets clat (msec): min=959, max=1748, avg=1354.24, stdev=557.90 lat (msec): min=959, max=1749, avg=1354.51, stdev=557.97 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8078, max= 8078, per=99.65%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.47%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183585: Tue Mar 17 05:37:39 2026 write: IOPS=1, BW=4126KiB/s (4225kB/s)(12.0MiB/2978msec); 0 zone resets clat (msec): min=410, max=1520, avg=899.65, stdev=566.70 lat (msec): min=411, max=1521, avg=899.89, stdev=566.64 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.64%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183586: Tue Mar 17 05:37:39 2026 write: IOPS=0, BW=3534KiB/s (3619kB/s)(12.0MiB/3477msec); 0 zone resets clat (msec): min=425, max=1502, avg=1067.00, stdev=567.60 lat (msec): min=425, max=1502, avg=1068.97, stdev=568.30 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.82%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4053KiB/s (4151kB/s), 1013KiB/s-3421KiB/s (1038kB/s-3503kB/s), io=16.0MiB (16.8MB), run=3592-4042msec WRITE: bw=8107KiB/s (8301kB/s), 2027KiB/s-4126KiB/s (2075kB/s-4225kB/s), io=32.0MiB (33.6MB), run=2978-4042msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183587: Tue Mar 17 05:37:40 2026 read: IOPS=1, BW=4312KiB/s (4415kB/s)(12.0MiB/2850msec) clat (msec): min=774, max=1017, avg=932.04, stdev=136.48 lat (msec): min=774, max=1017, avg=932.04, stdev=136.48 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7831, max= 7968, per=100.00%, avg=7899.50, stdev=96.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.85%, ctx=209, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183588: Tue Mar 17 05:37:40 2026 read: IOPS=0, BW=960KiB/s (983kB/s)(4096KiB/4267msec) clat (nsec): min=958505k, max=958505k, avg=958504945.00, stdev= 0.00 lat (nsec): min=958507k, max=958507k, avg=958507220.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7831, max= 7831, per=100.00%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1920KiB/s (1966kB/s)(8192KiB/4267msec); 0 zone resets clat (msec): min=439, max=2775, avg=1607.09, stdev=1651.85 lat (msec): min=439, max=2775, avg=1607.42, stdev=1651.84 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 2769], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.09%, sys=3.96%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183589: Tue Mar 17 05:37:40 2026 write: IOPS=0, BW=2842KiB/s (2911kB/s)(12.0MiB/4323msec); 0 zone resets clat (msec): min=489, max=2241, avg=1402.21, stdev=878.17 lat (msec): min=494, max=2244, avg=1404.53, stdev=877.33 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.15%, ctx=52, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183590: Tue Mar 17 05:37:40 2026 write: IOPS=0, BW=3270KiB/s (3348kB/s)(12.0MiB/3758msec); 0 zone resets clat (msec): min=475, max=2169, avg=1231.01, stdev=861.84 lat (msec): min=475, max=2169, avg=1231.36, stdev=861.64 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7787, max= 7787, per=100.00%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.90%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3840KiB/s (3932kB/s), 960KiB/s-4312KiB/s (983kB/s-4415kB/s), io=16.0MiB (16.8MB), run=2850-4267msec WRITE: bw=7580KiB/s (7762kB/s), 1920KiB/s-3270KiB/s (1966kB/s-3348kB/s), io=32.0MiB (33.6MB), run=3758-4323msec