== sanity test 398b: DIO and buffer IO race ============== 14:54:34 (1779994474) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.03178 s, 10.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145146: Thu May 28 14:56:58 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5992KiB/126691msec) clat (usec): min=30, max=706467, avg=41523.68, stdev=36982.74 lat (usec): min=31, max=706468, avg=41527.98, stdev=36983.44 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 55], 10.00th=[ 103], 20.00th=[ 18482], | 30.00th=[ 23987], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 60556], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[166724], 99.50th=[225444], 99.90th=[308282], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 11, max= 103, per=25.15%, avg=47.28, stdev=18.57, samples=246 iops : min= 2, max= 25, avg=11.18, stdev= 4.66, samples=246 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6296KiB/126691msec); 0 zone resets clat (usec): min=1014, max=564516, avg=40650.14, stdev=43820.22 lat (usec): min=1015, max=564518, avg=40652.74, stdev=43820.58 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1860], 20.00th=[ 4424], | 30.00th=[ 9372], 40.00th=[ 20317], 50.00th=[ 31327], 60.00th=[ 42206], | 70.00th=[ 53740], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[175113], 99.50th=[225444], 99.90th=[471860], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 119, per=25.06%, avg=49.36, stdev=21.22, samples=248 iops : min= 1, max= 29, avg=11.71, stdev= 5.33, samples=248 lat (usec) : 50=0.72%, 100=4.10%, 250=0.39%, 500=0.10% lat (msec) : 2=5.47%, 4=4.13%, 10=6.61%, 20=9.70%, 50=37.89% lat (msec) : 100=24.61%, 250=5.96%, 500=0.26%, 750=0.07% cpu : usr=0.07%, sys=5.19%, ctx=6490, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145148: Thu May 28 14:56:58 2026 read: IOPS=11, BW=46.9KiB/s (48.0kB/s)(5940KiB/126645msec) clat (usec): min=27, max=647057, avg=41427.90, stdev=35464.60 lat (usec): min=27, max=647060, avg=41433.02, stdev=35468.37 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 56], 10.00th=[ 1614], 20.00th=[ 18482], | 30.00th=[ 23987], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[147850], 99.50th=[187696], 99.90th=[299893], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 117, per=24.81%, avg=46.64, stdev=20.24, samples=247 iops : min= 1, max= 29, avg=11.02, stdev= 5.10, samples=247 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6348KiB/126645msec); 0 zone resets clat (usec): min=1093, max=381934, avg=40690.74, stdev=42299.25 lat (usec): min=1094, max=381936, avg=40692.51, stdev=42299.38 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1680], 20.00th=[ 4555], | 30.00th=[ 8979], 40.00th=[ 19268], 50.00th=[ 30016], 60.00th=[ 40633], | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[122160], | 99.00th=[175113], 99.50th=[217056], 99.90th=[346031], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 127, per=25.26%, avg=49.77, stdev=21.11, samples=247 iops : min= 1, max= 31, avg=11.81, stdev= 5.31, samples=247 lat (usec) : 50=0.75%, 100=3.55%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.99%, 4=3.65%, 10=7.06%, 20=10.48%, 50=36.33% lat (msec) : 100=25.20%, 250=6.22%, 500=0.29%, 750=0.03% cpu : usr=0.06%, sys=5.11%, ctx=6591, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145150: Thu May 28 14:56:58 2026 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6028KiB/127045msec) clat (usec): min=28, max=285382, avg=40149.28, stdev=32264.14 lat (usec): min=28, max=285383, avg=40153.07, stdev=32263.81 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 322], 20.00th=[ 18482], | 30.00th=[ 23462], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[208667], 99.90th=[265290], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 103, per=25.33%, avg=47.63, stdev=20.28, samples=246 iops : min= 1, max= 25, avg=11.27, stdev= 5.11, samples=246 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6260KiB/127045msec); 0 zone resets clat (usec): min=1085, max=768231, avg=42192.17, stdev=47493.43 lat (usec): min=1086, max=768233, avg=42199.05, stdev=47491.02 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1827], 20.00th=[ 4621], | 30.00th=[ 10028], 40.00th=[ 19268], 50.00th=[ 31589], 60.00th=[ 41681], | 70.00th=[ 54789], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[179307], 99.50th=[235930], 99.90th=[417334], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 103, per=24.73%, avg=48.72, stdev=19.43, samples=249 iops : min= 1, max= 25, avg=11.55, stdev= 4.89, samples=249 lat (usec) : 50=1.14%, 100=3.52%, 250=0.20%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.44%, 4=3.91%, 10=6.38%, 20=11.00%, 50=37.96% lat (msec) : 100=23.14%, 250=6.84%, 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=5.21%, ctx=6590, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145151: Thu May 28 14:56:58 2026 read: IOPS=11, BW=47.5KiB/s (48.6kB/s)(6052KiB/127431msec) clat (usec): min=32, max=275838, avg=42043.57, stdev=32100.50 lat (usec): min=33, max=275839, avg=42045.16, stdev=32100.57 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 10159], 20.00th=[ 19530], | 30.00th=[ 24773], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[164627], 99.50th=[196084], 99.90th=[244319], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 133, per=25.40%, avg=47.76, stdev=20.03, samples=247 iops : min= 1, max= 33, avg=11.30, stdev= 5.04, samples=247 write: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6236KiB/127431msec); 0 zone resets clat (usec): min=1065, max=654958, avg=40643.15, stdev=42161.48 lat (usec): min=1065, max=654960, avg=40649.65, stdev=42169.83 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 2008], 20.00th=[ 4817], | 30.00th=[ 9634], 40.00th=[ 20841], 50.00th=[ 31589], 60.00th=[ 42206], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[111674], | 99.00th=[168821], 99.50th=[214959], 99.90th=[287310], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 135, per=24.55%, avg=48.36, stdev=19.79, samples=251 iops : min= 1, max= 33, avg=11.46, stdev= 4.98, samples=251 lat (usec) : 50=0.98%, 100=3.06%, 250=0.23%, 500=0.13%, 1000=0.07% lat (msec) : 2=5.05%, 4=3.74%, 10=7.06%, 20=9.90%, 50=37.86% lat (msec) : 100=25.91%, 250=5.86%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.21%, ctx=6669, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (193kB/s), 46.9KiB/s-47.5KiB/s (48.0kB/s-48.6kB/s), io=23.4MiB (24.6MB), run=126645-127431msec WRITE: bw=197KiB/s (202kB/s), 48.9KiB/s-50.1KiB/s (50.1kB/s-51.3kB/s), io=24.6MiB (25.7MB), run=126645-127431msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145144: Thu May 28 14:59:15 2026 read: IOPS=5, BW=22.9KiB/s (23.4kB/s)(5992KiB/262204msec) clat (msec): min=4, max=717, avg=37.52, stdev=40.63 lat (msec): min=4, max=717, avg=37.52, stdev=40.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 77], 95.00th=[ 106], | 99.00th=[ 186], 99.50th=[ 243], 99.90th=[ 380], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 111, per=28.03%, avg=25.23, stdev=16.87, samples=459 iops : min= 1, max= 27, avg= 5.68, stdev= 4.25, samples=459 write: IOPS=6, BW=24.0KiB/s (24.6kB/s)(6296KiB/262204msec); 0 zone resets clat (msec): min=36, max=637, avg=130.57, stdev=63.90 lat (msec): min=36, max=637, avg=130.57, stdev=63.90 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 131], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 211], 95.00th=[ 249], | 99.00th=[ 342], 99.50th=[ 401], 99.90th=[ 600], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 56, per=25.23%, avg=23.71, stdev=10.83, samples=511 iops : min= 1, max= 14, avg= 5.29, stdev= 2.78, samples=511 lat (msec) : 10=3.52%, 20=14.81%, 50=21.22%, 100=26.24%, 250=31.51% lat (msec) : 500=2.57%, 750=0.13% cpu : usr=0.03%, sys=1.39%, ctx=5455, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145145: Thu May 28 14:59:15 2026 read: IOPS=5, BW=22.4KiB/s (22.0kB/s)(5940KiB/264644msec) clat (msec): min=5, max=659, avg=38.36, stdev=40.23 lat (msec): min=5, max=659, avg=38.36, stdev=40.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 190], 99.50th=[ 236], 99.90th=[ 401], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 112, per=27.55%, avg=24.80, stdev=16.53, samples=462 iops : min= 1, max= 28, avg= 5.57, stdev= 4.19, samples=462 write: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6348KiB/264644msec); 0 zone resets clat (msec): min=39, max=632, avg=130.58, stdev=62.36 lat (msec): min=39, max=632, avg=130.58, stdev=62.36 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 211], 95.00th=[ 247], | 99.00th=[ 326], 99.50th=[ 363], 99.90th=[ 523], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 56, per=25.11%, avg=23.60, stdev=10.89, samples=518 iops : min= 1, max= 14, avg= 5.26, stdev= 2.79, samples=518 lat (msec) : 10=3.09%, 20=13.96%, 50=21.71%, 100=25.78%, 250=32.81% lat (msec) : 500=2.51%, 750=0.13% cpu : usr=0.04%, sys=1.38%, ctx=5517, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145147: Thu May 28 14:59:15 2026 read: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6028KiB/262894msec) clat (msec): min=5, max=380, avg=38.13, stdev=35.49 lat (msec): min=5, max=380, avg=38.13, stdev=35.49 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 79], 95.00th=[ 102], | 99.00th=[ 174], 99.50th=[ 243], 99.90th=[ 368], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 103, per=27.80%, avg=25.02, stdev=16.73, samples=466 iops : min= 1, max= 25, avg= 5.62, stdev= 4.20, samples=466 write: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6260KiB/262894msec); 0 zone resets clat (msec): min=33, max=774, avg=130.97, stdev=64.02 lat (msec): min=33, max=774, avg=130.98, stdev=64.02 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 131], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 249], | 99.00th=[ 342], 99.50th=[ 397], 99.90th=[ 542], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 55, per=24.87%, avg=23.38, stdev=10.99, samples=516 iops : min= 1, max= 13, avg= 5.21, stdev= 2.81, samples=516 lat (msec) : 10=3.16%, 20=13.51%, 50=21.97%, 100=27.44%, 250=31.22% lat (msec) : 500=2.60%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.35%, ctx=5439, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145149: Thu May 28 14:59:15 2026 read: IOPS=5, BW=22.0KiB/s (23.5kB/s)(6052KiB/263593msec) clat (msec): min=5, max=366, avg=36.38, stdev=34.48 lat (msec): min=5, max=366, avg=36.38, stdev=34.48 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 49], 90.00th=[ 74], 95.00th=[ 108], | 99.00th=[ 169], 99.50th=[ 203], 99.90th=[ 355], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 96, per=29.03%, avg=26.13, stdev=17.60, samples=448 iops : min= 1, max= 24, avg= 5.90, stdev= 4.46, samples=448 write: IOPS=5, BW=23.7KiB/s (24.2kB/s)(6236KiB/263593msec); 0 zone resets clat (msec): min=32, max=778, avg=133.46, stdev=69.63 lat (msec): min=32, max=778, avg=133.46, stdev=69.63 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 83], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 226], 95.00th=[ 257], | 99.00th=[ 359], 99.50th=[ 464], 99.90th=[ 693], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 55, per=24.91%, avg=23.42, stdev=10.62, samples=513 iops : min= 1, max= 13, avg= 5.22, stdev= 2.72, samples=513 lat (msec) : 10=3.52%, 20=14.52%, 50=22.53%, 100=24.61%, 250=31.61% lat (msec) : 500=3.09%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.36%, ctx=5538, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=90.7KiB/s (92.9kB/s), 22.4KiB/s-22.0KiB/s (22.0kB/s-23.5kB/s), io=23.4MiB (24.6MB), run=262204-264644msec WRITE: bw=94.0KiB/s (97.3kB/s), 23.7KiB/s-24.0KiB/s (24.2kB/s-24.6kB/s), io=24.6MiB (25.7MB), run=262204-264644msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145215: Thu May 28 14:59:53 2026 read: IOPS=15, BW=253KiB/s (259kB/s)(5920KiB/23415msec) clat (usec): min=33, max=139328, avg=33951.62, stdev=27579.10 lat (usec): min=33, max=139330, avg=33952.82, stdev=27579.12 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 91], | 30.00th=[ 19530], 40.00th=[ 26084], 50.00th=[ 32900], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[124257], 99.50th=[139461], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 126, max= 441, per=26.77%, avg=251.61, stdev=76.65, samples=46 iops : min= 7, max= 27, avg=14.96, stdev= 4.90, samples=46 write: IOPS=16, BW=272KiB/s (278kB/s)(6368KiB/23415msec); 0 zone resets clat (usec): min=1526, max=154994, avg=27203.13, stdev=26943.18 lat (usec): min=1528, max=154994, avg=27209.59, stdev=26941.19 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1893], 10.00th=[ 2704], 20.00th=[ 4424], | 30.00th=[ 6980], 40.00th=[ 10552], 50.00th=[ 17695], 60.00th=[ 26084], | 70.00th=[ 35914], 80.00th=[ 47973], 90.00th=[ 64750], 95.00th=[ 81265], | 99.00th=[126354], 99.50th=[135267], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 95, max= 446, per=27.42%, avg=271.15, stdev=78.14, samples=46 iops : min= 5, max= 27, avg=16.20, stdev= 4.94, samples=46 lat (usec) : 50=1.69%, 100=8.59%, 250=1.17%, 1000=0.26% lat (msec) : 2=3.26%, 4=6.25%, 10=11.07%, 20=8.72%, 50=37.63% lat (msec) : 100=19.79%, 250=1.56% cpu : usr=0.08%, sys=6.71%, ctx=1483, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145216: Thu May 28 14:59:53 2026 read: IOPS=14, BW=225KiB/s (231kB/s)(5744KiB/25479msec) clat (usec): min=36, max=150591, avg=34295.52, stdev=28280.94 lat (usec): min=37, max=150592, avg=34304.03, stdev=28282.76 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 92], | 30.00th=[ 18482], 40.00th=[ 27395], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 45876], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 80217], | 99.00th=[123208], 99.50th=[149947], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 31, max= 540, per=24.51%, avg=230.39, stdev=93.57, samples=49 iops : min= 1, max= 33, avg=13.61, stdev= 5.90, samples=49 write: IOPS=16, BW=257KiB/s (263kB/s)(6544KiB/25479msec); 0 zone resets clat (usec): min=1298, max=269571, avg=32084.03, stdev=37274.52 lat (usec): min=1300, max=269574, avg=32087.77, stdev=37273.27 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2089], 10.00th=[ 3097], 20.00th=[ 5014], | 30.00th=[ 8029], 40.00th=[ 11338], 50.00th=[ 17171], 60.00th=[ 27395], | 70.00th=[ 41157], 80.00th=[ 57410], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[210764], 99.50th=[233833], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 446, per=25.97%, avg=256.86, stdev=105.79, samples=50 iops : min= 3, max= 27, avg=15.26, stdev= 6.66, samples=50 lat (usec) : 50=1.30%, 100=8.46%, 250=1.43%, 500=0.52% lat (msec) : 2=2.47%, 4=4.82%, 10=12.11%, 20=10.68%, 50=32.81% lat (msec) : 100=22.27%, 250=2.99%, 500=0.13% cpu : usr=0.09%, sys=6.73%, ctx=1499, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145217: Thu May 28 14:59:53 2026 read: IOPS=15, BW=247KiB/s (253kB/s)(6256KiB/25363msec) clat (usec): min=36, max=151682, avg=34193.38, stdev=27989.96 lat (usec): min=37, max=151683, avg=34194.62, stdev=27989.98 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 100], | 30.00th=[ 19268], 40.00th=[ 26084], 50.00th=[ 31589], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 80217], | 99.00th=[122160], 99.50th=[149947], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 93, max= 500, per=26.65%, avg=250.55, stdev=94.36, samples=49 iops : min= 5, max= 31, avg=14.90, stdev= 5.97, samples=49 write: IOPS=14, BW=238KiB/s (244kB/s)(6032KiB/25363msec); 0 zone resets clat (usec): min=1423, max=169273, avg=31702.72, stdev=31492.37 lat (usec): min=1424, max=169275, avg=31704.86, stdev=31492.25 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1795], 10.00th=[ 2278], 20.00th=[ 4948], | 30.00th=[ 7373], 40.00th=[ 12387], 50.00th=[ 21890], 60.00th=[ 31851], | 70.00th=[ 42206], 80.00th=[ 58459], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[147850], 99.50th=[160433], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 63, max= 509, per=24.00%, avg=237.39, stdev=100.49, samples=49 iops : min= 3, max= 31, avg=14.08, stdev= 6.34, samples=49 lat (usec) : 50=2.08%, 100=8.07%, 250=1.69%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.91%, 4=4.82%, 10=9.64%, 20=8.59%, 50=35.55% lat (msec) : 100=23.05%, 250=2.34% cpu : usr=0.07%, sys=6.42%, ctx=1541, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145218: Thu May 28 14:59:53 2026 read: IOPS=15, BW=242KiB/s (247kB/s)(6032KiB/24977msec) clat (usec): min=33, max=157410, avg=34223.62, stdev=29603.26 lat (usec): min=33, max=157411, avg=34226.70, stdev=29601.07 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 69], | 30.00th=[ 15139], 40.00th=[ 26346], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 56361], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[127402], 99.50th=[145753], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 63, max= 505, per=26.33%, avg=247.48, stdev=96.71, samples=48 iops : min= 3, max= 31, avg=14.71, stdev= 6.11, samples=48 write: IOPS=15, BW=250KiB/s (256kB/s)(6256KiB/24977msec); 0 zone resets clat (usec): min=1462, max=293016, avg=30699.72, stdev=36900.17 lat (usec): min=1464, max=293018, avg=30707.20, stdev=36897.56 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1844], 10.00th=[ 2376], 20.00th=[ 4424], | 30.00th=[ 6783], 40.00th=[ 10028], 50.00th=[ 17957], 60.00th=[ 25560], | 70.00th=[ 39584], 80.00th=[ 52691], 90.00th=[ 70779], 95.00th=[ 95945], | 99.00th=[191890], 99.50th=[274727], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 63, max= 447, per=25.48%, avg=251.98, stdev=88.26, samples=49 iops : min= 3, max= 27, avg=14.98, stdev= 5.59, samples=49 lat (usec) : 50=1.69%, 100=9.77%, 250=1.56%, 500=0.26% lat (msec) : 2=3.65%, 4=5.73%, 10=11.07%, 20=8.85%, 50=33.59% lat (msec) : 100=21.09%, 250=2.47%, 500=0.26% cpu : usr=0.06%, sys=6.48%, ctx=1409, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=940KiB/s (963kB/s), 225KiB/s-253KiB/s (231kB/s-259kB/s), io=23.4MiB (24.5MB), run=23415-25479msec WRITE: bw=989KiB/s (1013kB/s), 238KiB/s-272KiB/s (244kB/s-278kB/s), io=24.6MiB (25.8MB), run=23415-25479msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145210: Thu May 28 15:00:35 2026 read: IOPS=5, BW=87.9KiB/s (90.0kB/s)(5920KiB/67340msec) clat (msec): min=8, max=278, avg=41.53, stdev=33.18 lat (msec): min=8, max=278, avg=41.53, stdev=33.18 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 80], 95.00th=[ 116], | 99.00th=[ 148], 99.50th=[ 230], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 286, per=26.63%, avg=94.01, stdev=56.48, samples=124 iops : min= 1, max= 17, avg= 5.13, stdev= 3.57, samples=124 write: IOPS=5, BW=94.6KiB/s (96.8kB/s)(6368KiB/67340msec); 0 zone resets clat (msec): min=41, max=351, avg=129.97, stdev=46.70 lat (msec): min=41, max=351, avg=129.97, stdev=46.70 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 92], | 30.00th=[ 103], 40.00th=[ 114], 50.00th=[ 124], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 165], 90.00th=[ 192], 95.00th=[ 218], | 99.00th=[ 268], 99.50th=[ 292], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 192, per=25.34%, avg=94.27, stdev=36.23, samples=133 iops : min= 1, max= 12, avg= 5.15, stdev= 2.35, samples=133 lat (msec) : 10=0.65%, 20=8.59%, 50=28.13%, 100=21.88%, 250=39.58% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.56%, ctx=1405, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145211: Thu May 28 15:00:35 2026 read: IOPS=5, BW=84.8KiB/s (86.8kB/s)(5744KiB/67735msec) clat (msec): min=7, max=218, avg=39.22, stdev=31.59 lat (msec): min=7, max=218, avg=39.22, stdev=31.59 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 55], 90.00th=[ 72], 95.00th=[ 97], | 99.00th=[ 199], 99.50th=[ 211], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 21, max= 318, per=27.00%, avg=95.31, stdev=58.76, samples=117 iops : min= 1, max= 19, avg= 5.22, stdev= 3.69, samples=117 write: IOPS=6, BW=96.6KiB/s (98.9kB/s)(6544KiB/67735msec); 0 zone resets clat (msec): min=45, max=448, avg=130.43, stdev=51.20 lat (msec): min=45, max=448, avg=130.43, stdev=51.20 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 75], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 197], 95.00th=[ 222], | 99.00th=[ 292], 99.50th=[ 342], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 192, per=25.63%, avg=95.33, stdev=35.40, samples=133 iops : min= 1, max= 12, avg= 5.22, stdev= 2.30, samples=133 lat (msec) : 10=1.30%, 20=13.15%, 50=21.48%, 100=25.00%, 250=37.89% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.42%, ctx=1349, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145212: Thu May 28 15:00:35 2026 read: IOPS=5, BW=93.8KiB/s (96.1kB/s)(6256KiB/66693msec) clat (msec): min=6, max=322, avg=40.29, stdev=35.79 lat (msec): min=6, max=322, avg=40.29, stdev=35.79 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 74], 95.00th=[ 118], | 99.00th=[ 182], 99.50th=[ 213], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 319, per=28.33%, avg=100.00, stdev=68.98, samples=123 iops : min= 1, max= 19, avg= 5.50, stdev= 4.35, samples=123 write: IOPS=5, BW=90.4KiB/s (92.6kB/s)(6032KiB/66693msec); 0 zone resets clat (msec): min=42, max=302, avg=134.89, stdev=48.32 lat (msec): min=42, max=302, avg=134.89, stdev=48.32 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 115], 50.00th=[ 127], 60.00th=[ 142], | 70.00th=[ 157], 80.00th=[ 176], 90.00th=[ 203], 95.00th=[ 226], | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 160, per=24.50%, avg=91.13, stdev=33.54, samples=129 iops : min= 1, max= 10, avg= 4.95, stdev= 2.15, samples=129 lat (msec) : 10=1.69%, 20=12.11%, 50=26.43%, 100=20.18%, 250=38.28% lat (msec) : 500=1.30% cpu : usr=0.04%, sys=1.51%, ctx=1436, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145213: Thu May 28 15:00:35 2026 read: IOPS=5, BW=91.0KiB/s (93.2kB/s)(6032KiB/66249msec) clat (msec): min=8, max=187, avg=40.30, stdev=29.59 lat (msec): min=8, max=187, avg=40.31, stdev=29.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 57], 90.00th=[ 74], 95.00th=[ 103], | 99.00th=[ 155], 99.50th=[ 163], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 22, max= 318, per=27.83%, avg=98.26, stdev=61.42, samples=121 iops : min= 1, max= 19, avg= 5.39, stdev= 3.83, samples=121 write: IOPS=5, BW=94.4KiB/s (96.7kB/s)(6256KiB/66249msec); 0 zone resets clat (msec): min=39, max=430, avg=130.00, stdev=50.22 lat (msec): min=39, max=430, avg=130.00, stdev=50.22 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 80], 20.00th=[ 91], | 30.00th=[ 100], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 197], 95.00th=[ 220], | 99.00th=[ 288], 99.50th=[ 359], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 31, max= 191, per=25.31%, avg=94.14, stdev=33.55, samples=131 iops : min= 1, max= 11, avg= 5.14, stdev= 2.18, samples=131 lat (msec) : 10=1.69%, 20=11.59%, 50=22.53%, 100=26.69%, 250=36.33% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.60%, ctx=1474, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=354KiB/s (362kB/s), 84.8KiB/s-93.8KiB/s (86.8kB/s-96.1kB/s), io=23.4MiB (24.5MB), run=66249-67735msec WRITE: bw=372KiB/s (381kB/s), 90.4KiB/s-96.6KiB/s (92.6kB/s-98.9kB/s), io=24.6MiB (25.8MB), run=66249-67735msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145233: Thu May 28 15:00:48 2026 read: IOPS=2, BW=2347KiB/s (2403kB/s)(7168KiB/3054msec) clat (usec): min=465, max=357306, avg=195293.73, stdev=116557.25 lat (usec): min=467, max=357308, avg=195295.23, stdev=116557.19 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[135267], | 30.00th=[139461], 40.00th=[139461], 50.00th=[198181], 60.00th=[252707], | 70.00th=[252707], 80.00th=[283116], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 2000, max= 4055, per=60.92%, avg=2981.00, stdev=1030.65, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1676KiB/s (1717kB/s)(5120KiB/3054msec); 0 zone resets clat (msec): min=249, max=432, avg=304.27, stdev=74.59 lat (msec): min=249, max=432, avg=304.38, stdev=74.57 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1984, max= 3992, per=38.94%, avg=2667.67, stdev=1147.11, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=58.33% cpu : usr=0.20%, sys=19.95%, ctx=269, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145234: Thu May 28 15:00:48 2026 read: IOPS=0, BW=489KiB/s (501kB/s)(2048KiB/4185msec) clat (usec): min=687, max=309595, avg=155141.66, stdev=218431.32 lat (usec): min=688, max=309598, avg=155143.54, stdev=218432.41 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[ 685], | 30.00th=[ 685], 40.00th=[ 685], 50.00th=[ 685], 60.00th=[308282], | 70.00th=[308282], 80.00th=[308282], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 1528, max= 1996, per=36.01%, avg=1762.00, stdev=330.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2447KiB/s (2506kB/s)(10.0MiB/4185msec); 0 zone resets clat (msec): min=107, max=674, avg=375.26, stdev=202.85 lat (msec): min=108, max=674, avg=375.78, stdev=203.26 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 131], | 30.00th=[ 186], 40.00th=[ 275], 50.00th=[ 284], 60.00th=[ 456], | 70.00th=[ 542], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1996, max= 3968, per=34.10%, avg=2336.17, stdev=799.51, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=16.42%, ctx=152, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145235: Thu May 28 15:00:48 2026 read: IOPS=1, BW=1930KiB/s (1976kB/s)(6144KiB/3184msec) clat (usec): min=937, max=243174, avg=107136.38, stdev=103308.35 lat (usec): min=939, max=243175, avg=107137.53, stdev=103308.11 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 938], 10.00th=[ 938], 20.00th=[ 955], | 30.00th=[ 955], 40.00th=[ 54789], 50.00th=[ 54789], 60.00th=[145753], | 70.00th=[196084], 80.00th=[196084], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 1996, max= 3968, per=54.25%, avg=2654.67, stdev=1137.38, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1930KiB/s (1976kB/s)(6144KiB/3184msec); 0 zone resets clat (msec): min=157, max=863, avg=391.28, stdev=264.17 lat (msec): min=157, max=863, avg=392.41, stdev=264.38 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 426], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1984, max= 2989, per=32.73%, avg=2242.25, stdev=497.88, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.06%, sys=14.17%, ctx=170, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145236: Thu May 28 15:00:48 2026 read: IOPS=1, BW=1700KiB/s (1741kB/s)(5120KiB/3011msec) clat (usec): min=387, max=340168, avg=105614.39, stdev=153154.30 lat (usec): min=388, max=340169, avg=105615.32, stdev=153154.53 clat percentiles (usec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 400], 40.00th=[ 400], 50.00th=[ 3064], 60.00th=[ 3064], | 70.00th=[183501], 80.00th=[183501], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 1984, max= 5988, per=81.46%, avg=3986.00, stdev=2831.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2381KiB/s (2438kB/s)(7168KiB/3011msec); 0 zone resets clat (msec): min=195, max=807, avg=348.79, stdev=207.83 lat (msec): min=195, max=807, avg=349.09, stdev=207.75 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 232], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 279], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 347], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1473, max= 4000, per=34.65%, avg=2374.00, stdev=1113.40, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=16.67% lat (msec) : 4=8.33%, 250=25.00%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=14.45%, ctx=131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4894KiB/s (5011kB/s), 489KiB/s-2347KiB/s (501kB/s-2403kB/s), io=20.0MiB (20.0MB), run=3011-4185msec WRITE: bw=6851KiB/s (7016kB/s), 1676KiB/s-2447KiB/s (1717kB/s-2506kB/s), io=28.0MiB (29.4MB), run=3011-4185msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145238: Thu May 28 15:00:48 2026 read: IOPS=1, BW=1909KiB/s (1955kB/s)(7168KiB/3754msec) clat (msec): min=106, max=677, avg=257.96, stdev=210.37 lat (msec): min=106, max=677, avg=257.96, stdev=210.37 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 115], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 138], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 363], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1732, max= 4023, per=43.91%, avg=2330.20, stdev=952.86, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1364KiB/s (1397kB/s)(5120KiB/3754msec); 0 zone resets clat (msec): min=184, max=728, avg=376.58, stdev=210.26 lat (msec): min=184, max=729, avg=376.72, stdev=210.40 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1992, max= 4031, per=44.97%, avg=3341.00, stdev=1168.37, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=5.52%, ctx=66, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145239: Thu May 28 15:00:48 2026 read: IOPS=0, BW=533KiB/s (546kB/s)(2048KiB/3841msec) clat (msec): min=136, max=178, avg=157.38, stdev=29.53 lat (msec): min=136, max=178, avg=157.38, stdev=29.53 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1765, max= 2015, per=35.61%, avg=1890.00, stdev=176.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2666KiB/s (2730kB/s)(10.0MiB/3841msec); 0 zone resets clat (msec): min=139, max=533, avg=345.49, stdev=140.97 lat (msec): min=139, max=533, avg=345.65, stdev=140.91 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 184], | 30.00th=[ 226], 40.00th=[ 255], 50.00th=[ 326], 60.00th=[ 376], | 70.00th=[ 430], 80.00th=[ 485], 90.00th=[ 506], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1889, max= 6047, per=40.26%, avg=2991.00, stdev=1699.10, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=6.98%, ctx=103, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145240: Thu May 28 15:00:48 2026 read: IOPS=1, BW=1690KiB/s (1731kB/s)(6144KiB/3635msec) clat (msec): min=61, max=333, avg=146.32, stdev=98.09 lat (msec): min=61, max=333, avg=146.32, stdev=98.09 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 102], 50.00th=[ 102], 60.00th=[ 144], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1992, max= 4031, per=47.27%, avg=2508.50, stdev=1015.03, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1690KiB/s (1731kB/s)(6144KiB/3635msec); 0 zone resets clat (msec): min=326, max=579, avg=438.36, stdev=91.84 lat (msec): min=326, max=579, avg=438.51, stdev=91.91 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 464], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1602, max= 2011, per=25.56%, avg=1898.80, stdev=172.99, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=4.76%, ctx=69, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145241: Thu May 28 15:00:48 2026 read: IOPS=1, BW=1327KiB/s (1359kB/s)(5120KiB/3859msec) clat (msec): min=45, max=287, avg=177.80, stdev=98.89 lat (msec): min=45, max=287, avg=177.80, stdev=98.89 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 4000, max= 4031, per=75.66%, avg=4015.50, stdev=21.92, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1857KiB/s (1902kB/s)(7168KiB/3859msec); 0 zone resets clat (msec): min=121, max=823, avg=419.94, stdev=244.43 lat (msec): min=121, max=823, avg=420.04, stdev=244.45 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 190], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 401], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 609], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1774, max= 4031, per=31.83%, avg=2364.60, stdev=936.99, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=4.80%, ctx=76, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5307KiB/s (5434kB/s), 533KiB/s-1909KiB/s (546kB/s-1955kB/s), io=20.0MiB (20.0MB), run=3635-3859msec WRITE: bw=7430KiB/s (7608kB/s), 1364KiB/s-2666KiB/s (1397kB/s-2730kB/s), io=28.0MiB (29.4MB), run=3635-3859msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145247: Thu May 28 15:01:01 2026 read: IOPS=0, BW=3614KiB/s (3701kB/s)(12.0MiB/3400msec) clat (msec): min=319, max=1509, avg=1061.09, stdev=647.22 lat (msec): min=319, max=1509, avg=1061.09, stdev=647.22 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.59%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145248: Thu May 28 15:01:01 2026 read: IOPS=0, BW=2624KiB/s (2687kB/s)(4096KiB/1561msec) clat (nsec): min=344238k, max=344238k, avg=344237671.00, stdev= 0.00 lat (nsec): min=344240k, max=344240k, avg=344240331.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 6410, max= 6410, per=100.00%, avg=6410.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5248KiB/s (5374kB/s)(8192KiB/1561msec); 0 zone resets clat (msec): min=567, max=587, avg=577.69, stdev=14.53 lat (msec): min=567, max=588, avg=578.03, stdev=14.50 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8175, max= 8175, per=67.46%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=7.69%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145249: Thu May 28 15:01:01 2026 write: IOPS=1, BW=6575KiB/s (6732kB/s)(12.0MiB/1869msec); 0 zone resets clat (msec): min=441, max=639, avg=567.58, stdev=109.14 lat (msec): min=442, max=639, avg=567.84, stdev=109.10 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7892, max= 8175, per=66.29%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.05%, sys=7.65%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145250: Thu May 28 15:01:01 2026 write: IOPS=1, BW=4544KiB/s (4653kB/s)(12.0MiB/2704msec); 0 zone resets clat (msec): min=391, max=1732, avg=855.56, stdev=760.27 lat (msec): min=392, max=1733, avg=856.14, stdev=760.03 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 6400, max= 8175, per=60.14%, avg=7287.50, stdev=1255.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.66%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4819KiB/s (4934kB/s), 2624KiB/s-3614KiB/s (2687kB/s-3701kB/s), io=16.0MiB (16.8MB), run=1561-3400msec WRITE: bw=11.8MiB/s (12.4MB/s), 4544KiB/s-6575KiB/s (4653kB/s-6732kB/s), io=32.0MiB (33.6MB), run=1561-2704msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145252: Thu May 28 15:01:02 2026 read: IOPS=1, BW=4428KiB/s (4534kB/s)(12.0MiB/2775msec) clat (msec): min=813, max=966, avg=881.15, stdev=77.59 lat (msec): min=813, max=966, avg=881.15, stdev=77.59 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.31%, ctx=388, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145253: Thu May 28 15:01:02 2026 read: IOPS=0, BW=1155KiB/s (1183kB/s)(4096KiB/3545msec) clat (nsec): min=1021.6M, max=1021.6M, avg=1021597936.00, stdev= 0.00 lat (nsec): min=1021.6M, max=1021.6M, avg=1021600568.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2311KiB/s (2366kB/s)(8192KiB/3545msec); 0 zone resets clat (msec): min=788, max=1638, avg=1213.40, stdev=600.54 lat (msec): min=789, max=1639, avg=1214.25, stdev=601.03 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8192, max= 8192, per=90.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.91%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145254: Thu May 28 15:01:02 2026 write: IOPS=0, BW=3395KiB/s (3477kB/s)(12.0MiB/3619msec); 0 zone resets clat (msec): min=414, max=1887, avg=1177.16, stdev=738.06 lat (msec): min=414, max=1893, avg=1179.36, stdev=740.49 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8094, max= 8192, per=89.94%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.14%, sys=3.18%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145255: Thu May 28 15:01:02 2026 write: IOPS=1, BW=4681KiB/s (4793kB/s)(12.0MiB/2625msec); 0 zone resets clat (msec): min=313, max=1188, avg=817.97, stdev=452.69 lat (msec): min=313, max=1190, avg=818.96, stdev=453.55 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8192, max= 8192, per=90.48%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.68%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4622KiB/s (4733kB/s), 1155KiB/s-4428KiB/s (1183kB/s-4534kB/s), io=16.0MiB (16.8MB), run=2775-3545msec WRITE: bw=9054KiB/s (9272kB/s), 2311KiB/s-4681KiB/s (2366kB/s-4793kB/s), io=32.0MiB (33.6MB), run=2625-3619msec