== sanity test 398b: DIO and buffer IO race ============== 00:56:52 (1781240212) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.49414 s, 9.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146001: Fri Jun 12 00:59:16 2026 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(5992KiB/126374msec) clat (usec): min=33, max=865541, avg=40461.71, stdev=37402.56 lat (usec): min=33, max=865543, avg=40463.64, stdev=37402.02 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 57], 10.00th=[ 717], 20.00th=[ 18482], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[139461], 99.50th=[183501], 99.90th=[379585], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 112, per=24.84%, avg=46.95, stdev=20.75, samples=248 iops : min= 1, max= 28, avg=11.10, stdev= 5.25, samples=248 write: IOPS=12, BW=49.8KiB/s (51.0kB/s)(6296KiB/126374msec); 0 zone resets clat (usec): min=1085, max=467486, avg=41502.21, stdev=43338.96 lat (usec): min=1085, max=467487, avg=41509.13, stdev=43338.82 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 2040], 20.00th=[ 4752], | 30.00th=[ 10028], 40.00th=[ 19792], 50.00th=[ 30540], 60.00th=[ 41681], | 70.00th=[ 54264], 80.00th=[ 68682], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[183501], 99.50th=[217056], 99.90th=[375391], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 151, per=25.28%, avg=50.06, stdev=20.90, samples=245 iops : min= 1, max= 37, avg=11.88, stdev= 5.24, samples=245 lat (usec) : 50=0.52%, 100=3.58%, 250=0.55%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=5.14%, 4=3.87%, 10=6.67%, 20=11.23%, 50=36.98% lat (msec) : 100=24.67%, 250=6.32%, 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=5.45%, ctx=6517, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146004: Fri Jun 12 00:59:16 2026 read: IOPS=11, BW=46.9KiB/s (48.1kB/s)(5940KiB/126575msec) clat (usec): min=25, max=608237, avg=41923.35, stdev=34438.49 lat (usec): min=25, max=608238, avg=41931.18, stdev=34442.89 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 60], 10.00th=[ 10159], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[198181], 99.90th=[346031], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 144, per=24.65%, avg=46.59, stdev=21.05, samples=249 iops : min= 1, max= 36, avg=11.00, stdev= 5.31, samples=249 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6348KiB/126575msec); 0 zone resets clat (usec): min=1118, max=938267, avg=40268.11, stdev=46039.61 lat (usec): min=1118, max=938268, avg=40272.85, stdev=46037.02 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 2040], 20.00th=[ 4555], | 30.00th=[ 9241], 40.00th=[ 18220], 50.00th=[ 27657], 60.00th=[ 39584], | 70.00th=[ 54789], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[179307], 99.50th=[202376], 99.90th=[316670], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 192, per=25.22%, avg=49.94, stdev=22.17, samples=248 iops : min= 1, max= 48, avg=11.86, stdev= 5.61, samples=248 lat (usec) : 50=0.33%, 100=3.61%, 250=0.29%, 500=0.13%, 750=0.10% lat (msec) : 2=5.21%, 4=4.26%, 10=6.90%, 20=10.48%, 50=36.49% lat (msec) : 100=25.91%, 250=6.15%, 500=0.07%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.24%, ctx=6453, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146006: Fri Jun 12 00:59:16 2026 read: IOPS=11, BW=47.9KiB/s (49.0kB/s)(6028KiB/125854msec) clat (usec): min=30, max=379556, avg=40600.73, stdev=31561.74 lat (usec): min=30, max=379557, avg=40605.97, stdev=31560.23 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 865], 20.00th=[ 19268], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[145753], 99.50th=[179307], 99.90th=[316670], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 110, per=25.34%, avg=47.89, stdev=20.40, samples=245 iops : min= 1, max= 27, avg=11.34, stdev= 5.16, samples=245 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6260KiB/125854msec); 0 zone resets clat (usec): min=1145, max=1203.2k, avg=41073.29, stdev=51042.05 lat (usec): min=1146, max=1203.2k, avg=41079.34, stdev=51040.03 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1926], | 20.00th=[ 4817], 30.00th=[ 9110], 40.00th=[ 19268], | 50.00th=[ 29230], 60.00th=[ 40109], 70.00th=[ 52691], | 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[ 115868], | 99.00th=[ 181404], 99.50th=[ 219153], 99.90th=[ 392168], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 7, max= 114, per=24.95%, avg=49.41, stdev=21.02, samples=246 iops : min= 1, max= 28, avg=11.72, stdev= 5.32, samples=246 lat (usec) : 50=0.98%, 100=3.52%, 250=0.26%, 500=0.13%, 1000=0.03% lat (msec) : 2=5.47%, 4=3.19%, 10=7.81%, 20=10.09%, 50=37.86% lat (msec) : 100=24.38%, 250=5.99%, 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=5.20%, ctx=6400, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146007: Fri Jun 12 00:59:16 2026 read: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6052KiB/126044msec) clat (usec): min=32, max=995122, avg=41371.60, stdev=37986.45 lat (usec): min=33, max=995124, avg=41372.68, stdev=37986.46 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 9372], 20.00th=[ 19792], | 30.00th=[ 24773], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[149947], 99.50th=[173016], 99.90th=[229639], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 127, per=25.43%, avg=48.07, stdev=20.97, samples=246 iops : min= 1, max= 31, avg=11.38, stdev= 5.27, samples=246 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6236KiB/126044msec); 0 zone resets clat (usec): min=1080, max=336623, avg=40475.49, stdev=41662.85 lat (usec): min=1080, max=336624, avg=40477.24, stdev=41662.55 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1975], 20.00th=[ 4621], | 30.00th=[ 8717], 40.00th=[ 18482], 50.00th=[ 29492], 60.00th=[ 41157], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[189793], 99.50th=[212861], 99.90th=[267387], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 120, per=24.91%, avg=49.33, stdev=19.60, samples=247 iops : min= 1, max= 30, avg=11.70, stdev= 4.97, samples=247 lat (usec) : 50=1.11%, 100=3.03%, 250=0.33%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.37%, 4=4.39%, 10=6.90%, 20=9.86%, 50=38.18% lat (msec) : 100=24.61%, 250=5.92%, 500=0.10%, 1000=0.03% cpu : usr=0.05%, sys=5.42%, ctx=6501, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (194kB/s), 46.9KiB/s-48.0KiB/s (48.1kB/s-49.2kB/s), io=23.4MiB (24.6MB), run=125854-126575msec WRITE: bw=199KiB/s (203kB/s), 49.5KiB/s-50.2KiB/s (50.7kB/s-51.4kB/s), io=24.6MiB (25.7MB), run=125854-126575msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146002: Fri Jun 12 01:01:30 2026 read: IOPS=5, BW=23.0KiB/s (23.6kB/s)(5992KiB/260322msec) clat (msec): min=5, max=893, avg=36.31, stdev=42.96 lat (msec): min=5, max=893, avg=36.31, stdev=42.96 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 79], 95.00th=[ 103], | 99.00th=[ 169], 99.50th=[ 234], 99.90th=[ 518], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 87, per=27.64%, avg=25.43, stdev=17.03, samples=456 iops : min= 1, max= 21, avg= 5.74, stdev= 4.30, samples=456 write: IOPS=6, BW=24.2KiB/s (24.8kB/s)(6296KiB/260322msec); 0 zone resets clat (msec): min=37, max=588, avg=130.61, stdev=61.76 lat (msec): min=37, max=588, avg=130.62, stdev=61.76 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 115], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 220], 95.00th=[ 255], | 99.00th=[ 330], 99.50th=[ 355], 99.90th=[ 456], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 55, per=24.81%, avg=23.81, stdev=10.66, samples=510 iops : min= 1, max= 13, avg= 5.34, stdev= 2.74, samples=510 lat (msec) : 10=3.52%, 20=16.15%, 50=20.48%, 100=24.02%, 250=32.91% lat (msec) : 500=2.83%, 750=0.07%, 1000=0.03% cpu : usr=0.03%, sys=1.35%, ctx=5413, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146003: Fri Jun 12 01:01:30 2026 read: IOPS=5, BW=22.8KiB/s (23.3kB/s)(5940KiB/260556msec) clat (msec): min=5, max=1001, avg=36.72, stdev=45.64 lat (msec): min=5, max=1001, avg=36.72, stdev=45.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 83], 95.00th=[ 106], | 99.00th=[ 222], 99.50th=[ 288], 99.90th=[ 330], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 87, per=27.53%, avg=25.33, stdev=16.74, samples=453 iops : min= 1, max= 21, avg= 5.72, stdev= 4.23, samples=453 write: IOPS=6, BW=24.4KiB/s (24.9kB/s)(6348KiB/260556msec); 0 zone resets clat (msec): min=41, max=596, avg=129.61, stdev=61.31 lat (msec): min=41, max=596, avg=129.61, stdev=61.31 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 207], 95.00th=[ 245], | 99.00th=[ 334], 99.50th=[ 384], 99.90th=[ 584], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 48, per=25.08%, avg=24.08, stdev=10.78, samples=508 iops : min= 1, max= 12, avg= 5.41, stdev= 2.78, samples=508 lat (msec) : 10=3.45%, 20=16.05%, 50=20.41%, 100=25.26%, 250=32.19% lat (msec) : 500=2.51%, 750=0.10%, 2000=0.03% cpu : usr=0.03%, sys=1.36%, ctx=5535, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146005: Fri Jun 12 01:01:30 2026 read: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6028KiB/260563msec) clat (msec): min=5, max=527, avg=36.16, stdev=35.18 lat (msec): min=5, max=527, avg=36.16, stdev=35.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 72], 95.00th=[ 99], | 99.00th=[ 157], 99.50th=[ 211], 99.90th=[ 401], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 103, per=27.19%, avg=25.02, stdev=16.21, samples=465 iops : min= 1, max= 25, avg= 5.64, stdev= 4.07, samples=465 write: IOPS=6, BW=24.0KiB/s (24.6kB/s)(6260KiB/260563msec); 0 zone resets clat (msec): min=38, max=1175, avg=131.48, stdev=69.24 lat (msec): min=38, max=1175, avg=131.48, stdev=69.25 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 93], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 218], 95.00th=[ 259], | 99.00th=[ 351], 99.50th=[ 384], 99.90th=[ 600], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 56, per=24.88%, avg=23.89, stdev=10.67, samples=505 iops : min= 1, max= 14, avg= 5.36, stdev= 2.75, samples=505 lat (msec) : 10=2.47%, 20=15.85%, 50=21.52%, 100=26.60%, 250=30.31% lat (msec) : 500=3.16%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.42%, ctx=5481, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146008: Fri Jun 12 01:01:30 2026 read: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6052KiB/259610msec) clat (msec): min=5, max=395, avg=36.37, stdev=36.72 lat (msec): min=5, max=395, avg=36.38, stdev=36.74 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 79], 95.00th=[ 103], | 99.00th=[ 188], 99.50th=[ 222], 99.90th=[ 351], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 95, per=27.91%, avg=25.68, stdev=17.63, samples=456 iops : min= 1, max= 23, avg= 5.81, stdev= 4.47, samples=456 write: IOPS=6, BW=24.0KiB/s (24.6kB/s)(6236KiB/259610msec); 0 zone resets clat (msec): min=34, max=1101, avg=130.99, stdev=66.12 lat (msec): min=34, max=1101, avg=130.99, stdev=66.12 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 218], 95.00th=[ 253], | 99.00th=[ 338], 99.50th=[ 384], 99.90th=[ 542], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 56, per=24.79%, avg=23.79, stdev=10.63, samples=505 iops : min= 1, max= 14, avg= 5.34, stdev= 2.72, samples=505 lat (msec) : 10=3.29%, 20=16.15%, 50=20.80%, 100=25.72%, 250=31.22% lat (msec) : 500=2.77%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.38%, ctx=5469, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=92.2KiB/s (94.4kB/s), 22.8KiB/s-23.3KiB/s (23.3kB/s-23.9kB/s), io=23.4MiB (24.6MB), run=259610-260563msec WRITE: bw=96.5KiB/s (98.8kB/s), 24.0KiB/s-24.4KiB/s (24.6kB/s-24.9kB/s), io=24.6MiB (25.7MB), run=259610-260563msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146077: Fri Jun 12 01:02:11 2026 read: IOPS=13, BW=215KiB/s (221kB/s)(5920KiB/27476msec) clat (usec): min=36, max=240741, avg=40122.15, stdev=33989.70 lat (usec): min=36, max=240742, avg=40123.67, stdev=33989.29 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 113], | 30.00th=[ 22938], 40.00th=[ 30016], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[145753], 99.50th=[179307], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 94, max= 445, per=26.72%, avg=213.51, stdev=76.76, samples=53 iops : min= 5, max= 27, avg=12.58, stdev= 4.90, samples=53 write: IOPS=14, BW=232KiB/s (237kB/s)(6368KiB/27476msec); 0 zone resets clat (usec): min=1489, max=200876, avg=31316.01, stdev=34231.67 lat (usec): min=1490, max=200878, avg=31317.86, stdev=34231.62 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1876], 10.00th=[ 2376], 20.00th=[ 4883], | 30.00th=[ 7242], 40.00th=[ 10945], 50.00th=[ 17433], 60.00th=[ 27395], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[149947], 99.50th=[173016], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 92, max= 411, per=27.66%, avg=232.34, stdev=71.35, samples=53 iops : min= 5, max= 25, avg=13.77, stdev= 4.50, samples=53 lat (usec) : 50=1.17%, 100=7.94%, 250=1.30%, 500=0.13%, 750=0.26% lat (msec) : 2=4.17%, 4=5.08%, 10=10.81%, 20=9.38%, 50=31.64% lat (msec) : 100=22.40%, 250=5.73% cpu : usr=0.07%, sys=6.35%, ctx=1445, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146079: Fri Jun 12 01:02:11 2026 read: IOPS=11, BW=192KiB/s (196kB/s)(5744KiB/29976msec) clat (usec): min=38, max=163400, avg=40371.72, stdev=32145.37 lat (usec): min=39, max=163401, avg=40380.36, stdev=32148.56 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 112], | 30.00th=[ 21627], 40.00th=[ 29492], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 55837], 80.00th=[ 70779], 90.00th=[ 82314], 95.00th=[ 90702], | 99.00th=[129500], 99.50th=[147850], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 22, max= 411, per=23.92%, avg=191.09, stdev=87.15, samples=58 iops : min= 1, max= 25, avg=11.19, stdev= 5.51, samples=58 write: IOPS=13, BW=218KiB/s (224kB/s)(6544KiB/29976msec); 0 zone resets clat (usec): min=1526, max=202676, avg=36677.59, stdev=37590.59 lat (usec): min=1529, max=202677, avg=36693.78, stdev=37586.35 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2180], 10.00th=[ 2933], 20.00th=[ 5407], | 30.00th=[ 9503], 40.00th=[ 15008], 50.00th=[ 23462], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 64226], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[156238], 99.50th=[168821], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 94, max= 446, per=26.42%, avg=221.93, stdev=80.12, samples=57 iops : min= 5, max= 27, avg=13.12, stdev= 5.07, samples=57 lat (usec) : 50=0.78%, 100=8.07%, 250=1.56%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.82%, 4=6.12%, 10=8.85%, 20=10.55%, 50=31.51% lat (msec) : 100=24.61%, 250=5.73% cpu : usr=0.06%, sys=6.08%, ctx=1549, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146081: Fri Jun 12 01:02:11 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29120msec) clat (usec): min=33, max=183498, avg=39353.27, stdev=32303.81 lat (usec): min=33, max=183498, avg=39354.39, stdev=32303.82 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 96], | 30.00th=[ 21890], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 65799], 90.00th=[ 79168], 95.00th=[ 93848], | 99.00th=[137364], 99.50th=[173016], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 414, per=27.03%, avg=215.93, stdev=81.28, samples=57 iops : min= 3, max= 25, avg=12.74, stdev= 5.10, samples=57 write: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29120msec); 0 zone resets clat (usec): min=1502, max=223617, avg=35187.28, stdev=37521.15 lat (usec): min=1503, max=223618, avg=35195.08, stdev=37520.97 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1827], 10.00th=[ 2540], 20.00th=[ 5014], | 30.00th=[ 8094], 40.00th=[ 13304], 50.00th=[ 21103], 60.00th=[ 30802], | 70.00th=[ 44827], 80.00th=[ 60556], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[147850], 99.50th=[160433], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 63, max= 443, per=24.53%, avg=206.02, stdev=85.95, samples=57 iops : min= 3, max= 27, avg=12.14, stdev= 5.44, samples=57 lat (usec) : 50=1.43%, 100=8.85%, 250=1.04%, 500=0.13% lat (msec) : 2=3.91%, 4=4.43%, 10=9.51%, 20=8.59%, 50=33.07% lat (msec) : 100=22.79%, 250=6.25% cpu : usr=0.07%, sys=6.24%, ctx=1479, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146084: Fri Jun 12 01:02:11 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29718msec) clat (usec): min=38, max=181853, avg=39385.25, stdev=34794.45 lat (usec): min=38, max=181853, avg=39386.63, stdev=34794.46 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 61], 20.00th=[ 76], | 30.00th=[ 18220], 40.00th=[ 28443], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 54789], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[158335], 99.50th=[166724], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 32, max= 379, per=26.33%, avg=210.39, stdev=72.43, samples=56 iops : min= 2, max= 23, avg=12.41, stdev= 4.56, samples=56 write: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29718msec); 0 zone resets clat (usec): min=1587, max=278158, avg=36644.37, stdev=44348.22 lat (usec): min=1589, max=278160, avg=36647.06, stdev=44349.92 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2008], 10.00th=[ 2900], 20.00th=[ 6325], | 30.00th=[ 8455], 40.00th=[ 13173], 50.00th=[ 19268], 60.00th=[ 30540], | 70.00th=[ 43779], 80.00th=[ 57410], 90.00th=[ 88605], 95.00th=[137364], | 99.00th=[242222], 99.50th=[256902], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 23, max= 478, per=25.27%, avg=212.29, stdev=98.38, samples=58 iops : min= 1, max= 29, avg=12.52, stdev= 6.14, samples=58 lat (usec) : 50=0.78%, 100=10.03%, 250=1.56%, 500=0.65%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.60%, 4=5.08%, 10=10.29%, 20=10.16%, 50=29.43% lat (msec) : 100=22.66%, 250=6.25%, 500=0.26% cpu : usr=0.06%, sys=5.97%, ctx=1441, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=799KiB/s (818kB/s), 192KiB/s-215KiB/s (196kB/s-221kB/s), io=23.4MiB (24.5MB), run=27476-29976msec WRITE: bw=841KiB/s (861kB/s), 207KiB/s-232KiB/s (212kB/s-237kB/s), io=24.6MiB (25.8MB), run=27476-29976msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146078: Fri Jun 12 01:02:49 2026 read: IOPS=5, BW=87.6KiB/s (89.7kB/s)(5920KiB/67569msec) clat (msec): min=6, max=385, avg=39.24, stdev=40.75 lat (msec): min=6, max=385, avg=39.24, stdev=40.75 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 81], 95.00th=[ 121], | 99.00th=[ 213], 99.50th=[ 247], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 348, per=27.13%, avg=96.04, stdev=62.03, samples=120 iops : min= 1, max= 21, avg= 5.28, stdev= 3.97, samples=120 write: IOPS=5, BW=94.2KiB/s (96.5kB/s)(6368KiB/67569msec); 0 zone resets clat (msec): min=35, max=461, avg=132.12, stdev=67.47 lat (msec): min=35, max=461, avg=132.12, stdev=67.47 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 66], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 127], | 70.00th=[ 148], 80.00th=[ 180], 90.00th=[ 224], 95.00th=[ 271], | 99.00th=[ 384], 99.50th=[ 414], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 29, max= 219, per=25.39%, avg=94.46, stdev=46.42, samples=132 iops : min= 1, max= 13, avg= 5.18, stdev= 3.02, samples=132 lat (msec) : 10=2.08%, 20=14.19%, 50=24.48%, 100=22.92%, 250=32.68% lat (msec) : 500=3.65% cpu : usr=0.03%, sys=1.49%, ctx=1348, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146080: Fri Jun 12 01:02:49 2026 read: IOPS=5, BW=85.2KiB/s (87.2kB/s)(5744KiB/67415msec) clat (msec): min=6, max=255, avg=40.23, stdev=40.54 lat (msec): min=6, max=255, avg=40.23, stdev=40.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 88], 95.00th=[ 142], | 99.00th=[ 213], 99.50th=[ 243], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 22, max= 415, per=28.74%, avg=101.73, stdev=71.39, samples=111 iops : min= 1, max= 25, avg= 5.66, stdev= 4.49, samples=111 write: IOPS=6, BW=97.1KiB/s (99.4kB/s)(6544KiB/67415msec); 0 zone resets clat (msec): min=29, max=457, avg=129.16, stdev=67.11 lat (msec): min=29, max=457, avg=129.17, stdev=67.10 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 66], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 100], 50.00th=[ 110], 60.00th=[ 124], | 70.00th=[ 142], 80.00th=[ 171], 90.00th=[ 220], 95.00th=[ 264], | 99.00th=[ 351], 99.50th=[ 359], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 31, max= 220, per=26.41%, avg=98.24, stdev=45.91, samples=131 iops : min= 1, max= 13, avg= 5.41, stdev= 3.03, samples=131 lat (msec) : 10=3.26%, 20=12.24%, 50=23.83%, 100=25.65%, 250=31.64% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.66%, ctx=1471, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146082: Fri Jun 12 01:02:49 2026 read: IOPS=5, BW=94.3KiB/s (96.6kB/s)(6256KiB/66333msec) clat (msec): min=7, max=219, avg=36.53, stdev=33.34 lat (msec): min=7, max=219, avg=36.53, stdev=33.34 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 117], | 99.00th=[ 174], 99.50th=[ 197], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 29, max= 315, per=28.41%, avg=100.59, stdev=70.05, samples=123 iops : min= 1, max= 19, avg= 5.56, stdev= 4.52, samples=123 write: IOPS=5, BW=90.9KiB/s (93.1kB/s)(6032KiB/66333msec); 0 zone resets clat (msec): min=32, max=460, avg=136.79, stdev=70.58 lat (msec): min=32, max=460, avg=136.79, stdev=70.58 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 122], 60.00th=[ 138], | 70.00th=[ 150], 80.00th=[ 178], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 397], 99.50th=[ 422], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 31, max= 192, per=24.79%, avg=92.23, stdev=42.77, samples=129 iops : min= 1, max= 12, avg= 5.05, stdev= 2.79, samples=129 lat (msec) : 10=2.34%, 20=15.49%, 50=25.00%, 100=21.74%, 250=31.38% lat (msec) : 500=4.04% cpu : usr=0.03%, sys=1.60%, ctx=1471, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146083: Fri Jun 12 01:02:49 2026 read: IOPS=5, BW=90.7KiB/s (92.9kB/s)(6032KiB/66503msec) clat (msec): min=5, max=213, avg=38.64, stdev=37.20 lat (msec): min=5, max=213, avg=38.64, stdev=37.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 49], 90.00th=[ 88], 95.00th=[ 130], | 99.00th=[ 194], 99.50th=[ 199], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 416, per=28.26%, avg=100.03, stdev=63.18, samples=118 iops : min= 1, max= 26, avg= 5.54, stdev= 4.10, samples=118 write: IOPS=5, BW=94.1KiB/s (96.3kB/s)(6256KiB/66503msec); 0 zone resets clat (msec): min=38, max=393, avg=131.70, stdev=65.59 lat (msec): min=38, max=393, avg=131.70, stdev=65.59 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 230], 95.00th=[ 275], | 99.00th=[ 359], 99.50th=[ 380], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 22, max= 252, per=25.24%, avg=93.90, stdev=46.50, samples=131 iops : min= 1, max= 15, avg= 5.15, stdev= 3.03, samples=131 lat (msec) : 10=2.47%, 20=14.71%, 50=23.31%, 100=23.57%, 250=31.90% lat (msec) : 500=4.04% cpu : usr=0.03%, sys=1.50%, ctx=1351, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=354KiB/s (363kB/s), 85.2KiB/s-94.3KiB/s (87.2kB/s-96.6kB/s), io=23.4MiB (24.5MB), run=66333-67569msec WRITE: bw=373KiB/s (382kB/s), 90.9KiB/s-97.1KiB/s (93.1kB/s-99.4kB/s), io=24.6MiB (25.8MB), run=66333-67569msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146101: Fri Jun 12 01:03:06 2026 read: IOPS=1, BW=1391KiB/s (1424kB/s)(7168KiB/5154msec) clat (usec): min=512, max=348381, avg=223476.01, stdev=114965.53 lat (usec): min=513, max=348382, avg=223477.23, stdev=114965.65 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[179307], | 30.00th=[187696], 40.00th=[187696], 50.00th=[270533], 60.00th=[287310], | 70.00th=[287310], 80.00th=[291505], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 1992, max= 4063, per=95.03%, avg=3033.25, stdev=1184.51, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=993KiB/s (1017kB/s)(5120KiB/5154msec); 0 zone resets clat (msec): min=291, max=1985, avg=692.50, stdev=724.47 lat (msec): min=291, max=1985, avg=692.58, stdev=724.47 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 2035, max= 3820, per=58.88%, avg=2631.33, stdev=1029.42, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=66.67%, 2000=8.33% cpu : usr=0.00%, sys=7.39%, ctx=258, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146103: Fri Jun 12 01:03:06 2026 read: IOPS=0, BW=319KiB/s (327kB/s)(2048KiB/6415msec) clat (usec): min=1158, max=2205.0k, avg=1103568.84, stdev=1559043.30 lat (usec): min=1159, max=2205.0k, avg=1103569.96, stdev=1559043.57 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1156], 10.00th=[ 1156], | 20.00th=[ 1156], 30.00th=[ 1156], 40.00th=[ 1156], | 50.00th=[ 1156], 60.00th=[2197816], 70.00th=[2197816], | 80.00th=[2197816], 90.00th=[2197816], 95.00th=[2197816], | 99.00th=[2197816], 99.50th=[2197816], 99.90th=[2197816], | 99.95th=[2197816], 99.99th=[2197816] bw ( KiB/s): min= 2023, max= 2035, per=63.57%, avg=2029.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1596KiB/s (1635kB/s)(10.0MiB/6415msec); 0 zone resets clat (msec): min=186, max=1342, avg=409.28, stdev=338.33 lat (msec): min=186, max=1342, avg=409.40, stdev=338.31 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 220], | 30.00th=[ 230], 40.00th=[ 266], 50.00th=[ 284], 60.00th=[ 347], | 70.00th=[ 380], 80.00th=[ 401], 90.00th=[ 439], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1910, max= 4071, per=60.12%, avg=2686.83, stdev=1063.96, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 2=8.33%, 250=25.00%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=9.45%, ctx=254, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146104: Fri Jun 12 01:03:06 2026 read: IOPS=1, BW=1707KiB/s (1748kB/s)(6144KiB/3599msec) clat (msec): min=162, max=285, avg=222.39, stdev=43.56 lat (msec): min=162, max=285, avg=222.40, stdev=43.56 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 232], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 2023, max= 4071, per=79.64%, avg=2542.00, stdev=1019.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1707KiB/s (1748kB/s)(6144KiB/3599msec); 0 zone resets clat (msec): min=225, max=526, avg=371.87, stdev=100.27 lat (msec): min=225, max=526, avg=372.16, stdev=100.25 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 380], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1935, max= 2039, per=45.09%, avg=2015.00, stdev=39.60, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=13.84%, ctx=222, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146105: Fri Jun 12 01:03:06 2026 read: IOPS=0, BW=854KiB/s (875kB/s)(5120KiB/5995msec) clat (msec): min=192, max=289, avg=244.04, stdev=35.86 lat (msec): min=192, max=289, avg=244.04, stdev=35.86 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 3820, max= 4079, per=100.00%, avg=3949.50, stdev=183.14, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1196KiB/s (1224kB/s)(7168KiB/5995msec); 0 zone resets clat (msec): min=224, max=2050, avg=673.62, stdev=619.80 lat (msec): min=224, max=2050, avg=673.87, stdev=619.94 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 330], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 523], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 558], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 1932, max= 2035, per=45.02%, avg=2011.83, stdev=39.39, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=8.39%, ctx=182, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3193KiB/s (3269kB/s), 319KiB/s-1707KiB/s (327kB/s-1748kB/s), io=20.0MiB (20.0MB), run=3599-6415msec WRITE: bw=4470KiB/s (4577kB/s), 993KiB/s-1707KiB/s (1017kB/s-1748kB/s), io=28.0MiB (29.4MB), run=3599-6415msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146106: Fri Jun 12 01:03:06 2026 read: IOPS=1, BW=1248KiB/s (1278kB/s)(7168KiB/5743msec) clat (msec): min=69, max=574, avg=215.55, stdev=188.54 lat (msec): min=69, max=574, avg=215.56, stdev=188.54 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 93], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 126], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 376], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2031, max= 4047, per=97.97%, avg=3024.25, stdev=1144.89, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=892KiB/s (913kB/s)(5120KiB/5743msec); 0 zone resets clat (msec): min=295, max=2395, avg=830.95, stdev=889.31 lat (msec): min=295, max=2395, avg=831.04, stdev=889.31 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1988, max= 2039, per=46.77%, avg=2021.25, stdev=23.19, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.05%, sys=3.01%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146107: Fri Jun 12 01:03:06 2026 read: IOPS=0, BW=309KiB/s (316kB/s)(2048KiB/6633msec) clat (msec): min=168, max=1894, avg=1031.65, stdev=1220.69 lat (msec): min=168, max=1894, avg=1031.66, stdev=1220.69 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 1888], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 2019, max= 2048, per=65.87%, avg=2033.50, stdev=20.51, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1544KiB/s (1581kB/s)(10.0MiB/6633msec); 0 zone resets clat (msec): min=155, max=914, avg=410.83, stdev=236.71 lat (msec): min=156, max=914, avg=411.05, stdev=236.74 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 188], | 30.00th=[ 197], 40.00th=[ 309], 50.00th=[ 326], 60.00th=[ 401], | 70.00th=[ 456], 80.00th=[ 510], 90.00th=[ 659], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 2000, max= 4063, per=62.58%, avg=2704.83, stdev=1049.10, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 0.89, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=3.63%, ctx=122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146108: Fri Jun 12 01:03:06 2026 read: IOPS=1, BW=1207KiB/s (1236kB/s)(6144KiB/5092msec) clat (msec): min=86, max=1792, avg=446.10, stdev=661.29 lat (msec): min=86, max=1792, avg=446.10, stdev=661.29 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 201], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1992, max= 4031, per=100.00%, avg=3351.33, stdev=1177.22, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1207KiB/s (1236kB/s)(6144KiB/5092msec); 0 zone resets clat (msec): min=189, max=735, avg=325.61, stdev=204.76 lat (msec): min=189, max=737, avg=326.13, stdev=205.25 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 271], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1490, max= 2015, per=43.94%, avg=1899.20, stdev=229.05, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.42%, ctx=120, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146109: Fri Jun 12 01:03:06 2026 read: IOPS=0, BW=822KiB/s (842kB/s)(5120KiB/6225msec) clat (msec): min=89, max=441, avg=187.41, stdev=145.62 lat (msec): min=89, max=441, avg=187.41, stdev=145.62 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 3984, max= 4063, per=100.00%, avg=4023.50, stdev=55.86, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1151KiB/s (1179kB/s)(7168KiB/6225msec); 0 zone resets clat (msec): min=351, max=2186, avg=713.66, stdev=656.39 lat (msec): min=352, max=2186, avg=713.76, stdev=656.44 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 388], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 502], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 600], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1988, max= 4096, per=56.26%, avg=2431.60, stdev=930.67, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.08%, ctx=163, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3088KiB/s (3162kB/s), 309KiB/s-1248KiB/s (316kB/s-1278kB/s), io=20.0MiB (20.0MB), run=5092-6633msec WRITE: bw=4323KiB/s (4426kB/s), 892KiB/s-1544KiB/s (913kB/s-1581kB/s), io=28.0MiB (29.4MB), run=5092-6633msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146121: Fri Jun 12 01:03:21 2026 read: IOPS=1, BW=5639KiB/s (5775kB/s)(12.0MiB/2179msec) clat (msec): min=435, max=970, avg=725.92, stdev=270.51 lat (msec): min=435, max=970, avg=725.92, stdev=270.51 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8015, max= 8175, per=100.00%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.37%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146122: Fri Jun 12 01:03:21 2026 read: IOPS=0, BW=1434KiB/s (1468kB/s)(4096KiB/2857msec) clat (nsec): min=1012.8M, max=1012.8M, avg=1012783169.00, stdev= 0.00 lat (nsec): min=1012.8M, max=1012.8M, avg=1012784590.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2867KiB/s (2936kB/s)(8192KiB/2857msec); 0 zone resets clat (msec): min=706, max=1120, avg=913.78, stdev=292.54 lat (msec): min=707, max=1121, avg=914.14, stdev=292.57 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8175, max= 8175, per=81.78%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.68%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146123: Fri Jun 12 01:03:21 2026 write: IOPS=1, BW=4539KiB/s (4648kB/s)(12.0MiB/2707msec); 0 zone resets clat (msec): min=414, max=1447, avg=901.41, stdev=519.13 lat (msec): min=415, max=1448, avg=901.91, stdev=518.93 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8175, max= 8192, per=81.87%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.95%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146124: Fri Jun 12 01:03:21 2026 write: IOPS=0, BW=3749KiB/s (3839kB/s)(12.0MiB/3278msec); 0 zone resets clat (msec): min=319, max=2407, avg=1091.57, stdev=1145.23 lat (msec): min=321, max=2407, avg=1092.34, stdev=1144.68 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 5550, max= 8094, per=68.25%, avg=6822.00, stdev=1798.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.13%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5735KiB/s (5872kB/s), 1434KiB/s-5639KiB/s (1468kB/s-5775kB/s), io=16.0MiB (16.8MB), run=2179-2857msec WRITE: bw=9996KiB/s (10.2MB/s), 2867KiB/s-4539KiB/s (2936kB/s-4648kB/s), io=32.0MiB (33.6MB), run=2707-3278msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146116: Fri Jun 12 01:03:21 2026 read: IOPS=1, BW=4800KiB/s (4915kB/s)(12.0MiB/2560msec) clat (msec): min=753, max=940, avg=839.55, stdev=94.69 lat (msec): min=753, max=940, avg=839.55, stdev=94.69 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7787, max= 8110, per=100.00%, avg=7948.50, stdev=228.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=15.40%, ctx=282, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146117: Fri Jun 12 01:03:21 2026 read: IOPS=0, BW=1348KiB/s (1381kB/s)(4096KiB/3038msec) clat (nsec): min=690177k, max=690177k, avg=690177098.00, stdev= 0.00 lat (nsec): min=690180k, max=690180k, avg=690179508.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7787, max= 7787, per=100.00%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2697KiB/s (2761kB/s)(8192KiB/3038msec); 0 zone resets clat (msec): min=581, max=1725, avg=1153.61, stdev=808.44 lat (msec): min=582, max=1728, avg=1155.21, stdev=810.28 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8110, max= 8110, per=99.45%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.68%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146118: Fri Jun 12 01:03:21 2026 write: IOPS=0, BW=3058KiB/s (3132kB/s)(12.0MiB/4018msec); 0 zone resets clat (msec): min=267, max=2271, avg=1324.78, stdev=1006.77 lat (msec): min=268, max=2272, avg=1325.21, stdev=1006.70 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.53%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146119: Fri Jun 12 01:03:21 2026 write: IOPS=1, BW=4447KiB/s (4554kB/s)(12.0MiB/2763msec); 0 zone resets clat (msec): min=314, max=1827, avg=891.52, stdev=817.69 lat (msec): min=314, max=1828, avg=892.29, stdev=818.43 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min=15574, max=15574, per=100.00%, avg=15574.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.13%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5393KiB/s (5522kB/s), 1348KiB/s-4800KiB/s (1381kB/s-4915kB/s), io=16.0MiB (16.8MB), run=2560-3038msec WRITE: bw=8155KiB/s (8351kB/s), 2697KiB/s-4447KiB/s (2761kB/s-4554kB/s), io=32.0MiB (33.6MB), run=2763-4018msec