== sanity test 398b: DIO and buffer IO race ============== 17:04:56 (1778619896) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.98578 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144316: Tue May 12 17:07:46 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(5992KiB/144748msec) clat (usec): min=21, max=942820, avg=47403.81, stdev=42615.98 lat (usec): min=21, max=942822, avg=47406.24, stdev=42616.62 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 84], 20.00th=[ 20841], | 30.00th=[ 27395], 40.00th=[ 33162], 50.00th=[ 40109], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[173016], 99.50th=[189793], 99.90th=[367002], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 5, max= 109, per=25.47%, avg=41.52, stdev=19.37, samples=280 iops : min= 1, max= 27, avg= 9.74, stdev= 4.89, samples=280 write: IOPS=10, BW=43.5KiB/s (44.5kB/s)(6296KiB/144748msec); 0 zone resets clat (usec): min=826, max=649721, avg=46598.16, stdev=51124.44 lat (usec): min=827, max=649723, avg=46604.74, stdev=51123.23 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1303], 10.00th=[ 1483], 20.00th=[ 4424], | 30.00th=[ 9503], 40.00th=[ 21103], 50.00th=[ 32900], 60.00th=[ 47449], | 70.00th=[ 61080], 80.00th=[ 79168], 90.00th=[108528], 95.00th=[143655], | 99.00th=[214959], 99.50th=[287310], 99.90th=[396362], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 134, per=25.49%, avg=43.33, stdev=19.78, samples=282 iops : min= 1, max= 33, avg=10.20, stdev= 4.98, samples=282 lat (usec) : 50=0.85%, 100=4.30%, 250=0.07%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=6.45%, 4=3.12%, 10=6.12%, 20=8.24%, 50=32.98% lat (msec) : 100=27.67%, 250=9.51%, 500=0.33%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.25%, ctx=6244, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144317: Tue May 12 17:07:46 2026 read: IOPS=10, BW=40.4KiB/s (41.3kB/s)(5940KiB/147161msec) clat (usec): min=29, max=928411, avg=47565.70, stdev=41698.28 lat (usec): min=30, max=928413, avg=47569.61, stdev=41699.82 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 482], 20.00th=[ 21627], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[177210], 99.50th=[200279], 99.90th=[278922], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 103, per=24.94%, avg=40.65, stdev=18.96, samples=284 iops : min= 1, max= 25, avg= 9.51, stdev= 4.78, samples=284 write: IOPS=10, BW=43.1KiB/s (44.2kB/s)(6348KiB/147161msec); 0 zone resets clat (usec): min=897, max=617567, avg=47879.87, stdev=52749.00 lat (usec): min=898, max=617568, avg=47900.59, stdev=52755.55 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1434], 20.00th=[ 4178], | 30.00th=[ 9372], 40.00th=[ 21627], 50.00th=[ 34866], 60.00th=[ 47449], | 70.00th=[ 63177], 80.00th=[ 84411], 90.00th=[109577], 95.00th=[143655], | 99.00th=[231736], 99.50th=[274727], 99.90th=[379585], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 119, per=25.31%, avg=43.02, stdev=19.58, samples=286 iops : min= 1, max= 29, avg=10.11, stdev= 4.90, samples=286 lat (usec) : 50=0.65%, 100=3.91%, 250=0.16%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=7.26%, 4=2.73%, 10=5.99%, 20=7.71%, 50=33.50% lat (msec) : 100=27.57%, 250=9.80%, 500=0.36%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.33%, ctx=6149, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144318: Tue May 12 17:07:46 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6028KiB/146739msec) clat (usec): min=31, max=248019, avg=46282.32, stdev=34078.90 lat (usec): min=32, max=248021, avg=46286.94, stdev=34080.17 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 75], 20.00th=[ 21103], | 30.00th=[ 28443], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 56886], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[166724], 99.50th=[181404], 99.90th=[231736], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 6, max= 117, per=25.07%, avg=40.86, stdev=19.15, samples=286 iops : min= 1, max= 29, avg= 9.57, stdev= 4.82, samples=286 write: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6260KiB/146739msec); 0 zone resets clat (usec): min=821, max=888905, avg=48953.14, stdev=54585.70 lat (usec): min=822, max=888906, avg=48957.13, stdev=54584.37 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1483], 20.00th=[ 4883], | 30.00th=[ 10814], 40.00th=[ 23987], 50.00th=[ 36439], 60.00th=[ 49546], | 70.00th=[ 64226], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[139461], | 99.00th=[235930], 99.50th=[287310], 99.90th=[455082], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 95, per=24.82%, avg=42.20, stdev=18.15, samples=287 iops : min= 1, max= 23, avg= 9.90, stdev= 4.56, samples=287 lat (usec) : 50=1.04%, 100=4.30%, 250=0.26%, 500=0.07%, 1000=0.10% lat (msec) : 2=6.28%, 4=3.12%, 10=5.76%, 20=7.26%, 50=33.63% lat (msec) : 100=28.09%, 250=9.70%, 500=0.36%, 1000=0.03% cpu : usr=0.06%, sys=4.39%, ctx=6316, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144319: Tue May 12 17:07:46 2026 read: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6052KiB/145796msec) clat (usec): min=28, max=363689, avg=47037.69, stdev=34444.90 lat (usec): min=29, max=363690, avg=47039.12, stdev=34444.92 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 81], 20.00th=[ 22152], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[154141], 99.50th=[160433], 99.90th=[274727], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 134, per=25.70%, avg=41.89, stdev=18.90, samples=281 iops : min= 1, max= 33, avg= 9.83, stdev= 4.76, samples=281 write: IOPS=10, BW=42.8KiB/s (43.8kB/s)(6236KiB/145796msec); 0 zone resets clat (usec): min=865, max=1047.7k, avg=47522.25, stdev=55802.86 lat (usec): min=866, max=1047.7k, avg=47534.14, stdev=55798.71 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1565], | 20.00th=[ 4752], 30.00th=[ 10028], 40.00th=[ 21103], | 50.00th=[ 34341], 60.00th=[ 48497], 70.00th=[ 61080], | 80.00th=[ 79168], 90.00th=[ 111674], 95.00th=[ 137364], | 99.00th=[ 233833], 99.50th=[ 270533], 99.90th=[ 408945], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 7, max= 120, per=25.14%, avg=42.73, stdev=18.81, samples=283 iops : min= 1, max= 30, avg=10.04, stdev= 4.73, samples=283 lat (usec) : 50=0.78%, 100=4.36%, 250=0.16%, 500=0.13%, 1000=0.10% lat (msec) : 2=5.92%, 4=3.26%, 10=6.22%, 20=7.52%, 50=32.49% lat (msec) : 100=29.30%, 250=9.34%, 500=0.39%, 2000=0.03% cpu : usr=0.07%, sys=4.32%, ctx=6146, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 40.4KiB/s-41.5KiB/s (41.3kB/s-42.5kB/s), io=23.4MiB (24.6MB), run=144748-147161msec WRITE: bw=171KiB/s (175kB/s), 42.7KiB/s-43.5KiB/s (43.7kB/s-44.5kB/s), io=24.6MiB (25.7MB), run=144748-147161msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144312: Tue May 12 17:10:44 2026 read: IOPS=4, BW=18.5KiB/s (18.9kB/s)(5992KiB/323938msec) clat (msec): min=5, max=945, avg=44.04, stdev=46.70 lat (msec): min=5, max=945, avg=44.04, stdev=46.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 62], 90.00th=[ 86], 95.00th=[ 115], | 99.00th=[ 182], 99.50th=[ 203], 99.90th=[ 751], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 79, per=29.73%, avg=21.70, stdev=14.49, samples=530 iops : min= 1, max= 19, avg= 4.78, stdev= 3.64, samples=530 write: IOPS=4, BW=19.4KiB/s (19.9kB/s)(6296KiB/323938msec); 0 zone resets clat (msec): min=43, max=776, avg=163.59, stdev=76.55 lat (msec): min=43, max=776, avg=163.60, stdev=76.55 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 75], 10.00th=[ 86], 20.00th=[ 102], | 30.00th=[ 118], 40.00th=[ 131], 50.00th=[ 146], 60.00th=[ 165], | 70.00th=[ 184], 80.00th=[ 218], 90.00th=[ 266], 95.00th=[ 317], | 99.00th=[ 414], 99.50th=[ 485], 99.90th=[ 558], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 6, max= 47, per=25.08%, avg=19.31, stdev= 8.44, samples=622 iops : min= 1, max= 11, avg= 4.18, stdev= 2.14, samples=622 lat (msec) : 10=1.30%, 20=11.13%, 50=22.88%, 100=19.24%, 250=38.93% lat (msec) : 500=6.25%, 750=0.20%, 1000=0.07% cpu : usr=0.04%, sys=1.16%, ctx=5423, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144313: Tue May 12 17:10:44 2026 read: IOPS=4, BW=18.3KiB/s (18.7kB/s)(5940KiB/324497msec) clat (msec): min=5, max=974, avg=43.66, stdev=46.30 lat (msec): min=5, max=974, avg=43.66, stdev=46.30 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 207], 99.50th=[ 249], 99.90th=[ 584], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 94, per=30.09%, avg=21.97, stdev=13.94, samples=519 iops : min= 1, max= 23, avg= 4.84, stdev= 3.52, samples=519 write: IOPS=4, BW=19.6KiB/s (20.0kB/s)(6348KiB/324497msec); 0 zone resets clat (msec): min=48, max=624, avg=163.32, stdev=74.50 lat (msec): min=48, max=624, avg=163.33, stdev=74.50 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 78], 10.00th=[ 89], 20.00th=[ 106], | 30.00th=[ 118], 40.00th=[ 131], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 184], 80.00th=[ 215], 90.00th=[ 262], 95.00th=[ 305], | 99.00th=[ 422], 99.50th=[ 472], 99.90th=[ 609], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 6, max= 56, per=24.99%, avg=19.25, stdev= 8.52, samples=630 iops : min= 1, max= 14, avg= 4.17, stdev= 2.17, samples=630 lat (msec) : 10=1.66%, 20=10.71%, 50=23.34%, 100=18.23%, 250=39.94% lat (msec) : 500=5.89%, 750=0.20%, 1000=0.03% cpu : usr=0.04%, sys=1.17%, ctx=5417, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144314: Tue May 12 17:10:44 2026 read: IOPS=4, BW=18.5KiB/s (18.0kB/s)(6028KiB/325710msec) clat (msec): min=5, max=468, avg=44.70, stdev=39.99 lat (msec): min=5, max=468, avg=44.71, stdev=39.99 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 62], 90.00th=[ 87], 95.00th=[ 122], | 99.00th=[ 188], 99.50th=[ 239], 99.90th=[ 464], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 6, max= 110, per=28.75%, avg=20.99, stdev=14.54, samples=549 iops : min= 1, max= 27, avg= 4.60, stdev= 3.67, samples=549 write: IOPS=4, BW=19.2KiB/s (19.7kB/s)(6260KiB/325710msec); 0 zone resets clat (msec): min=37, max=971, avg=164.72, stdev=79.41 lat (msec): min=37, max=971, avg=164.73, stdev=79.41 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 79], 10.00th=[ 89], 20.00th=[ 106], | 30.00th=[ 121], 40.00th=[ 133], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 182], 80.00th=[ 211], 90.00th=[ 266], 95.00th=[ 317], | 99.00th=[ 426], 99.50th=[ 506], 99.90th=[ 676], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 6, max= 47, per=24.75%, avg=19.05, stdev= 8.55, samples=626 iops : min= 1, max= 11, avg= 4.12, stdev= 2.17, samples=626 lat (msec) : 10=1.43%, 20=10.71%, 50=22.95%, 100=18.39%, 250=40.10% lat (msec) : 500=6.12%, 750=0.26%, 1000=0.03% cpu : usr=0.04%, sys=1.13%, ctx=5417, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144315: Tue May 12 17:10:44 2026 read: IOPS=4, BW=18.7KiB/s (19.1kB/s)(6052KiB/323789msec) clat (msec): min=6, max=756, avg=44.81, stdev=46.82 lat (msec): min=6, max=756, avg=44.81, stdev=46.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 60], 90.00th=[ 93], 95.00th=[ 126], | 99.00th=[ 192], 99.50th=[ 249], 99.90th=[ 592], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 87, per=29.53%, avg=21.55, stdev=15.04, samples=539 iops : min= 1, max= 21, avg= 4.74, stdev= 3.78, samples=539 write: IOPS=4, BW=19.3KiB/s (19.7kB/s)(6236KiB/323789msec); 0 zone resets clat (msec): min=50, max=1140, avg=163.92, stdev=75.56 lat (msec): min=50, max=1140, avg=163.92, stdev=75.56 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 79], 10.00th=[ 90], 20.00th=[ 106], | 30.00th=[ 120], 40.00th=[ 133], 50.00th=[ 148], 60.00th=[ 163], | 70.00th=[ 186], 80.00th=[ 215], 90.00th=[ 264], 95.00th=[ 305], | 99.00th=[ 401], 99.50th=[ 439], 99.90th=[ 550], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 6, max= 47, per=24.80%, avg=19.09, stdev= 8.42, samples=624 iops : min= 1, max= 11, avg= 4.13, stdev= 2.13, samples=624 lat (msec) : 10=1.43%, 20=10.38%, 50=24.41%, 100=17.45%, 250=39.97% lat (msec) : 500=6.15%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5432, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=73.7KiB/s (75.5kB/s), 18.3KiB/s-18.7KiB/s (18.7kB/s-19.1kB/s), io=23.4MiB (24.6MB), run=323789-325710msec WRITE: bw=77.2KiB/s (79.0kB/s), 19.2KiB/s-19.6KiB/s (19.7kB/s-20.0kB/s), io=24.6MiB (25.7MB), run=323789-325710msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144381: Tue May 12 17:11:26 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(5920KiB/29703msec) clat (usec): min=34, max=301284, avg=40995.90, stdev=38206.25 lat (usec): min=34, max=301284, avg=40997.35, stdev=38206.20 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 84], | 30.00th=[ 22676], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 44303], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 79168], 95.00th=[ 90702], | 99.00th=[168821], 99.50th=[291505], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 61, max= 412, per=24.75%, avg=199.47, stdev=82.61, samples=58 iops : min= 3, max= 25, avg=11.69, stdev= 5.20, samples=58 write: IOPS=13, BW=214KiB/s (220kB/s)(6368KiB/29703msec); 0 zone resets clat (usec): min=1428, max=249043, avg=35861.02, stdev=39209.18 lat (usec): min=1431, max=249046, avg=35863.58, stdev=39209.13 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 1975], 10.00th=[ 3163], 20.00th=[ 5473], | 30.00th=[ 7701], 40.00th=[ 11207], 50.00th=[ 22152], 60.00th=[ 33817], | 70.00th=[ 46924], 80.00th=[ 63701], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[198181], 99.50th=[214959], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 63, max= 442, per=25.35%, avg=215.00, stdev=92.12, samples=58 iops : min= 3, max= 27, avg=12.66, stdev= 5.80, samples=58 lat (usec) : 50=1.82%, 100=9.38%, 250=0.65%, 500=0.26% lat (msec) : 2=2.99%, 4=3.65%, 10=13.41%, 20=5.99%, 50=31.51% lat (msec) : 100=24.74%, 250=5.21%, 500=0.39% cpu : usr=0.06%, sys=5.27%, ctx=1352, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144382: Tue May 12 17:11:26 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(5744KiB/28240msec) clat (usec): min=32, max=191796, avg=40042.26, stdev=33680.69 lat (usec): min=32, max=191796, avg=40050.54, stdev=33672.84 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 86], | 30.00th=[ 20841], 40.00th=[ 32113], 50.00th=[ 38011], 60.00th=[ 47449], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[147850], 99.50th=[187696], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 61, max= 415, per=25.07%, avg=202.04, stdev=82.25, samples=55 iops : min= 3, max= 25, avg=11.84, stdev= 5.17, samples=55 write: IOPS=14, BW=232KiB/s (237kB/s)(6544KiB/28240msec); 0 zone resets clat (usec): min=1285, max=202804, avg=33654.51, stdev=35026.73 lat (usec): min=1286, max=202806, avg=33657.05, stdev=35026.59 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2057], 10.00th=[ 3392], 20.00th=[ 6194], | 30.00th=[ 10028], 40.00th=[ 12911], 50.00th=[ 20579], 60.00th=[ 30016], | 70.00th=[ 41681], 80.00th=[ 57934], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[166724], 99.50th=[185598], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 411, per=27.21%, avg=230.75, stdev=79.71, samples=55 iops : min= 1, max= 25, avg=13.65, stdev= 5.03, samples=55 lat (usec) : 50=1.43%, 100=8.59%, 250=1.43%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.47%, 4=4.30%, 10=9.77%, 20=10.94%, 50=30.21% lat (msec) : 100=25.00%, 250=5.21% cpu : usr=0.11%, sys=5.56%, ctx=1363, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144383: Tue May 12 17:11:26 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29607msec) clat (usec): min=36, max=320095, avg=39853.04, stdev=37039.66 lat (usec): min=36, max=320097, avg=39855.71, stdev=37039.04 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 82], | 30.00th=[ 23200], 40.00th=[ 31327], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[168821], 99.50th=[246416], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 442, per=26.22%, avg=211.31, stdev=79.94, samples=58 iops : min= 1, max= 27, avg=12.41, stdev= 5.04, samples=58 write: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29607msec); 0 zone resets clat (usec): min=1329, max=311025, avg=36549.34, stdev=37614.58 lat (usec): min=1332, max=311028, avg=36567.87, stdev=37603.05 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1958], 10.00th=[ 2278], 20.00th=[ 5080], | 30.00th=[ 8848], 40.00th=[ 15139], 50.00th=[ 24511], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 65274], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[164627], 99.50th=[196084], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 29, max= 445, per=23.92%, avg=202.84, stdev=96.41, samples=58 iops : min= 1, max= 27, avg=11.88, stdev= 6.09, samples=58 lat (usec) : 50=1.30%, 100=10.81%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=3.26%, 4=4.30%, 10=9.11%, 20=7.16%, 50=32.94% lat (msec) : 100=25.26%, 250=4.82%, 500=0.26% cpu : usr=0.09%, sys=5.49%, ctx=1439, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144384: Tue May 12 17:11:26 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29655msec) clat (usec): min=36, max=202849, avg=41636.38, stdev=35316.31 lat (usec): min=36, max=202851, avg=41638.43, stdev=35316.76 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 87], | 30.00th=[ 22938], 40.00th=[ 30802], 50.00th=[ 40109], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[ 94897], | 99.00th=[183501], 99.50th=[200279], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 379, per=24.97%, avg=201.29, stdev=69.19, samples=58 iops : min= 1, max= 23, avg=11.81, stdev= 4.38, samples=58 write: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29655msec); 0 zone resets clat (usec): min=1189, max=363807, avg=35243.05, stdev=40181.40 lat (usec): min=1191, max=363810, avg=35246.60, stdev=40181.53 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1926], 10.00th=[ 2769], 20.00th=[ 4948], | 30.00th=[ 7767], 40.00th=[ 11469], 50.00th=[ 19268], 60.00th=[ 32637], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[112722], | 99.00th=[162530], 99.50th=[200279], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 62, max= 415, per=24.88%, avg=210.95, stdev=85.31, samples=58 iops : min= 3, max= 25, avg=12.40, stdev= 5.42, samples=58 lat (usec) : 50=1.04%, 100=9.77%, 250=0.65%, 500=0.39%, 750=0.26% lat (msec) : 2=3.65%, 4=5.08%, 10=10.68%, 20=7.94%, 50=27.47% lat (msec) : 100=27.99%, 250=4.95%, 500=0.13% cpu : usr=0.08%, sys=5.30%, ctx=1389, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=806KiB/s (826kB/s), 199KiB/s-211KiB/s (204kB/s-216kB/s), io=23.4MiB (24.5MB), run=28240-29703msec WRITE: bw=848KiB/s (869kB/s), 204KiB/s-232KiB/s (209kB/s-237kB/s), io=24.6MiB (25.8MB), run=28240-29703msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144386: Tue May 12 17:12:14 2026 read: IOPS=4, BW=79.3KiB/s (81.2kB/s)(5920KiB/74628msec) clat (msec): min=7, max=196, avg=42.49, stdev=31.60 lat (msec): min=7, max=196, avg=42.49, stdev=31.61 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 75], 95.00th=[ 111], | 99.00th=[ 165], 99.50th=[ 190], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 29, max= 381, per=28.58%, avg=88.61, stdev=57.68, samples=131 iops : min= 1, max= 23, avg= 4.73, stdev= 3.63, samples=131 write: IOPS=5, BW=85.3KiB/s (87.4kB/s)(6368KiB/74628msec); 0 zone resets clat (msec): min=42, max=462, avg=147.65, stdev=63.78 lat (msec): min=42, max=462, avg=147.66, stdev=63.78 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 85], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 123], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 190], 90.00th=[ 226], 95.00th=[ 279], | 99.00th=[ 384], 99.50th=[ 426], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 160, per=26.46%, avg=86.53, stdev=34.39, samples=144 iops : min= 1, max= 10, avg= 4.59, stdev= 2.24, samples=144 lat (msec) : 10=0.26%, 20=9.51%, 50=25.65%, 100=22.14%, 250=39.06% lat (msec) : 500=3.39% cpu : usr=0.05%, sys=1.35%, ctx=1403, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144387: Tue May 12 17:12:14 2026 read: IOPS=4, BW=74.6KiB/s (76.4kB/s)(5744KiB/77033msec) clat (msec): min=7, max=305, avg=46.35, stdev=40.27 lat (msec): min=7, max=305, avg=46.36, stdev=40.27 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 61], 90.00th=[ 85], 95.00th=[ 124], | 99.00th=[ 241], 99.50th=[ 255], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 28, max= 254, per=29.46%, avg=91.32, stdev=55.19, samples=123 iops : min= 1, max= 15, avg= 4.91, stdev= 3.50, samples=123 write: IOPS=5, BW=84.0KiB/s (86.0kB/s)(6544KiB/77033msec); 0 zone resets clat (msec): min=42, max=487, avg=147.36, stdev=68.54 lat (msec): min=42, max=487, avg=147.37, stdev=68.54 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 72], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 131], 60.00th=[ 144], | 70.00th=[ 167], 80.00th=[ 199], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 363], 99.50th=[ 393], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 30, max= 192, per=26.53%, avg=86.76, stdev=36.85, samples=148 iops : min= 1, max= 12, avg= 4.61, stdev= 2.36, samples=148 lat (msec) : 10=0.91%, 20=7.55%, 50=24.74%, 100=24.35%, 250=37.76% lat (msec) : 500=4.69% cpu : usr=0.05%, sys=1.42%, ctx=1462, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144388: Tue May 12 17:12:14 2026 read: IOPS=5, BW=87.5KiB/s (89.6kB/s)(6256KiB/71490msec) clat (msec): min=7, max=188, avg=38.89, stdev=31.51 lat (msec): min=7, max=188, avg=38.89, stdev=31.51 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 72], 95.00th=[ 103], | 99.00th=[ 178], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 30, max= 318, per=31.57%, avg=97.87, stdev=64.95, samples=126 iops : min= 1, max= 19, avg= 5.31, stdev= 4.10, samples=126 write: IOPS=5, BW=84.4KiB/s (86.4kB/s)(6032KiB/71490msec); 0 zone resets clat (msec): min=50, max=514, avg=149.00, stdev=67.69 lat (msec): min=50, max=515, avg=149.01, stdev=67.72 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 122], 50.00th=[ 133], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 388], 99.50th=[ 393], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 28, max= 159, per=26.33%, avg=86.11, stdev=33.08, samples=137 iops : min= 1, max= 9, avg= 4.57, stdev= 2.12, samples=137 lat (msec) : 10=0.65%, 20=11.20%, 50=28.52%, 100=18.88%, 250=36.72% lat (msec) : 500=3.91%, 750=0.13% cpu : usr=0.04%, sys=1.28%, ctx=1369, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144391: Tue May 12 17:12:14 2026 read: IOPS=4, BW=79.0KiB/s (81.9kB/s)(6032KiB/75431msec) clat (msec): min=7, max=238, avg=43.75, stdev=33.27 lat (msec): min=7, max=238, avg=43.76, stdev=33.27 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 59], 90.00th=[ 85], 95.00th=[ 112], | 99.00th=[ 174], 99.50th=[ 190], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 30, max= 287, per=29.91%, avg=92.72, stdev=56.90, samples=127 iops : min= 1, max= 17, avg= 4.98, stdev= 3.60, samples=127 write: IOPS=5, BW=82.9KiB/s (84.9kB/s)(6256KiB/75431msec); 0 zone resets clat (msec): min=41, max=487, avg=150.50, stdev=67.65 lat (msec): min=41, max=487, avg=150.51, stdev=67.65 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 95], | 30.00th=[ 107], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 190], 90.00th=[ 241], 95.00th=[ 292], | 99.00th=[ 363], 99.50th=[ 418], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 28, max= 160, per=25.22%, avg=82.48, stdev=35.55, samples=149 iops : min= 1, max= 10, avg= 4.34, stdev= 2.27, samples=149 lat (msec) : 10=0.78%, 20=7.68%, 50=27.99%, 100=20.44%, 250=38.54% lat (msec) : 500=4.56% cpu : usr=0.05%, sys=1.32%, ctx=1448, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=311KiB/s (318kB/s), 74.6KiB/s-87.5KiB/s (76.4kB/s-89.6kB/s), io=23.4MiB (24.5MB), run=71490-77033msec WRITE: bw=327KiB/s (335kB/s), 82.9KiB/s-85.3KiB/s (84.9kB/s-87.4kB/s), io=24.6MiB (25.8MB), run=71490-77033msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144411: Tue May 12 17:12:30 2026 read: IOPS=1, BW=1954KiB/s (2001kB/s)(7168KiB/3668msec) clat (usec): min=486, max=828990, avg=319163.76, stdev=286521.47 lat (usec): min=487, max=828991, avg=319165.50, stdev=286521.31 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 7832], | 30.00th=[261096], 40.00th=[261096], 50.00th=[299893], 60.00th=[341836], | 70.00th=[341836], 80.00th=[492831], 90.00th=[826278], 95.00th=[826278], | 99.00th=[826278], 99.50th=[826278], 99.90th=[826278], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 1512, max= 3961, per=49.08%, avg=2326.00, stdev=1106.55, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1396KiB/s (1429kB/s)(5120KiB/3668msec); 0 zone resets clat (msec): min=128, max=373, avg=235.97, stdev=99.72 lat (msec): min=128, max=373, avg=236.09, stdev=99.72 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1932, max= 3961, per=39.85%, avg=2644.00, stdev=1141.81, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=50.00%, 1000=8.33% cpu : usr=0.00%, sys=10.17%, ctx=241, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144413: Tue May 12 17:12:30 2026 read: IOPS=0, BW=474KiB/s (485kB/s)(2048KiB/4321msec) clat (msec): min=5, max=245, avg=125.11, stdev=169.80 lat (msec): min=5, max=245, avg=125.11, stdev=169.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 1526, max= 2039, per=37.61%, avg=1782.50, stdev=362.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2370KiB/s (2427kB/s)(10.0MiB/4321msec); 0 zone resets clat (msec): min=83, max=646, avg=371.59, stdev=194.93 lat (msec): min=83, max=646, avg=371.82, stdev=195.01 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 109], | 30.00th=[ 234], 40.00th=[ 313], 50.00th=[ 334], 60.00th=[ 384], | 70.00th=[ 468], 80.00th=[ 558], 90.00th=[ 584], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1932, max= 5976, per=53.55%, avg=3553.20, stdev=1681.52, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 10=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=25.00% cpu : usr=0.02%, sys=11.62%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144414: Tue May 12 17:12:30 2026 read: IOPS=1, BW=1471KiB/s (1506kB/s)(6144KiB/4178msec) clat (usec): min=557, max=460307, avg=144327.96, stdev=218909.74 lat (usec): min=559, max=460309, avg=144329.65, stdev=218909.79 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 668], 50.00th=[ 668], 60.00th=[ 13304], | 70.00th=[392168], 80.00th=[392168], 90.00th=[459277], 95.00th=[459277], | 99.00th=[459277], 99.50th=[459277], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 1980, max= 4079, per=69.80%, avg=3307.67, stdev=1154.81, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1471KiB/s (1506kB/s)(6144KiB/4178msec); 0 zone resets clat (msec): min=175, max=1005, avg=496.26, stdev=339.47 lat (msec): min=175, max=1005, avg=496.41, stdev=339.39 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 558], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1519, max= 2035, per=28.47%, avg=1889.20, stdev=210.13, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=25.00% lat (msec) : 20=8.33%, 250=16.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=7.42%, ctx=147, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144415: Tue May 12 17:12:30 2026 read: IOPS=1, BW=1350KiB/s (1383kB/s)(5120KiB/3792msec) clat (usec): min=1294, max=452096, avg=197098.23, stdev=208740.24 lat (usec): min=1295, max=452098, avg=197100.02, stdev=208740.26 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1287], 10.00th=[ 1287], 20.00th=[ 1287], | 30.00th=[ 1893], 40.00th=[ 1893], 50.00th=[156238], 60.00th=[156238], | 70.00th=[375391], 80.00th=[375391], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 1932, max= 5941, per=83.07%, avg=3936.50, stdev=2834.79, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1890KiB/s (1936kB/s)(7168KiB/3792msec); 0 zone resets clat (msec): min=254, max=531, avg=394.06, stdev=111.61 lat (msec): min=254, max=532, avg=394.19, stdev=111.60 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 284], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 384], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 506], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1514, max= 2039, per=28.63%, avg=1899.83, stdev=196.96, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 2=16.67%, 250=8.33%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=11.42%, ctx=164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4740KiB/s (4853kB/s), 474KiB/s-1954KiB/s (485kB/s-2001kB/s), io=20.0MiB (20.0MB), run=3668-4321msec WRITE: bw=6636KiB/s (6795kB/s), 1396KiB/s-2370KiB/s (1429kB/s-2427kB/s), io=28.0MiB (29.4MB), run=3668-4321msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144416: Tue May 12 17:12:32 2026 read: IOPS=1, BW=1227KiB/s (1257kB/s)(7168KiB/5841msec) clat (msec): min=141, max=861, avg=386.94, stdev=296.52 lat (msec): min=141, max=861, avg=386.95, stdev=296.52 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 146], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 234], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 726], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2011, max= 4055, per=69.29%, avg=2429.40, stdev=908.80, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=877KiB/s (898kB/s)(5120KiB/5841msec); 0 zone resets clat (msec): min=184, max=1260, avg=476.93, stdev=444.87 lat (msec): min=184, max=1260, avg=477.04, stdev=444.88 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 2011, max= 4079, per=68.85%, avg=3379.00, stdev=1184.83, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.69%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144417: Tue May 12 17:12:32 2026 read: IOPS=0, BW=391KiB/s (400kB/s)(2048KiB/5242msec) clat (msec): min=215, max=344, avg=279.60, stdev=91.31 lat (msec): min=215, max=344, avg=279.60, stdev=91.32 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 2011, max= 2019, per=57.47%, avg=2015.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1953KiB/s (2000kB/s)(10.0MiB/5242msec); 0 zone resets clat (msec): min=176, max=971, avg=399.23, stdev=267.69 lat (msec): min=176, max=971, avg=399.36, stdev=267.69 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 220], 40.00th=[ 292], 50.00th=[ 313], 60.00th=[ 330], | 70.00th=[ 338], 80.00th=[ 376], 90.00th=[ 802], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1914, max= 4096, per=57.57%, avg=2825.40, stdev=1152.96, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 1000=16.67% cpu : usr=0.00%, sys=3.66%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144418: Tue May 12 17:12:32 2026 read: IOPS=1, BW=1158KiB/s (1186kB/s)(6144KiB/5304msec) clat (msec): min=129, max=396, avg=238.31, stdev=106.63 lat (msec): min=129, max=396, avg=238.31, stdev=106.63 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 222], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2039, max= 4087, per=96.49%, avg=3383.00, stdev=1164.38, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1158KiB/s (1186kB/s)(6144KiB/5304msec); 0 zone resets clat (msec): min=221, max=954, avg=591.42, stdev=248.34 lat (msec): min=221, max=954, avg=591.54, stdev=248.34 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 600], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1914, max= 2048, per=41.04%, avg=2014.33, stdev=50.20, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=3.09%, ctx=139, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144419: Tue May 12 17:12:32 2026 read: IOPS=0, BW=944KiB/s (967kB/s)(5120KiB/5424msec) clat (msec): min=71, max=402, avg=242.42, stdev=145.31 lat (msec): min=71, max=402, avg=242.42, stdev=145.31 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1914, max= 4023, per=75.83%, avg=2658.67, stdev=1183.20, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1322KiB/s (1353kB/s)(7168KiB/5424msec); 0 zone resets clat (msec): min=173, max=1084, avg=587.89, stdev=383.48 lat (msec): min=173, max=1085, avg=588.13, stdev=383.65 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 222], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 443], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1914, max= 2048, per=41.10%, avg=2017.00, stdev=51.42, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.06%, ctx=118, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3506KiB/s (3590kB/s), 391KiB/s-1227KiB/s (400kB/s-1257kB/s), io=20.0MiB (20.0MB), run=5242-5841msec WRITE: bw=4909KiB/s (5027kB/s), 877KiB/s-1953KiB/s (898kB/s-2000kB/s), io=28.0MiB (29.4MB), run=5242-5841msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144431: Tue May 12 17:12:49 2026 read: IOPS=1, BW=4115KiB/s (4214kB/s)(12.0MiB/2986msec) clat (msec): min=877, max=1104, avg=970.30, stdev=119.16 lat (msec): min=877, max=1104, avg=970.31, stdev=119.16 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7876, max= 7937, per=100.00%, avg=7906.50, stdev=43.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.84%, ctx=343, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144432: Tue May 12 17:12:49 2026 read: IOPS=0, BW=1125KiB/s (1152kB/s)(4096KiB/3640msec) clat (nsec): min=1008.6M, max=1008.6M, avg=1008575272.00, stdev= 0.00 lat (nsec): min=1008.6M, max=1008.6M, avg=1008578069.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2251KiB/s (2305kB/s)(8192KiB/3640msec); 0 zone resets clat (msec): min=1268, max=1319, avg=1293.93, stdev=36.23 lat (msec): min=1268, max=1327, avg=1298.00, stdev=41.32 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8094, max= 8094, per=95.50%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.68%, ctx=123, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144433: Tue May 12 17:12:49 2026 write: IOPS=0, BW=3178KiB/s (3255kB/s)(12.0MiB/3866msec); 0 zone resets clat (msec): min=606, max=1828, avg=1191.98, stdev=612.47 lat (msec): min=608, max=1832, avg=1194.11, stdev=613.53 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 7656, max= 8094, per=92.92%, avg=7875.00, stdev=309.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.66%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144434: Tue May 12 17:12:49 2026 write: IOPS=1, BW=4679KiB/s (4792kB/s)(12.0MiB/2626msec); 0 zone resets clat (msec): min=469, max=1494, avg=848.75, stdev=562.23 lat (msec): min=472, max=1495, avg=850.44, stdev=561.16 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7447, max= 8192, per=92.27%, avg=7819.50, stdev=526.79, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.73%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4501KiB/s (4609kB/s), 1125KiB/s-4115KiB/s (1152kB/s-4214kB/s), io=16.0MiB (16.8MB), run=2986-3640msec WRITE: bw=8476KiB/s (8679kB/s), 2251KiB/s-4679KiB/s (2305kB/s-4792kB/s), io=32.0MiB (33.6MB), run=2626-3866msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144427: Tue May 12 17:12:49 2026 read: IOPS=0, BW=3204KiB/s (3281kB/s)(12.0MiB/3835msec) clat (msec): min=961, max=1568, avg=1237.41, stdev=306.92 lat (msec): min=961, max=1568, avg=1237.42, stdev=306.92 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8000, max= 8126, per=100.00%, avg=8063.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.45%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144428: Tue May 12 17:12:49 2026 read: IOPS=0, BW=1047KiB/s (1072kB/s)(4096KiB/3912msec) clat (nsec): min=1253.2M, max=1253.2M, avg=1253235420.00, stdev= 0.00 lat (nsec): min=1253.2M, max=1253.2M, avg=1253238910.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2094KiB/s (2144kB/s)(8192KiB/3912msec); 0 zone resets clat (msec): min=596, max=1981, avg=1288.79, stdev=979.74 lat (msec): min=596, max=1982, avg=1289.55, stdev=979.43 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1989], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8143, max= 8143, per=97.22%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.45%, ctx=55, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144429: Tue May 12 17:12:49 2026 write: IOPS=1, BW=5857KiB/s (5998kB/s)(12.0MiB/2098msec); 0 zone resets clat (msec): min=351, max=1160, avg=662.29, stdev=436.29 lat (msec): min=351, max=1161, avg=663.01, stdev=436.16 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 6930, max= 7968, per=88.93%, avg=7449.00, stdev=733.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.14%, sys=5.82%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144430: Tue May 12 17:12:49 2026 write: IOPS=1, BW=4187KiB/s (4287kB/s)(12.0MiB/2935msec); 0 zone resets clat (msec): min=403, max=1394, avg=898.90, stdev=495.37 lat (msec): min=404, max=1395, avg=899.37, stdev=495.32 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8110, max= 8126, per=96.92%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.27%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4188KiB/s (4289kB/s), 1047KiB/s-3204KiB/s (1072kB/s-3281kB/s), io=16.0MiB (16.8MB), run=3835-3912msec WRITE: bw=8376KiB/s (8577kB/s), 2094KiB/s-5857KiB/s (2144kB/s-5998kB/s), io=32.0MiB (33.6MB), run=2098-3912msec