== sanity test 398b: DIO and buffer IO race ============== 05:39:43 (1786009183) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.81357 s, 6.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143233: Thu Aug 6 05:42:56 2026 read: IOPS=8, BW=35.3KiB/s (36.1kB/s)(5992KiB/169825msec) clat (usec): min=34, max=1089.1k, avg=56584.48, stdev=51184.54 lat (usec): min=34, max=1089.1k, avg=56586.86, stdev=51183.85 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 2868], | 20.00th=[ 25822], 30.00th=[ 32900], 40.00th=[ 39584], | 50.00th=[ 46924], 60.00th=[ 56361], 70.00th=[ 67634], | 80.00th=[ 81265], 90.00th=[ 109577], 95.00th=[ 132645], | 99.00th=[ 196084], 99.50th=[ 267387], 99.90th=[ 509608], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 6, max= 87, per=25.46%, avg=35.64, stdev=15.71, samples=325 iops : min= 1, max= 21, avg= 8.25, stdev= 3.95, samples=325 write: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6296KiB/169825msec); 0 zone resets clat (usec): min=1025, max=538673, avg=53614.30, stdev=54617.96 lat (usec): min=1026, max=538674, avg=53616.37, stdev=54617.48 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1270], 10.00th=[ 1582], 20.00th=[ 5997], | 30.00th=[ 11994], 40.00th=[ 25035], 50.00th=[ 42206], 60.00th=[ 55313], | 70.00th=[ 69731], 80.00th=[ 89654], 90.00th=[124257], 95.00th=[158335], | 99.00th=[233833], 99.50th=[274727], 99.90th=[325059], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 109, per=24.94%, avg=36.66, stdev=16.55, samples=332 iops : min= 1, max= 27, avg= 8.52, stdev= 4.18, samples=332 lat (usec) : 50=1.01%, 100=3.35%, 250=0.23%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.44%, 4=2.28%, 10=6.80%, 20=6.28%, 50=28.84% lat (msec) : 100=31.18%, 250=13.80%, 500=0.52%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=3.93%, ctx=6205, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143234: Thu Aug 6 05:42:56 2026 read: IOPS=9, BW=36.3KiB/s (37.2kB/s)(5940KiB/163511msec) clat (usec): min=31, max=326762, avg=53497.32, stdev=37998.72 lat (usec): min=32, max=326763, avg=53499.23, stdev=37999.02 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 1156], 20.00th=[ 24511], | 30.00th=[ 31851], 40.00th=[ 39060], 50.00th=[ 46400], 60.00th=[ 56361], | 70.00th=[ 67634], 80.00th=[ 81265], 90.00th=[104334], 95.00th=[121111], | 99.00th=[162530], 99.50th=[191890], 99.90th=[278922], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 6, max= 95, per=26.21%, avg=36.70, stdev=16.53, samples=313 iops : min= 1, max= 23, avg= 8.52, stdev= 4.17, samples=313 write: IOPS=9, BW=38.8KiB/s (39.8kB/s)(6348KiB/163511msec); 0 zone resets clat (usec): min=1022, max=1175.9k, avg=52612.05, stdev=66212.39 lat (usec): min=1023, max=1175.9k, avg=52613.97, stdev=66212.01 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1270], 10.00th=[ 1663], | 20.00th=[ 6128], 30.00th=[ 11600], 40.00th=[ 22152], | 50.00th=[ 35914], 60.00th=[ 50594], 70.00th=[ 68682], | 80.00th=[ 89654], 90.00th=[ 122160], 95.00th=[ 154141], | 99.00th=[ 244319], 99.50th=[ 278922], 99.90th=[1149240], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 102, per=26.35%, avg=38.74, stdev=18.52, samples=317 iops : min= 1, max= 25, avg= 9.03, stdev= 4.66, samples=317 lat (usec) : 50=0.75%, 100=3.74%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.63%, 4=2.41%, 10=6.87%, 20=7.58%, 50=29.26% lat (msec) : 100=29.20%, 250=13.74%, 500=0.46%, 2000=0.07% cpu : usr=0.06%, sys=4.12%, ctx=6041, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143235: Thu Aug 6 05:42:56 2026 read: IOPS=8, BW=35.4KiB/s (36.2kB/s)(6028KiB/170340msec) clat (usec): min=30, max=1112.2k, avg=54247.23, stdev=49936.89 lat (usec): min=30, max=1112.2k, avg=54248.45, stdev=49936.97 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 84], | 20.00th=[ 24249], 30.00th=[ 31851], 40.00th=[ 38536], | 50.00th=[ 46400], 60.00th=[ 54789], 70.00th=[ 65274], | 80.00th=[ 81265], 90.00th=[ 105382], 95.00th=[ 125305], | 99.00th=[ 183501], 99.50th=[ 217056], 99.90th=[ 557843], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 95, per=25.49%, avg=35.69, stdev=16.29, samples=327 iops : min= 1, max= 23, avg= 8.26, stdev= 4.13, samples=327 write: IOPS=9, BW=36.8KiB/s (37.6kB/s)(6260KiB/170340msec); 0 zone resets clat (usec): min=1046, max=1047.5k, avg=56273.69, stdev=61629.81 lat (usec): min=1047, max=1047.5k, avg=56276.45, stdev=61630.96 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1287], 10.00th=[ 1729], | 20.00th=[ 6718], 30.00th=[ 13698], 40.00th=[ 27657], | 50.00th=[ 41157], 60.00th=[ 54789], 70.00th=[ 73925], | 80.00th=[ 96994], 90.00th=[ 128451], 95.00th=[ 160433], | 99.00th=[ 238027], 99.50th=[ 299893], 99.90th=[ 534774], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 7, max= 127, per=24.90%, avg=36.61, stdev=17.73, samples=331 iops : min= 1, max= 31, avg= 8.50, stdev= 4.46, samples=331 lat (usec) : 50=1.07%, 100=4.00%, 250=0.26%, 500=0.07%, 1000=0.07% lat (msec) : 2=5.57%, 4=1.63%, 10=6.09%, 20=6.54%, 50=30.37% lat (msec) : 100=29.04%, 250=14.68%, 500=0.49%, 750=0.07%, 2000=0.07% cpu : usr=0.05%, sys=4.12%, ctx=6302, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143236: Thu Aug 6 05:42:56 2026 read: IOPS=8, BW=35.5KiB/s (36.3kB/s)(6052KiB/170661msec) clat (usec): min=28, max=542201, avg=55378.15, stdev=44977.77 lat (usec): min=28, max=542202, avg=55379.75, stdev=44978.16 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 110], 20.00th=[ 22938], | 30.00th=[ 31327], 40.00th=[ 39584], 50.00th=[ 47973], 60.00th=[ 56886], | 70.00th=[ 66847], 80.00th=[ 81265], 90.00th=[106431], 95.00th=[128451], | 99.00th=[212861], 99.50th=[270533], 99.90th=[400557], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 95, per=25.61%, avg=35.85, stdev=17.36, samples=324 iops : min= 1, max= 23, avg= 8.30, stdev= 4.38, samples=324 write: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6236KiB/170661msec); 0 zone resets clat (usec): min=1027, max=1111.9k, avg=55352.87, stdev=65344.69 lat (usec): min=1028, max=1111.9k, avg=55376.52, stdev=65343.72 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1254], 10.00th=[ 1401], | 20.00th=[ 5866], 30.00th=[ 10945], 40.00th=[ 24773], | 50.00th=[ 40109], 60.00th=[ 55837], 70.00th=[ 71828], | 80.00th=[ 95945], 90.00th=[ 129500], 95.00th=[ 162530], | 99.00th=[ 246416], 99.50th=[ 278922], 99.90th=[ 876610], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 6, max= 103, per=24.85%, avg=36.54, stdev=17.95, samples=328 iops : min= 1, max= 25, avg= 8.48, stdev= 4.53, samples=328 lat (usec) : 50=1.07%, 100=3.84%, 250=0.20%, 500=0.03%, 750=0.03% lat (msec) : 2=6.41%, 4=1.82%, 10=6.90%, 20=6.51%, 50=27.44% lat (msec) : 100=30.57%, 250=14.39%, 500=0.68%, 750=0.03%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.06%, sys=4.00%, ctx=6176, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=141KiB/s (144kB/s), 35.3KiB/s-36.3KiB/s (36.1kB/s-37.2kB/s), io=23.4MiB (24.6MB), run=163511-170661msec WRITE: bw=147KiB/s (151kB/s), 36.5KiB/s-38.8KiB/s (37.4kB/s-39.8kB/s), io=24.6MiB (25.7MB), run=163511-170661msec fio: pid=143239, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=143238: Thu Aug 6 05:45:56 2026 read: IOPS=4, BW=17.2KiB/s (17.6kB/s)(5992KiB/349062msec) clat (msec): min=5, max=1201, avg=47.73, stdev=58.52 lat (msec): min=5, max=1201, avg=47.73, stdev=58.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 97], 95.00th=[ 136], | 99.00th=[ 257], 99.50th=[ 309], 99.90th=[ 852], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 87, per=37.47%, avg=21.36, stdev=15.19, samples=540 iops : min= 1, max= 21, avg= 4.75, stdev= 3.86, samples=540 write: IOPS=4, BW=18.0KiB/s (18.5kB/s)(6296KiB/349062msec); 0 zone resets clat (msec): min=39, max=699, avg=176.25, stdev=94.55 lat (msec): min=39, max=699, avg=176.25, stdev=94.55 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 101], | 30.00th=[ 116], 40.00th=[ 136], 50.00th=[ 155], 60.00th=[ 176], | 70.00th=[ 207], 80.00th=[ 243], 90.00th=[ 300], 95.00th=[ 359], | 99.00th=[ 506], 99.50th=[ 575], 99.90th=[ 693], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 56, per=30.10%, avg=18.06, stdev= 9.17, samples=666 iops : min= 1, max= 14, avg= 3.90, stdev= 2.37, samples=666 lat (msec) : 10=2.18%, 20=11.26%, 50=20.90%, 100=20.05%, 250=36.10% lat (msec) : 500=8.85%, 750=0.59%, 1000=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.09%, ctx=5737, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=143239: Thu Aug 6 05:45:56 2026 read: IOPS=2, BW=11.3KiB/s (11.5kB/s)(2188KiB/194177msec) clat (msec): min=7, max=1101, avg=82.11, stdev=87.65 lat (msec): min=7, max=1101, avg=82.11, stdev=87.65 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 18], 10.00th=[ 24], 20.00th=[ 32], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 63], 60.00th=[ 81], | 70.00th=[ 95], 80.00th=[ 116], 90.00th=[ 150], 95.00th=[ 186], | 99.00th=[ 418], 99.50th=[ 584], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 80, per=27.21%, avg=15.51, stdev=11.07, samples=264 iops : min= 1, max= 20, avg= 3.22, stdev= 2.79, samples=264 write: IOPS=3, BW=12.4KiB/s (12.7kB/s)(2404KiB/194177msec); 0 zone resets clat (msec): min=57, max=707, avg=248.09, stdev=96.08 lat (msec): min=57, max=707, avg=248.11, stdev=96.09 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 116], 10.00th=[ 133], 20.00th=[ 167], | 30.00th=[ 197], 40.00th=[ 220], 50.00th=[ 236], 60.00th=[ 257], | 70.00th=[ 284], 80.00th=[ 313], 90.00th=[ 372], 95.00th=[ 418], | 99.00th=[ 527], 99.50th=[ 567], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 39, per=20.90%, avg=12.54, stdev= 5.91, samples=358 iops : min= 1, max= 9, avg= 2.48, stdev= 1.54, samples=358 lat (msec) : 10=0.61%, 20=2.61%, 50=16.36%, 100=16.80%, 250=39.43% lat (msec) : 500=22.72%, 750=1.22%, 2000=0.17% cpu : usr=0.02%, sys=0.74%, ctx=1636, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=548,601,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143240: Thu Aug 6 05:45:56 2026 read: IOPS=4, BW=17.2KiB/s (17.6kB/s)(6028KiB/349803msec) clat (msec): min=6, max=501, avg=49.07, stdev=49.29 lat (msec): min=6, max=501, avg=49.07, stdev=49.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 107], 95.00th=[ 144], | 99.00th=[ 247], 99.50th=[ 321], 99.90th=[ 426], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 95, per=35.93%, avg=20.48, stdev=13.79, samples=565 iops : min= 1, max= 23, avg= 4.52, stdev= 3.47, samples=565 write: IOPS=4, BW=17.9KiB/s (18.3kB/s)(6260KiB/349803msec); 0 zone resets clat (msec): min=37, max=1277, avg=176.18, stdev=99.38 lat (msec): min=37, max=1277, avg=176.18, stdev=99.38 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 101], | 30.00th=[ 118], 40.00th=[ 136], 50.00th=[ 155], 60.00th=[ 178], | 70.00th=[ 203], 80.00th=[ 239], 90.00th=[ 305], 95.00th=[ 351], | 99.00th=[ 477], 99.50th=[ 567], 99.90th=[ 1250], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 64, per=30.25%, avg=18.15, stdev= 9.51, samples=658 iops : min= 1, max= 16, avg= 3.93, stdev= 2.45, samples=658 lat (msec) : 10=2.15%, 20=11.07%, 50=20.93%, 100=19.76%, 250=36.56% lat (msec) : 500=9.11%, 750=0.36%, 2000=0.07% cpu : usr=0.02%, sys=1.06%, ctx=5703, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143241: Thu Aug 6 05:45:56 2026 read: IOPS=4, BW=17.3KiB/s (17.8kB/s)(6052KiB/348822msec) clat (msec): min=5, max=511, avg=46.57, stdev=47.90 lat (msec): min=5, max=511, avg=46.57, stdev=47.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 102], 95.00th=[ 136], | 99.00th=[ 266], 99.50th=[ 305], 99.90th=[ 409], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 87, per=38.53%, avg=21.96, stdev=15.29, samples=530 iops : min= 1, max= 21, avg= 4.88, stdev= 3.89, samples=530 write: IOPS=4, BW=17.9KiB/s (18.3kB/s)(6236KiB/348822msec); 0 zone resets clat (msec): min=40, max=1317, avg=178.46, stdev=103.62 lat (msec): min=40, max=1317, avg=178.47, stdev=103.62 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 100], | 30.00th=[ 116], 40.00th=[ 136], 50.00th=[ 157], 60.00th=[ 180], | 70.00th=[ 205], 80.00th=[ 243], 90.00th=[ 305], 95.00th=[ 363], | 99.00th=[ 506], 99.50th=[ 634], 99.90th=[ 1267], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 56, per=30.21%, avg=18.13, stdev= 9.38, samples=657 iops : min= 1, max= 14, avg= 3.92, stdev= 2.40, samples=657 lat (msec) : 10=2.15%, 20=11.49%, 50=22.04%, 100=19.01%, 250=35.64% lat (msec) : 500=9.08%, 750=0.46%, 1000=0.07%, 2000=0.07% cpu : usr=0.03%, sys=1.07%, ctx=5667, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=57.9KiB/s (59.3kB/s), 11.3KiB/s-17.3KiB/s (11.5kB/s-17.8kB/s), io=19.8MiB (20.7MB), run=194177-349803msec WRITE: bw=60.6KiB/s (62.0kB/s), 12.4KiB/s-18.0KiB/s (12.7kB/s-18.5kB/s), io=20.7MiB (21.7MB), run=194177-349803msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143306: Thu Aug 6 05:46:50 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(5920KiB/39561msec) clat (usec): min=31, max=274831, avg=52227.65, stdev=46829.41 lat (usec): min=31, max=274831, avg=52228.81, stdev=46829.43 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 51], 10.00th=[ 59], 20.00th=[ 75], | 30.00th=[ 23200], 40.00th=[ 38536], 50.00th=[ 46400], 60.00th=[ 58459], | 70.00th=[ 70779], 80.00th=[ 88605], 90.00th=[107480], 95.00th=[135267], | 99.00th=[206570], 99.50th=[267387], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 413, per=25.14%, avg=152.08, stdev=69.70, samples=76 iops : min= 1, max= 25, avg= 8.72, stdev= 4.38, samples=76 write: IOPS=10, BW=161KiB/s (165kB/s)(6368KiB/39561msec); 0 zone resets clat (usec): min=1401, max=353298, avg=50264.79, stdev=54303.54 lat (usec): min=1402, max=353301, avg=50266.88, stdev=54303.61 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1876], 10.00th=[ 4621], 20.00th=[ 7373], | 30.00th=[ 12125], 40.00th=[ 18482], 50.00th=[ 29754], 60.00th=[ 46924], | 70.00th=[ 65799], 80.00th=[ 90702], 90.00th=[113771], 95.00th=[162530], | 99.00th=[274727], 99.50th=[291505], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 22, max= 442, per=25.70%, avg=163.45, stdev=87.33, samples=76 iops : min= 1, max= 27, avg= 9.45, stdev= 5.53, samples=76 lat (usec) : 50=2.21%, 100=9.11%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=2.99%, 4=2.08%, 10=8.85%, 20=8.98%, 50=23.05% lat (msec) : 100=27.60%, 250=13.15%, 500=0.78% cpu : usr=0.05%, sys=4.23%, ctx=1414, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143307: Thu Aug 6 05:46:50 2026 read: IOPS=9, BW=154KiB/s (157kB/s)(5744KiB/37382msec) clat (usec): min=32, max=341351, avg=54654.47, stdev=48473.11 lat (usec): min=33, max=341352, avg=54655.65, stdev=48473.16 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 80], | 30.00th=[ 26870], 40.00th=[ 40109], 50.00th=[ 50070], 60.00th=[ 58459], | 70.00th=[ 71828], 80.00th=[ 89654], 90.00th=[116917], 95.00th=[135267], | 99.00th=[221250], 99.50th=[229639], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 22, max= 413, per=25.36%, avg=153.43, stdev=72.93, samples=72 iops : min= 1, max= 25, avg= 8.83, stdev= 4.61, samples=72 write: IOPS=10, BW=175KiB/s (179kB/s)(6544KiB/37382msec); 0 zone resets clat (usec): min=1440, max=261051, avg=42542.66, stdev=46177.61 lat (usec): min=1441, max=261053, avg=42544.94, stdev=46177.48 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1876], 10.00th=[ 3916], 20.00th=[ 7046], | 30.00th=[ 10421], 40.00th=[ 14091], 50.00th=[ 23462], 60.00th=[ 35914], | 70.00th=[ 54789], 80.00th=[ 79168], 90.00th=[107480], 95.00th=[135267], | 99.00th=[198181], 99.50th=[246416], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 60, max= 380, per=27.42%, avg=174.38, stdev=86.36, samples=72 iops : min= 3, max= 23, avg=10.14, stdev= 5.48, samples=72 lat (usec) : 50=1.69%, 100=8.98%, 250=0.65%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.52%, 4=2.60%, 10=9.64%, 20=10.42%, 50=21.48% lat (msec) : 100=26.82%, 250=13.54%, 500=0.39% cpu : usr=0.06%, sys=4.88%, ctx=1396, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143308: Thu Aug 6 05:46:50 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6256KiB/38226msec) clat (usec): min=36, max=215902, avg=51906.18, stdev=43563.43 lat (usec): min=36, max=215904, avg=51907.44, stdev=43563.44 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 92], | 30.00th=[ 27395], 40.00th=[ 38536], 50.00th=[ 47973], 60.00th=[ 57410], | 70.00th=[ 68682], 80.00th=[ 88605], 90.00th=[110625], 95.00th=[130548], | 99.00th=[185598], 99.50th=[187696], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 61, max= 437, per=27.15%, avg=164.26, stdev=63.58, samples=74 iops : min= 3, max= 27, avg= 9.50, stdev= 4.00, samples=74 write: IOPS=9, BW=158KiB/s (162kB/s)(6032KiB/38226msec); 0 zone resets clat (usec): min=1407, max=444603, avg=47322.55, stdev=52109.90 lat (usec): min=1408, max=444606, avg=47324.73, stdev=52109.86 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1860], 10.00th=[ 4686], 20.00th=[ 8586], | 30.00th=[ 12911], 40.00th=[ 18482], 50.00th=[ 29492], 60.00th=[ 41681], | 70.00th=[ 57410], 80.00th=[ 80217], 90.00th=[115868], 95.00th=[154141], | 99.00th=[229639], 99.50th=[263193], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 30, max= 345, per=24.72%, avg=157.24, stdev=70.00, samples=74 iops : min= 1, max= 21, avg= 9.05, stdev= 4.44, samples=74 lat (usec) : 50=1.17%, 100=9.38%, 250=0.65%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=3.78%, 4=1.43%, 10=6.90%, 20=9.51%, 50=24.61% lat (msec) : 100=28.52%, 250=12.89%, 500=0.39% cpu : usr=0.07%, sys=4.84%, ctx=1456, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143309: Thu Aug 6 05:46:50 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39199msec) clat (usec): min=39, max=315961, avg=53645.41, stdev=47567.93 lat (usec): min=39, max=315963, avg=53646.60, stdev=47567.94 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 61], 20.00th=[ 87], | 30.00th=[ 27132], 40.00th=[ 39584], 50.00th=[ 48497], 60.00th=[ 59507], | 70.00th=[ 71828], 80.00th=[ 89654], 90.00th=[113771], 95.00th=[137364], | 99.00th=[206570], 99.50th=[252707], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 30, max= 319, per=25.48%, avg=154.13, stdev=62.58, samples=75 iops : min= 1, max= 19, avg= 8.87, stdev= 3.97, samples=75 write: IOPS=9, BW=160KiB/s (163kB/s)(6256KiB/39199msec); 0 zone resets clat (usec): min=1559, max=353162, avg=47745.01, stdev=49415.56 lat (usec): min=1561, max=353164, avg=47747.46, stdev=49415.39 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1811], 10.00th=[ 4178], 20.00th=[ 8586], | 30.00th=[ 11731], 40.00th=[ 17171], 50.00th=[ 30540], 60.00th=[ 43779], | 70.00th=[ 62129], 80.00th=[ 83362], 90.00th=[116917], 95.00th=[149947], | 99.00th=[191890], 99.50th=[200279], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 318, per=25.38%, avg=161.44, stdev=65.34, samples=75 iops : min= 1, max= 19, avg= 9.32, stdev= 4.14, samples=75 lat (usec) : 50=1.17%, 100=8.85%, 250=1.17%, 500=0.26%, 750=0.13% lat (msec) : 2=4.17%, 4=1.69%, 10=7.81%, 20=9.38%, 50=22.79% lat (msec) : 100=27.73%, 250=14.45%, 500=0.39% cpu : usr=0.06%, sys=4.63%, ctx=1518, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=605KiB/s (620kB/s), 150KiB/s-164KiB/s (153kB/s-168kB/s), io=23.4MiB (24.5MB), run=37382-39561msec WRITE: bw=637KiB/s (652kB/s), 158KiB/s-175KiB/s (162kB/s-179kB/s), io=24.6MiB (25.8MB), run=37382-39561msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143310: Thu Aug 6 05:47:41 2026 read: IOPS=4, BW=64.9KiB/s (66.5kB/s)(5920KiB/91197msec) clat (msec): min=6, max=486, avg=53.06, stdev=56.69 lat (msec): min=6, max=486, avg=53.07, stdev=56.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 53], 80.00th=[ 75], 90.00th=[ 115], 95.00th=[ 174], | 99.00th=[ 275], 99.50th=[ 368], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 30, max= 255, per=30.54%, avg=80.01, stdev=51.00, samples=145 iops : min= 1, max= 15, avg= 4.24, stdev= 3.28, samples=145 write: IOPS=4, BW=69.8KiB/s (71.5kB/s)(6368KiB/91197msec); 0 zone resets clat (msec): min=34, max=601, avg=179.43, stdev=84.43 lat (msec): min=34, max=601, avg=179.43, stdev=84.43 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 70], 10.00th=[ 85], 20.00th=[ 108], | 30.00th=[ 129], 40.00th=[ 146], 50.00th=[ 161], 60.00th=[ 184], | 70.00th=[ 213], 80.00th=[ 249], 90.00th=[ 288], 95.00th=[ 347], | 99.00th=[ 447], 99.50th=[ 485], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 29, max= 191, per=26.51%, avg=73.16, stdev=35.46, samples=171 iops : min= 1, max= 11, avg= 3.80, stdev= 2.30, samples=171 lat (msec) : 10=1.30%, 20=10.29%, 50=21.88%, 100=16.80%, 250=39.06% lat (msec) : 500=10.55%, 750=0.13% cpu : usr=0.03%, sys=1.08%, ctx=1376, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143311: Thu Aug 6 05:47:41 2026 read: IOPS=3, BW=62.0KiB/s (64.5kB/s)(5744KiB/91222msec) clat (msec): min=6, max=425, avg=54.06, stdev=56.69 lat (msec): min=6, max=425, avg=54.06, stdev=56.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 75], 90.00th=[ 123], 95.00th=[ 167], | 99.00th=[ 284], 99.50th=[ 418], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 21, max= 351, per=30.48%, avg=79.86, stdev=53.28, samples=140 iops : min= 1, max= 21, avg= 4.20, stdev= 3.41, samples=140 write: IOPS=4, BW=71.7KiB/s (73.5kB/s)(6544KiB/91222msec); 0 zone resets clat (msec): min=43, max=558, avg=174.72, stdev=87.14 lat (msec): min=43, max=558, avg=174.74, stdev=87.13 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 101], | 30.00th=[ 117], 40.00th=[ 138], 50.00th=[ 159], 60.00th=[ 180], | 70.00th=[ 207], 80.00th=[ 243], 90.00th=[ 300], 95.00th=[ 351], | 99.00th=[ 439], 99.50th=[ 468], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 256, per=27.35%, avg=75.49, stdev=37.93, samples=169 iops : min= 1, max= 16, avg= 3.92, stdev= 2.51, samples=169 lat (msec) : 10=0.78%, 20=9.64%, 50=20.83%, 100=20.44%, 250=38.02% lat (msec) : 500=10.16%, 750=0.13% cpu : usr=0.02%, sys=1.06%, ctx=1288, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143312: Thu Aug 6 05:47:41 2026 read: IOPS=4, BW=69.8KiB/s (71.5kB/s)(6256KiB/89654msec) clat (msec): min=6, max=517, avg=47.83, stdev=51.53 lat (msec): min=6, max=517, avg=47.84, stdev=51.53 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 99], 95.00th=[ 146], | 99.00th=[ 275], 99.50th=[ 305], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 30, max= 416, per=32.42%, avg=84.94, stdev=66.29, samples=145 iops : min= 1, max= 26, avg= 4.53, stdev= 4.23, samples=145 write: IOPS=4, BW=67.3KiB/s (68.9kB/s)(6032KiB/89654msec); 0 zone resets clat (msec): min=40, max=544, avg=187.21, stdev=97.87 lat (msec): min=40, max=544, avg=187.22, stdev=97.87 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 77], 10.00th=[ 87], 20.00th=[ 104], | 30.00th=[ 124], 40.00th=[ 142], 50.00th=[ 163], 60.00th=[ 190], | 70.00th=[ 222], 80.00th=[ 253], 90.00th=[ 317], 95.00th=[ 393], | 99.00th=[ 506], 99.50th=[ 531], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 190, per=24.98%, avg=68.94, stdev=35.20, samples=170 iops : min= 1, max= 11, avg= 3.50, stdev= 2.31, samples=170 lat (msec) : 10=1.56%, 20=10.94%, 50=24.22%, 100=17.84%, 250=34.38% lat (msec) : 500=10.42%, 750=0.65% cpu : usr=0.03%, sys=1.05%, ctx=1324, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143313: Thu Aug 6 05:47:41 2026 read: IOPS=4, BW=67.0KiB/s (68.6kB/s)(6032KiB/90001msec) clat (msec): min=6, max=526, avg=48.35, stdev=53.21 lat (msec): min=6, max=526, avg=48.35, stdev=53.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 100], 95.00th=[ 150], | 99.00th=[ 284], 99.50th=[ 288], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 29, max= 286, per=32.29%, avg=84.59, stdev=57.36, samples=139 iops : min= 1, max= 17, avg= 4.50, stdev= 3.65, samples=139 write: IOPS=4, BW=69.5KiB/s (71.2kB/s)(6256KiB/90001msec); 0 zone resets clat (msec): min=49, max=532, avg=182.66, stdev=91.90 lat (msec): min=49, max=532, avg=182.67, stdev=91.91 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 66], 10.00th=[ 83], 20.00th=[ 105], | 30.00th=[ 125], 40.00th=[ 140], 50.00th=[ 163], 60.00th=[ 188], | 70.00th=[ 220], 80.00th=[ 257], 90.00th=[ 313], 95.00th=[ 363], | 99.00th=[ 464], 99.50th=[ 527], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 30, max= 160, per=25.76%, avg=71.09, stdev=37.93, samples=172 iops : min= 1, max= 10, avg= 3.63, stdev= 2.47, samples=172 lat (msec) : 10=1.43%, 20=11.85%, 50=21.48%, 100=18.23%, 250=34.77% lat (msec) : 500=11.85%, 750=0.39% cpu : usr=0.02%, sys=1.14%, ctx=1322, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=263KiB/s (269kB/s), 62.0KiB/s-69.8KiB/s (64.5kB/s-71.5kB/s), io=23.4MiB (24.5MB), run=89654-91222msec WRITE: bw=276KiB/s (283kB/s), 67.3KiB/s-71.7KiB/s (68.9kB/s-73.5kB/s), io=24.6MiB (25.8MB), run=89654-91222msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143336: Thu Aug 6 05:48:02 2026 read: IOPS=1, BW=1358KiB/s (1391kB/s)(7168KiB/5277msec) clat (msec): min=2, max=639, avg=265.83, stdev=221.59 lat (msec): min=2, max=639, avg=265.84, stdev=221.59 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 259], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 368], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1892, max= 4000, per=98.90%, avg=2944.25, stdev=1158.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=970KiB/s (994kB/s)(5120KiB/5277msec); 0 zone resets clat (msec): min=354, max=1283, avg=663.31, stdev=378.44 lat (msec): min=354, max=1283, avg=663.37, stdev=378.44 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1872, max= 2043, per=47.75%, avg=1990.25, stdev=79.46, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 4=16.67%, 250=8.33%, 500=41.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=8.00%, ctx=184, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143338: Thu Aug 6 05:48:02 2026 read: IOPS=0, BW=298KiB/s (305kB/s)(2048KiB/6878msec) clat (msec): min=301, max=316, avg=308.92, stdev=10.59 lat (msec): min=301, max=316, avg=308.92, stdev=10.59 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1992, max= 2000, per=67.05%, avg=1996.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1489KiB/s (1525kB/s)(10.0MiB/6878msec); 0 zone resets clat (msec): min=259, max=1091, avg=569.63, stdev=270.78 lat (msec): min=259, max=1092, avg=569.81, stdev=270.97 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 264], | 30.00th=[ 397], 40.00th=[ 422], 50.00th=[ 477], 60.00th=[ 498], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 885], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1872, max= 4079, per=54.16%, avg=2257.50, stdev=738.36, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 500=66.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.01%, sys=8.33%, ctx=236, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143341: Thu Aug 6 05:48:02 2026 read: IOPS=1, BW=1277KiB/s (1307kB/s)(6144KiB/4812msec) clat (msec): min=270, max=388, avg=326.93, stdev=45.78 lat (msec): min=270, max=388, avg=326.93, stdev=45.78 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2019, max= 4087, per=100.00%, avg=3335.33, stdev=1143.81, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1277KiB/s (1307kB/s)(6144KiB/4812msec); 0 zone resets clat (msec): min=264, max=549, avg=437.73, stdev=110.56 lat (msec): min=264, max=549, avg=437.79, stdev=110.55 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 498], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1872, max= 2043, per=47.40%, avg=1975.50, stdev=62.45, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 500=83.33%, 750=16.67% cpu : usr=0.00%, sys=10.23%, ctx=229, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143342: Thu Aug 6 05:48:02 2026 read: IOPS=1, BW=1065KiB/s (1090kB/s)(5120KiB/4808msec) clat (usec): min=459, max=411261, avg=201862.38, stdev=189493.20 lat (usec): min=460, max=411262, avg=201863.63, stdev=189493.50 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 461], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[295699], 60.00th=[295699], | 70.00th=[304088], 80.00th=[304088], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 1939, max= 4039, per=88.65%, avg=2639.00, stdev=1212.44, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1491KiB/s (1527kB/s)(7168KiB/4808msec); 0 zone resets clat (msec): min=255, max=909, avg=524.56, stdev=210.77 lat (msec): min=255, max=909, avg=524.61, stdev=210.77 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 380], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 456], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 617], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1450, max= 2043, per=44.96%, avg=1874.00, stdev=244.60, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 500=58.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=8.20%, ctx=239, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2978KiB/s (3049kB/s), 298KiB/s-1358KiB/s (305kB/s-1391kB/s), io=20.0MiB (20.0MB), run=4808-6878msec WRITE: bw=4169KiB/s (4269kB/s), 970KiB/s-1491KiB/s (994kB/s-1527kB/s), io=28.0MiB (29.4MB), run=4808-6878msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143337: Thu Aug 6 05:48:02 2026 read: IOPS=1, BW=1379KiB/s (1412kB/s)(7168KiB/5199msec) clat (msec): min=164, max=616, avg=321.16, stdev=179.65 lat (msec): min=164, max=616, avg=321.16, stdev=179.65 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 171], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 245], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 489], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1848, max= 4047, per=96.38%, avg=2759.50, stdev=1023.63, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=985KiB/s (1008kB/s)(5120KiB/5199msec); 0 zone resets clat (msec): min=276, max=892, avg=578.22, stdev=220.71 lat (msec): min=276, max=892, avg=578.29, stdev=220.70 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2035, max= 2048, per=50.87%, avg=2039.25, stdev= 6.13, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=2.54%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143339: Thu Aug 6 05:48:02 2026 read: IOPS=0, BW=307KiB/s (315kB/s)(2048KiB/6661msec) clat (msec): min=160, max=447, avg=303.55, stdev=202.88 lat (msec): min=160, max=447, avg=303.55, stdev=202.88 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1646, max= 1848, per=61.02%, avg=1747.00, stdev=142.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1537KiB/s (1574kB/s)(10.0MiB/6661msec); 0 zone resets clat (msec): min=175, max=1136, avg=584.97, stdev=352.68 lat (msec): min=175, max=1136, avg=585.06, stdev=352.66 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 186], | 30.00th=[ 271], 40.00th=[ 409], 50.00th=[ 456], 60.00th=[ 531], | 70.00th=[ 743], 80.00th=[ 902], 90.00th=[ 1053], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1946, max= 4096, per=75.64%, avg=3032.33, stdev=1124.43, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.19%, ctx=69, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143340: Thu Aug 6 05:48:02 2026 read: IOPS=1, BW=1123KiB/s (1150kB/s)(6144KiB/5469msec) clat (msec): min=88, max=550, avg=279.50, stdev=200.28 lat (msec): min=88, max=550, avg=279.50, stdev=200.28 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 226], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1946, max= 3696, per=84.58%, avg=2421.50, stdev=850.69, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1123KiB/s (1150kB/s)(6144KiB/5469msec); 0 zone resets clat (msec): min=244, max=993, avg=593.94, stdev=299.06 lat (msec): min=245, max=993, avg=594.46, stdev=298.80 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 735], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1946, max= 4071, per=62.68%, avg=2513.00, stdev=1039.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 750=41.67%, 1000=8.33% cpu : usr=0.00%, sys=3.55%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143343: Thu Aug 6 05:48:02 2026 read: IOPS=0, BW=716KiB/s (733kB/s)(5120KiB/7151msec) clat (msec): min=94, max=610, avg=344.35, stdev=243.73 lat (msec): min=94, max=610, avg=344.35, stdev=243.73 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2003, max= 3992, per=93.49%, avg=2676.67, stdev=1139.22, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=1002KiB/s (1026kB/s)(7168KiB/7151msec); 0 zone resets clat (msec): min=156, max=1427, avg=712.89, stdev=420.14 lat (msec): min=156, max=1427, avg=712.96, stdev=420.14 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 397], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 676], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 1053], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 1848, max= 2048, per=50.04%, avg=2006.17, stdev=78.05, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=16.67%, 750=41.67%, 2000=16.67% cpu : usr=0.04%, sys=2.74%, ctx=145, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2864KiB/s (2933kB/s), 307KiB/s-1379KiB/s (315kB/s-1412kB/s), io=20.0MiB (20.0MB), run=5199-7151msec WRITE: bw=4010KiB/s (4106kB/s), 985KiB/s-1537KiB/s (1008kB/s-1574kB/s), io=28.0MiB (29.4MB), run=5199-7151msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143352: Thu Aug 6 05:48:22 2026 read: IOPS=0, BW=3034KiB/s (3107kB/s)(12.0MiB/4050msec) clat (msec): min=517, max=1992, avg=1322.58, stdev=746.72 lat (msec): min=517, max=1992, avg=1322.58, stdev=746.72 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.85%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143354: Thu Aug 6 05:48:22 2026 read: IOPS=0, BW=1434KiB/s (1469kB/s)(4096KiB/2856msec) clat (nsec): min=297408k, max=297408k, avg=297408167.00, stdev= 0.00 lat (nsec): min=297410k, max=297410k, avg=297410336.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 6159, max= 6159, per=100.00%, avg=6159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2868KiB/s (2937kB/s)(8192KiB/2856msec); 0 zone resets clat (msec): min=1056, max=1436, avg=1246.16, stdev=268.83 lat (msec): min=1056, max=1436, avg=1246.77, stdev=268.57 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8143, max= 8143, per=92.54%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.04%, sys=5.64%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143356: Thu Aug 6 05:48:22 2026 write: IOPS=0, BW=3300KiB/s (3379kB/s)(12.0MiB/3724msec); 0 zone resets clat (msec): min=511, max=1683, avg=1208.57, stdev=616.82 lat (msec): min=511, max=1684, avg=1209.64, stdev=617.44 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8143, max= 8159, per=92.64%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.08%, ctx=90, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143358: Thu Aug 6 05:48:22 2026 write: IOPS=0, BW=3321KiB/s (3401kB/s)(12.0MiB/3700msec); 0 zone resets clat (msec): min=401, max=2544, avg=1165.20, stdev=1196.45 lat (msec): min=405, max=2545, avg=1167.04, stdev=1196.38 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 8015, max= 8015, per=91.09%, avg=8015.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=3.76%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4045KiB/s (4143kB/s), 1434KiB/s-3034KiB/s (1469kB/s-3107kB/s), io=16.0MiB (16.8MB), run=2856-4050msec WRITE: bw=8799KiB/s (9010kB/s), 2868KiB/s-3321KiB/s (2937kB/s-3401kB/s), io=32.0MiB (33.6MB), run=2856-3724msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143351: Thu Aug 6 05:48:23 2026 read: IOPS=0, BW=3535KiB/s (3620kB/s)(12.0MiB/3476msec) clat (msec): min=901, max=1145, avg=1046.63, stdev=128.13 lat (msec): min=901, max=1145, avg=1046.63, stdev=128.13 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7953, max= 8175, per=100.00%, avg=8064.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.17%, ctx=275, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143353: Thu Aug 6 05:48:23 2026 read: IOPS=0, BW=1047KiB/s (1072kB/s)(4096KiB/3911msec) clat (nsec): min=1132.7M, max=1132.7M, avg=1132674046.00, stdev= 0.00 lat (nsec): min=1132.7M, max=1132.7M, avg=1132676325.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2095KiB/s (2145kB/s)(8192KiB/3911msec); 0 zone resets clat (msec): min=826, max=1672, avg=1249.32, stdev=597.91 lat (msec): min=828, max=1674, avg=1251.64, stdev=597.95 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.17%, ctx=130, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143355: Thu Aug 6 05:48:23 2026 write: IOPS=0, BW=2547KiB/s (2608kB/s)(12.0MiB/4825msec); 0 zone resets clat (msec): min=429, max=2784, avg=1570.68, stdev=1179.17 lat (msec): min=429, max=2784, avg=1570.96, stdev=1179.21 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.47%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143357: Thu Aug 6 05:48:23 2026 write: IOPS=0, BW=3119KiB/s (3194kB/s)(12.0MiB/3940msec); 0 zone resets clat (msec): min=550, max=2152, avg=1245.06, stdev=822.18 lat (msec): min=550, max=2152, avg=1245.41, stdev=822.06 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7937, max= 7953, per=100.00%, avg=7945.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.10%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4189KiB/s (4290kB/s), 1047KiB/s-3535KiB/s (1072kB/s-3620kB/s), io=16.0MiB (16.8MB), run=3476-3911msec WRITE: bw=6791KiB/s (6954kB/s), 2095KiB/s-3119KiB/s (2145kB/s-3194kB/s), io=32.0MiB (33.6MB), run=3911-4825msec