== sanity test 398b: DIO and buffer IO race ============== 19:25:37 (1763339137) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.11071 s, 9.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147817: Sun Nov 16 19:27:35 2025 read: IOPS=14, BW=58.4KiB/s (59.8kB/s)(5992KiB/102565msec) clat (usec): min=104, max=715026, avg=32958.40, stdev=28873.11 lat (usec): min=104, max=715029, avg=32960.25, stdev=28873.09 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 176], 10.00th=[ 1074], 20.00th=[ 16450], | 30.00th=[ 20579], 40.00th=[ 24511], 50.00th=[ 28443], 60.00th=[ 33424], | 70.00th=[ 40109], 80.00th=[ 47449], 90.00th=[ 60031], 95.00th=[ 71828], | 99.00th=[112722], 99.50th=[137364], 99.90th=[212861], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 118, per=25.06%, avg=57.89, stdev=23.11, samples=202 iops : min= 1, max= 29, avg=13.81, stdev= 5.81, samples=202 write: IOPS=15, BW=61.4KiB/s (62.9kB/s)(6296KiB/102565msec); 0 zone resets clat (usec): min=875, max=347573, avg=33535.12, stdev=35661.76 lat (usec): min=875, max=347574, avg=33540.90, stdev=35665.50 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 2704], | 30.00th=[ 7898], 40.00th=[ 16319], 50.00th=[ 24249], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 56886], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[168821], 99.50th=[202376], 99.90th=[278922], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 139, per=25.25%, avg=61.11, stdev=24.13, samples=201 iops : min= 1, max= 34, avg=14.62, stdev= 6.08, samples=201 lat (usec) : 250=3.97%, 500=0.75%, 750=0.03%, 1000=0.42% lat (msec) : 2=8.53%, 4=3.22%, 10=5.44%, 20=14.45%, 50=41.86% lat (msec) : 100=18.39%, 250=2.80%, 500=0.10%, 750=0.03% cpu : usr=0.10%, sys=7.21%, ctx=6443, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147818: Sun Nov 16 19:27:35 2025 read: IOPS=14, BW=57.0KiB/s (59.4kB/s)(5940KiB/102436msec) clat (usec): min=96, max=708362, avg=33919.08, stdev=30256.27 lat (usec): min=96, max=708363, avg=33923.66, stdev=30257.97 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 184], 10.00th=[ 2507], 20.00th=[ 16909], | 30.00th=[ 20841], 40.00th=[ 24773], 50.00th=[ 29230], 60.00th=[ 34341], | 70.00th=[ 40633], 80.00th=[ 49021], 90.00th=[ 62129], 95.00th=[ 76022], | 99.00th=[112722], 99.50th=[124257], 99.90th=[316670], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 127, per=25.18%, avg=58.17, stdev=22.72, samples=200 iops : min= 1, max= 31, avg=13.89, stdev= 5.72, samples=200 write: IOPS=15, BW=61.0KiB/s (63.5kB/s)(6348KiB/102436msec); 0 zone resets clat (usec): min=952, max=368364, avg=32531.39, stdev=33185.92 lat (usec): min=953, max=368365, avg=32533.52, stdev=33186.14 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1352], 20.00th=[ 3326], | 30.00th=[ 7963], 40.00th=[ 16319], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 54789], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[141558], 99.50th=[154141], 99.90th=[274727], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 15, max= 143, per=25.42%, avg=61.50, stdev=23.79, samples=202 iops : min= 3, max= 35, avg=14.72, stdev= 5.99, samples=202 lat (usec) : 100=0.03%, 250=3.87%, 500=0.78%, 1000=0.13% lat (msec) : 2=8.20%, 4=3.29%, 10=6.22%, 20=13.12%, 50=43.13% lat (msec) : 100=18.29%, 250=2.80%, 500=0.10%, 750=0.03% cpu : usr=0.11%, sys=7.13%, ctx=6305, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147820: Sun Nov 16 19:27:35 2025 read: IOPS=14, BW=58.0KiB/s (59.4kB/s)(6028KiB/103856msec) clat (usec): min=107, max=322230, avg=33147.59, stdev=24263.57 lat (usec): min=108, max=322233, avg=33150.19, stdev=24262.92 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 182], 10.00th=[ 486], 20.00th=[ 15926], | 30.00th=[ 20579], 40.00th=[ 24249], 50.00th=[ 28967], 60.00th=[ 34341], | 70.00th=[ 41157], 80.00th=[ 50070], 90.00th=[ 62653], 95.00th=[ 73925], | 99.00th=[103285], 99.50th=[141558], 99.90th=[162530], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 149, per=25.04%, avg=57.85, stdev=24.65, samples=204 iops : min= 1, max= 37, avg=13.79, stdev= 6.18, samples=204 write: IOPS=15, BW=60.3KiB/s (61.7kB/s)(6260KiB/103856msec); 0 zone resets clat (usec): min=864, max=695676, avg=34176.96, stdev=40958.06 lat (usec): min=865, max=695677, avg=34180.44, stdev=40956.68 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 2376], | 30.00th=[ 6783], 40.00th=[ 16581], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 43779], 80.00th=[ 56361], 90.00th=[ 76022], 95.00th=[ 98042], | 99.00th=[158335], 99.50th=[206570], 99.90th=[421528], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 182, per=24.70%, avg=59.77, stdev=27.34, samples=205 iops : min= 1, max= 45, avg=14.29, stdev= 6.88, samples=205 lat (usec) : 250=4.20%, 500=0.72%, 750=0.07%, 1000=0.42% lat (msec) : 2=8.95%, 4=3.68%, 10=5.57%, 20=12.50%, 50=41.47% lat (msec) : 100=19.43%, 250=2.73%, 500=0.23%, 750=0.03% cpu : usr=0.11%, sys=7.06%, ctx=6433, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147821: Sun Nov 16 19:27:35 2025 read: IOPS=14, BW=59.1KiB/s (60.5kB/s)(6052KiB/102488msec) clat (usec): min=110, max=235198, avg=32411.75, stdev=23934.51 lat (usec): min=111, max=235199, avg=32415.83, stdev=23936.54 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 176], 10.00th=[ 297], 20.00th=[ 15139], | 30.00th=[ 20317], 40.00th=[ 24249], 50.00th=[ 27919], 60.00th=[ 33162], | 70.00th=[ 40109], 80.00th=[ 48497], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[106431], 99.50th=[114820], 99.90th=[210764], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 119, per=25.65%, avg=59.24, stdev=22.51, samples=200 iops : min= 1, max= 29, avg=14.15, stdev= 5.65, samples=200 write: IOPS=15, BW=60.8KiB/s (62.3kB/s)(6236KiB/102488msec); 0 zone resets clat (usec): min=819, max=815257, avg=34012.30, stdev=41277.87 lat (usec): min=820, max=815259, avg=34024.35, stdev=41283.10 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 2769], | 30.00th=[ 7439], 40.00th=[ 16450], 50.00th=[ 24773], 60.00th=[ 33162], | 70.00th=[ 43779], 80.00th=[ 57934], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[145753], 99.50th=[168821], 99.90th=[425722], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 126, per=25.19%, avg=60.95, stdev=23.15, samples=200 iops : min= 1, max= 31, avg=14.59, stdev= 5.81, samples=200 lat (usec) : 250=4.79%, 500=0.78%, 750=0.16%, 1000=0.36% lat (msec) : 2=9.08%, 4=2.93%, 10=6.05%, 20=12.92%, 50=41.34% lat (msec) : 100=18.59%, 250=2.86%, 500=0.10%, 1000=0.03% cpu : usr=0.11%, sys=7.09%, ctx=6307, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=231KiB/s (237kB/s), 57.0KiB/s-59.1KiB/s (59.4kB/s-60.5kB/s), io=23.4MiB (24.6MB), run=102436-103856msec WRITE: bw=242KiB/s (248kB/s), 60.3KiB/s-61.0KiB/s (61.7kB/s-63.5kB/s), io=24.6MiB (25.7MB), run=102436-103856msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147819: Sun Nov 16 19:30:03 2025 read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(5992KiB/250866msec) clat (msec): min=5, max=732, avg=30.86, stdev=35.39 lat (msec): min=5, max=732, avg=30.86, stdev=35.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 62], 95.00th=[ 88], | 99.00th=[ 153], 99.50th=[ 180], 99.90th=[ 439], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 86, per=27.43%, avg=26.05, stdev=16.90, samples=445 iops : min= 1, max= 21, avg= 5.88, stdev= 4.26, samples=445 write: IOPS=6, BW=25.1KiB/s (25.7kB/s)(6296KiB/250866msec); 0 zone resets clat (msec): min=44, max=409, avg=129.78, stdev=51.32 lat (msec): min=44, max=409, avg=129.78, stdev=51.32 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 108], 50.00th=[ 120], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 163], 90.00th=[ 197], 95.00th=[ 228], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 401], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 48, per=25.02%, avg=24.77, stdev= 9.43, samples=491 iops : min= 1, max= 12, avg= 5.56, stdev= 2.42, samples=491 lat (msec) : 10=2.70%, 20=20.96%, 50=18.13%, 100=21.48%, 250=34.90% lat (msec) : 500=1.79%, 750=0.03% cpu : usr=0.05%, sys=1.39%, ctx=5442, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147822: Sun Nov 16 19:30:03 2025 read: IOPS=5, BW=23.6KiB/s (24.1kB/s)(5940KiB/252086msec) clat (msec): min=6, max=676, avg=29.41, stdev=31.25 lat (msec): min=6, max=676, avg=29.41, stdev=31.25 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 58], 95.00th=[ 82], | 99.00th=[ 138], 99.50th=[ 165], 99.90th=[ 342], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 111, per=27.57%, avg=26.19, stdev=16.64, samples=438 iops : min= 1, max= 27, avg= 5.91, stdev= 4.19, samples=438 write: IOPS=6, BW=25.2KiB/s (25.8kB/s)(6348KiB/252086msec); 0 zone resets clat (msec): min=46, max=501, avg=131.09, stdev=55.43 lat (msec): min=46, max=501, avg=131.10, stdev=55.44 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 121], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 236], | 99.00th=[ 326], 99.50th=[ 376], 99.90th=[ 477], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 55, per=24.97%, avg=24.72, stdev= 9.65, samples=495 iops : min= 1, max= 13, avg= 5.55, stdev= 2.49, samples=495 lat (msec) : 10=2.51%, 20=21.71%, 50=17.81%, 100=21.29%, 250=34.96% lat (msec) : 500=1.66%, 750=0.07% cpu : usr=0.05%, sys=1.37%, ctx=5282, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147823: Sun Nov 16 19:30:03 2025 read: IOPS=6, BW=24.2KiB/s (24.7kB/s)(6028KiB/249402msec) clat (msec): min=5, max=340, avg=30.03, stdev=26.88 lat (msec): min=5, max=340, avg=30.03, stdev=26.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 63], 95.00th=[ 81], | 99.00th=[ 127], 99.50th=[ 150], 99.90th=[ 313], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 95, per=26.91%, avg=25.57, stdev=16.68, samples=456 iops : min= 1, max= 23, avg= 5.76, stdev= 4.19, samples=456 write: IOPS=6, BW=25.1KiB/s (25.7kB/s)(6260KiB/249402msec); 0 zone resets clat (msec): min=30, max=731, avg=130.20, stdev=57.61 lat (msec): min=30, max=731, avg=130.21, stdev=57.61 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 107], 50.00th=[ 117], 60.00th=[ 130], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 236], | 99.00th=[ 321], 99.50th=[ 363], 99.90th=[ 558], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 48, per=24.96%, avg=24.71, stdev= 9.47, samples=489 iops : min= 1, max= 12, avg= 5.54, stdev= 2.44, samples=489 lat (msec) : 10=3.03%, 20=20.25%, 50=18.55%, 100=23.27%, 250=32.88% lat (msec) : 500=1.92%, 750=0.10% cpu : usr=0.06%, sys=1.41%, ctx=5245, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147824: Sun Nov 16 19:30:03 2025 read: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6052KiB/249101msec) clat (msec): min=5, max=261, avg=29.84, stdev=26.79 lat (msec): min=5, max=261, avg=29.85, stdev=26.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 64], 95.00th=[ 83], | 99.00th=[ 140], 99.50th=[ 171], 99.90th=[ 226], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 88, per=27.81%, avg=26.42, stdev=16.65, samples=443 iops : min= 1, max= 22, avg= 5.98, stdev= 4.20, samples=443 write: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6236KiB/249101msec); 0 zone resets clat (msec): min=39, max=795, avg=130.59, stdev=54.92 lat (msec): min=39, max=795, avg=130.59, stdev=54.92 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 109], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 228], | 99.00th=[ 296], 99.50th=[ 363], 99.90th=[ 558], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 56, per=24.78%, avg=24.53, stdev= 9.32, samples=490 iops : min= 1, max= 14, avg= 5.50, stdev= 2.40, samples=490 lat (msec) : 10=3.29%, 20=20.87%, 50=17.68%, 100=21.29%, 250=35.35% lat (msec) : 500=1.46%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.39%, ctx=5415, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=95.3KiB/s (97.5kB/s), 23.6KiB/s-24.3KiB/s (24.1kB/s-24.9kB/s), io=23.4MiB (24.6MB), run=249101-252086msec WRITE: bw=99.7KiB/s (102kB/s), 25.0KiB/s-25.2KiB/s (25.6kB/s-25.8kB/s), io=24.6MiB (25.7MB), run=249101-252086msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147883: Sun Nov 16 19:30:36 2025 read: IOPS=16, BW=259KiB/s (265kB/s)(5920KiB/22875msec) clat (usec): min=114, max=234511, avg=31047.82, stdev=28098.38 lat (usec): min=114, max=234513, avg=31049.43, stdev=28098.36 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 169], 10.00th=[ 184], 20.00th=[ 243], | 30.00th=[ 17695], 40.00th=[ 22414], 50.00th=[ 27132], 60.00th=[ 32637], | 70.00th=[ 38536], 80.00th=[ 47973], 90.00th=[ 64226], 95.00th=[ 80217], | 99.00th=[137364], 99.50th=[160433], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 413, per=24.13%, avg=252.68, stdev=88.82, samples=44 iops : min= 1, max= 25, avg=15.11, stdev= 5.63, samples=44 write: IOPS=17, BW=278KiB/s (285kB/s)(6368KiB/22875msec); 0 zone resets clat (usec): min=1495, max=208597, avg=28449.07, stdev=30767.87 lat (usec): min=1497, max=208600, avg=28505.26, stdev=30785.97 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1778], 10.00th=[ 1942], 20.00th=[ 4752], | 30.00th=[ 7898], 40.00th=[ 11731], 50.00th=[ 18482], 60.00th=[ 26608], | 70.00th=[ 35914], 80.00th=[ 48497], 90.00th=[ 66323], 95.00th=[ 83362], | 99.00th=[177210], 99.50th=[198181], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 95, max= 730, per=25.00%, avg=275.25, stdev=114.00, samples=44 iops : min= 5, max= 45, avg=16.52, stdev= 7.23, samples=44 lat (usec) : 250=9.64%, 500=0.52%, 1000=0.13% lat (msec) : 2=5.86%, 4=4.17%, 10=9.38%, 20=13.93%, 50=37.76% lat (msec) : 100=16.67%, 250=1.95% cpu : usr=0.16%, sys=8.13%, ctx=1462, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147884: Sun Nov 16 19:30:36 2025 read: IOPS=16, BW=261KiB/s (268kB/s)(5744KiB/21988msec) clat (usec): min=106, max=213617, avg=31376.91, stdev=25254.25 lat (usec): min=106, max=213619, avg=31378.35, stdev=25254.49 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 178], 10.00th=[ 194], 20.00th=[ 1909], | 30.00th=[ 20841], 40.00th=[ 24511], 50.00th=[ 29754], 60.00th=[ 34866], | 70.00th=[ 40109], 80.00th=[ 48497], 90.00th=[ 60031], 95.00th=[ 69731], | 99.00th=[112722], 99.50th=[137364], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 95, max= 477, per=25.13%, avg=263.07, stdev=90.55, samples=42 iops : min= 5, max= 29, avg=15.71, stdev= 5.72, samples=42 write: IOPS=18, BW=298KiB/s (305kB/s)(6544KiB/21988msec); 0 zone resets clat (usec): min=1321, max=215170, avg=26163.65, stdev=27965.78 lat (usec): min=1323, max=215174, avg=26166.31, stdev=27965.78 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1795], 10.00th=[ 1942], 20.00th=[ 3261], | 30.00th=[ 6456], 40.00th=[ 10683], 50.00th=[ 16057], 60.00th=[ 22938], | 70.00th=[ 32113], 80.00th=[ 50070], 90.00th=[ 66323], 95.00th=[ 80217], | 99.00th=[110625], 99.50th=[112722], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 90, max= 604, per=27.15%, avg=298.95, stdev=105.75, samples=42 iops : min= 5, max= 37, avg=18.00, stdev= 6.68, samples=42 lat (usec) : 250=6.77%, 500=2.21%, 750=0.13% lat (msec) : 2=6.51%, 4=5.99%, 10=8.59%, 20=12.50%, 50=38.28% lat (msec) : 100=17.45%, 250=1.56% cpu : usr=0.11%, sys=8.89%, ctx=1393, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147885: Sun Nov 16 19:30:36 2025 read: IOPS=17, BW=280KiB/s (287kB/s)(6256KiB/22304msec) clat (usec): min=117, max=144790, avg=31408.72, stdev=25572.39 lat (usec): min=118, max=144791, avg=31410.31, stdev=25572.36 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 169], 10.00th=[ 190], 20.00th=[ 6783], | 30.00th=[ 19792], 40.00th=[ 22676], 50.00th=[ 27657], 60.00th=[ 32375], | 70.00th=[ 40633], 80.00th=[ 46924], 90.00th=[ 61604], 95.00th=[ 76022], | 99.00th=[135267], 99.50th=[139461], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 126, max= 509, per=26.95%, avg=282.19, stdev=84.18, samples=43 iops : min= 7, max= 31, avg=16.91, stdev= 5.30, samples=43 write: IOPS=16, BW=270KiB/s (277kB/s)(6032KiB/22304msec); 0 zone resets clat (usec): min=1468, max=171067, avg=26448.23, stdev=28622.83 lat (usec): min=1470, max=171069, avg=26451.04, stdev=28622.88 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1680], 10.00th=[ 1811], 20.00th=[ 2671], | 30.00th=[ 7373], 40.00th=[ 11863], 50.00th=[ 18744], 60.00th=[ 26608], | 70.00th=[ 33424], 80.00th=[ 39060], 90.00th=[ 61080], 95.00th=[ 84411], | 99.00th=[147850], 99.50th=[166724], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 95, max= 540, per=24.27%, avg=267.21, stdev=99.98, samples=43 iops : min= 5, max= 33, avg=16.00, stdev= 6.34, samples=43 lat (usec) : 250=8.33%, 500=1.17% lat (msec) : 2=7.68%, 4=3.78%, 10=7.42%, 20=12.37%, 50=42.84% lat (msec) : 100=14.32%, 250=2.08% cpu : usr=0.14%, sys=8.84%, ctx=1488, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147886: Sun Nov 16 19:30:36 2025 read: IOPS=16, BW=271KiB/s (277kB/s)(6032KiB/22262msec) clat (usec): min=99, max=170874, avg=30365.53, stdev=28355.65 lat (usec): min=100, max=170876, avg=30366.98, stdev=28355.61 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 159], 10.00th=[ 178], 20.00th=[ 289], | 30.00th=[ 13173], 40.00th=[ 21890], 50.00th=[ 26608], 60.00th=[ 32637], | 70.00th=[ 40633], 80.00th=[ 49021], 90.00th=[ 62129], 95.00th=[ 80217], | 99.00th=[143655], 99.50th=[162530], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 99, max= 453, per=25.74%, avg=269.47, stdev=91.12, samples=43 iops : min= 6, max= 28, avg=16.14, stdev= 5.74, samples=43 write: IOPS=17, BW=281KiB/s (288kB/s)(6256KiB/22262msec); 0 zone resets clat (usec): min=1419, max=195668, avg=27567.78, stdev=31201.95 lat (usec): min=1421, max=195670, avg=27573.29, stdev=31199.72 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1713], 10.00th=[ 1844], 20.00th=[ 3032], | 30.00th=[ 6259], 40.00th=[ 9110], 50.00th=[ 14353], 60.00th=[ 23987], | 70.00th=[ 33817], 80.00th=[ 47973], 90.00th=[ 72877], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[152044], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 123, max= 479, per=25.59%, avg=281.74, stdev=92.12, samples=43 iops : min= 7, max= 29, avg=16.86, stdev= 5.76, samples=43 lat (usec) : 100=0.13%, 250=9.24%, 500=2.73%, 750=0.13% lat (msec) : 2=7.81%, 4=5.21%, 10=10.81%, 20=9.64%, 50=35.68% lat (msec) : 100=15.63%, 250=2.99% cpu : usr=0.12%, sys=8.87%, ctx=1321, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1047KiB/s (1072kB/s), 259KiB/s-280KiB/s (265kB/s-287kB/s), io=23.4MiB (24.5MB), run=21988-22875msec WRITE: bw=1102KiB/s (1128kB/s), 270KiB/s-298KiB/s (277kB/s-305kB/s), io=24.6MiB (25.8MB), run=21988-22875msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147878: Sun Nov 16 19:31:16 2025 read: IOPS=5, BW=93.5KiB/s (95.7kB/s)(5920KiB/63345msec) clat (msec): min=6, max=208, avg=32.12, stdev=30.73 lat (msec): min=6, max=208, avg=32.12, stdev=30.73 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 44], 90.00th=[ 65], 95.00th=[ 94], | 99.00th=[ 167], 99.50th=[ 201], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 320, per=27.40%, avg=103.01, stdev=61.62, samples=113 iops : min= 1, max= 20, avg= 5.67, stdev= 3.93, samples=113 write: IOPS=6, BW=101KiB/s (103kB/s)(6368KiB/63345msec); 0 zone resets clat (msec): min=46, max=489, avg=128.78, stdev=49.08 lat (msec): min=46, max=489, avg=128.79, stdev=49.08 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 121], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 163], 90.00th=[ 184], 95.00th=[ 201], | 99.00th=[ 321], 99.50th=[ 351], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 31, max= 191, per=25.45%, avg=100.77, stdev=35.67, samples=124 iops : min= 1, max= 11, avg= 5.53, stdev= 2.31, samples=124 lat (msec) : 10=1.69%, 20=20.18%, 50=18.49%, 100=21.35%, 250=37.11% lat (msec) : 500=1.17% cpu : usr=0.06%, sys=1.53%, ctx=1404, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147879: Sun Nov 16 19:31:16 2025 read: IOPS=5, BW=90.3KiB/s (92.5kB/s)(5744KiB/63593msec) clat (msec): min=6, max=298, avg=32.31, stdev=32.44 lat (msec): min=6, max=298, avg=32.31, stdev=32.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 99], | 99.00th=[ 157], 99.50th=[ 197], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 29, max= 286, per=26.83%, avg=100.89, stdev=59.82, samples=111 iops : min= 1, max= 17, avg= 5.55, stdev= 3.80, samples=111 write: IOPS=6, BW=103KiB/s (105kB/s)(6544KiB/63593msec); 0 zone resets clat (msec): min=45, max=343, avg=126.70, stdev=44.63 lat (msec): min=45, max=343, avg=126.71, stdev=44.64 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 102], 40.00th=[ 111], 50.00th=[ 121], 60.00th=[ 130], | 70.00th=[ 142], 80.00th=[ 157], 90.00th=[ 184], 95.00th=[ 207], | 99.00th=[ 284], 99.50th=[ 326], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 191, per=25.75%, avg=101.95, stdev=34.66, samples=125 iops : min= 1, max= 11, avg= 5.61, stdev= 2.24, samples=125 lat (msec) : 10=2.73%, 20=19.53%, 50=16.80%, 100=20.70%, 250=39.45% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.56%, ctx=1404, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147880: Sun Nov 16 19:31:16 2025 read: IOPS=6, BW=104KiB/s (107kB/s)(6256KiB/60056msec) clat (msec): min=7, max=257, avg=29.63, stdev=28.47 lat (msec): min=7, max=257, avg=29.63, stdev=28.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 58], 95.00th=[ 77], | 99.00th=[ 159], 99.50th=[ 205], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 411, per=29.81%, avg=112.10, stdev=75.37, samples=110 iops : min= 1, max= 25, avg= 6.24, stdev= 4.77, samples=110 write: IOPS=6, BW=100KiB/s (103kB/s)(6032KiB/60056msec); 0 zone resets clat (msec): min=47, max=428, avg=128.06, stdev=50.61 lat (msec): min=47, max=428, avg=128.06, stdev=50.61 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 90], | 30.00th=[ 100], 40.00th=[ 107], 50.00th=[ 115], 60.00th=[ 131], | 70.00th=[ 140], 80.00th=[ 161], 90.00th=[ 190], 95.00th=[ 211], | 99.00th=[ 309], 99.50th=[ 422], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 160, per=25.28%, avg=100.11, stdev=35.55, samples=118 iops : min= 1, max= 10, avg= 5.48, stdev= 2.30, samples=118 lat (msec) : 10=1.69%, 20=23.83%, 50=19.27%, 100=19.66%, 250=34.24% lat (msec) : 500=1.30% cpu : usr=0.07%, sys=1.61%, ctx=1455, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147881: Sun Nov 16 19:31:16 2025 read: IOPS=6, BW=97.6KiB/s (99.9kB/s)(6032KiB/61798msec) clat (msec): min=7, max=135, avg=29.81, stdev=22.92 lat (msec): min=7, max=135, avg=29.81, stdev=22.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 60], 95.00th=[ 82], | 99.00th=[ 121], 99.50th=[ 136], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 29, max= 318, per=28.43%, avg=106.88, stdev=65.96, samples=111 iops : min= 1, max= 19, avg= 5.93, stdev= 4.17, samples=111 write: IOPS=6, BW=101KiB/s (104kB/s)(6256KiB/61798msec); 0 zone resets clat (msec): min=53, max=407, avg=129.07, stdev=46.37 lat (msec): min=53, max=407, avg=129.07, stdev=46.37 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 73], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 111], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 146], 80.00th=[ 161], 90.00th=[ 184], 95.00th=[ 211], | 99.00th=[ 300], 99.50th=[ 334], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 30, max= 160, per=25.50%, avg=100.98, stdev=33.55, samples=122 iops : min= 1, max= 10, avg= 5.54, stdev= 2.19, samples=122 lat (msec) : 10=1.82%, 20=20.31%, 50=19.40%, 100=21.22%, 250=36.46% lat (msec) : 500=0.78% cpu : usr=0.07%, sys=1.61%, ctx=1377, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=377KiB/s (386kB/s), 90.3KiB/s-104KiB/s (92.5kB/s-107kB/s), io=23.4MiB (24.5MB), run=60056-63593msec WRITE: bw=396KiB/s (406kB/s), 100KiB/s-103KiB/s (103kB/s-105kB/s), io=24.6MiB (25.8MB), run=60056-63593msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147904: Sun Nov 16 19:31:32 2025 read: IOPS=1, BW=1828KiB/s (1872kB/s)(7168KiB/3922msec) clat (msec): min=70, max=292, avg=213.11, stdev=93.73 lat (msec): min=70, max=292, avg=213.11, stdev=93.73 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 87], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 251], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 284], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 2031, max= 3103, per=55.04%, avg=2249.40, stdev=477.21, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1305KiB/s (1337kB/s)(5120KiB/3922msec); 0 zone resets clat (msec): min=135, max=817, avg=475.99, stdev=304.49 lat (msec): min=135, max=817, avg=476.19, stdev=304.43 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2023, max= 4063, per=47.33%, avg=2708.33, stdev=1173.20, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=16.67%, 500=50.00%, 1000=16.67% cpu : usr=0.00%, sys=7.65%, ctx=195, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147906: Sun Nov 16 19:31:32 2025 read: IOPS=0, BW=409KiB/s (419kB/s)(2048KiB/5010msec) clat (msec): min=180, max=245, avg=212.92, stdev=46.55 lat (msec): min=180, max=245, avg=212.93, stdev=46.55 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 1689, max= 2043, per=45.66%, avg=1866.00, stdev=250.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2044KiB/s (2093kB/s)(10.0MiB/5010msec); 0 zone resets clat (msec): min=52, max=865, avg=422.20, stdev=285.30 lat (msec): min=53, max=865, avg=422.28, stdev=285.31 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 266], 50.00th=[ 351], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 726], 90.00th=[ 760], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2023, max= 6131, per=53.34%, avg=3052.33, stdev=1709.72, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.06%, sys=11.02%, ctx=122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147907: Sun Nov 16 19:31:32 2025 read: IOPS=1, BW=1565KiB/s (1603kB/s)(6144KiB/3926msec) clat (usec): min=566, max=517435, avg=252636.70, stdev=171899.40 lat (usec): min=567, max=517436, avg=252637.85, stdev=171899.48 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[164627], | 30.00th=[164627], 40.00th=[235930], 50.00th=[235930], 60.00th=[270533], | 70.00th=[329253], 80.00th=[329253], 90.00th=[517997], 95.00th=[517997], | 99.00th=[517997], 99.50th=[517997], 99.90th=[517997], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 2023, max= 3849, per=60.84%, avg=2486.50, stdev=908.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1565KiB/s (1603kB/s)(6144KiB/3926msec); 0 zone resets clat (msec): min=157, max=655, avg=374.56, stdev=196.38 lat (msec): min=157, max=655, avg=374.65, stdev=196.37 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 477], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1633, max= 2039, per=33.76%, avg=1931.60, stdev=173.58, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.10%, sys=11.06%, ctx=135, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147909: Sun Nov 16 19:31:32 2025 read: IOPS=1, BW=1403KiB/s (1436kB/s)(5120KiB/3650msec) clat (usec): min=644, max=204811, avg=112961.35, stdev=99923.37 lat (usec): min=645, max=204812, avg=112962.74, stdev=99923.47 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 644], | 30.00th=[ 9896], 40.00th=[ 9896], 50.00th=[156238], 60.00th=[156238], | 70.00th=[191890], 80.00th=[191890], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 2043, max= 6071, per=99.27%, avg=4057.00, stdev=2848.23, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1964KiB/s (2011kB/s)(7168KiB/3650msec); 0 zone resets clat (msec): min=197, max=682, avg=391.55, stdev=185.29 lat (msec): min=197, max=682, avg=391.62, stdev=185.29 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 275], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 296], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 617], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2031, max= 4079, per=52.44%, avg=3000.50, stdev=1116.52, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.05%, sys=13.21%, ctx=134, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4088KiB/s (4186kB/s), 409KiB/s-1828KiB/s (419kB/s-1872kB/s), io=20.0MiB (20.0MB), run=3650-5010msec WRITE: bw=5723KiB/s (5860kB/s), 1305KiB/s-2044KiB/s (1337kB/s-2093kB/s), io=28.0MiB (29.4MB), run=3650-5010msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147903: Sun Nov 16 19:31:32 2025 read: IOPS=1, BW=1637KiB/s (1676kB/s)(7168KiB/4380msec) clat (msec): min=41, max=294, avg=171.10, stdev=106.60 lat (msec): min=41, max=294, avg=171.10, stdev=106.60 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 88], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 136], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 292], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1595, max= 4023, per=60.23%, avg=2288.00, stdev=981.63, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1169KiB/s (1197kB/s)(5120KiB/4380msec); 0 zone resets clat (msec): min=301, max=1109, avg=608.74, stdev=331.06 lat (msec): min=301, max=1109, avg=608.83, stdev=331.06 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1910, max= 2031, per=37.14%, avg=1975.50, stdev=50.11, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=8.33%, 500=41.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.40%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147905: Sun Nov 16 19:31:32 2025 read: IOPS=0, BW=386KiB/s (396kB/s)(2048KiB/5301msec) clat (msec): min=65, max=569, avg=317.85, stdev=356.52 lat (msec): min=65, max=569, avg=317.85, stdev=356.52 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 66], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1973, max= 2011, per=52.43%, avg=1992.00, stdev=26.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1932KiB/s (1978kB/s)(10.0MiB/5301msec); 0 zone resets clat (msec): min=179, max=1290, avg=419.91, stdev=334.14 lat (msec): min=179, max=1290, avg=420.00, stdev=334.13 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 182], | 30.00th=[ 251], 40.00th=[ 266], 50.00th=[ 275], 60.00th=[ 317], | 70.00th=[ 355], 80.00th=[ 460], 90.00th=[ 625], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1939, max= 4063, per=56.50%, avg=3005.00, stdev=1117.46, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.92%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147908: Sun Nov 16 19:31:32 2025 read: IOPS=1, BW=1227KiB/s (1257kB/s)(6144KiB/5006msec) clat (msec): min=87, max=655, avg=285.51, stdev=209.38 lat (msec): min=87, max=655, avg=285.51, stdev=209.38 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 262], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1939, max= 3946, per=65.46%, avg=2486.75, stdev=973.80, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1227KiB/s (1257kB/s)(6144KiB/5006msec); 0 zone resets clat (msec): min=250, max=842, avg=484.35, stdev=205.53 lat (msec): min=250, max=842, avg=484.42, stdev=205.53 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 464], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1910, max= 4007, per=46.70%, avg=2484.00, stdev=1016.57, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 500=58.33%, 750=16.67%, 1000=8.33% cpu : usr=0.08%, sys=3.32%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147910: Sun Nov 16 19:31:32 2025 read: IOPS=0, BW=950KiB/s (973kB/s)(5120KiB/5390msec) clat (msec): min=87, max=495, avg=227.67, stdev=159.97 lat (msec): min=87, max=495, avg=227.67, stdev=159.97 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1988, max= 3946, per=69.89%, avg=2655.00, stdev=1118.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1330KiB/s (1362kB/s)(7168KiB/5390msec); 0 zone resets clat (msec): min=185, max=1127, avg=546.33, stdev=359.10 lat (msec): min=185, max=1127, avg=546.41, stdev=359.10 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 201], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 567], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 860], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1939, max= 4063, per=45.21%, avg=2404.80, stdev=927.56, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.84%, ctx=67, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3800KiB/s (3891kB/s), 386KiB/s-1637KiB/s (396kB/s-1676kB/s), io=20.0MiB (20.0MB), run=4380-5390msec WRITE: bw=5319KiB/s (5447kB/s), 1169KiB/s-1932KiB/s (1197kB/s-1978kB/s), io=28.0MiB (29.4MB), run=4380-5390msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147917: Sun Nov 16 19:31:45 2025 read: IOPS=2, BW=10.6MiB/s (11.1MB/s)(12.0MiB/1135msec) clat (msec): min=203, max=545, avg=350.45, stdev=175.83 lat (msec): min=203, max=545, avg=350.46, stdev=175.83 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min=12760, max=12760, per=100.00%, avg=12760.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=11.11%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147918: Sun Nov 16 19:31:45 2025 read: IOPS=0, BW=1361KiB/s (1394kB/s)(4096KiB/3009msec) clat (nsec): min=1042.7M, max=1042.7M, avg=1042713654.00, stdev= 0.00 lat (nsec): min=1042.7M, max=1042.7M, avg=1042717119.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2722KiB/s (2788kB/s)(8192KiB/3009msec); 0 zone resets clat (msec): min=688, max=1130, avg=909.47, stdev=313.05 lat (msec): min=688, max=1131, avg=909.98, stdev=313.01 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8126, max= 8126, per=74.63%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.62%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147919: Sun Nov 16 19:31:45 2025 write: IOPS=1, BW=4917KiB/s (5035kB/s)(12.0MiB/2499msec); 0 zone resets clat (msec): min=463, max=1307, avg=815.99, stdev=438.97 lat (msec): min=463, max=1308, avg=816.45, stdev=438.97 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7013, max= 8159, per=69.67%, avg=7586.00, stdev=810.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.28%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147920: Sun Nov 16 19:31:45 2025 write: IOPS=1, BW=6454KiB/s (6609kB/s)(12.0MiB/1904msec); 0 zone resets clat (msec): min=368, max=1044, avg=610.56, stdev=376.23 lat (msec): min=369, max=1044, avg=611.01, stdev=376.22 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 6470, max= 8192, per=67.32%, avg=7331.00, stdev=1217.64, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.31%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5445KiB/s (5576kB/s), 1361KiB/s-10.6MiB/s (1394kB/s-11.1MB/s), io=16.0MiB (16.8MB), run=1135-3009msec WRITE: bw=10.6MiB/s (11.2MB/s), 2722KiB/s-6454KiB/s (2788kB/s-6609kB/s), io=32.0MiB (33.6MB), run=1904-3009msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147922: Sun Nov 16 19:31:45 2025 read: IOPS=1, BW=4842KiB/s (4958kB/s)(12.0MiB/2538msec) clat (msec): min=799, max=858, avg=820.87, stdev=32.43 lat (msec): min=799, max=858, avg=820.87, stdev=32.43 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8015, max= 8094, per=100.00%, avg=8054.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=15.53%, ctx=300, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147923: Sun Nov 16 19:31:45 2025 read: IOPS=0, BW=1821KiB/s (1865kB/s)(4096KiB/2249msec) clat (nsec): min=678346k, max=678346k, avg=678345997.00, stdev= 0.00 lat (nsec): min=678349k, max=678349k, avg=678348656.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3643KiB/s (3730kB/s)(8192KiB/2249msec); 0 zone resets clat (msec): min=249, max=1153, avg=701.15, stdev=639.03 lat (msec): min=249, max=1153, avg=701.63, stdev=639.17 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8192, max= 8192, per=77.53%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=7.52%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147924: Sun Nov 16 19:31:45 2025 write: IOPS=0, BW=3963KiB/s (4058kB/s)(12.0MiB/3101msec); 0 zone resets clat (msec): min=260, max=1588, avg=1005.66, stdev=678.46 lat (msec): min=261, max=1588, avg=1006.14, stdev=678.31 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8015, max= 8015, per=75.86%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.13%, sys=5.84%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147925: Sun Nov 16 19:31:45 2025 write: IOPS=1, BW=5570KiB/s (5704kB/s)(12.0MiB/2206msec); 0 zone resets clat (msec): min=350, max=1374, avg=712.96, stdev=574.08 lat (msec): min=350, max=1375, avg=713.40, stdev=574.11 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 5910, max= 5910, per=55.93%, avg=5910.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.57%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6455KiB/s (6610kB/s), 1821KiB/s-4842KiB/s (1865kB/s-4958kB/s), io=16.0MiB (16.8MB), run=2249-2538msec WRITE: bw=10.3MiB/s (10.8MB/s), 3643KiB/s-5570KiB/s (3730kB/s-5704kB/s), io=32.0MiB (33.6MB), run=2206-3101msec