== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 21:01:28 (1787360488)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.50 seconds: 20.07 ops/second
 - mkdir 204 (time 1787360511.32 total 10.04 last 20.31)
 - mkdir 450 (time 1787360521.37 total 20.10 last 24.46)
 - mkdir 665 (time 1787360531.37 total 30.10 last 21.50)
 - mkdir 852 (time 1787360541.40 total 40.13 last 18.65)
total: 1000 mkdir in 47.59 seconds: 21.01 ops/second
 - mkdir 205 (time 1787360510.08 total 10.01 last 20.48)
 - mkdir 439 (time 1787360520.11 total 20.04 last 23.33)
 - mkdir 651 (time 1787360530.16 total 30.09 last 21.09)
 - mkdir 822 (time 1787360540.19 total 40.12 last 17.05)
total: 1000 mkdir in 48.80 seconds: 20.49 ops/second
 - mkdir 207 (time 1787360511.40 total 10.02 last 20.66)
 - mkdir 449 (time 1787360521.42 total 20.03 last 24.16)
 - mkdir 658 (time 1787360531.44 total 30.05 last 20.86)
 - mkdir 852 (time 1787360541.47 total 40.09 last 19.33)
total: 1000 mkdir in 47.96 seconds: 20.85 ops/second
 - mkdir 208 (time 1787360510.77 total 10.06 last 20.67)
 - mkdir 439 (time 1787360520.79 total 20.09 last 23.04)
 - mkdir 649 (time 1787360530.81 total 30.10 last 20.97)
 - mkdir 834 (time 1787360540.81 total 40.10 last 18.50)
total: 1000 mkdir in 49.03 seconds: 20.39 ops/second
 - mkdir 199 (time 1787360510.33 total 10.01 last 19.87)
 - mkdir 434 (time 1787360520.35 total 20.03 last 23.45)
 - mkdir 648 (time 1787360530.40 total 30.08 last 21.31)
 - mkdir 815 (time 1787360540.42 total 40.09 last 16.67)
total: 1000 mkdir in 49.50 seconds: 20.20 ops/second
 - mkdir 205 (time 1787360510.98 total 10.03 last 20.44)
 - mkdir 439 (time 1787360520.99 total 20.04 last 23.37)
 - mkdir 646 (time 1787360531.02 total 30.08 last 20.63)
 - mkdir 829 (time 1787360541.04 total 40.10 last 18.26)
total: 1000 mkdir in 49.21 seconds: 20.32 ops/second
 - mkdir 197 (time 1787360511.00 total 10.04 last 19.63)
 - mkdir 430 (time 1787360521.01 total 20.05 last 23.27)
 - mkdir 637 (time 1787360531.02 total 30.05 last 20.69)
 - mkdir 821 (time 1787360541.02 total 40.05 last 18.40)
total: 1000 mkdir in 49.47 seconds: 20.21 ops/second
 - mkdir 208 (time 1787360511.29 total 10.03 last 20.74)
 - mkdir 447 (time 1787360521.32 total 20.06 last 23.83)
 - mkdir 653 (time 1787360531.32 total 30.06 last 20.60)
 - mkdir 835 (time 1787360541.32 total 40.06 last 18.20)
total: 1000 mkdir in 49.27 seconds: 20.30 ops/second
 - mkdir 198 (time 1787360511.35 total 10.03 last 19.74)
 - mkdir 427 (time 1787360521.39 total 20.08 last 22.79)
 - mkdir 631 (time 1787360531.44 total 30.12 last 20.31)
 - mkdir 812 (time 1787360541.44 total 40.12 last 18.10)
 - mkdir 978 (time 1787360551.50 total 50.18 last 16.51)
total: 1000 mkdir in 51.99 seconds: 19.24 ops/second
 - mkdir 195 (time 1787360510.53 total 10.00 last 19.50)
 - mkdir 418 (time 1787360520.56 total 20.03 last 22.23)
 - mkdir 613 (time 1787360530.58 total 30.06 last 19.45)
 - mkdir 782 (time 1787360540.59 total 40.06 last 16.89)
 - mkdir 959 (time 1787360550.62 total 50.10 last 17.64)
total: 1000 mkdir in 53.75 seconds: 18.60 ops/second
Time for file creation 63 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 19.90 ops/second
 - mkdir 228 (time 1787361055.00 total 10.02 last 22.75)
 - mkdir 380 (time 1787361065.07 total 20.09 last 15.10)
 - mkdir 589 (time 1787361075.11 total 30.13 last 20.81)
 - mkdir 755 (time 1787361085.14 total 40.16 last 16.56)
 - mkdir 961 (time 1787361095.15 total 50.17 last 20.57)
total: 1000 mkdir in 51.92 seconds: 19.26 ops/second
 - mkdir 229 (time 1787361055.07 total 10.06 last 22.77)
 - mkdir 380 (time 1787361065.07 total 20.06 last 15.10)
 - mkdir 590 (time 1787361075.07 total 30.06 last 20.99)
 - mkdir 753 (time 1787361085.10 total 40.09 last 16.25)
 - mkdir 957 (time 1787361095.12 total 50.11 last 20.36)
total: 1000 mkdir in 52.39 seconds: 19.09 ops/second
 - mkdir 234 (time 1787361055.94 total 10.01 last 23.37)
 - mkdir 387 (time 1787361065.99 total 20.06 last 15.22)
 - mkdir 591 (time 1787361076.04 total 30.12 last 20.29)
 - mkdir 766 (time 1787361086.06 total 40.14 last 17.46)
 - mkdir 974 (time 1787361096.16 total 50.24 last 20.60)
total: 1000 mkdir in 52.11 seconds: 19.19 ops/second
 - mkdir 236 (time 1787361056.23 total 10.11 last 23.34)
 - mkdir 387 (time 1787361066.26 total 20.15 last 15.05)
 - mkdir 592 (time 1787361076.32 total 30.21 last 20.37)
 - mkdir 769 (time 1787361086.34 total 40.23 last 17.67)
 - mkdir 978 (time 1787361096.37 total 50.25 last 20.85)
total: 1000 mkdir in 52.05 seconds: 19.21 ops/second
 - mkdir 231 (time 1787361055.76 total 10.00 last 23.09)
 - mkdir 378 (time 1787361065.81 total 20.05 last 14.64)
 - mkdir 584 (time 1787361075.82 total 30.06 last 20.57)
 - mkdir 763 (time 1787361085.86 total 40.10 last 17.84)
 - mkdir 967 (time 1787361095.86 total 50.10 last 20.39)
total: 1000 mkdir in 52.70 seconds: 18.97 ops/second
 - mkdir 232 (time 1787361055.73 total 10.05 last 23.09)
 - mkdir 383 (time 1787361065.76 total 20.07 last 15.06)
 - mkdir 591 (time 1787361075.80 total 30.12 last 20.72)
 - mkdir 765 (time 1787361085.80 total 40.12 last 17.40)
 - mkdir 963 (time 1787361095.82 total 50.14 last 19.75)
total: 1000 mkdir in 53.06 seconds: 18.85 ops/second
 - mkdir 224 (time 1787361056.28 total 10.04 last 22.31)
 - mkdir 377 (time 1787361066.28 total 20.04 last 15.30)
 - mkdir 584 (time 1787361076.32 total 30.09 last 20.61)
 - mkdir 762 (time 1787361086.38 total 40.15 last 17.69)
 - mkdir 968 (time 1787361096.40 total 50.16 last 20.57)
total: 1000 mkdir in 53.06 seconds: 18.85 ops/second
 - mkdir 227 (time 1787361055.76 total 10.03 last 22.64)
 - mkdir 376 (time 1787361065.83 total 20.10 last 14.80)
 - mkdir 578 (time 1787361075.86 total 30.13 last 20.13)
 - mkdir 753 (time 1787361085.88 total 40.14 last 17.47)
 - mkdir 959 (time 1787361095.91 total 50.18 last 20.53)
total: 1000 mkdir in 53.82 seconds: 18.58 ops/second
 - mkdir 217 (time 1787361054.88 total 10.02 last 21.67)
 - mkdir 365 (time 1787361064.94 total 20.07 last 14.72)
 - mkdir 560 (time 1787361074.94 total 30.07 last 19.50)
 - mkdir 718 (time 1787361084.95 total 40.08 last 15.78)
 - mkdir 923 (time 1787361094.97 total 50.10 last 20.45)
total: 1000 mkdir in 55.64 seconds: 17.97 ops/second
 - mkdir 223 (time 1787361055.86 total 10.02 last 22.25)
 - mkdir 366 (time 1787361065.91 total 20.08 last 14.23)
 - mkdir 565 (time 1787361075.93 total 30.10 last 19.86)
 - mkdir 743 (time 1787361085.94 total 40.10 last 17.79)
 - mkdir 950 (time 1787361095.96 total 50.13 last 20.65)
total: 1000 mkdir in 54.97 seconds: 18.19 ops/second
Time for file creation 66 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787361111 ; total 1 ; last 1)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787361112 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787361112 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787361112 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787361113 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787361114 ; total 1 ; last 1)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787361113 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787361114 ; total 1 ; last 1)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787361113 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787361113 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 46 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8