== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 00:50:37 (1787460637)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.41 seconds: 24.58 ops/second
 - mkdir 164 (time 1787460661.72 total 10.07 last 16.29)
 - mkdir 321 (time 1787460671.75 total 20.11 last 15.64)
 - mkdir 472 (time 1787460681.78 total 30.13 last 15.06)
 - mkdir 637 (time 1787460691.83 total 40.18 last 16.42)
 - mkdir 794 (time 1787460701.84 total 50.19 last 15.69)
 - mkdir 958 (time 1787460711.90 total 60.25 last 16.29)
total: 1000 mkdir in 63.18 seconds: 15.83 ops/second
 - mkdir 159 (time 1787460662.03 total 10.05 last 15.82)
 - mkdir 315 (time 1787460672.04 total 20.06 last 15.58)
 - mkdir 463 (time 1787460682.09 total 30.10 last 14.74)
 - mkdir 624 (time 1787460692.11 total 40.12 last 16.07)
 - mkdir 777 (time 1787460702.16 total 50.18 last 15.21)
 - mkdir 936 (time 1787460712.21 total 60.23 last 15.82)
total: 1000 mkdir in 65.82 seconds: 15.19 ops/second
 - mkdir 163 (time 1787460662.35 total 10.02 last 16.27)
 - mkdir 310 (time 1787460672.36 total 20.02 last 14.69)
 - mkdir 462 (time 1787460682.41 total 30.07 last 15.13)
 - mkdir 623 (time 1787460692.41 total 40.07 last 16.10)
 - mkdir 777 (time 1787460702.43 total 50.09 last 15.36)
 - mkdir 939 (time 1787460712.49 total 60.15 last 16.11)
total: 1000 mkdir in 65.54 seconds: 15.26 ops/second
 - mkdir 162 (time 1787460662.69 total 10.01 last 16.19)
 - mkdir 315 (time 1787460672.72 total 20.04 last 15.25)
 - mkdir 466 (time 1787460682.73 total 30.05 last 15.09)
 - mkdir 629 (time 1787460692.82 total 40.13 last 16.16)
 - mkdir 780 (time 1787460702.86 total 50.17 last 15.04)
 - mkdir 941 (time 1787460712.93 total 60.25 last 15.97)
total: 1000 mkdir in 66.15 seconds: 15.12 ops/second
 - mkdir 159 (time 1787460661.89 total 10.04 last 15.83)
 - mkdir 303 (time 1787460671.89 total 20.05 last 14.40)
 - mkdir 451 (time 1787460681.90 total 30.05 last 14.79)
 - mkdir 612 (time 1787460691.92 total 40.07 last 16.07)
 - mkdir 759 (time 1787460701.94 total 50.09 last 14.67)
 - mkdir 923 (time 1787460712.03 total 60.18 last 16.25)
total: 1000 mkdir in 67.99 seconds: 14.71 ops/second
 - mkdir 159 (time 1787460662.82 total 10.10 last 15.75)
 - mkdir 313 (time 1787460672.84 total 20.11 last 15.38)
 - mkdir 464 (time 1787460682.88 total 30.16 last 15.03)
 - mkdir 624 (time 1787460692.91 total 40.18 last 15.96)
 - mkdir 777 (time 1787460702.95 total 50.22 last 15.24)
 - mkdir 933 (time 1787460713.04 total 60.31 last 15.46)
total: 1000 mkdir in 67.89 seconds: 14.73 ops/second
 - mkdir 165 (time 1787460663.03 total 10.10 last 16.34)
 - mkdir 324 (time 1787460673.04 total 20.11 last 15.88)
 - mkdir 471 (time 1787460683.06 total 30.13 last 14.67)
 - mkdir 628 (time 1787460693.18 total 40.24 last 15.53)
 - mkdir 774 (time 1787460703.18 total 50.25 last 14.59)
 - mkdir 931 (time 1787460713.23 total 60.29 last 15.63)
total: 1000 mkdir in 68.17 seconds: 14.67 ops/second
 - mkdir 156 (time 1787460661.65 total 10.02 last 15.57)
 - mkdir 300 (time 1787460671.70 total 20.07 last 14.33)
 - mkdir 443 (time 1787460681.70 total 30.07 last 14.30)
 - mkdir 600 (time 1787460691.77 total 40.14 last 15.59)
 - mkdir 746 (time 1787460701.81 total 50.18 last 14.55)
 - mkdir 909 (time 1787460711.87 total 60.24 last 16.20)
total: 1000 mkdir in 69.64 seconds: 14.36 ops/second
 - mkdir 160 (time 1787460661.35 total 10.07 last 15.88)
 - mkdir 300 (time 1787460671.46 total 20.19 last 13.84)
 - mkdir 439 (time 1787460681.51 total 30.24 last 13.83)
 - mkdir 592 (time 1787460691.53 total 40.26 last 15.27)
 - mkdir 739 (time 1787460701.58 total 50.30 last 14.63)
 - mkdir 899 (time 1787460711.60 total 60.33 last 15.96)
 - mkdir 996 (time 1787460721.66 total 70.39 last 9.64)
total: 1000 mkdir in 70.84 seconds: 14.12 ops/second
 - mkdir 155 (time 1787460662.89 total 10.06 last 15.41)
 - mkdir 298 (time 1787460672.91 total 20.07 last 14.28)
 - mkdir 436 (time 1787460683.00 total 30.16 last 13.68)
 - mkdir 592 (time 1787460693.04 total 40.20 last 15.54)
 - mkdir 741 (time 1787460703.07 total 50.24 last 14.84)
 - mkdir 892 (time 1787460713.11 total 60.28 last 15.04)
 - mkdir 983 (time 1787460723.21 total 70.37 last 9.01)
total: 1000 mkdir in 71.55 seconds: 13.98 ops/second
Time for file creation 85 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.42 seconds: 23.82 ops/second
 - mkdir 189 (time 1787461251.98 total 10.04 last 18.82)
 - mkdir 359 (time 1787461262.11 total 20.17 last 16.79)
 - mkdir 542 (time 1787461272.14 total 30.21 last 18.23)
 - mkdir 734 (time 1787461282.19 total 40.25 last 19.11)
 - mkdir 901 (time 1787461292.25 total 50.31 last 16.60)
total: 1000 mkdir in 56.50 seconds: 17.70 ops/second
 - mkdir 185 (time 1787461251.32 total 10.01 last 18.49)
 - mkdir 346 (time 1787461261.36 total 20.04 last 16.04)
 - mkdir 517 (time 1787461271.37 total 30.06 last 17.08)
 - mkdir 709 (time 1787461281.46 total 40.15 last 19.03)
 - mkdir 868 (time 1787461291.47 total 50.16 last 15.88)
total: 1000 mkdir in 59.69 seconds: 16.75 ops/second
 - mkdir 187 (time 1787461251.03 total 10.03 last 18.65)
 - mkdir 345 (time 1787461261.08 total 20.08 last 15.71)
 - mkdir 514 (time 1787461271.14 total 30.14 last 16.80)
 - mkdir 706 (time 1787461281.21 total 40.21 last 19.06)
 - mkdir 863 (time 1787461291.24 total 50.24 last 15.66)
total: 1000 mkdir in 60.10 seconds: 16.64 ops/second
 - mkdir 177 (time 1787461250.49 total 10.01 last 17.68)
 - mkdir 336 (time 1787461260.51 total 20.03 last 15.88)
 - mkdir 504 (time 1787461270.52 total 30.04 last 16.77)
 - mkdir 694 (time 1787461280.54 total 40.06 last 18.96)
 - mkdir 851 (time 1787461290.56 total 50.08 last 15.67)
 - mkdir 994 (time 1787461300.62 total 60.14 last 14.21)
total: 1000 mkdir in 60.69 seconds: 16.48 ops/second
 - mkdir 182 (time 1787461251.51 total 10.06 last 18.09)
 - mkdir 343 (time 1787461261.52 total 20.07 last 16.09)
 - mkdir 518 (time 1787461271.53 total 30.08 last 17.48)
 - mkdir 713 (time 1787461281.54 total 40.09 last 19.47)
 - mkdir 868 (time 1787461291.56 total 50.11 last 15.47)
total: 1000 mkdir in 60.01 seconds: 16.66 ops/second
 - mkdir 184 (time 1787461251.47 total 10.04 last 18.33)
 - mkdir 345 (time 1787461261.48 total 20.05 last 16.08)
 - mkdir 513 (time 1787461271.49 total 30.06 last 16.78)
 - mkdir 704 (time 1787461281.51 total 40.07 last 19.07)
 - mkdir 865 (time 1787461291.51 total 50.08 last 16.09)
total: 1000 mkdir in 60.07 seconds: 16.65 ops/second
 - mkdir 178 (time 1787461250.80 total 10.06 last 17.70)
 - mkdir 337 (time 1787461260.81 total 20.07 last 15.88)
 - mkdir 506 (time 1787461270.83 total 30.09 last 16.87)
 - mkdir 701 (time 1787461280.85 total 40.11 last 19.46)
 - mkdir 856 (time 1787461290.95 total 50.20 last 15.35)
 - mkdir 993 (time 1787461300.98 total 60.24 last 13.66)
total: 1000 mkdir in 60.91 seconds: 16.42 ops/second
 - mkdir 176 (time 1787461250.20 total 10.01 last 17.59)
 - mkdir 334 (time 1787461260.23 total 20.04 last 15.75)
 - mkdir 497 (time 1787461270.24 total 30.04 last 16.29)
 - mkdir 682 (time 1787461280.29 total 40.09 last 18.41)
 - mkdir 837 (time 1787461290.31 total 50.12 last 15.46)
 - mkdir 980 (time 1787461300.35 total 60.15 last 14.25)
total: 1000 mkdir in 62.28 seconds: 16.06 ops/second
 - mkdir 176 (time 1787461251.74 total 10.02 last 17.57)
 - mkdir 336 (time 1787461261.79 total 20.07 last 15.92)
 - mkdir 509 (time 1787461271.81 total 30.09 last 17.26)
 - mkdir 696 (time 1787461281.82 total 40.10 last 18.68)
 - mkdir 855 (time 1787461291.87 total 50.15 last 15.83)
 - mkdir 988 (time 1787461301.95 total 60.23 last 13.20)
total: 1000 mkdir in 61.39 seconds: 16.29 ops/second
 - mkdir 171 (time 1787461251.00 total 10.01 last 17.08)
 - mkdir 322 (time 1787461261.02 total 20.04 last 15.07)
 - mkdir 483 (time 1787461271.07 total 30.09 last 16.02)
 - mkdir 665 (time 1787461281.08 total 40.09 last 18.19)
 - mkdir 816 (time 1787461291.12 total 50.13 last 15.04)
 - mkdir 952 (time 1787461301.18 total 60.19 last 13.52)
total: 1000 mkdir in 64.90 seconds: 15.41 ops/second
Time for file creation 74 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787461313 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787461315 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787461316 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787461316 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787461316 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787461316 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787461316 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787461317 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787461316 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787461317 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 46 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8