== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:30:07 (1787603407)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.45 seconds: 22.04 ops/second
 - mkdir 161 (time 1787603426.58 total 10.00 last 16.09)
 - mkdir 339 (time 1787603436.61 total 20.03 last 17.76)
 - mkdir 551 (time 1787603446.63 total 30.05 last 21.15)
 - mkdir 758 (time 1787603456.69 total 40.11 last 20.58)
 - mkdir 934 (time 1787603466.74 total 50.17 last 17.50)
total: 1000 mkdir in 53.89 seconds: 18.55 ops/second
 - mkdir 171 (time 1787603429.40 total 10.05 last 17.02)
 - mkdir 369 (time 1787603439.43 total 20.07 last 19.75)
 - mkdir 593 (time 1787603449.45 total 30.09 last 22.35)
 - mkdir 782 (time 1787603459.48 total 40.12 last 18.85)
 - mkdir 956 (time 1787603469.53 total 50.17 last 17.32)
total: 1000 mkdir in 54.58 seconds: 18.32 ops/second
 - mkdir 160 (time 1787603428.57 total 10.05 last 15.93)
 - mkdir 352 (time 1787603438.58 total 20.05 last 19.18)
 - mkdir 567 (time 1787603448.60 total 30.07 last 21.46)
 - mkdir 761 (time 1787603458.63 total 40.11 last 19.32)
 - mkdir 930 (time 1787603468.65 total 50.12 last 16.88)
total: 1000 mkdir in 56.54 seconds: 17.69 ops/second
 - mkdir 163 (time 1787603429.58 total 10.03 last 16.25)
 - mkdir 364 (time 1787603439.62 total 20.07 last 20.02)
 - mkdir 584 (time 1787603449.65 total 30.10 last 21.94)
 - mkdir 776 (time 1787603459.65 total 40.10 last 19.19)
 - mkdir 943 (time 1787603469.70 total 50.16 last 16.61)
total: 1000 mkdir in 56.10 seconds: 17.83 ops/second
 - mkdir 161 (time 1787603429.04 total 10.07 last 15.99)
 - mkdir 353 (time 1787603439.07 total 20.10 last 19.14)
 - mkdir 568 (time 1787603449.10 total 30.12 last 21.44)
 - mkdir 765 (time 1787603459.19 total 40.21 last 19.53)
 - mkdir 937 (time 1787603469.23 total 50.25 last 17.13)
total: 1000 mkdir in 56.87 seconds: 17.58 ops/second
 - mkdir 158 (time 1787603428.52 total 10.02 last 15.76)
 - mkdir 343 (time 1787603438.53 total 20.04 last 18.48)
 - mkdir 551 (time 1787603448.54 total 30.05 last 20.77)
 - mkdir 743 (time 1787603458.56 total 40.07 last 19.17)
 - mkdir 915 (time 1787603468.60 total 50.11 last 17.13)
total: 1000 mkdir in 58.43 seconds: 17.11 ops/second
 - mkdir 161 (time 1787603428.88 total 10.07 last 15.98)
 - mkdir 346 (time 1787603438.88 total 20.08 last 18.49)
 - mkdir 560 (time 1787603448.89 total 30.09 last 21.38)
 - mkdir 753 (time 1787603458.90 total 40.10 last 19.28)
 - mkdir 923 (time 1787603468.91 total 50.11 last 16.98)
total: 1000 mkdir in 58.16 seconds: 17.19 ops/second
 - mkdir 165 (time 1787603429.30 total 10.06 last 16.41)
 - mkdir 355 (time 1787603439.34 total 20.09 last 18.93)
 - mkdir 569 (time 1787603449.35 total 30.11 last 21.36)
 - mkdir 757 (time 1787603459.36 total 40.11 last 18.79)
 - mkdir 927 (time 1787603469.37 total 50.13 last 16.98)
total: 1000 mkdir in 58.07 seconds: 17.22 ops/second
 - mkdir 161 (time 1787603429.82 total 10.06 last 16.01)
 - mkdir 352 (time 1787603439.85 total 20.08 last 19.04)
 - mkdir 575 (time 1787603449.88 total 30.12 last 22.23)
 - mkdir 763 (time 1787603459.90 total 40.14 last 18.76)
 - mkdir 932 (time 1787603469.93 total 50.17 last 16.85)
total: 1000 mkdir in 57.71 seconds: 17.33 ops/second
 - mkdir 152 (time 1787603429.46 total 10.07 last 15.10)
 - mkdir 333 (time 1787603439.46 total 20.07 last 18.10)
 - mkdir 543 (time 1787603449.50 total 30.11 last 20.92)
 - mkdir 731 (time 1787603459.52 total 40.12 last 18.78)
 - mkdir 903 (time 1787603469.52 total 50.13 last 17.19)
total: 1000 mkdir in 59.94 seconds: 16.68 ops/second
Time for file creation 69 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.49 seconds: 20.23 ops/second
 - mkdir 161 (time 1787604015.53 total 10.06 last 16.00)
 - mkdir 302 (time 1787604025.59 total 20.12 last 14.02)
 - mkdir 471 (time 1787604035.65 total 30.18 last 16.80)
 - mkdir 622 (time 1787604045.69 total 40.22 last 15.05)
 - mkdir 804 (time 1787604055.71 total 50.25 last 18.15)
 - mkdir 962 (time 1787604065.72 total 60.25 last 15.79)
total: 1000 mkdir in 62.47 seconds: 16.01 ops/second
 - mkdir 161 (time 1787604018.37 total 10.05 last 16.02)
 - mkdir 313 (time 1787604028.40 total 20.08 last 15.16)
 - mkdir 481 (time 1787604038.50 total 30.18 last 16.64)
 - mkdir 631 (time 1787604048.51 total 40.20 last 14.97)
 - mkdir 819 (time 1787604058.58 total 50.26 last 18.67)
 - mkdir 977 (time 1787604068.62 total 60.30 last 15.74)
total: 1000 mkdir in 62.77 seconds: 15.93 ops/second
 - mkdir 161 (time 1787604018.51 total 10.03 last 16.05)
 - mkdir 304 (time 1787604028.53 total 20.05 last 14.27)
 - mkdir 472 (time 1787604038.62 total 30.14 last 16.66)
 - mkdir 623 (time 1787604048.63 total 40.14 last 15.09)
 - mkdir 815 (time 1787604058.67 total 50.19 last 19.11)
 - mkdir 975 (time 1787604068.70 total 60.22 last 15.95)
total: 1000 mkdir in 63.22 seconds: 15.82 ops/second
 - mkdir 156 (time 1787604018.22 total 10.08 last 15.48)
 - mkdir 304 (time 1787604028.23 total 20.08 last 14.79)
 - mkdir 470 (time 1787604038.30 total 30.16 last 16.48)
 - mkdir 619 (time 1787604048.36 total 40.21 last 14.82)
 - mkdir 808 (time 1787604058.40 total 50.25 last 18.82)
 - mkdir 967 (time 1787604068.41 total 60.26 last 15.89)
total: 1000 mkdir in 64.31 seconds: 15.55 ops/second
 - mkdir 152 (time 1787604018.40 total 10.06 last 15.11)
 - mkdir 297 (time 1787604028.43 total 20.08 last 14.47)
 - mkdir 462 (time 1787604038.49 total 30.15 last 16.39)
 - mkdir 612 (time 1787604048.50 total 40.16 last 14.99)
 - mkdir 799 (time 1787604058.54 total 50.20 last 18.63)
 - mkdir 956 (time 1787604068.57 total 60.23 last 15.66)
total: 1000 mkdir in 65.73 seconds: 15.21 ops/second
 - mkdir 154 (time 1787604018.25 total 10.04 last 15.34)
 - mkdir 299 (time 1787604028.32 total 20.11 last 14.40)
 - mkdir 464 (time 1787604038.35 total 30.14 last 16.44)
 - mkdir 615 (time 1787604048.36 total 40.15 last 15.08)
 - mkdir 803 (time 1787604058.37 total 50.16 last 18.78)
 - mkdir 956 (time 1787604068.40 total 60.19 last 15.26)
total: 1000 mkdir in 65.87 seconds: 15.18 ops/second
 - mkdir 151 (time 1787604018.10 total 10.03 last 15.05)
 - mkdir 292 (time 1787604028.12 total 20.06 last 14.07)
 - mkdir 457 (time 1787604038.19 total 30.12 last 16.40)
 - mkdir 606 (time 1787604048.26 total 40.20 last 14.78)
 - mkdir 790 (time 1787604058.32 total 50.25 last 18.31)
 - mkdir 952 (time 1787604068.40 total 60.34 last 16.06)
total: 1000 mkdir in 66.08 seconds: 15.13 ops/second
 - mkdir 157 (time 1787604018.71 total 10.00 last 15.70)
 - mkdir 299 (time 1787604028.75 total 20.04 last 14.14)
 - mkdir 465 (time 1787604038.79 total 30.09 last 16.52)
 - mkdir 621 (time 1787604048.81 total 40.11 last 15.57)
 - mkdir 808 (time 1787604058.83 total 50.12 last 18.67)
 - mkdir 961 (time 1787604068.87 total 60.16 last 15.24)
total: 1000 mkdir in 65.60 seconds: 15.24 ops/second
 - mkdir 154 (time 1787604018.46 total 10.02 last 15.37)
 - mkdir 295 (time 1787604028.53 total 20.10 last 13.99)
 - mkdir 460 (time 1787604038.60 total 30.16 last 16.40)
 - mkdir 609 (time 1787604048.60 total 40.16 last 14.89)
 - mkdir 794 (time 1787604058.63 total 50.19 last 18.44)
 - mkdir 953 (time 1787604068.68 total 60.25 last 15.82)
total: 1000 mkdir in 66.11 seconds: 15.13 ops/second
 - mkdir 151 (time 1787604017.57 total 10.05 last 15.03)
 - mkdir 292 (time 1787604027.59 total 20.08 last 14.06)
 - mkdir 449 (time 1787604037.66 total 30.15 last 15.59)
 - mkdir 599 (time 1787604047.73 total 40.22 last 14.90)
 - mkdir 781 (time 1787604057.78 total 50.26 last 18.12)
 - mkdir 936 (time 1787604067.79 total 60.28 last 15.47)
total: 1000 mkdir in 67.52 seconds: 14.81 ops/second
Time for file creation 77 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787604083 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787604084 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787604084 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787604085 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787604085 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787604084 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787604085 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787604085 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787604085 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787604085 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8