== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 15:32:22 (1787859142)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.73 seconds: 13.65 ops/second
 - mkdir 114 (time 1787859163.40 total 10.04 last 11.35)
 - mkdir 267 (time 1787859173.41 total 20.05 last 15.29)
 - mkdir 413 (time 1787859183.45 total 30.09 last 14.54)
 - mkdir 576 (time 1787859193.49 total 40.14 last 16.23)
 - mkdir 739 (time 1787859203.51 total 50.16 last 16.26)
 - mkdir 934 (time 1787859213.52 total 60.16 last 19.50)
total: 1000 mkdir in 63.23 seconds: 15.82 ops/second
 - mkdir 119 (time 1787859165.93 total 10.01 last 11.89)
 - mkdir 286 (time 1787859175.96 total 20.04 last 16.65)
 - mkdir 440 (time 1787859186.00 total 30.09 last 15.33)
 - mkdir 600 (time 1787859196.06 total 40.14 last 15.92)
 - mkdir 773 (time 1787859206.11 total 50.19 last 17.21)
 - mkdir 975 (time 1787859216.12 total 60.20 last 20.18)
total: 1000 mkdir in 61.65 seconds: 16.22 ops/second
 - mkdir 110 (time 1787859165.12 total 10.06 last 10.94)
 - mkdir 276 (time 1787859175.14 total 20.08 last 16.56)
 - mkdir 429 (time 1787859185.18 total 30.12 last 15.24)
 - mkdir 585 (time 1787859195.20 total 40.14 last 15.56)
 - mkdir 745 (time 1787859205.21 total 50.15 last 15.99)
 - mkdir 946 (time 1787859215.21 total 60.15 last 20.09)
total: 1000 mkdir in 63.87 seconds: 15.66 ops/second
 - mkdir 114 (time 1787859165.82 total 10.00 last 11.40)
 - mkdir 275 (time 1787859175.84 total 20.02 last 16.07)
 - mkdir 430 (time 1787859185.87 total 30.05 last 15.46)
 - mkdir 590 (time 1787859195.96 total 40.14 last 15.85)
 - mkdir 760 (time 1787859205.96 total 50.15 last 16.99)
 - mkdir 960 (time 1787859215.99 total 60.17 last 19.95)
total: 1000 mkdir in 63.15 seconds: 15.84 ops/second
 - mkdir 109 (time 1787859164.28 total 10.01 last 10.89)
 - mkdir 268 (time 1787859174.29 total 20.02 last 15.89)
 - mkdir 415 (time 1787859184.35 total 30.07 last 14.62)
 - mkdir 573 (time 1787859194.37 total 40.10 last 15.76)
 - mkdir 730 (time 1787859204.48 total 50.20 last 15.53)
 - mkdir 919 (time 1787859214.48 total 60.21 last 18.89)
total: 1000 mkdir in 65.38 seconds: 15.30 ops/second
 - mkdir 117 (time 1787859165.63 total 10.05 last 11.65)
 - mkdir 283 (time 1787859175.69 total 20.10 last 16.51)
 - mkdir 435 (time 1787859185.70 total 30.12 last 15.18)
 - mkdir 590 (time 1787859195.76 total 40.18 last 15.40)
 - mkdir 756 (time 1787859205.80 total 50.21 last 16.54)
 - mkdir 955 (time 1787859215.82 total 60.23 last 19.86)
total: 1000 mkdir in 64.23 seconds: 15.57 ops/second
 - mkdir 112 (time 1787859165.60 total 10.03 last 11.17)
 - mkdir 273 (time 1787859175.64 total 20.06 last 16.05)
 - mkdir 429 (time 1787859185.70 total 30.13 last 15.50)
 - mkdir 586 (time 1787859195.74 total 40.17 last 15.63)
 - mkdir 750 (time 1787859205.78 total 50.21 last 16.34)
 - mkdir 947 (time 1787859215.80 total 60.22 last 19.67)
total: 1000 mkdir in 64.99 seconds: 15.39 ops/second
 - mkdir 115 (time 1787859166.02 total 10.03 last 11.47)
 - mkdir 273 (time 1787859176.04 total 20.04 last 15.77)
 - mkdir 427 (time 1787859186.17 total 30.18 last 15.20)
 - mkdir 581 (time 1787859196.21 total 40.21 last 15.34)
 - mkdir 748 (time 1787859206.22 total 50.22 last 16.68)
 - mkdir 947 (time 1787859216.23 total 60.24 last 19.87)
total: 1000 mkdir in 65.13 seconds: 15.35 ops/second
 - mkdir 110 (time 1787859165.71 total 10.00 last 11.00)
 - mkdir 264 (time 1787859175.82 total 20.12 last 15.23)
 - mkdir 411 (time 1787859185.87 total 30.16 last 14.64)
 - mkdir 564 (time 1787859195.89 total 40.19 last 15.26)
 - mkdir 726 (time 1787859206.00 total 50.29 last 16.03)
 - mkdir 915 (time 1787859216.01 total 60.31 last 18.87)
total: 1000 mkdir in 66.77 seconds: 14.98 ops/second
 - mkdir 109 (time 1787859165.94 total 10.02 last 10.88)
 - mkdir 262 (time 1787859175.96 total 20.04 last 15.26)
 - mkdir 409 (time 1787859186.03 total 30.12 last 14.59)
 - mkdir 559 (time 1787859196.08 total 40.16 last 14.93)
 - mkdir 725 (time 1787859206.08 total 50.16 last 16.60)
 - mkdir 914 (time 1787859216.09 total 60.18 last 18.87)
total: 1000 mkdir in 66.86 seconds: 14.96 ops/second
Time for file creation 78 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.57 seconds: 17.43 ops/second
 - mkdir 149 (time 1787859796.16 total 10.11 last 14.75)
 - mkdir 295 (time 1787859806.23 total 20.18 last 14.49)
 - mkdir 483 (time 1787859816.24 total 30.19 last 18.79)
 - mkdir 646 (time 1787859826.25 total 40.20 last 16.28)
 - mkdir 817 (time 1787859836.26 total 50.20 last 17.09)
 - mkdir 986 (time 1787859846.27 total 60.22 last 16.87)
total: 1000 mkdir in 61.05 seconds: 16.38 ops/second
 - mkdir 150 (time 1787859796.55 total 10.05 last 14.92)
 - mkdir 292 (time 1787859806.60 total 20.11 last 14.12)
 - mkdir 482 (time 1787859816.63 total 30.13 last 18.95)
 - mkdir 646 (time 1787859826.67 total 40.18 last 16.33)
 - mkdir 815 (time 1787859836.73 total 50.24 last 16.80)
 - mkdir 988 (time 1787859846.76 total 60.27 last 17.25)
total: 1000 mkdir in 61.24 seconds: 16.33 ops/second
 - mkdir 151 (time 1787859796.55 total 10.07 last 14.99)
 - mkdir 291 (time 1787859806.60 total 20.13 last 13.93)
 - mkdir 469 (time 1787859816.61 total 30.13 last 17.79)
 - mkdir 634 (time 1787859826.66 total 40.18 last 16.41)
 - mkdir 806 (time 1787859836.73 total 50.25 last 17.08)
 - mkdir 974 (time 1787859846.74 total 60.26 last 16.79)
total: 1000 mkdir in 62.44 seconds: 16.01 ops/second
 - mkdir 145 (time 1787859794.93 total 10.01 last 14.48)
 - mkdir 267 (time 1787859804.93 total 20.02 last 12.20)
 - mkdir 447 (time 1787859814.94 total 30.02 last 17.99)
 - mkdir 608 (time 1787859824.95 total 40.04 last 16.07)
 - mkdir 773 (time 1787859834.96 total 50.04 last 16.50)
 - mkdir 949 (time 1787859845.01 total 60.09 last 17.50)
total: 1000 mkdir in 64.03 seconds: 15.62 ops/second
 - mkdir 146 (time 1787859797.06 total 10.16 last 14.37)
 - mkdir 287 (time 1787859807.06 total 20.16 last 14.09)
 - mkdir 471 (time 1787859817.08 total 30.18 last 18.37)
 - mkdir 641 (time 1787859827.09 total 40.20 last 16.97)
 - mkdir 808 (time 1787859837.13 total 50.23 last 16.64)
 - mkdir 978 (time 1787859847.18 total 60.28 last 16.91)
total: 1000 mkdir in 62.44 seconds: 16.02 ops/second
 - mkdir 147 (time 1787859797.70 total 10.00 last 14.69)
 - mkdir 296 (time 1787859807.78 total 20.08 last 14.79)
 - mkdir 477 (time 1787859817.79 total 30.09 last 18.07)
 - mkdir 645 (time 1787859827.82 total 40.12 last 16.75)
 - mkdir 816 (time 1787859837.88 total 50.18 last 17.01)
 - mkdir 984 (time 1787859848.06 total 60.36 last 16.50)
total: 1000 mkdir in 61.91 seconds: 16.15 ops/second
 - mkdir 140 (time 1787859797.51 total 10.04 last 13.95)
 - mkdir 290 (time 1787859807.55 total 20.08 last 14.94)
 - mkdir 466 (time 1787859817.55 total 30.08 last 17.60)
 - mkdir 638 (time 1787859827.61 total 40.15 last 17.09)
 - mkdir 808 (time 1787859837.66 total 50.19 last 16.93)
 - mkdir 978 (time 1787859847.66 total 60.20 last 16.98)
total: 1000 mkdir in 62.31 seconds: 16.05 ops/second
 - mkdir 143 (time 1787859796.88 total 10.08 last 14.19)
 - mkdir 285 (time 1787859806.90 total 20.10 last 14.16)
 - mkdir 467 (time 1787859816.98 total 30.18 last 18.06)
 - mkdir 631 (time 1787859826.98 total 40.18 last 16.39)
 - mkdir 798 (time 1787859837.04 total 50.23 last 16.61)
 - mkdir 968 (time 1787859847.08 total 60.28 last 16.93)
total: 1000 mkdir in 63.49 seconds: 15.75 ops/second
 - mkdir 145 (time 1787859797.17 total 10.07 last 14.40)
 - mkdir 289 (time 1787859807.22 total 20.12 last 14.33)
 - mkdir 470 (time 1787859817.26 total 30.17 last 18.02)
 - mkdir 634 (time 1787859827.30 total 40.20 last 16.35)
 - mkdir 803 (time 1787859837.35 total 50.25 last 16.82)
 - mkdir 974 (time 1787859847.41 total 60.31 last 16.99)
total: 1000 mkdir in 63.28 seconds: 15.80 ops/second
 - mkdir 145 (time 1787859797.05 total 10.01 last 14.48)
 - mkdir 285 (time 1787859807.06 total 20.02 last 13.99)
 - mkdir 468 (time 1787859817.12 total 30.08 last 18.19)
 - mkdir 635 (time 1787859827.12 total 40.08 last 16.69)
 - mkdir 803 (time 1787859837.20 total 50.16 last 16.68)
 - mkdir 972 (time 1787859847.34 total 60.30 last 16.66)
total: 1000 mkdir in 63.36 seconds: 15.78 ops/second
Time for file creation 74 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787859862 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787859862 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787859864 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787859864 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787859864 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787859864 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787859864 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787859864 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787859864 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787859864 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
Time for file removal 53 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8