== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 02:49:44 (1784184584)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.65 seconds: 15.27 ops/second
 - mkdir 185 (time 1784184605.97 total 10.02 last 18.47)
 - mkdir 353 (time 1784184616.05 total 20.10 last 16.65)
 - mkdir 521 (time 1784184626.10 total 30.15 last 16.73)
 - mkdir 692 (time 1784184636.15 total 40.20 last 17.01)
 - mkdir 822 (time 1784184646.16 total 50.22 last 12.98)
 - mkdir 998 (time 1784184656.22 total 60.27 last 17.50)
total: 1000 mkdir in 60.33 seconds: 16.58 ops/second
 - mkdir 183 (time 1784184605.97 total 10.01 last 18.28)
 - mkdir 343 (time 1784184615.98 total 20.01 last 15.99)
 - mkdir 507 (time 1784184625.98 total 30.02 last 16.39)
 - mkdir 689 (time 1784184636.07 total 40.11 last 18.04)
 - mkdir 813 (time 1784184646.10 total 50.14 last 12.36)
 - mkdir 982 (time 1784184656.11 total 60.14 last 16.89)
total: 1000 mkdir in 62.16 seconds: 16.09 ops/second
 - mkdir 181 (time 1784184606.56 total 10.01 last 18.09)
 - mkdir 341 (time 1784184616.59 total 20.04 last 15.94)
 - mkdir 497 (time 1784184626.62 total 30.06 last 15.57)
 - mkdir 674 (time 1784184636.67 total 40.12 last 17.60)
 - mkdir 800 (time 1784184646.70 total 50.15 last 12.56)
 - mkdir 970 (time 1784184656.73 total 60.17 last 16.96)
total: 1000 mkdir in 63.73 seconds: 15.69 ops/second
 - mkdir 184 (time 1784184607.15 total 10.01 last 18.38)
 - mkdir 345 (time 1784184617.17 total 20.04 last 16.06)
 - mkdir 503 (time 1784184627.22 total 30.08 last 15.73)
 - mkdir 672 (time 1784184637.32 total 40.18 last 16.73)
 - mkdir 801 (time 1784184647.36 total 50.23 last 12.85)
 - mkdir 970 (time 1784184657.46 total 60.32 last 16.74)
total: 1000 mkdir in 64.19 seconds: 15.58 ops/second
 - mkdir 180 (time 1784184606.67 total 10.06 last 17.89)
 - mkdir 338 (time 1784184616.67 total 20.06 last 15.80)
 - mkdir 495 (time 1784184626.72 total 30.11 last 15.62)
 - mkdir 656 (time 1784184636.77 total 40.17 last 16.01)
 - mkdir 782 (time 1784184646.80 total 50.20 last 12.56)
 - mkdir 953 (time 1784184656.84 total 60.23 last 17.04)
total: 1000 mkdir in 65.96 seconds: 15.16 ops/second
 - mkdir 181 (time 1784184607.43 total 10.02 last 18.06)
 - mkdir 340 (time 1784184617.52 total 20.11 last 15.76)
 - mkdir 498 (time 1784184627.53 total 30.12 last 15.79)
 - mkdir 664 (time 1784184637.54 total 40.12 last 16.59)
 - mkdir 795 (time 1784184647.57 total 50.15 last 13.06)
 - mkdir 960 (time 1784184657.58 total 60.17 last 16.47)
total: 1000 mkdir in 65.51 seconds: 15.26 ops/second
 - mkdir 178 (time 1784184607.24 total 10.06 last 17.69)
 - mkdir 335 (time 1784184617.28 total 20.10 last 15.64)
 - mkdir 489 (time 1784184627.35 total 30.17 last 15.30)
 - mkdir 657 (time 1784184637.39 total 40.22 last 16.72)
 - mkdir 786 (time 1784184647.48 total 50.30 last 12.79)
 - mkdir 951 (time 1784184657.57 total 60.39 last 16.35)
total: 1000 mkdir in 66.67 seconds: 15.00 ops/second
 - mkdir 169 (time 1784184605.13 total 10.02 last 16.86)
 - mkdir 333 (time 1784184615.16 total 20.05 last 16.35)
 - mkdir 473 (time 1784184625.22 total 30.11 last 13.92)
 - mkdir 641 (time 1784184635.23 total 40.12 last 16.77)
 - mkdir 757 (time 1784184645.31 total 50.20 last 11.51)
 - mkdir 916 (time 1784184655.32 total 60.21 last 15.89)
total: 1000 mkdir in 69.22 seconds: 14.45 ops/second
 - mkdir 178 (time 1784184607.36 total 10.04 last 17.73)
 - mkdir 334 (time 1784184617.38 total 20.06 last 15.56)
 - mkdir 483 (time 1784184627.40 total 30.08 last 14.87)
 - mkdir 644 (time 1784184637.42 total 40.11 last 16.06)
 - mkdir 775 (time 1784184647.43 total 50.12 last 13.09)
 - mkdir 946 (time 1784184657.52 total 60.20 last 16.95)
total: 1000 mkdir in 67.09 seconds: 14.91 ops/second
 - mkdir 175 (time 1784184607.26 total 10.03 last 17.45)
 - mkdir 331 (time 1784184617.28 total 20.05 last 15.56)
 - mkdir 482 (time 1784184627.34 total 30.11 last 15.01)
 - mkdir 644 (time 1784184637.39 total 40.16 last 16.12)
 - mkdir 766 (time 1784184647.51 total 50.28 last 12.06)
 - mkdir 923 (time 1784184657.63 total 60.40 last 15.51)
total: 1000 mkdir in 68.63 seconds: 14.57 ops/second
Time for file creation 79 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.63 seconds: 15.84 ops/second
 - mkdir 132 (time 1784185207.76 total 10.00 last 13.20)
 - mkdir 290 (time 1784185217.82 total 20.06 last 15.70)
 - mkdir 454 (time 1784185227.87 total 30.11 last 16.32)
 - mkdir 656 (time 1784185237.89 total 40.13 last 20.16)
 - mkdir 845 (time 1784185247.89 total 50.13 last 18.90)
 - mkdir 978 (time 1784185258.00 total 60.25 last 13.15)
total: 1000 mkdir in 61.58 seconds: 16.24 ops/second
 - mkdir 140 (time 1784185209.51 total 10.01 last 13.99)
 - mkdir 307 (time 1784185219.52 total 20.02 last 16.68)
 - mkdir 465 (time 1784185229.54 total 30.04 last 15.77)
 - mkdir 689 (time 1784185239.57 total 40.07 last 22.32)
 - mkdir 854 (time 1784185249.65 total 50.15 last 16.38)
 - mkdir 992 (time 1784185259.72 total 60.22 last 13.70)
total: 1000 mkdir in 61.28 seconds: 16.32 ops/second
 - mkdir 165 (time 1784185212.28 total 10.05 last 16.43)
 - mkdir 347 (time 1784185222.28 total 20.05 last 18.20)
 - mkdir 499 (time 1784185232.29 total 30.06 last 15.19)
 - mkdir 743 (time 1784185242.29 total 40.06 last 24.40)
 - mkdir 891 (time 1784185252.33 total 50.10 last 14.74)
total: 1000 mkdir in 58.79 seconds: 17.01 ops/second
 - mkdir 150 (time 1784185210.88 total 10.03 last 14.96)
 - mkdir 320 (time 1784185220.91 total 20.05 last 16.96)
 - mkdir 484 (time 1784185230.94 total 30.08 last 16.35)
 - mkdir 717 (time 1784185240.94 total 40.09 last 23.29)
 - mkdir 866 (time 1784185251.02 total 50.16 last 14.79)
 - mkdir 993 (time 1784185261.03 total 60.17 last 12.68)
total: 1000 mkdir in 61.33 seconds: 16.30 ops/second
 - mkdir 160 (time 1784185212.84 total 10.05 last 15.92)
 - mkdir 346 (time 1784185222.85 total 20.06 last 18.58)
 - mkdir 501 (time 1784185232.88 total 30.09 last 15.45)
 - mkdir 746 (time 1784185242.94 total 40.15 last 24.35)
 - mkdir 893 (time 1784185252.99 total 50.20 last 14.63)
total: 1000 mkdir in 59.78 seconds: 16.73 ops/second
 - mkdir 159 (time 1784185212.59 total 10.01 last 15.88)
 - mkdir 341 (time 1784185222.62 total 20.04 last 18.15)
 - mkdir 498 (time 1784185232.64 total 30.06 last 15.68)
 - mkdir 741 (time 1784185242.68 total 40.10 last 24.18)
 - mkdir 890 (time 1784185252.72 total 50.14 last 14.85)
 - mkdir 999 (time 1784185262.87 total 60.29 last 10.74)
total: 1000 mkdir in 60.29 seconds: 16.59 ops/second
 - mkdir 154 (time 1784185211.85 total 10.10 last 15.25)
 - mkdir 335 (time 1784185221.87 total 20.13 last 18.06)
 - mkdir 487 (time 1784185231.91 total 30.16 last 15.15)
 - mkdir 730 (time 1784185241.94 total 40.19 last 24.22)
 - mkdir 876 (time 1784185251.98 total 50.23 last 14.54)
 - mkdir 995 (time 1784185262.23 total 60.48 last 11.62)
total: 1000 mkdir in 61.13 seconds: 16.36 ops/second
 - mkdir 147 (time 1784185211.50 total 10.04 last 14.65)
 - mkdir 320 (time 1784185221.55 total 20.08 last 17.22)
 - mkdir 476 (time 1784185231.60 total 30.14 last 15.52)
 - mkdir 713 (time 1784185241.70 total 40.24 last 23.46)
 - mkdir 861 (time 1784185251.73 total 50.27 last 14.76)
 - mkdir 985 (time 1784185261.84 total 60.38 last 12.27)
total: 1000 mkdir in 62.56 seconds: 15.98 ops/second
 - mkdir 158 (time 1784185212.59 total 10.11 last 15.63)
 - mkdir 331 (time 1784185222.61 total 20.13 last 17.27)
 - mkdir 486 (time 1784185232.65 total 30.16 last 15.44)
 - mkdir 728 (time 1784185242.67 total 40.18 last 24.15)
 - mkdir 876 (time 1784185252.70 total 50.21 last 14.76)
 - mkdir 986 (time 1784185262.81 total 60.32 last 10.88)
total: 1000 mkdir in 61.76 seconds: 16.19 ops/second
 - mkdir 155 (time 1784185211.84 total 10.01 last 15.48)
 - mkdir 324 (time 1784185221.85 total 20.02 last 16.90)
 - mkdir 477 (time 1784185231.93 total 30.10 last 15.17)
 - mkdir 719 (time 1784185241.94 total 40.11 last 24.18)
 - mkdir 862 (time 1784185251.97 total 50.14 last 14.26)
 - mkdir 981 (time 1784185262.00 total 60.17 last 11.86)
total: 1000 mkdir in 62.65 seconds: 15.96 ops/second
Time for file creation 77 sec for 1 RPC sent at a time
 - unlinked 0 (time 1784185274 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1784185275 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1784185276 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1784185275 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1784185276 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1784185276 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1784185276 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1784185276 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1784185276 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1784185277 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8