== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 14:44:10 (1789152250)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 1.02 seconds: 9.80 ops/second
 - mkdir 139 (time 1789152277.84 total 10.01 last 13.89)
 - mkdir 338 (time 1789152287.87 total 20.04 last 19.85)
 - mkdir 497 (time 1789152297.90 total 30.06 last 15.86)
 - mkdir 629 (time 1789152307.91 total 40.07 last 13.19)
 - mkdir 770 (time 1789152317.97 total 50.13 last 14.02)
 - mkdir 926 (time 1789152328.01 total 60.18 last 15.53)
total: 1000 mkdir in 65.85 seconds: 15.19 ops/second
 - mkdir 132 (time 1789152277.54 total 10.01 last 13.19)
 - mkdir 335 (time 1789152287.56 total 20.02 last 20.27)
 - mkdir 497 (time 1789152297.61 total 30.08 last 16.12)
 - mkdir 624 (time 1789152307.62 total 40.09 last 12.69)
 - mkdir 763 (time 1789152317.68 total 50.14 last 13.83)
 - mkdir 923 (time 1789152327.72 total 60.19 last 15.92)
total: 1000 mkdir in 66.48 seconds: 15.04 ops/second
 - mkdir 112 (time 1789152275.20 total 10.02 last 11.18)
 - mkdir 302 (time 1789152285.21 total 20.03 last 18.99)
 - mkdir 468 (time 1789152295.32 total 30.13 last 16.42)
 - mkdir 593 (time 1789152305.36 total 40.17 last 12.45)
 - mkdir 728 (time 1789152315.37 total 50.18 last 13.49)
 - mkdir 887 (time 1789152325.44 total 60.26 last 15.78)
total: 1000 mkdir in 70.08 seconds: 14.27 ops/second
 - mkdir 155 (time 1789152279.85 total 10.02 last 15.47)
 - mkdir 359 (time 1789152289.92 total 20.09 last 20.26)
 - mkdir 519 (time 1789152299.93 total 30.10 last 15.98)
 - mkdir 642 (time 1789152310.02 total 40.19 last 12.19)
 - mkdir 790 (time 1789152320.09 total 50.26 last 14.70)
 - mkdir 931 (time 1789152330.10 total 60.27 last 14.09)
total: 1000 mkdir in 66.59 seconds: 15.02 ops/second
 - mkdir 151 (time 1789152279.15 total 10.03 last 15.05)
 - mkdir 349 (time 1789152289.22 total 20.10 last 19.67)
 - mkdir 504 (time 1789152299.26 total 30.14 last 15.44)
 - mkdir 627 (time 1789152309.30 total 40.18 last 12.25)
 - mkdir 768 (time 1789152319.31 total 50.19 last 14.08)
 - mkdir 923 (time 1789152329.39 total 60.27 last 15.38)
total: 1000 mkdir in 67.37 seconds: 14.84 ops/second
 - mkdir 151 (time 1789152279.50 total 10.05 last 15.03)
 - mkdir 348 (time 1789152289.53 total 20.08 last 19.63)
 - mkdir 500 (time 1789152299.55 total 30.10 last 15.18)
 - mkdir 624 (time 1789152309.59 total 40.14 last 12.35)
 - mkdir 767 (time 1789152319.63 total 50.18 last 14.24)
 - mkdir 914 (time 1789152329.70 total 60.25 last 14.60)
total: 1000 mkdir in 68.46 seconds: 14.61 ops/second
 - mkdir 140 (time 1789152278.30 total 10.04 last 13.95)
 - mkdir 335 (time 1789152288.36 total 20.10 last 19.39)
 - mkdir 482 (time 1789152298.37 total 30.11 last 14.68)
 - mkdir 608 (time 1789152308.39 total 40.12 last 12.58)
 - mkdir 743 (time 1789152318.50 total 50.24 last 13.35)
 - mkdir 902 (time 1789152328.59 total 60.33 last 15.75)
total: 1000 mkdir in 69.73 seconds: 14.34 ops/second
 - mkdir 145 (time 1789152278.78 total 10.08 last 14.39)
 - mkdir 342 (time 1789152288.78 total 20.08 last 19.69)
 - mkdir 490 (time 1789152298.83 total 30.12 last 14.74)
 - mkdir 613 (time 1789152308.89 total 40.19 last 12.22)
 - mkdir 750 (time 1789152318.92 total 50.21 last 13.67)
 - mkdir 908 (time 1789152328.93 total 60.22 last 15.79)
total: 1000 mkdir in 69.31 seconds: 14.43 ops/second
 - mkdir 147 (time 1789152278.96 total 10.02 last 14.68)
 - mkdir 337 (time 1789152289.02 total 20.07 last 18.90)
 - mkdir 489 (time 1789152299.07 total 30.12 last 15.12)
 - mkdir 613 (time 1789152309.11 total 40.16 last 12.35)
 - mkdir 753 (time 1789152319.15 total 50.20 last 13.94)
 - mkdir 907 (time 1789152329.17 total 60.22 last 15.37)
total: 1000 mkdir in 69.54 seconds: 14.38 ops/second
 - mkdir 152 (time 1789152279.33 total 10.02 last 15.17)
 - mkdir 346 (time 1789152289.33 total 20.03 last 19.39)
 - mkdir 496 (time 1789152299.39 total 30.09 last 14.91)
 - mkdir 618 (time 1789152309.48 total 40.17 last 12.09)
 - mkdir 757 (time 1789152319.51 total 50.20 last 13.86)
 - mkdir 904 (time 1789152329.52 total 60.22 last 14.68)
total: 1000 mkdir in 69.44 seconds: 14.40 ops/second
Time for file creation 85 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.58 seconds: 17.34 ops/second
 - mkdir 155 (time 1789152854.31 total 10.09 last 15.37)
 - mkdir 315 (time 1789152864.33 total 20.10 last 15.97)
 - mkdir 512 (time 1789152874.39 total 30.16 last 19.58)
 - mkdir 670 (time 1789152884.43 total 40.20 last 15.74)
 - mkdir 833 (time 1789152894.44 total 50.21 last 16.28)
total: 1000 mkdir in 58.21 seconds: 17.18 ops/second
 - mkdir 147 (time 1789152853.33 total 10.08 last 14.58)
 - mkdir 296 (time 1789152863.38 total 20.13 last 14.82)
 - mkdir 500 (time 1789152873.44 total 30.19 last 20.28)
 - mkdir 660 (time 1789152883.47 total 40.22 last 15.96)
 - mkdir 820 (time 1789152893.50 total 50.25 last 15.96)
total: 1000 mkdir in 59.22 seconds: 16.88 ops/second
 - mkdir 158 (time 1789152856.46 total 10.03 last 15.75)
 - mkdir 335 (time 1789152866.47 total 20.04 last 17.69)
 - mkdir 514 (time 1789152876.54 total 30.11 last 17.77)
 - mkdir 675 (time 1789152886.56 total 40.14 last 16.06)
 - mkdir 833 (time 1789152896.57 total 50.15 last 15.79)
 - mkdir 998 (time 1789152906.65 total 60.23 last 16.36)
total: 1000 mkdir in 60.40 seconds: 16.56 ops/second
 - mkdir 154 (time 1789152856.33 total 10.05 last 15.32)
 - mkdir 324 (time 1789152866.35 total 20.07 last 16.97)
 - mkdir 507 (time 1789152876.36 total 30.08 last 18.28)
 - mkdir 664 (time 1789152886.42 total 40.15 last 15.60)
 - mkdir 827 (time 1789152896.48 total 50.21 last 16.20)
 - mkdir 993 (time 1789152906.58 total 60.30 last 16.45)
total: 1000 mkdir in 61.12 seconds: 16.36 ops/second
 - mkdir 146 (time 1789152855.94 total 10.06 last 14.52)
 - mkdir 315 (time 1789152865.95 total 20.06 last 16.89)
 - mkdir 500 (time 1789152876.01 total 30.13 last 18.38)
 - mkdir 656 (time 1789152886.10 total 40.21 last 15.46)
 - mkdir 814 (time 1789152896.17 total 50.29 last 15.68)
 - mkdir 986 (time 1789152906.18 total 60.30 last 17.19)
total: 1000 mkdir in 62.03 seconds: 16.12 ops/second
 - mkdir 152 (time 1789152857.00 total 10.05 last 15.12)
 - mkdir 334 (time 1789152867.03 total 20.08 last 18.15)
 - mkdir 514 (time 1789152877.04 total 30.09 last 17.99)
 - mkdir 673 (time 1789152887.09 total 40.14 last 15.82)
 - mkdir 829 (time 1789152897.16 total 50.21 last 15.49)
 - mkdir 989 (time 1789152907.23 total 60.28 last 15.89)
total: 1000 mkdir in 61.62 seconds: 16.23 ops/second
 - mkdir 150 (time 1789152856.93 total 10.09 last 14.87)
 - mkdir 326 (time 1789152867.00 total 20.16 last 17.48)
 - mkdir 509 (time 1789152877.00 total 30.16 last 18.29)
 - mkdir 670 (time 1789152887.05 total 40.21 last 16.02)
 - mkdir 827 (time 1789152897.06 total 50.22 last 15.69)
 - mkdir 985 (time 1789152907.10 total 60.26 last 15.74)
total: 1000 mkdir in 62.23 seconds: 16.07 ops/second
 - mkdir 151 (time 1789152857.20 total 10.08 last 14.99)
 - mkdir 332 (time 1789152867.21 total 20.09 last 18.07)
 - mkdir 509 (time 1789152877.27 total 30.15 last 17.61)
 - mkdir 666 (time 1789152887.27 total 40.15 last 15.70)
 - mkdir 823 (time 1789152897.27 total 50.15 last 15.70)
 - mkdir 987 (time 1789152907.35 total 60.23 last 16.28)
total: 1000 mkdir in 61.98 seconds: 16.13 ops/second
 - mkdir 146 (time 1789152856.39 total 10.02 last 14.57)
 - mkdir 311 (time 1789152866.40 total 20.03 last 16.49)
 - mkdir 488 (time 1789152876.43 total 30.06 last 17.64)
 - mkdir 645 (time 1789152886.47 total 40.09 last 15.64)
 - mkdir 805 (time 1789152896.54 total 50.17 last 15.89)
 - mkdir 975 (time 1789152906.66 total 60.29 last 16.80)
total: 1000 mkdir in 63.74 seconds: 15.69 ops/second
 - mkdir 137 (time 1789152856.95 total 10.02 last 13.67)
 - mkdir 302 (time 1789152866.95 total 20.03 last 16.50)
 - mkdir 471 (time 1789152876.96 total 30.04 last 16.88)
 - mkdir 632 (time 1789152886.96 total 40.04 last 16.10)
 - mkdir 791 (time 1789152896.98 total 50.06 last 15.87)
 - mkdir 957 (time 1789152907.03 total 60.11 last 16.52)
total: 1000 mkdir in 64.80 seconds: 15.43 ops/second
Time for file creation 77 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789152923 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1789152926 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789152926 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789152927 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1789152926 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789152927 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789152927 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789152927 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789152927 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1789152928 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
Time for file removal 58 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8