== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 17:34:28 (1788471268)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.45 seconds: 22.27 ops/second
 - mkdir 170 (time 1788471288.59 total 10.03 last 16.95)
 - mkdir 353 (time 1788471298.61 total 20.05 last 18.27)
 - mkdir 519 (time 1788471308.64 total 30.07 last 16.56)
 - mkdir 687 (time 1788471318.66 total 40.10 last 16.76)
 - mkdir 866 (time 1788471328.72 total 50.15 last 17.80)
total: 1000 mkdir in 57.41 seconds: 17.42 ops/second
 - mkdir 179 (time 1788471289.96 total 10.04 last 17.82)
 - mkdir 359 (time 1788471299.99 total 20.07 last 17.95)
 - mkdir 533 (time 1788471310.05 total 30.14 last 17.29)
 - mkdir 703 (time 1788471320.15 total 40.24 last 16.84)
 - mkdir 886 (time 1788471330.17 total 50.26 last 18.26)
total: 1000 mkdir in 56.67 seconds: 17.65 ops/second
 - mkdir 170 (time 1788471290.05 total 10.09 last 16.85)
 - mkdir 352 (time 1788471300.06 total 20.11 last 18.17)
 - mkdir 517 (time 1788471310.07 total 30.11 last 16.49)
 - mkdir 694 (time 1788471320.09 total 40.13 last 17.67)
 - mkdir 877 (time 1788471330.14 total 50.18 last 18.20)
total: 1000 mkdir in 57.38 seconds: 17.43 ops/second
 - mkdir 173 (time 1788471290.30 total 10.09 last 17.15)
 - mkdir 356 (time 1788471300.36 total 20.15 last 18.19)
 - mkdir 533 (time 1788471310.42 total 30.21 last 17.59)
 - mkdir 703 (time 1788471320.44 total 40.23 last 16.96)
 - mkdir 886 (time 1788471330.47 total 50.26 last 18.25)
total: 1000 mkdir in 57.25 seconds: 17.47 ops/second
 - mkdir 172 (time 1788471289.94 total 10.04 last 17.13)
 - mkdir 351 (time 1788471299.94 total 20.05 last 17.90)
 - mkdir 522 (time 1788471309.95 total 30.05 last 17.09)
 - mkdir 695 (time 1788471319.97 total 40.08 last 17.25)
 - mkdir 875 (time 1788471329.99 total 50.09 last 17.98)
total: 1000 mkdir in 57.66 seconds: 17.34 ops/second
 - mkdir 165 (time 1788471289.75 total 10.03 last 16.45)
 - mkdir 340 (time 1788471299.79 total 20.07 last 17.44)
 - mkdir 507 (time 1788471309.86 total 30.14 last 16.58)
 - mkdir 681 (time 1788471319.89 total 40.17 last 17.35)
 - mkdir 866 (time 1788471329.94 total 50.23 last 18.40)
total: 1000 mkdir in 58.28 seconds: 17.16 ops/second
 - mkdir 170 (time 1788471290.05 total 10.03 last 16.96)
 - mkdir 345 (time 1788471300.12 total 20.10 last 17.38)
 - mkdir 514 (time 1788471310.16 total 30.14 last 16.83)
 - mkdir 681 (time 1788471320.19 total 40.17 last 16.66)
 - mkdir 870 (time 1788471330.19 total 50.17 last 18.90)
total: 1000 mkdir in 58.36 seconds: 17.14 ops/second
 - mkdir 170 (time 1788471290.23 total 10.04 last 16.94)
 - mkdir 350 (time 1788471300.24 total 20.04 last 17.99)
 - mkdir 519 (time 1788471310.30 total 30.11 last 16.79)
 - mkdir 686 (time 1788471320.36 total 40.16 last 16.61)
 - mkdir 867 (time 1788471330.40 total 50.20 last 18.03)
total: 1000 mkdir in 58.38 seconds: 17.13 ops/second
 - mkdir 158 (time 1788471288.84 total 10.01 last 15.78)
 - mkdir 326 (time 1788471298.88 total 20.06 last 16.73)
 - mkdir 486 (time 1788471308.90 total 30.07 last 15.98)
 - mkdir 657 (time 1788471318.90 total 40.08 last 17.09)
 - mkdir 837 (time 1788471328.96 total 50.14 last 17.90)
 - mkdir 994 (time 1788471339.13 total 60.30 last 15.45)
total: 1000 mkdir in 60.76 seconds: 16.46 ops/second
 - mkdir 164 (time 1788471290.26 total 10.09 last 16.25)
 - mkdir 337 (time 1788471300.30 total 20.13 last 17.23)
 - mkdir 499 (time 1788471310.33 total 30.15 last 16.16)
 - mkdir 669 (time 1788471320.36 total 40.19 last 16.95)
 - mkdir 852 (time 1788471330.38 total 50.21 last 18.25)
total: 1000 mkdir in 60.02 seconds: 16.66 ops/second
Time for file creation 70 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 10 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.42 seconds: 24.09 ops/second
 - mkdir 181 (time 1788471855.68 total 10.00 last 18.09)
 - mkdir 359 (time 1788471865.76 total 20.09 last 17.65)
 - mkdir 503 (time 1788471875.78 total 30.11 last 14.38)
 - mkdir 648 (time 1788471885.82 total 40.14 last 14.45)
 - mkdir 824 (time 1788471895.88 total 50.21 last 17.48)
 - mkdir 956 (time 1788471905.94 total 60.27 last 13.12)
total: 1000 mkdir in 63.19 seconds: 15.83 ops/second
 - mkdir 198 (time 1788471857.68 total 10.03 last 19.74)
 - mkdir 372 (time 1788471867.71 total 20.06 last 17.35)
 - mkdir 515 (time 1788471877.77 total 30.12 last 14.22)
 - mkdir 671 (time 1788471887.77 total 40.12 last 15.60)
 - mkdir 836 (time 1788471897.77 total 50.12 last 16.50)
 - mkdir 975 (time 1788471907.78 total 60.13 last 13.89)
total: 1000 mkdir in 61.99 seconds: 16.13 ops/second
 - mkdir 194 (time 1788471857.44 total 10.05 last 19.30)
 - mkdir 360 (time 1788471867.55 total 20.17 last 16.41)
 - mkdir 494 (time 1788471877.62 total 30.23 last 13.31)
 - mkdir 649 (time 1788471887.64 total 40.26 last 15.47)
 - mkdir 814 (time 1788471897.69 total 50.31 last 16.42)
 - mkdir 953 (time 1788471907.75 total 60.36 last 13.82)
total: 1000 mkdir in 64.70 seconds: 15.46 ops/second
 - mkdir 201 (time 1788471858.42 total 10.02 last 20.06)
 - mkdir 366 (time 1788471868.42 total 20.02 last 16.49)
 - mkdir 494 (time 1788471878.47 total 30.08 last 12.73)
 - mkdir 659 (time 1788471888.50 total 40.10 last 16.46)
 - mkdir 825 (time 1788471898.55 total 50.15 last 16.52)
 - mkdir 963 (time 1788471908.56 total 60.16 last 13.79)
total: 1000 mkdir in 63.69 seconds: 15.70 ops/second
 - mkdir 202 (time 1788471858.33 total 10.06 last 20.09)
 - mkdir 367 (time 1788471868.34 total 20.06 last 16.48)
 - mkdir 489 (time 1788471878.37 total 30.09 last 12.17)
 - mkdir 659 (time 1788471888.40 total 40.12 last 16.95)
 - mkdir 820 (time 1788471898.46 total 50.18 last 16.01)
 - mkdir 957 (time 1788471908.52 total 60.24 last 13.61)
total: 1000 mkdir in 64.22 seconds: 15.57 ops/second
 - mkdir 193 (time 1788471857.91 total 10.05 last 19.20)
 - mkdir 360 (time 1788471867.94 total 20.09 last 16.64)
 - mkdir 492 (time 1788471878.02 total 30.16 last 13.10)
 - mkdir 653 (time 1788471888.05 total 40.20 last 16.05)
 - mkdir 819 (time 1788471898.05 total 50.20 last 16.60)
 - mkdir 955 (time 1788471908.15 total 60.30 last 13.46)
total: 1000 mkdir in 64.68 seconds: 15.46 ops/second
 - mkdir 204 (time 1788471858.53 total 10.00 last 20.40)
 - mkdir 372 (time 1788471868.53 total 20.00 last 16.80)
 - mkdir 497 (time 1788471878.58 total 30.05 last 12.44)
 - mkdir 664 (time 1788471888.60 total 40.07 last 16.66)
 - mkdir 821 (time 1788471898.70 total 50.17 last 15.55)
 - mkdir 959 (time 1788471908.72 total 60.19 last 13.77)
total: 1000 mkdir in 64.47 seconds: 15.51 ops/second
 - mkdir 195 (time 1788471858.14 total 10.03 last 19.43)
 - mkdir 361 (time 1788471868.17 total 20.07 last 16.54)
 - mkdir 488 (time 1788471878.22 total 30.12 last 12.64)
 - mkdir 647 (time 1788471888.26 total 40.16 last 15.82)
 - mkdir 806 (time 1788471898.27 total 50.17 last 15.89)
 - mkdir 943 (time 1788471908.30 total 60.20 last 13.66)
total: 1000 mkdir in 65.72 seconds: 15.22 ops/second
 - mkdir 196 (time 1788471858.32 total 10.06 last 19.49)
 - mkdir 354 (time 1788471868.34 total 20.08 last 15.77)
 - mkdir 473 (time 1788471878.40 total 30.14 last 11.83)
 - mkdir 635 (time 1788471888.41 total 40.14 last 16.19)
 - mkdir 796 (time 1788471898.43 total 50.16 last 16.07)
 - mkdir 936 (time 1788471908.44 total 60.17 last 13.99)
total: 1000 mkdir in 66.12 seconds: 15.12 ops/second
 - mkdir 192 (time 1788471858.29 total 10.01 last 19.18)
 - mkdir 347 (time 1788471868.35 total 20.07 last 15.40)
 - mkdir 471 (time 1788471878.36 total 30.08 last 12.39)
 - mkdir 632 (time 1788471888.40 total 40.12 last 16.05)
 - mkdir 794 (time 1788471898.40 total 50.12 last 16.19)
 - mkdir 929 (time 1788471908.45 total 60.17 last 13.43)
total: 1000 mkdir in 66.83 seconds: 14.96 ops/second
Time for file creation 75 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788471921 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1788471922 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1788471923 ; total 1 ; last 1)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788471922 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788471922 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1788471923 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788471923 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788471923 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1788471923 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1788471923 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
Time for file removal 36 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8