== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 20:46:26 (1788223586)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.52 seconds: 19.29 ops/second
 - mkdir 171 (time 1788223606.10 total 10.04 last 17.03)
 - mkdir 334 (time 1788223616.11 total 20.05 last 16.28)
 - mkdir 478 (time 1788223626.16 total 30.10 last 14.33)
 - mkdir 630 (time 1788223636.20 total 40.14 last 15.14)
 - mkdir 812 (time 1788223646.23 total 50.17 last 18.14)
 - mkdir 967 (time 1788223656.29 total 60.24 last 15.40)
total: 1000 mkdir in 62.74 seconds: 15.94 ops/second
 - mkdir 167 (time 1788223607.92 total 10.00 last 16.69)
 - mkdir 339 (time 1788223617.99 total 20.07 last 17.08)
 - mkdir 481 (time 1788223628.01 total 30.09 last 14.17)
 - mkdir 640 (time 1788223638.01 total 40.09 last 15.90)
 - mkdir 821 (time 1788223648.02 total 50.10 last 18.09)
 - mkdir 969 (time 1788223658.04 total 60.13 last 14.76)
total: 1000 mkdir in 62.99 seconds: 15.88 ops/second
 - mkdir 165 (time 1788223606.20 total 10.11 last 16.31)
 - mkdir 319 (time 1788223616.24 total 20.15 last 15.34)
 - mkdir 458 (time 1788223626.28 total 30.19 last 13.84)
 - mkdir 611 (time 1788223636.35 total 40.27 last 15.19)
 - mkdir 790 (time 1788223646.36 total 50.27 last 17.90)
 - mkdir 946 (time 1788223656.39 total 60.31 last 15.54)
total: 1000 mkdir in 65.35 seconds: 15.30 ops/second
 - mkdir 169 (time 1788223607.88 total 10.11 last 16.72)
 - mkdir 333 (time 1788223617.94 total 20.17 last 16.30)
 - mkdir 475 (time 1788223627.96 total 30.19 last 14.17)
 - mkdir 634 (time 1788223638.02 total 40.25 last 15.80)
 - mkdir 817 (time 1788223648.03 total 50.26 last 18.29)
 - mkdir 965 (time 1788223658.12 total 60.35 last 14.67)
total: 1000 mkdir in 63.78 seconds: 15.68 ops/second
 - mkdir 168 (time 1788223607.91 total 10.08 last 16.67)
 - mkdir 329 (time 1788223617.96 total 20.14 last 16.01)
 - mkdir 471 (time 1788223628.01 total 30.18 last 14.14)
 - mkdir 634 (time 1788223638.07 total 40.24 last 16.20)
 - mkdir 814 (time 1788223648.09 total 50.26 last 17.96)
 - mkdir 960 (time 1788223658.09 total 60.26 last 14.60)
total: 1000 mkdir in 64.64 seconds: 15.47 ops/second
 - mkdir 173 (time 1788223607.13 total 10.05 last 17.22)
 - mkdir 329 (time 1788223617.14 total 20.06 last 15.58)
 - mkdir 470 (time 1788223627.19 total 30.11 last 14.04)
 - mkdir 623 (time 1788223637.21 total 40.13 last 15.27)
 - mkdir 798 (time 1788223647.23 total 50.15 last 17.45)
 - mkdir 950 (time 1788223657.28 total 60.20 last 15.13)
total: 1000 mkdir in 65.71 seconds: 15.22 ops/second
 - mkdir 170 (time 1788223607.90 total 10.02 last 16.96)
 - mkdir 333 (time 1788223617.96 total 20.09 last 16.19)
 - mkdir 475 (time 1788223628.00 total 30.12 last 14.15)
 - mkdir 634 (time 1788223638.07 total 40.19 last 15.79)
 - mkdir 809 (time 1788223648.12 total 50.25 last 17.41)
 - mkdir 956 (time 1788223658.14 total 60.27 last 14.66)
total: 1000 mkdir in 65.26 seconds: 15.32 ops/second
 - mkdir 166 (time 1788223608.04 total 10.13 last 16.38)
 - mkdir 328 (time 1788223618.09 total 20.19 last 16.11)
 - mkdir 468 (time 1788223628.13 total 30.22 last 13.95)
 - mkdir 624 (time 1788223638.20 total 40.29 last 15.49)
 - mkdir 806 (time 1788223648.22 total 50.32 last 18.15)
 - mkdir 953 (time 1788223658.23 total 60.33 last 14.69)
total: 1000 mkdir in 65.75 seconds: 15.21 ops/second
 - mkdir 165 (time 1788223607.73 total 10.03 last 16.46)
 - mkdir 319 (time 1788223617.74 total 20.04 last 15.38)
 - mkdir 460 (time 1788223627.78 total 30.08 last 14.04)
 - mkdir 617 (time 1788223637.86 total 40.16 last 15.58)
 - mkdir 798 (time 1788223647.89 total 50.18 last 18.05)
 - mkdir 945 (time 1788223657.96 total 60.26 last 14.59)
total: 1000 mkdir in 67.01 seconds: 14.92 ops/second
 - mkdir 158 (time 1788223606.94 total 10.04 last 15.74)
 - mkdir 306 (time 1788223617.00 total 20.10 last 14.72)
 - mkdir 440 (time 1788223627.01 total 30.11 last 13.38)
 - mkdir 596 (time 1788223637.06 total 40.15 last 15.53)
 - mkdir 778 (time 1788223647.09 total 50.18 last 18.14)
 - mkdir 929 (time 1788223657.14 total 60.23 last 15.02)
total: 1000 mkdir in 68.46 seconds: 14.61 ops/second
Time for file creation 78 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.54 seconds: 18.65 ops/second
 - mkdir 204 (time 1788224182.13 total 10.06 last 20.27)
 - mkdir 406 (time 1788224192.20 total 20.13 last 20.06)
 - mkdir 629 (time 1788224202.25 total 30.18 last 22.19)
 - mkdir 809 (time 1788224212.37 total 40.31 last 17.77)
 - mkdir 979 (time 1788224222.37 total 50.31 last 17.00)
total: 1000 mkdir in 51.27 seconds: 19.50 ops/second
 - mkdir 213 (time 1788224182.71 total 10.03 last 21.23)
 - mkdir 418 (time 1788224192.73 total 20.06 last 20.45)
 - mkdir 632 (time 1788224202.79 total 30.11 last 21.29)
 - mkdir 805 (time 1788224212.84 total 40.16 last 17.22)
 - mkdir 978 (time 1788224222.88 total 50.20 last 17.22)
total: 1000 mkdir in 51.76 seconds: 19.32 ops/second
 - mkdir 215 (time 1788224183.24 total 10.02 last 21.46)
 - mkdir 417 (time 1788224193.24 total 20.02 last 20.20)
 - mkdir 634 (time 1788224203.24 total 30.02 last 21.70)
 - mkdir 809 (time 1788224213.24 total 40.02 last 17.50)
 - mkdir 985 (time 1788224223.27 total 50.05 last 17.54)
total: 1000 mkdir in 51.23 seconds: 19.52 ops/second
 - mkdir 213 (time 1788224183.04 total 10.02 last 21.25)
 - mkdir 410 (time 1788224193.08 total 20.06 last 19.64)
 - mkdir 628 (time 1788224203.10 total 30.08 last 21.75)
 - mkdir 801 (time 1788224213.11 total 40.08 last 17.29)
 - mkdir 975 (time 1788224223.14 total 50.12 last 17.34)
total: 1000 mkdir in 52.32 seconds: 19.11 ops/second
 - mkdir 198 (time 1788224182.94 total 10.03 last 19.74)
 - mkdir 400 (time 1788224192.94 total 20.03 last 20.20)
 - mkdir 614 (time 1788224202.99 total 30.08 last 21.28)
 - mkdir 786 (time 1788224213.00 total 40.09 last 17.19)
 - mkdir 965 (time 1788224223.01 total 50.10 last 17.87)
total: 1000 mkdir in 52.88 seconds: 18.91 ops/second
 - mkdir 209 (time 1788224183.43 total 10.00 last 20.90)
 - mkdir 410 (time 1788224193.47 total 20.04 last 20.03)
 - mkdir 621 (time 1788224203.50 total 30.07 last 21.04)
 - mkdir 792 (time 1788224213.50 total 40.07 last 17.10)
 - mkdir 972 (time 1788224223.50 total 50.07 last 18.00)
total: 1000 mkdir in 52.62 seconds: 19.00 ops/second
 - mkdir 208 (time 1788224183.30 total 10.04 last 20.72)
 - mkdir 402 (time 1788224193.33 total 20.07 last 19.34)
 - mkdir 617 (time 1788224203.34 total 30.08 last 21.48)
 - mkdir 793 (time 1788224213.49 total 40.23 last 17.34)
 - mkdir 970 (time 1788224223.55 total 50.29 last 17.59)
total: 1000 mkdir in 52.90 seconds: 18.90 ops/second
 - mkdir 197 (time 1788224183.31 total 10.03 last 19.65)
 - mkdir 395 (time 1788224193.33 total 20.05 last 19.76)
 - mkdir 610 (time 1788224203.35 total 30.06 last 21.46)
 - mkdir 782 (time 1788224213.38 total 40.10 last 17.14)
 - mkdir 965 (time 1788224223.42 total 50.14 last 18.24)
total: 1000 mkdir in 53.68 seconds: 18.63 ops/second
 - mkdir 210 (time 1788224183.58 total 10.04 last 20.92)
 - mkdir 406 (time 1788224193.63 total 20.08 last 19.52)
 - mkdir 620 (time 1788224203.68 total 30.14 last 21.28)
 - mkdir 790 (time 1788224213.73 total 40.18 last 16.92)
 - mkdir 967 (time 1788224223.81 total 50.26 last 17.56)
total: 1000 mkdir in 53.52 seconds: 18.69 ops/second
 - mkdir 212 (time 1788224183.64 total 10.01 last 21.17)
 - mkdir 412 (time 1788224193.65 total 20.02 last 19.98)
 - mkdir 623 (time 1788224203.73 total 30.11 last 20.93)
 - mkdir 794 (time 1788224213.75 total 40.13 last 17.07)
 - mkdir 969 (time 1788224223.79 total 50.16 last 17.44)
total: 1000 mkdir in 53.51 seconds: 18.69 ops/second
Time for file creation 63 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788224233 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788224234 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788224234 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788224234 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788224235 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788224235 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788224234 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1788224235 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788224235 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788224235 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 39 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8