== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 14:13:40 (1788286420)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.51 seconds: 19.53 ops/second
 - mkdir 137 (time 1788286444.62 total 10.07 last 13.60)
 - mkdir 306 (time 1788286454.64 total 20.09 last 16.87)
 - mkdir 480 (time 1788286464.72 total 30.17 last 17.26)
 - mkdir 640 (time 1788286474.76 total 40.21 last 15.94)
 - mkdir 800 (time 1788286484.78 total 50.23 last 15.97)
 - mkdir 949 (time 1788286494.82 total 60.26 last 14.85)
total: 1000 mkdir in 64.09 seconds: 15.60 ops/second
 - mkdir 137 (time 1788286445.98 total 10.02 last 13.67)
 - mkdir 315 (time 1788286456.02 total 20.06 last 17.73)
 - mkdir 493 (time 1788286466.05 total 30.09 last 17.75)
 - mkdir 649 (time 1788286476.07 total 40.11 last 15.57)
 - mkdir 812 (time 1788286486.08 total 50.12 last 16.28)
 - mkdir 961 (time 1788286496.09 total 60.13 last 14.90)
total: 1000 mkdir in 63.11 seconds: 15.85 ops/second
 - mkdir 134 (time 1788286445.60 total 10.07 last 13.30)
 - mkdir 303 (time 1788286455.63 total 20.10 last 16.86)
 - mkdir 481 (time 1788286465.66 total 30.13 last 17.74)
 - mkdir 636 (time 1788286475.66 total 40.13 last 15.50)
 - mkdir 797 (time 1788286485.66 total 50.13 last 16.09)
 - mkdir 947 (time 1788286495.71 total 60.19 last 14.92)
total: 1000 mkdir in 64.84 seconds: 15.42 ops/second
 - mkdir 137 (time 1788286445.97 total 10.02 last 13.67)
 - mkdir 315 (time 1788286456.02 total 20.07 last 17.72)
 - mkdir 491 (time 1788286466.08 total 30.13 last 17.48)
 - mkdir 642 (time 1788286476.08 total 40.13 last 15.10)
 - mkdir 807 (time 1788286486.14 total 50.19 last 16.41)
 - mkdir 950 (time 1788286496.19 total 60.24 last 14.23)
total: 1000 mkdir in 65.04 seconds: 15.38 ops/second
 - mkdir 134 (time 1788286446.15 total 10.03 last 13.36)
 - mkdir 304 (time 1788286456.18 total 20.06 last 16.94)
 - mkdir 479 (time 1788286466.19 total 30.07 last 17.49)
 - mkdir 633 (time 1788286476.20 total 40.09 last 15.38)
 - mkdir 796 (time 1788286486.22 total 50.11 last 16.27)
 - mkdir 945 (time 1788286496.28 total 60.16 last 14.82)
total: 1000 mkdir in 65.05 seconds: 15.37 ops/second
 - mkdir 127 (time 1788286442.36 total 10.09 last 12.59)
 - mkdir 273 (time 1788286452.37 total 20.10 last 14.58)
 - mkdir 448 (time 1788286462.44 total 30.17 last 17.38)
 - mkdir 609 (time 1788286472.49 total 40.21 last 16.03)
 - mkdir 750 (time 1788286482.56 total 50.29 last 13.99)
 - mkdir 899 (time 1788286492.59 total 60.32 last 14.86)
total: 1000 mkdir in 69.19 seconds: 14.45 ops/second
 - mkdir 134 (time 1788286445.80 total 10.02 last 13.38)
 - mkdir 310 (time 1788286455.84 total 20.06 last 17.52)
 - mkdir 486 (time 1788286465.89 total 30.11 last 17.51)
 - mkdir 633 (time 1788286475.95 total 40.17 last 14.62)
 - mkdir 794 (time 1788286485.99 total 50.21 last 16.04)
 - mkdir 935 (time 1788286496.05 total 60.26 last 14.02)
total: 1000 mkdir in 66.52 seconds: 15.03 ops/second
 - mkdir 136 (time 1788286446.16 total 10.01 last 13.59)
 - mkdir 307 (time 1788286456.21 total 20.06 last 17.00)
 - mkdir 482 (time 1788286466.22 total 30.07 last 17.49)
 - mkdir 633 (time 1788286476.26 total 40.11 last 15.04)
 - mkdir 789 (time 1788286486.29 total 50.14 last 15.55)
 - mkdir 937 (time 1788286496.42 total 60.27 last 14.61)
total: 1000 mkdir in 66.40 seconds: 15.06 ops/second
 - mkdir 135 (time 1788286446.07 total 10.04 last 13.44)
 - mkdir 305 (time 1788286456.11 total 20.08 last 16.94)
 - mkdir 471 (time 1788286466.21 total 30.18 last 16.44)
 - mkdir 621 (time 1788286476.26 total 40.24 last 14.91)
 - mkdir 781 (time 1788286486.27 total 50.24 last 15.99)
 - mkdir 923 (time 1788286496.28 total 60.25 last 14.19)
total: 1000 mkdir in 67.37 seconds: 14.84 ops/second
 - mkdir 130 (time 1788286444.84 total 10.07 last 12.91)
 - mkdir 291 (time 1788286454.85 total 20.08 last 16.08)
 - mkdir 457 (time 1788286464.85 total 30.09 last 16.60)
 - mkdir 604 (time 1788286474.89 total 40.13 last 14.63)
 - mkdir 760 (time 1788286484.91 total 50.15 last 15.57)
 - mkdir 899 (time 1788286494.92 total 60.15 last 13.89)
total: 1000 mkdir in 69.59 seconds: 14.37 ops/second
Time for file creation 80 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 21 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 19.82 ops/second
 - mkdir 210 (time 1788287013.79 total 10.01 last 20.97)
 - mkdir 393 (time 1788287023.81 total 20.04 last 18.26)
 - mkdir 583 (time 1788287033.92 total 30.15 last 18.80)
 - mkdir 760 (time 1788287043.95 total 40.17 last 17.65)
 - mkdir 929 (time 1788287053.96 total 50.18 last 16.89)
total: 1000 mkdir in 54.35 seconds: 18.40 ops/second
 - mkdir 199 (time 1788287014.81 total 10.02 last 19.86)
 - mkdir 379 (time 1788287024.84 total 20.05 last 17.94)
 - mkdir 573 (time 1788287034.86 total 30.07 last 19.37)
 - mkdir 744 (time 1788287044.92 total 40.13 last 16.99)
 - mkdir 908 (time 1788287054.95 total 50.16 last 16.36)
total: 1000 mkdir in 57.01 seconds: 17.54 ops/second
 - mkdir 216 (time 1788287016.84 total 10.01 last 21.57)
 - mkdir 400 (time 1788287026.90 total 20.08 last 18.29)
 - mkdir 585 (time 1788287037.07 total 30.25 last 18.19)
 - mkdir 770 (time 1788287047.14 total 40.32 last 18.36)
 - mkdir 939 (time 1788287057.18 total 50.36 last 16.84)
total: 1000 mkdir in 56.21 seconds: 17.79 ops/second
 - mkdir 207 (time 1788287016.61 total 10.01 last 20.68)
 - mkdir 395 (time 1788287026.62 total 20.02 last 18.78)
 - mkdir 579 (time 1788287036.67 total 30.07 last 18.32)
 - mkdir 762 (time 1788287046.73 total 40.13 last 18.18)
 - mkdir 926 (time 1788287056.76 total 50.15 last 16.37)
total: 1000 mkdir in 57.75 seconds: 17.32 ops/second
 - mkdir 212 (time 1788287016.60 total 10.01 last 21.17)
 - mkdir 390 (time 1788287026.62 total 20.03 last 17.77)
 - mkdir 568 (time 1788287036.62 total 30.04 last 17.79)
 - mkdir 747 (time 1788287046.66 total 40.07 last 17.84)
 - mkdir 915 (time 1788287056.69 total 50.10 last 16.75)
total: 1000 mkdir in 58.26 seconds: 17.17 ops/second
 - mkdir 208 (time 1788287016.67 total 10.00 last 20.79)
 - mkdir 387 (time 1788287026.74 total 20.07 last 17.78)
 - mkdir 568 (time 1788287036.75 total 30.08 last 18.08)
 - mkdir 750 (time 1788287046.78 total 40.11 last 18.14)
 - mkdir 912 (time 1788287056.79 total 50.13 last 16.18)
total: 1000 mkdir in 58.95 seconds: 16.96 ops/second
 - mkdir 208 (time 1788287016.77 total 10.02 last 20.76)
 - mkdir 390 (time 1788287026.80 total 20.04 last 18.16)
 - mkdir 574 (time 1788287036.83 total 30.07 last 18.35)
 - mkdir 757 (time 1788287046.91 total 40.15 last 18.15)
 - mkdir 916 (time 1788287056.95 total 50.19 last 15.84)
total: 1000 mkdir in 58.99 seconds: 16.95 ops/second
 - mkdir 215 (time 1788287017.11 total 10.08 last 21.34)
 - mkdir 392 (time 1788287027.15 total 20.12 last 17.62)
 - mkdir 575 (time 1788287037.20 total 30.16 last 18.22)
 - mkdir 755 (time 1788287047.24 total 40.21 last 17.93)
 - mkdir 914 (time 1788287057.27 total 50.23 last 15.85)
total: 1000 mkdir in 59.48 seconds: 16.81 ops/second
 - mkdir 207 (time 1788287016.97 total 10.04 last 20.62)
 - mkdir 384 (time 1788287026.98 total 20.05 last 17.69)
 - mkdir 557 (time 1788287037.01 total 30.07 last 17.26)
 - mkdir 740 (time 1788287047.07 total 40.13 last 18.19)
 - mkdir 902 (time 1788287057.07 total 50.14 last 16.20)
total: 1000 mkdir in 59.87 seconds: 16.70 ops/second
 - mkdir 201 (time 1788287016.84 total 10.02 last 20.07)
 - mkdir 372 (time 1788287026.87 total 20.05 last 17.05)
 - mkdir 547 (time 1788287036.87 total 30.05 last 17.50)
 - mkdir 728 (time 1788287046.91 total 40.09 last 18.03)
 - mkdir 893 (time 1788287056.98 total 50.16 last 16.39)
 - mkdir 991 (time 1788287067.03 total 60.21 last 9.75)
total: 1000 mkdir in 61.01 seconds: 16.39 ops/second
Time for file creation 71 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788287077 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1788287077 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1788287078 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788287079 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1788287078 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1788287079 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788287079 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788287079 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788287079 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788287078 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 48 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8