== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 17:21:37 (1788211297)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.61 ops/second
 - mkdir 175 (time 1788211317.88 total 10.00 last 17.50)
 - mkdir 361 (time 1788211327.95 total 20.06 last 18.48)
 - mkdir 550 (time 1788211337.98 total 30.10 last 18.83)
 - mkdir 743 (time 1788211347.98 total 40.10 last 19.30)
 - mkdir 950 (time 1788211358.01 total 50.12 last 20.66)
total: 1000 mkdir in 52.18 seconds: 19.16 ops/second
 - mkdir 167 (time 1788211318.22 total 10.03 last 16.64)
 - mkdir 345 (time 1788211328.24 total 20.05 last 17.77)
 - mkdir 532 (time 1788211338.24 total 30.06 last 18.69)
 - mkdir 725 (time 1788211348.29 total 40.10 last 19.21)
 - mkdir 936 (time 1788211358.33 total 50.14 last 21.02)
total: 1000 mkdir in 53.68 seconds: 18.63 ops/second
 - mkdir 170 (time 1788211318.61 total 10.00 last 17.00)
 - mkdir 350 (time 1788211328.66 total 20.05 last 17.90)
 - mkdir 539 (time 1788211338.69 total 30.08 last 18.85)
 - mkdir 734 (time 1788211348.73 total 40.12 last 19.43)
 - mkdir 947 (time 1788211358.77 total 50.16 last 21.20)
total: 1000 mkdir in 53.47 seconds: 18.70 ops/second
 - mkdir 169 (time 1788211318.30 total 10.00 last 16.90)
 - mkdir 348 (time 1788211328.35 total 20.05 last 17.81)
 - mkdir 540 (time 1788211338.36 total 30.06 last 19.18)
 - mkdir 730 (time 1788211348.39 total 40.09 last 18.94)
 - mkdir 933 (time 1788211358.40 total 50.10 last 20.28)
total: 1000 mkdir in 54.15 seconds: 18.47 ops/second
 - mkdir 174 (time 1788211319.11 total 10.04 last 17.34)
 - mkdir 355 (time 1788211329.13 total 20.06 last 18.06)
 - mkdir 551 (time 1788211339.16 total 30.08 last 19.55)
 - mkdir 743 (time 1788211349.20 total 40.12 last 19.13)
 - mkdir 948 (time 1788211359.21 total 50.13 last 20.47)
total: 1000 mkdir in 53.92 seconds: 18.55 ops/second
 - mkdir 167 (time 1788211318.91 total 10.01 last 16.68)
 - mkdir 341 (time 1788211328.94 total 20.04 last 17.35)
 - mkdir 522 (time 1788211338.99 total 30.09 last 18.01)
 - mkdir 716 (time 1788211349.00 total 40.11 last 19.37)
 - mkdir 936 (time 1788211359.02 total 50.13 last 21.95)
total: 1000 mkdir in 54.77 seconds: 18.26 ops/second
 - mkdir 168 (time 1788211319.12 total 10.01 last 16.78)
 - mkdir 349 (time 1788211329.13 total 20.02 last 18.09)
 - mkdir 542 (time 1788211339.18 total 30.07 last 19.20)
 - mkdir 732 (time 1788211349.22 total 40.11 last 18.93)
 - mkdir 944 (time 1788211359.26 total 50.15 last 21.12)
total: 1000 mkdir in 54.56 seconds: 18.33 ops/second
 - mkdir 168 (time 1788211319.11 total 10.03 last 16.75)
 - mkdir 342 (time 1788211329.15 total 20.07 last 17.33)
 - mkdir 536 (time 1788211339.20 total 30.12 last 19.30)
 - mkdir 730 (time 1788211349.21 total 40.13 last 19.38)
 - mkdir 939 (time 1788211359.21 total 50.13 last 20.90)
total: 1000 mkdir in 54.94 seconds: 18.20 ops/second
 - mkdir 172 (time 1788211319.11 total 10.02 last 17.16)
 - mkdir 348 (time 1788211329.14 total 20.06 last 17.54)
 - mkdir 537 (time 1788211339.18 total 30.09 last 18.84)
 - mkdir 726 (time 1788211349.18 total 40.09 last 18.89)
 - mkdir 935 (time 1788211359.21 total 50.12 last 20.84)
total: 1000 mkdir in 54.99 seconds: 18.19 ops/second
 - mkdir 157 (time 1788211318.30 total 10.00 last 15.70)
 - mkdir 328 (time 1788211328.32 total 20.02 last 17.07)
 - mkdir 506 (time 1788211338.32 total 30.02 last 17.79)
 - mkdir 697 (time 1788211348.37 total 40.07 last 19.02)
 - mkdir 902 (time 1788211358.40 total 50.10 last 20.44)
total: 1000 mkdir in 56.60 seconds: 17.67 ops/second
Time for file creation 65 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 9 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.49 seconds: 20.40 ops/second
 - mkdir 169 (time 1788211875.70 total 10.04 last 16.84)
 - mkdir 342 (time 1788211885.76 total 20.10 last 17.19)
 - mkdir 500 (time 1788211895.81 total 30.15 last 15.73)
 - mkdir 662 (time 1788211905.86 total 40.20 last 16.12)
 - mkdir 837 (time 1788211915.89 total 50.23 last 17.44)
total: 1000 mkdir in 60.13 seconds: 16.63 ops/second
 - mkdir 152 (time 1788211873.97 total 10.01 last 15.18)
 - mkdir 321 (time 1788211884.00 total 20.04 last 16.86)
 - mkdir 486 (time 1788211894.06 total 30.10 last 16.40)
 - mkdir 639 (time 1788211904.07 total 40.11 last 15.28)
 - mkdir 806 (time 1788211914.12 total 50.16 last 16.62)
 - mkdir 962 (time 1788211924.12 total 60.17 last 15.59)
total: 1000 mkdir in 62.30 seconds: 16.05 ops/second
 - mkdir 157 (time 1788211875.04 total 10.02 last 15.66)
 - mkdir 321 (time 1788211885.10 total 20.08 last 16.31)
 - mkdir 488 (time 1788211895.12 total 30.11 last 16.66)
 - mkdir 649 (time 1788211905.16 total 40.14 last 16.04)
 - mkdir 821 (time 1788211915.18 total 50.16 last 17.16)
 - mkdir 982 (time 1788211925.22 total 60.21 last 16.03)
total: 1000 mkdir in 61.63 seconds: 16.23 ops/second
 - mkdir 164 (time 1788211875.84 total 10.05 last 16.32)
 - mkdir 332 (time 1788211885.92 total 20.13 last 16.67)
 - mkdir 487 (time 1788211895.98 total 30.19 last 15.41)
 - mkdir 647 (time 1788211905.98 total 40.19 last 16.00)
 - mkdir 817 (time 1788211915.99 total 50.20 last 16.98)
 - mkdir 978 (time 1788211926.07 total 60.27 last 15.98)
total: 1000 mkdir in 62.72 seconds: 15.94 ops/second
 - mkdir 159 (time 1788211875.84 total 10.03 last 15.84)
 - mkdir 329 (time 1788211885.85 total 20.04 last 16.99)
 - mkdir 483 (time 1788211895.97 total 30.17 last 15.21)
 - mkdir 641 (time 1788211905.97 total 40.17 last 15.80)
 - mkdir 814 (time 1788211916.04 total 50.23 last 17.19)
 - mkdir 976 (time 1788211926.06 total 60.25 last 16.16)
total: 1000 mkdir in 62.74 seconds: 15.94 ops/second
 - mkdir 144 (time 1788211874.11 total 10.04 last 14.34)
 - mkdir 305 (time 1788211884.14 total 20.07 last 16.05)
 - mkdir 456 (time 1788211894.14 total 30.07 last 15.10)
 - mkdir 604 (time 1788211904.14 total 40.07 last 14.80)
 - mkdir 783 (time 1788211914.19 total 50.13 last 17.81)
 - mkdir 942 (time 1788211924.22 total 60.16 last 15.85)
total: 1000 mkdir in 64.79 seconds: 15.43 ops/second
 - mkdir 161 (time 1788211876.19 total 10.04 last 16.03)
 - mkdir 330 (time 1788211886.20 total 20.05 last 16.88)
 - mkdir 488 (time 1788211896.28 total 30.13 last 15.68)
 - mkdir 648 (time 1788211906.29 total 40.13 last 16.00)
 - mkdir 821 (time 1788211916.31 total 50.16 last 17.25)
 - mkdir 978 (time 1788211926.38 total 60.23 last 15.60)
total: 1000 mkdir in 62.71 seconds: 15.95 ops/second
 - mkdir 162 (time 1788211876.25 total 10.03 last 16.15)
 - mkdir 334 (time 1788211886.31 total 20.09 last 17.09)
 - mkdir 488 (time 1788211896.33 total 30.11 last 15.37)
 - mkdir 653 (time 1788211906.37 total 40.15 last 16.43)
 - mkdir 823 (time 1788211916.45 total 50.23 last 16.87)
 - mkdir 976 (time 1788211926.47 total 60.25 last 15.27)
total: 1000 mkdir in 62.94 seconds: 15.89 ops/second
 - mkdir 158 (time 1788211875.43 total 10.01 last 15.79)
 - mkdir 325 (time 1788211885.47 total 20.05 last 16.63)
 - mkdir 476 (time 1788211895.48 total 30.06 last 15.08)
 - mkdir 638 (time 1788211905.57 total 40.14 last 16.07)
 - mkdir 805 (time 1788211915.59 total 50.16 last 16.66)
 - mkdir 964 (time 1788211925.63 total 60.21 last 15.83)
total: 1000 mkdir in 63.94 seconds: 15.64 ops/second
 - mkdir 159 (time 1788211875.92 total 10.03 last 15.86)
 - mkdir 326 (time 1788211885.95 total 20.05 last 16.66)
 - mkdir 470 (time 1788211896.01 total 30.11 last 14.32)
 - mkdir 628 (time 1788211906.03 total 40.13 last 15.77)
 - mkdir 803 (time 1788211916.03 total 50.13 last 17.50)
 - mkdir 966 (time 1788211926.09 total 60.20 last 16.20)
total: 1000 mkdir in 64.34 seconds: 15.54 ops/second
Time for file creation 76 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788211942 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1788211942 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1788211942 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1788211943 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1788211944 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1788211944 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1788211944 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1788211944 ; total 1 ; last 1)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1788211944 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1788211945 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
Time for file removal 54 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8