== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 15:01:47 (1789153307)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.52 seconds: 19.10 ops/second
 - mkdir 203 (time 1789153329.36 total 10.09 last 20.11)
 - mkdir 385 (time 1789153339.37 total 20.10 last 18.19)
 - mkdir 587 (time 1789153349.40 total 30.13 last 20.15)
 - mkdir 772 (time 1789153359.45 total 40.18 last 18.41)
 - mkdir 964 (time 1789153369.49 total 50.22 last 19.12)
total: 1000 mkdir in 52.10 seconds: 19.19 ops/second
 - mkdir 184 (time 1789153329.24 total 10.01 last 18.39)
 - mkdir 363 (time 1789153339.32 total 20.08 last 17.77)
 - mkdir 570 (time 1789153349.40 total 30.16 last 20.54)
 - mkdir 756 (time 1789153359.45 total 40.21 last 18.50)
 - mkdir 943 (time 1789153369.51 total 50.28 last 18.59)
total: 1000 mkdir in 54.44 seconds: 18.37 ops/second
 - mkdir 168 (time 1789153328.20 total 10.00 last 16.79)
 - mkdir 337 (time 1789153338.20 total 20.01 last 16.90)
 - mkdir 540 (time 1789153348.23 total 30.03 last 20.25)
 - mkdir 717 (time 1789153358.24 total 40.04 last 17.69)
 - mkdir 916 (time 1789153368.25 total 50.05 last 19.88)
total: 1000 mkdir in 55.71 seconds: 17.95 ops/second
 - mkdir 169 (time 1789153326.60 total 10.06 last 16.79)
 - mkdir 329 (time 1789153336.62 total 20.08 last 15.97)
 - mkdir 496 (time 1789153346.63 total 30.09 last 16.69)
 - mkdir 668 (time 1789153356.67 total 40.13 last 17.12)
 - mkdir 878 (time 1789153366.73 total 50.19 last 20.89)
total: 1000 mkdir in 58.86 seconds: 16.99 ops/second
 - mkdir 173 (time 1789153329.08 total 10.02 last 17.27)
 - mkdir 348 (time 1789153339.11 total 20.05 last 17.44)
 - mkdir 546 (time 1789153349.16 total 30.10 last 19.71)
 - mkdir 728 (time 1789153359.18 total 40.12 last 18.16)
 - mkdir 921 (time 1789153369.19 total 50.13 last 19.28)
total: 1000 mkdir in 56.58 seconds: 17.68 ops/second
 - mkdir 166 (time 1789153328.46 total 10.05 last 16.52)
 - mkdir 335 (time 1789153338.48 total 20.07 last 16.87)
 - mkdir 521 (time 1789153348.48 total 30.07 last 18.59)
 - mkdir 700 (time 1789153358.51 total 40.09 last 17.86)
 - mkdir 902 (time 1789153368.55 total 50.14 last 20.12)
total: 1000 mkdir in 57.84 seconds: 17.29 ops/second
 - mkdir 174 (time 1789153329.34 total 10.05 last 17.32)
 - mkdir 347 (time 1789153339.38 total 20.08 last 17.24)
 - mkdir 549 (time 1789153349.40 total 30.10 last 20.16)
 - mkdir 731 (time 1789153359.40 total 40.11 last 18.19)
 - mkdir 921 (time 1789153369.42 total 50.13 last 18.95)
total: 1000 mkdir in 57.07 seconds: 17.52 ops/second
 - mkdir 164 (time 1789153328.89 total 10.02 last 16.36)
 - mkdir 333 (time 1789153338.91 total 20.05 last 16.86)
 - mkdir 519 (time 1789153348.96 total 30.09 last 18.52)
 - mkdir 700 (time 1789153358.98 total 40.12 last 18.05)
 - mkdir 894 (time 1789153369.01 total 50.14 last 19.35)
total: 1000 mkdir in 58.84 seconds: 16.99 ops/second
 - mkdir 161 (time 1789153329.06 total 10.01 last 16.09)
 - mkdir 320 (time 1789153339.11 total 20.05 last 15.83)
 - mkdir 498 (time 1789153349.11 total 30.05 last 17.79)
 - mkdir 682 (time 1789153359.12 total 40.06 last 18.38)
 - mkdir 879 (time 1789153369.14 total 50.09 last 19.66)
total: 1000 mkdir in 59.86 seconds: 16.71 ops/second
 - mkdir 147 (time 1789153329.25 total 10.05 last 14.62)
 - mkdir 286 (time 1789153339.30 total 20.10 last 13.83)
 - mkdir 447 (time 1789153349.36 total 30.17 last 16.00)
 - mkdir 634 (time 1789153359.40 total 40.20 last 18.63)
 - mkdir 827 (time 1789153369.40 total 50.21 last 19.29)
 - mkdir 946 (time 1789153379.41 total 60.22 last 11.89)
total: 1000 mkdir in 62.44 seconds: 16.02 ops/second
Time for file creation 71 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 10 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.47 seconds: 21.46 ops/second
 - mkdir 176 (time 1789153923.86 total 10.02 last 17.57)
 - mkdir 330 (time 1789153933.91 total 20.06 last 15.34)
 - mkdir 506 (time 1789153943.95 total 30.10 last 17.52)
 - mkdir 706 (time 1789153954.01 total 40.16 last 19.89)
 - mkdir 884 (time 1789153964.01 total 50.17 last 17.79)
total: 1000 mkdir in 55.59 seconds: 17.99 ops/second
 - mkdir 166 (time 1789153922.95 total 10.08 last 16.47)
 - mkdir 324 (time 1789153932.97 total 20.09 last 15.78)
 - mkdir 500 (time 1789153943.00 total 30.13 last 17.53)
 - mkdir 681 (time 1789153953.06 total 40.19 last 18.00)
 - mkdir 859 (time 1789153963.09 total 50.22 last 17.74)
total: 1000 mkdir in 57.95 seconds: 17.26 ops/second
 - mkdir 165 (time 1789153922.77 total 10.03 last 16.46)
 - mkdir 318 (time 1789153932.82 total 20.08 last 15.22)
 - mkdir 484 (time 1789153942.87 total 30.13 last 16.52)
 - mkdir 671 (time 1789153952.89 total 40.15 last 18.65)
 - mkdir 851 (time 1789153962.89 total 50.15 last 18.00)
total: 1000 mkdir in 58.53 seconds: 17.09 ops/second
 - mkdir 165 (time 1789153922.93 total 10.07 last 16.39)
 - mkdir 313 (time 1789153932.97 total 20.11 last 14.74)
 - mkdir 485 (time 1789153942.99 total 30.13 last 17.17)
 - mkdir 671 (time 1789153953.02 total 40.16 last 18.55)
 - mkdir 848 (time 1789153963.07 total 50.21 last 17.61)
total: 1000 mkdir in 60.04 seconds: 16.65 ops/second
 - mkdir 165 (time 1789153924.08 total 10.02 last 16.46)
 - mkdir 312 (time 1789153934.12 total 20.06 last 14.64)
 - mkdir 476 (time 1789153944.17 total 30.10 last 16.33)
 - mkdir 660 (time 1789153954.25 total 40.19 last 18.24)
 - mkdir 833 (time 1789153964.26 total 50.20 last 17.29)
 - mkdir 976 (time 1789153974.29 total 60.23 last 14.25)
total: 1000 mkdir in 62.51 seconds: 16.00 ops/second
 - mkdir 166 (time 1789153923.76 total 10.03 last 16.55)
 - mkdir 309 (time 1789153933.79 total 20.06 last 14.26)
 - mkdir 470 (time 1789153943.82 total 30.09 last 16.05)
 - mkdir 654 (time 1789153953.89 total 40.15 last 18.28)
 - mkdir 825 (time 1789153963.90 total 50.16 last 17.09)
 - mkdir 970 (time 1789153973.97 total 60.24 last 14.40)
total: 1000 mkdir in 63.23 seconds: 15.81 ops/second
 - mkdir 159 (time 1789153924.20 total 10.06 last 15.81)
 - mkdir 300 (time 1789153934.23 total 20.09 last 14.05)
 - mkdir 462 (time 1789153944.31 total 30.17 last 16.08)
 - mkdir 644 (time 1789153954.36 total 40.22 last 18.11)
 - mkdir 812 (time 1789153964.41 total 50.27 last 16.71)
 - mkdir 954 (time 1789153974.44 total 60.30 last 14.16)
total: 1000 mkdir in 64.23 seconds: 15.57 ops/second
 - mkdir 155 (time 1789153924.26 total 10.07 last 15.39)
 - mkdir 293 (time 1789153934.29 total 20.11 last 13.75)
 - mkdir 451 (time 1789153944.33 total 30.14 last 15.74)
 - mkdir 622 (time 1789153954.37 total 40.18 last 17.03)
 - mkdir 782 (time 1789153964.39 total 50.21 last 15.96)
 - mkdir 926 (time 1789153974.46 total 60.28 last 14.30)
total: 1000 mkdir in 65.92 seconds: 15.17 ops/second
 - mkdir 145 (time 1789153923.14 total 10.02 last 14.47)
 - mkdir 277 (time 1789153933.18 total 20.06 last 13.15)
 - mkdir 429 (time 1789153943.32 total 30.19 last 15.00)
 - mkdir 596 (time 1789153953.32 total 40.20 last 16.69)
 - mkdir 748 (time 1789153963.38 total 50.26 last 15.12)
 - mkdir 899 (time 1789153973.41 total 60.28 last 15.06)
total: 1000 mkdir in 67.55 seconds: 14.80 ops/second
 - mkdir 138 (time 1789153924.15 total 10.03 last 13.76)
 - mkdir 264 (time 1789153934.18 total 20.06 last 12.56)
 - mkdir 408 (time 1789153944.19 total 30.07 last 14.39)
 - mkdir 565 (time 1789153954.28 total 40.16 last 15.56)
 - mkdir 711 (time 1789153964.32 total 50.20 last 14.54)
 - mkdir 853 (time 1789153974.40 total 60.28 last 14.09)
total: 1000 mkdir in 69.26 seconds: 14.44 ops/second
Time for file creation 78 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789153989 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789153989 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789153990 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789153990 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789153990 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789153990 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789153990 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789153990 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789153990 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789153990 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 40 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8