== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 09:17:01 (1787750221)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.71 seconds: 14.06 ops/second
 - mkdir 138 (time 1787750245.64 total 10.01 last 13.79)
 - mkdir 262 (time 1787750255.66 total 20.03 last 12.37)
 - mkdir 389 (time 1787750265.67 total 30.03 last 12.70)
 - mkdir 537 (time 1787750275.71 total 40.08 last 14.73)
 - mkdir 715 (time 1787750285.73 total 50.09 last 17.77)
 - mkdir 830 (time 1787750295.77 total 60.14 last 11.45)
 - mkdir 971 (time 1787750305.81 total 70.17 last 14.05)
total: 1000 mkdir in 72.54 seconds: 13.79 ops/second
 - mkdir 130 (time 1787750244.81 total 10.04 last 12.94)
 - mkdir 250 (time 1787750254.87 total 20.11 last 11.93)
 - mkdir 380 (time 1787750264.96 total 30.19 last 12.89)
 - mkdir 524 (time 1787750274.96 total 40.20 last 14.39)
 - mkdir 702 (time 1787750285.00 total 50.23 last 17.74)
 - mkdir 822 (time 1787750295.04 total 60.28 last 11.95)
 - mkdir 958 (time 1787750305.07 total 70.31 last 13.56)
total: 1000 mkdir in 73.86 seconds: 13.54 ops/second
 - mkdir 137 (time 1787750245.99 total 10.04 last 13.65)
 - mkdir 260 (time 1787750256.00 total 20.04 last 12.30)
 - mkdir 384 (time 1787750266.06 total 30.11 last 12.32)
 - mkdir 538 (time 1787750276.17 total 40.21 last 15.24)
 - mkdir 725 (time 1787750286.19 total 50.23 last 18.67)
 - mkdir 835 (time 1787750296.22 total 60.26 last 10.96)
 - mkdir 970 (time 1787750306.28 total 70.32 last 13.42)
total: 1000 mkdir in 72.76 seconds: 13.74 ops/second
 - mkdir 125 (time 1787750244.51 total 10.07 last 12.41)
 - mkdir 238 (time 1787750254.52 total 20.09 last 11.28)
 - mkdir 361 (time 1787750264.54 total 30.11 last 12.28)
 - mkdir 512 (time 1787750274.57 total 40.13 last 15.06)
 - mkdir 690 (time 1787750284.59 total 50.16 last 17.75)
 - mkdir 811 (time 1787750294.66 total 60.23 last 12.02)
 - mkdir 945 (time 1787750304.69 total 70.25 last 13.37)
total: 1000 mkdir in 74.87 seconds: 13.36 ops/second
 - mkdir 130 (time 1787750245.92 total 10.03 last 12.96)
 - mkdir 249 (time 1787750256.01 total 20.12 last 11.80)
 - mkdir 374 (time 1787750266.07 total 30.18 last 12.43)
 - mkdir 522 (time 1787750276.11 total 40.22 last 14.73)
 - mkdir 709 (time 1787750286.14 total 50.25 last 18.64)
 - mkdir 820 (time 1787750296.16 total 60.27 last 11.08)
 - mkdir 960 (time 1787750306.21 total 70.32 last 13.94)
total: 1000 mkdir in 73.54 seconds: 13.60 ops/second
 - mkdir 131 (time 1787750245.41 total 10.08 last 12.99)
 - mkdir 246 (time 1787750255.45 total 20.13 last 11.45)
 - mkdir 371 (time 1787750265.54 total 30.22 last 12.38)
 - mkdir 520 (time 1787750275.61 total 40.28 last 14.80)
 - mkdir 700 (time 1787750285.68 total 50.35 last 17.88)
 - mkdir 816 (time 1787750295.69 total 60.37 last 11.58)
 - mkdir 949 (time 1787750305.70 total 70.37 last 13.30)
total: 1000 mkdir in 74.93 seconds: 13.35 ops/second
 - mkdir 137 (time 1787750245.83 total 10.05 last 13.63)
 - mkdir 249 (time 1787750255.83 total 20.05 last 11.20)
 - mkdir 372 (time 1787750265.87 total 30.09 last 12.25)
 - mkdir 521 (time 1787750275.95 total 40.17 last 14.78)
 - mkdir 703 (time 1787750285.98 total 50.20 last 18.14)
 - mkdir 816 (time 1787750296.06 total 60.29 last 11.20)
 - mkdir 949 (time 1787750306.09 total 70.31 last 13.26)
total: 1000 mkdir in 74.62 seconds: 13.40 ops/second
 - mkdir 130 (time 1787750245.96 total 10.07 last 12.92)
 - mkdir 251 (time 1787750256.01 total 20.11 last 12.04)
 - mkdir 372 (time 1787750266.10 total 30.20 last 12.00)
 - mkdir 518 (time 1787750276.12 total 40.22 last 14.58)
 - mkdir 704 (time 1787750286.14 total 50.24 last 18.55)
 - mkdir 814 (time 1787750296.18 total 60.28 last 10.96)
 - mkdir 948 (time 1787750306.21 total 70.31 last 13.36)
total: 1000 mkdir in 74.85 seconds: 13.36 ops/second
 - mkdir 124 (time 1787750245.57 total 10.11 last 12.26)
 - mkdir 236 (time 1787750255.58 total 20.12 last 11.19)
 - mkdir 358 (time 1787750265.60 total 30.14 last 12.17)
 - mkdir 509 (time 1787750275.65 total 40.19 last 15.03)
 - mkdir 690 (time 1787750285.69 total 50.23 last 18.04)
 - mkdir 805 (time 1787750295.69 total 60.23 last 11.49)
 - mkdir 939 (time 1787750305.75 total 70.29 last 13.32)
total: 1000 mkdir in 75.75 seconds: 13.20 ops/second
 - mkdir 121 (time 1787750245.48 total 10.07 last 12.01)
 - mkdir 233 (time 1787750255.53 total 20.12 last 11.14)
 - mkdir 351 (time 1787750265.60 total 30.20 last 11.71)
 - mkdir 501 (time 1787750275.67 total 40.26 last 14.90)
 - mkdir 687 (time 1787750285.68 total 50.27 last 18.58)
 - mkdir 800 (time 1787750295.76 total 60.36 last 11.21)
 - mkdir 931 (time 1787750305.77 total 70.36 last 13.09)
total: 1000 mkdir in 77.23 seconds: 12.95 ops/second
Time for file creation 89 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.63 seconds: 15.76 ops/second
 - mkdir 142 (time 1787750935.93 total 10.02 last 14.17)
 - mkdir 277 (time 1787750945.94 total 20.03 last 13.50)
 - mkdir 425 (time 1787750956.04 total 30.13 last 14.65)
 - mkdir 531 (time 1787750966.09 total 40.18 last 10.55)
 - mkdir 677 (time 1787750976.15 total 50.24 last 14.51)
 - mkdir 833 (time 1787750986.24 total 60.33 last 15.46)
 - mkdir 980 (time 1787750996.34 total 70.43 last 14.56)
total: 1000 mkdir in 72.04 seconds: 13.88 ops/second
 - mkdir 140 (time 1787750934.49 total 10.01 last 13.99)
 - mkdir 274 (time 1787750944.52 total 20.04 last 13.36)
 - mkdir 412 (time 1787750954.58 total 30.10 last 13.72)
 - mkdir 520 (time 1787750964.63 total 40.15 last 10.75)
 - mkdir 661 (time 1787750974.64 total 50.17 last 14.08)
 - mkdir 809 (time 1787750984.69 total 60.21 last 14.73)
 - mkdir 944 (time 1787750994.74 total 70.26 last 13.43)
total: 1000 mkdir in 75.88 seconds: 13.18 ops/second
 - mkdir 138 (time 1787750934.16 total 10.10 last 13.66)
 - mkdir 269 (time 1787750944.23 total 20.17 last 13.01)
 - mkdir 410 (time 1787750954.28 total 30.23 last 14.03)
 - mkdir 521 (time 1787750964.28 total 40.23 last 11.09)
 - mkdir 659 (time 1787750974.33 total 50.28 last 13.73)
 - mkdir 801 (time 1787750984.37 total 60.32 last 14.14)
 - mkdir 939 (time 1787750994.45 total 70.40 last 13.70)
total: 1000 mkdir in 76.75 seconds: 13.03 ops/second
 - mkdir 135 (time 1787750936.23 total 10.05 last 13.43)
 - mkdir 265 (time 1787750946.28 total 20.11 last 12.93)
 - mkdir 410 (time 1787750956.33 total 30.15 last 14.43)
 - mkdir 517 (time 1787750966.44 total 40.27 last 10.58)
 - mkdir 661 (time 1787750976.46 total 50.29 last 14.37)
 - mkdir 814 (time 1787750986.52 total 60.34 last 15.22)
 - mkdir 950 (time 1787750996.52 total 70.35 last 13.60)
total: 1000 mkdir in 77.84 seconds: 12.85 ops/second
 - mkdir 139 (time 1787750935.88 total 10.00 last 13.90)
 - mkdir 265 (time 1787750945.93 total 20.05 last 12.54)
 - mkdir 404 (time 1787750956.00 total 30.12 last 13.80)
 - mkdir 507 (time 1787750966.01 total 40.14 last 10.28)
 - mkdir 653 (time 1787750976.07 total 50.20 last 14.52)
 - mkdir 807 (time 1787750986.10 total 60.23 last 15.36)
 - mkdir 942 (time 1787750996.14 total 70.27 last 13.44)
total: 1000 mkdir in 78.71 seconds: 12.70 ops/second
 - mkdir 133 (time 1787750934.71 total 10.04 last 13.24)
 - mkdir 261 (time 1787750944.72 total 20.05 last 12.78)
 - mkdir 402 (time 1787750954.73 total 30.07 last 14.08)
 - mkdir 509 (time 1787750964.75 total 40.09 last 10.67)
 - mkdir 655 (time 1787750974.81 total 50.15 last 14.52)
 - mkdir 800 (time 1787750984.87 total 60.21 last 14.41)
 - mkdir 927 (time 1787750994.92 total 70.26 last 12.63)
 - mkdir 999 (time 1787751005.08 total 80.41 last 7.09)
total: 1000 mkdir in 80.41 seconds: 12.44 ops/second
 - mkdir 135 (time 1787750934.04 total 10.05 last 13.44)
 - mkdir 259 (time 1787750944.11 total 20.11 last 12.32)
 - mkdir 399 (time 1787750954.16 total 30.16 last 13.93)
 - mkdir 507 (time 1787750964.23 total 40.23 last 10.73)
 - mkdir 643 (time 1787750974.23 total 50.24 last 13.59)
 - mkdir 781 (time 1787750984.25 total 60.25 last 13.78)
 - mkdir 918 (time 1787750994.38 total 70.39 last 13.52)
 - mkdir 993 (time 1787751004.43 total 80.43 last 7.47)
total: 1000 mkdir in 81.53 seconds: 12.27 ops/second
 - mkdir 133 (time 1787750935.83 total 10.03 last 13.26)
 - mkdir 261 (time 1787750945.86 total 20.06 last 12.77)
 - mkdir 398 (time 1787750955.93 total 30.13 last 13.61)
 - mkdir 501 (time 1787750965.96 total 40.16 last 10.26)
 - mkdir 646 (time 1787750975.97 total 50.17 last 14.49)
 - mkdir 799 (time 1787750986.00 total 60.20 last 15.25)
 - mkdir 933 (time 1787750996.08 total 70.28 last 13.29)
total: 1000 mkdir in 80.11 seconds: 12.48 ops/second
 - mkdir 137 (time 1787750935.69 total 10.01 last 13.69)
 - mkdir 262 (time 1787750945.81 total 20.12 last 12.36)
 - mkdir 403 (time 1787750955.87 total 30.18 last 14.02)
 - mkdir 507 (time 1787750965.90 total 40.21 last 10.36)
 - mkdir 651 (time 1787750976.07 total 50.38 last 14.16)
 - mkdir 799 (time 1787750986.23 total 60.54 last 14.57)
 - mkdir 930 (time 1787750996.32 total 70.64 last 12.98)
 - mkdir 999 (time 1787751006.35 total 80.66 last 6.88)
total: 1000 mkdir in 80.66 seconds: 12.40 ops/second
 - mkdir 133 (time 1787750935.55 total 10.03 last 13.25)
 - mkdir 262 (time 1787750945.63 total 20.12 last 12.79)
 - mkdir 398 (time 1787750955.66 total 30.15 last 13.56)
 - mkdir 502 (time 1787750965.68 total 40.16 last 10.39)
 - mkdir 638 (time 1787750975.71 total 50.20 last 13.55)
 - mkdir 784 (time 1787750985.79 total 60.28 last 14.49)
 - mkdir 919 (time 1787750995.88 total 70.37 last 13.38)
 - mkdir 993 (time 1787751006.00 total 80.49 last 7.31)
total: 1000 mkdir in 81.32 seconds: 12.30 ops/second
Time for file creation 93 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787751017 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1787751017 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1787751018 ; total 0 ; last 0)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
 - unlinked 0 (time 1787751018 ; total 0 ; last 0)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
 - unlinked 0 (time 1787751019 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1787751019 ; total 0 ; last 0)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
 - unlinked 0 (time 1787751019 ; total 0 ; last 0)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
 - unlinked 0 (time 1787751019 ; total 0 ; last 0)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
 - unlinked 0 (time 1787751019 ; total 0 ; last 0)
total: 1000 unlinks in 45 seconds: 22.222221 unlinks/second
 - unlinked 0 (time 1787751019 ; total 0 ; last 0)
total: 1000 unlinks in 45 seconds: 22.222221 unlinks/second
Time for file removal 60 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8