== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 07:59:35 (1778673575)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.54 seconds: 18.41 ops/second
 - mkdir 137 (time 1778673596.61 total 10.11 last 13.55)
 - mkdir 263 (time 1778673606.69 total 20.20 last 12.50)
 - mkdir 408 (time 1778673616.74 total 30.25 last 14.43)
 - mkdir 561 (time 1778673626.74 total 40.25 last 15.30)
 - mkdir 719 (time 1778673636.76 total 50.26 last 15.77)
 - mkdir 859 (time 1778673646.81 total 60.32 last 13.93)
total: 1000 mkdir in 70.20 seconds: 14.24 ops/second
 - mkdir 120 (time 1778673597.84 total 10.02 last 11.98)
 - mkdir 244 (time 1778673607.84 total 20.02 last 12.40)
 - mkdir 393 (time 1778673617.87 total 30.05 last 14.85)
 - mkdir 553 (time 1778673627.92 total 40.10 last 15.92)
 - mkdir 710 (time 1778673637.96 total 50.14 last 15.64)
 - mkdir 856 (time 1778673647.99 total 60.17 last 14.55)
 - mkdir 983 (time 1778673658.03 total 70.21 last 12.65)
total: 1000 mkdir in 73.14 seconds: 13.67 ops/second
 - mkdir 122 (time 1778673599.73 total 10.05 last 12.14)
 - mkdir 252 (time 1778673609.74 total 20.06 last 12.98)
 - mkdir 399 (time 1778673619.74 total 30.06 last 14.70)
 - mkdir 567 (time 1778673629.83 total 40.15 last 16.66)
 - mkdir 720 (time 1778673639.85 total 50.17 last 15.26)
 - mkdir 862 (time 1778673649.89 total 60.21 last 14.15)
 - mkdir 977 (time 1778673659.98 total 70.30 last 11.40)
total: 1000 mkdir in 74.37 seconds: 13.45 ops/second
 - mkdir 119 (time 1778673599.82 total 10.01 last 11.89)
 - mkdir 250 (time 1778673609.84 total 20.02 last 13.08)
 - mkdir 397 (time 1778673619.84 total 30.02 last 14.70)
 - mkdir 562 (time 1778673629.91 total 40.09 last 16.40)
 - mkdir 716 (time 1778673639.96 total 50.14 last 15.32)
 - mkdir 859 (time 1778673650.03 total 60.21 last 14.20)
 - mkdir 976 (time 1778673660.26 total 70.44 last 11.44)
total: 1000 mkdir in 75.16 seconds: 13.30 ops/second
 - mkdir 121 (time 1778673599.87 total 10.09 last 11.99)
 - mkdir 252 (time 1778673609.93 total 20.15 last 13.02)
 - mkdir 395 (time 1778673619.96 total 30.18 last 14.26)
 - mkdir 557 (time 1778673630.01 total 40.23 last 16.12)
 - mkdir 711 (time 1778673640.05 total 50.27 last 15.33)
 - mkdir 854 (time 1778673650.08 total 60.30 last 14.26)
 - mkdir 968 (time 1778673660.08 total 70.30 last 11.40)
total: 1000 mkdir in 75.86 seconds: 13.18 ops/second
 - mkdir 120 (time 1778673599.77 total 10.05 last 11.95)
 - mkdir 253 (time 1778673609.78 total 20.06 last 13.29)
 - mkdir 391 (time 1778673619.78 total 30.06 last 13.80)
 - mkdir 558 (time 1778673629.79 total 40.06 last 16.69)
 - mkdir 705 (time 1778673639.80 total 50.07 last 14.69)
 - mkdir 850 (time 1778673649.86 total 60.13 last 14.41)
 - mkdir 965 (time 1778673659.98 total 70.26 last 11.36)
total: 1000 mkdir in 76.51 seconds: 13.07 ops/second
 - mkdir 116 (time 1778673599.42 total 10.02 last 11.58)
 - mkdir 242 (time 1778673609.51 total 20.11 last 12.49)
 - mkdir 382 (time 1778673619.56 total 30.16 last 13.93)
 - mkdir 549 (time 1778673629.57 total 40.18 last 16.68)
 - mkdir 697 (time 1778673639.58 total 50.18 last 14.79)
 - mkdir 837 (time 1778673649.68 total 60.29 last 13.85)
 - mkdir 955 (time 1778673659.71 total 70.32 last 11.76)
total: 1000 mkdir in 78.27 seconds: 12.78 ops/second
 - mkdir 115 (time 1778673600.03 total 10.17 last 11.31)
 - mkdir 244 (time 1778673610.08 total 20.22 last 12.83)
 - mkdir 386 (time 1778673620.08 total 30.22 last 14.19)
 - mkdir 553 (time 1778673630.11 total 40.25 last 16.65)
 - mkdir 706 (time 1778673640.18 total 50.32 last 15.19)
 - mkdir 844 (time 1778673650.19 total 60.33 last 13.79)
 - mkdir 957 (time 1778673660.43 total 70.57 last 11.04)
total: 1000 mkdir in 78.04 seconds: 12.81 ops/second
 - mkdir 117 (time 1778673600.15 total 10.08 last 11.60)
 - mkdir 245 (time 1778673610.16 total 20.09 last 12.79)
 - mkdir 386 (time 1778673620.16 total 30.10 last 14.10)
 - mkdir 553 (time 1778673630.16 total 40.10 last 16.70)
 - mkdir 698 (time 1778673640.21 total 50.15 last 14.43)
 - mkdir 842 (time 1778673650.29 total 60.23 last 14.28)
 - mkdir 956 (time 1778673660.33 total 70.26 last 11.36)
total: 1000 mkdir in 78.13 seconds: 12.80 ops/second
 - mkdir 114 (time 1778673598.71 total 10.04 last 11.35)
 - mkdir 234 (time 1778673608.77 total 20.10 last 11.93)
 - mkdir 365 (time 1778673618.77 total 30.11 last 13.10)
 - mkdir 528 (time 1778673628.77 total 40.11 last 16.29)
 - mkdir 684 (time 1778673638.80 total 50.14 last 15.56)
 - mkdir 825 (time 1778673648.82 total 60.16 last 14.07)
 - mkdir 944 (time 1778673658.86 total 70.19 last 11.86)
total: 1000 mkdir in 79.77 seconds: 12.54 ops/second
Time for file creation 92 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.46 seconds: 21.82 ops/second
 - mkdir 140 (time 1778674258.05 total 10.11 last 13.84)
 - mkdir 279 (time 1778674268.12 total 20.19 last 13.80)
 - mkdir 421 (time 1778674278.21 total 30.27 last 14.08)
 - mkdir 574 (time 1778674288.22 total 40.29 last 15.27)
 - mkdir 720 (time 1778674298.24 total 50.31 last 14.58)
 - mkdir 849 (time 1778674308.24 total 60.31 last 12.89)
 - mkdir 990 (time 1778674318.25 total 70.32 last 14.09)
total: 1000 mkdir in 70.90 seconds: 14.10 ops/second
 - mkdir 144 (time 1778674257.02 total 10.03 last 14.35)
 - mkdir 279 (time 1778674267.02 total 20.04 last 13.49)
 - mkdir 413 (time 1778674277.08 total 30.09 last 13.33)
 - mkdir 564 (time 1778674287.13 total 40.14 last 15.03)
 - mkdir 709 (time 1778674297.18 total 50.19 last 14.42)
 - mkdir 842 (time 1778674307.19 total 60.20 last 13.29)
 - mkdir 970 (time 1778674317.24 total 70.25 last 12.73)
total: 1000 mkdir in 72.83 seconds: 13.73 ops/second
 - mkdir 140 (time 1778674257.38 total 10.02 last 13.97)
 - mkdir 272 (time 1778674267.40 total 20.04 last 13.17)
 - mkdir 406 (time 1778674277.45 total 30.10 last 13.33)
 - mkdir 556 (time 1778674287.47 total 40.12 last 14.97)
 - mkdir 704 (time 1778674297.51 total 50.15 last 14.75)
 - mkdir 837 (time 1778674307.52 total 60.16 last 13.28)
 - mkdir 966 (time 1778674317.59 total 70.23 last 12.81)
total: 1000 mkdir in 73.45 seconds: 13.61 ops/second
 - mkdir 134 (time 1778674257.29 total 10.03 last 13.36)
 - mkdir 269 (time 1778674267.35 total 20.08 last 13.43)
 - mkdir 405 (time 1778674277.36 total 30.10 last 13.58)
 - mkdir 555 (time 1778674287.39 total 40.13 last 14.96)
 - mkdir 702 (time 1778674297.45 total 50.19 last 14.61)
 - mkdir 834 (time 1778674307.54 total 60.28 last 13.08)
 - mkdir 961 (time 1778674317.61 total 70.35 last 12.61)
total: 1000 mkdir in 74.00 seconds: 13.51 ops/second
 - mkdir 140 (time 1778674257.49 total 10.08 last 13.89)
 - mkdir 271 (time 1778674267.54 total 20.14 last 13.03)
 - mkdir 402 (time 1778674277.57 total 30.17 last 13.07)
 - mkdir 554 (time 1778674287.62 total 40.22 last 15.12)
 - mkdir 699 (time 1778674297.66 total 50.26 last 14.44)
 - mkdir 833 (time 1778674307.67 total 60.26 last 13.40)
 - mkdir 965 (time 1778674317.76 total 70.35 last 13.08)
total: 1000 mkdir in 73.91 seconds: 13.53 ops/second
 - mkdir 142 (time 1778674258.02 total 10.13 last 14.02)
 - mkdir 276 (time 1778674268.13 total 20.24 last 13.25)
 - mkdir 409 (time 1778674278.22 total 30.33 last 13.18)
 - mkdir 561 (time 1778674288.27 total 40.37 last 15.14)
 - mkdir 711 (time 1778674298.32 total 50.42 last 14.92)
 - mkdir 841 (time 1778674308.37 total 60.47 last 12.93)
 - mkdir 974 (time 1778674318.41 total 70.51 last 13.25)
total: 1000 mkdir in 73.80 seconds: 13.55 ops/second
 - mkdir 140 (time 1778674257.73 total 10.06 last 13.92)
 - mkdir 276 (time 1778674267.76 total 20.08 last 13.56)
 - mkdir 408 (time 1778674277.80 total 30.13 last 13.14)
 - mkdir 556 (time 1778674287.83 total 40.16 last 14.75)
 - mkdir 698 (time 1778674297.89 total 50.21 last 14.12)
 - mkdir 821 (time 1778674307.91 total 60.23 last 12.28)
 - mkdir 952 (time 1778674317.94 total 70.26 last 13.06)
total: 1000 mkdir in 75.96 seconds: 13.16 ops/second
 - mkdir 134 (time 1778674257.92 total 10.04 last 13.34)
 - mkdir 266 (time 1778674268.04 total 20.17 last 13.04)
 - mkdir 398 (time 1778674278.07 total 30.19 last 13.16)
 - mkdir 544 (time 1778674288.07 total 40.19 last 14.60)
 - mkdir 688 (time 1778674298.07 total 50.20 last 14.40)
 - mkdir 817 (time 1778674308.11 total 60.23 last 12.86)
 - mkdir 946 (time 1778674318.12 total 70.24 last 12.88)
total: 1000 mkdir in 76.97 seconds: 12.99 ops/second
 - mkdir 128 (time 1778674256.96 total 10.04 last 12.76)
 - mkdir 256 (time 1778674266.99 total 20.06 last 12.76)
 - mkdir 387 (time 1778674277.08 total 30.16 last 12.98)
 - mkdir 534 (time 1778674287.08 total 40.16 last 14.69)
 - mkdir 669 (time 1778674297.12 total 50.20 last 13.45)
 - mkdir 796 (time 1778674307.16 total 60.24 last 12.65)
 - mkdir 927 (time 1778674317.17 total 70.25 last 13.08)
total: 1000 mkdir in 78.80 seconds: 12.69 ops/second
 - mkdir 126 (time 1778674256.75 total 10.07 last 12.51)
 - mkdir 251 (time 1778674266.81 total 20.14 last 12.42)
 - mkdir 376 (time 1778674276.87 total 30.20 last 12.43)
 - mkdir 519 (time 1778674286.96 total 40.29 last 14.18)
 - mkdir 657 (time 1778674296.98 total 50.31 last 13.77)
 - mkdir 782 (time 1778674307.03 total 60.36 last 12.43)
 - mkdir 908 (time 1778674317.08 total 70.41 last 12.54)
total: 1000 mkdir in 80.10 seconds: 12.48 ops/second
Time for file creation 88 sec for 1 RPC sent at a time
 - unlinked 0 (time 1778674335 ; total 1 ; last 1)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1778674336 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1778674336 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1778674337 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1778674337 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1778674338 ; total 1 ; last 1)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1778674337 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1778674336 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1778674337 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1778674338 ; total 1 ; last 1)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
Time for file removal 53 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8