== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 23:16:38 (1786850198)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.65 seconds: 15.43 ops/second
 - mkdir 129 (time 1786850224.70 total 10.00 last 12.90)
 - mkdir 287 (time 1786850234.72 total 20.03 last 15.76)
 - mkdir 424 (time 1786850244.77 total 30.07 last 13.64)
 - mkdir 560 (time 1786850254.82 total 40.12 last 13.53)
 - mkdir 682 (time 1786850264.87 total 50.18 last 12.13)
 - mkdir 819 (time 1786850274.88 total 60.19 last 13.69)
 - mkdir 949 (time 1786850284.93 total 70.24 last 12.94)
total: 1000 mkdir in 73.72 seconds: 13.56 ops/second
 - mkdir 109 (time 1786850222.43 total 10.06 last 10.83)
 - mkdir 270 (time 1786850232.46 total 20.10 last 16.04)
 - mkdir 383 (time 1786850242.51 total 30.14 last 11.25)
 - mkdir 532 (time 1786850252.64 total 40.28 last 14.70)
 - mkdir 649 (time 1786850262.69 total 50.33 last 11.64)
 - mkdir 779 (time 1786850272.71 total 60.34 last 12.98)
 - mkdir 906 (time 1786850282.71 total 70.35 last 12.70)
total: 1000 mkdir in 78.45 seconds: 12.75 ops/second
 - mkdir 121 (time 1786850224.17 total 10.04 last 12.05)
 - mkdir 280 (time 1786850234.19 total 20.07 last 15.87)
 - mkdir 404 (time 1786850244.20 total 30.08 last 12.38)
 - mkdir 544 (time 1786850254.21 total 40.09 last 13.98)
 - mkdir 662 (time 1786850264.24 total 50.12 last 11.77)
 - mkdir 797 (time 1786850274.24 total 60.12 last 13.50)
 - mkdir 916 (time 1786850284.24 total 70.12 last 11.89)
total: 1000 mkdir in 77.90 seconds: 12.84 ops/second
 - mkdir 135 (time 1786850225.64 total 10.02 last 13.48)
 - mkdir 290 (time 1786850235.70 total 20.08 last 15.40)
 - mkdir 425 (time 1786850245.71 total 30.09 last 13.49)
 - mkdir 556 (time 1786850255.86 total 40.23 last 12.91)
 - mkdir 679 (time 1786850265.87 total 50.24 last 12.29)
 - mkdir 807 (time 1786850275.92 total 60.29 last 12.74)
 - mkdir 938 (time 1786850285.92 total 70.30 last 13.09)
total: 1000 mkdir in 76.56 seconds: 13.06 ops/second
 - mkdir 118 (time 1786850224.07 total 10.07 last 11.72)
 - mkdir 273 (time 1786850234.08 total 20.08 last 15.48)
 - mkdir 392 (time 1786850244.08 total 30.08 last 11.90)
 - mkdir 533 (time 1786850254.15 total 40.15 last 14.00)
 - mkdir 655 (time 1786850264.27 total 50.27 last 12.06)
 - mkdir 792 (time 1786850274.39 total 60.39 last 13.54)
 - mkdir 915 (time 1786850284.48 total 70.48 last 12.19)
total: 1000 mkdir in 79.00 seconds: 12.66 ops/second
 - mkdir 121 (time 1786850224.97 total 10.07 last 12.02)
 - mkdir 270 (time 1786850235.00 total 20.10 last 14.85)
 - mkdir 401 (time 1786850245.03 total 30.13 last 13.06)
 - mkdir 531 (time 1786850255.06 total 40.16 last 12.96)
 - mkdir 652 (time 1786850265.09 total 50.19 last 12.07)
 - mkdir 784 (time 1786850275.22 total 60.32 last 13.02)
 - mkdir 912 (time 1786850285.25 total 70.35 last 12.76)
total: 1000 mkdir in 79.89 seconds: 12.52 ops/second
 - mkdir 134 (time 1786850226.00 total 10.11 last 13.25)
 - mkdir 279 (time 1786850236.01 total 20.13 last 14.48)
 - mkdir 415 (time 1786850246.06 total 30.18 last 13.53)
 - mkdir 543 (time 1786850256.07 total 40.18 last 12.80)
 - mkdir 664 (time 1786850266.11 total 50.23 last 12.05)
 - mkdir 802 (time 1786850276.15 total 60.27 last 13.74)
 - mkdir 929 (time 1786850286.19 total 70.30 last 12.66)
total: 1000 mkdir in 79.25 seconds: 12.62 ops/second
 - mkdir 137 (time 1786850226.18 total 10.09 last 13.58)
 - mkdir 282 (time 1786850236.27 total 20.18 last 14.37)
 - mkdir 422 (time 1786850246.31 total 30.22 last 13.94)
 - mkdir 546 (time 1786850256.31 total 40.22 last 12.39)
 - mkdir 669 (time 1786850266.33 total 50.24 last 12.28)
 - mkdir 798 (time 1786850276.36 total 60.27 last 12.86)
 - mkdir 930 (time 1786850286.38 total 70.29 last 13.18)
total: 1000 mkdir in 79.27 seconds: 12.61 ops/second
 - mkdir 118 (time 1786850224.68 total 10.06 last 11.73)
 - mkdir 266 (time 1786850234.87 total 20.25 last 14.53)
 - mkdir 399 (time 1786850244.89 total 30.27 last 13.27)
 - mkdir 523 (time 1786850254.92 total 40.30 last 12.36)
 - mkdir 634 (time 1786850264.98 total 50.36 last 11.04)
 - mkdir 763 (time 1786850274.99 total 60.37 last 12.88)
 - mkdir 880 (time 1786850285.00 total 70.38 last 11.69)
 - mkdir 976 (time 1786850295.12 total 80.50 last 9.49)
total: 1000 mkdir in 83.00 seconds: 12.05 ops/second
 - mkdir 121 (time 1786850225.16 total 10.01 last 12.09)
 - mkdir 262 (time 1786850235.18 total 20.03 last 14.07)
 - mkdir 393 (time 1786850245.25 total 30.10 last 13.01)
 - mkdir 515 (time 1786850255.32 total 40.17 last 12.12)
 - mkdir 627 (time 1786850265.37 total 50.22 last 11.13)
 - mkdir 753 (time 1786850275.42 total 60.28 last 12.54)
 - mkdir 879 (time 1786850285.45 total 70.30 last 12.57)
 - mkdir 970 (time 1786850295.49 total 80.35 last 9.06)
total: 1000 mkdir in 83.25 seconds: 12.01 ops/second
Time for file creation 97 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.54 seconds: 18.48 ops/second
 - mkdir 142 (time 1786850837.63 total 10.02 last 14.17)
 - mkdir 338 (time 1786850847.63 total 20.03 last 19.59)
 - mkdir 551 (time 1786850857.69 total 30.08 last 21.18)
 - mkdir 701 (time 1786850867.74 total 40.13 last 14.93)
 - mkdir 926 (time 1786850877.74 total 50.13 last 22.49)
total: 1000 mkdir in 53.13 seconds: 18.82 ops/second
 - mkdir 152 (time 1786850838.85 total 10.03 last 15.16)
 - mkdir 354 (time 1786850848.92 total 20.10 last 20.06)
 - mkdir 554 (time 1786850858.96 total 30.14 last 19.92)
 - mkdir 706 (time 1786850868.96 total 40.14 last 15.20)
 - mkdir 935 (time 1786850878.96 total 50.14 last 22.90)
total: 1000 mkdir in 53.05 seconds: 18.85 ops/second
 - mkdir 151 (time 1786850838.73 total 10.00 last 15.10)
 - mkdir 352 (time 1786850848.75 total 20.02 last 20.07)
 - mkdir 554 (time 1786850858.79 total 30.06 last 20.12)
 - mkdir 706 (time 1786850868.79 total 40.06 last 15.20)
 - mkdir 932 (time 1786850878.80 total 50.07 last 22.58)
total: 1000 mkdir in 53.45 seconds: 18.71 ops/second
 - mkdir 153 (time 1786850838.73 total 10.00 last 15.30)
 - mkdir 354 (time 1786850848.79 total 20.06 last 19.99)
 - mkdir 550 (time 1786850858.80 total 30.07 last 19.58)
 - mkdir 700 (time 1786850868.86 total 40.12 last 14.92)
 - mkdir 932 (time 1786850878.89 total 50.15 last 23.13)
total: 1000 mkdir in 53.79 seconds: 18.59 ops/second
 - mkdir 145 (time 1786850838.59 total 10.04 last 14.44)
 - mkdir 346 (time 1786850848.60 total 20.05 last 20.07)
 - mkdir 544 (time 1786850858.62 total 30.07 last 19.77)
 - mkdir 690 (time 1786850868.65 total 40.11 last 14.54)
 - mkdir 921 (time 1786850878.68 total 50.13 last 23.05)
total: 1000 mkdir in 54.73 seconds: 18.27 ops/second
 - mkdir 147 (time 1786850838.78 total 10.04 last 14.64)
 - mkdir 346 (time 1786850848.79 total 20.05 last 19.88)
 - mkdir 536 (time 1786850858.85 total 30.11 last 18.90)
 - mkdir 690 (time 1786850868.87 total 40.13 last 15.37)
 - mkdir 922 (time 1786850878.89 total 50.15 last 23.15)
total: 1000 mkdir in 55.14 seconds: 18.14 ops/second
 - mkdir 144 (time 1786850839.02 total 10.02 last 14.37)
 - mkdir 343 (time 1786850849.06 total 20.05 last 19.83)
 - mkdir 533 (time 1786850859.06 total 30.06 last 19.00)
 - mkdir 689 (time 1786850869.12 total 40.12 last 15.51)
 - mkdir 921 (time 1786850879.13 total 50.12 last 23.19)
total: 1000 mkdir in 55.61 seconds: 17.98 ops/second
 - mkdir 137 (time 1786850838.32 total 10.02 last 13.68)
 - mkdir 332 (time 1786850848.36 total 20.06 last 19.41)
 - mkdir 522 (time 1786850858.40 total 30.10 last 18.93)
 - mkdir 674 (time 1786850868.42 total 40.13 last 15.16)
 - mkdir 904 (time 1786850878.46 total 50.16 last 22.92)
total: 1000 mkdir in 56.37 seconds: 17.74 ops/second
 - mkdir 146 (time 1786850839.31 total 10.03 last 14.56)
 - mkdir 346 (time 1786850849.35 total 20.07 last 19.92)
 - mkdir 539 (time 1786850859.36 total 30.08 last 19.28)
 - mkdir 693 (time 1786850869.37 total 40.09 last 15.40)
 - mkdir 926 (time 1786850879.38 total 50.10 last 23.26)
total: 1000 mkdir in 55.69 seconds: 17.96 ops/second
 - mkdir 142 (time 1786850839.53 total 10.02 last 14.17)
 - mkdir 333 (time 1786850849.53 total 20.02 last 19.10)
 - mkdir 522 (time 1786850859.64 total 30.13 last 18.70)
 - mkdir 673 (time 1786850869.66 total 40.15 last 15.07)
 - mkdir 911 (time 1786850879.69 total 50.17 last 23.74)
total: 1000 mkdir in 56.83 seconds: 17.60 ops/second
Time for file creation 68 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786850893 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786850893 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786850895 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786850896 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786850896 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786850896 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786850896 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786850896 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786850896 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786850897 ; total 1 ; last 1)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8