== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 05:12:37 (1786439557)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.63 seconds: 15.82 ops/second
 - mkdir 82 (time 1786439584.02 total 10.01 last 8.19)
 - mkdir 205 (time 1786439594.06 total 20.06 last 12.24)
 - mkdir 325 (time 1786439604.12 total 30.11 last 11.93)
 - mkdir 443 (time 1786439614.17 total 40.16 last 11.75)
 - mkdir 564 (time 1786439624.19 total 50.19 last 12.07)
 - mkdir 682 (time 1786439634.33 total 60.32 last 11.65)
 - mkdir 806 (time 1786439644.39 total 70.38 last 12.33)
 - mkdir 934 (time 1786439654.41 total 80.40 last 12.77)
total: 1000 mkdir in 86.73 seconds: 11.53 ops/second
 - mkdir 70 (time 1786439582.73 total 10.03 last 6.98)
 - mkdir 191 (time 1786439592.79 total 20.09 last 12.03)
 - mkdir 310 (time 1786439602.83 total 30.13 last 11.85)
 - mkdir 431 (time 1786439612.88 total 40.18 last 12.04)
 - mkdir 551 (time 1786439622.89 total 50.19 last 11.99)
 - mkdir 668 (time 1786439632.91 total 60.21 last 11.67)
 - mkdir 795 (time 1786439642.98 total 70.28 last 12.61)
 - mkdir 907 (time 1786439653.01 total 80.31 last 11.17)
total: 1000 mkdir in 88.75 seconds: 11.27 ops/second
 - mkdir 97 (time 1786439586.20 total 10.06 last 9.64)
 - mkdir 214 (time 1786439596.22 total 20.08 last 11.68)
 - mkdir 339 (time 1786439606.25 total 30.11 last 12.46)
 - mkdir 451 (time 1786439616.31 total 40.17 last 11.13)
 - mkdir 582 (time 1786439626.43 total 50.29 last 12.94)
 - mkdir 701 (time 1786439636.50 total 60.36 last 11.82)
 - mkdir 817 (time 1786439646.52 total 70.38 last 11.58)
 - mkdir 945 (time 1786439656.55 total 80.41 last 12.76)
total: 1000 mkdir in 87.43 seconds: 11.44 ops/second
 - mkdir 100 (time 1786439586.13 total 10.02 last 9.98)
 - mkdir 219 (time 1786439596.17 total 20.06 last 11.85)
 - mkdir 340 (time 1786439606.17 total 30.06 last 12.10)
 - mkdir 454 (time 1786439616.23 total 40.12 last 11.34)
 - mkdir 580 (time 1786439626.26 total 50.15 last 12.56)
 - mkdir 703 (time 1786439636.35 total 60.24 last 12.20)
 - mkdir 819 (time 1786439646.41 total 70.30 last 11.53)
 - mkdir 945 (time 1786439656.42 total 80.31 last 12.58)
total: 1000 mkdir in 87.67 seconds: 11.41 ops/second
 - mkdir 72 (time 1786439583.14 total 10.02 last 7.19)
 - mkdir 197 (time 1786439593.19 total 20.06 last 12.44)
 - mkdir 307 (time 1786439603.21 total 30.08 last 10.98)
 - mkdir 424 (time 1786439613.22 total 40.10 last 11.69)
 - mkdir 547 (time 1786439623.27 total 50.15 last 12.24)
 - mkdir 666 (time 1786439633.32 total 60.19 last 11.85)
 - mkdir 787 (time 1786439643.32 total 70.19 last 12.10)
 - mkdir 903 (time 1786439653.36 total 80.24 last 11.55)
 - mkdir 996 (time 1786439663.37 total 90.24 last 9.29)
total: 1000 mkdir in 90.93 seconds: 11.00 ops/second
 - mkdir 102 (time 1786439586.58 total 10.01 last 10.19)
 - mkdir 222 (time 1786439596.63 total 20.06 last 11.94)
 - mkdir 346 (time 1786439606.70 total 30.13 last 12.31)
 - mkdir 456 (time 1786439616.81 total 40.24 last 10.88)
 - mkdir 588 (time 1786439626.83 total 50.26 last 13.17)
 - mkdir 708 (time 1786439636.83 total 60.26 last 12.00)
 - mkdir 826 (time 1786439646.87 total 70.30 last 11.76)
 - mkdir 948 (time 1786439657.00 total 80.43 last 12.04)
total: 1000 mkdir in 88.23 seconds: 11.33 ops/second
 - mkdir 88 (time 1786439585.14 total 10.10 last 8.71)
 - mkdir 206 (time 1786439595.16 total 20.13 last 11.77)
 - mkdir 322 (time 1786439605.16 total 30.13 last 11.60)
 - mkdir 443 (time 1786439615.19 total 40.16 last 12.07)
 - mkdir 574 (time 1786439625.22 total 50.18 last 13.07)
 - mkdir 685 (time 1786439635.25 total 60.22 last 11.06)
 - mkdir 801 (time 1786439645.26 total 70.23 last 11.58)
 - mkdir 927 (time 1786439655.30 total 80.27 last 12.55)
total: 1000 mkdir in 90.06 seconds: 11.10 ops/second
 - mkdir 102 (time 1786439586.36 total 10.01 last 10.19)
 - mkdir 224 (time 1786439596.39 total 20.03 last 12.17)
 - mkdir 344 (time 1786439606.43 total 30.07 last 11.95)
 - mkdir 453 (time 1786439616.63 total 40.27 last 10.69)
 - mkdir 581 (time 1786439626.69 total 50.33 last 12.72)
 - mkdir 697 (time 1786439636.71 total 60.35 last 11.58)
 - mkdir 816 (time 1786439646.72 total 70.36 last 11.89)
 - mkdir 941 (time 1786439656.77 total 80.41 last 12.44)
total: 1000 mkdir in 89.62 seconds: 11.16 ops/second
 - mkdir 89 (time 1786439586.00 total 10.03 last 8.87)
 - mkdir 204 (time 1786439596.01 total 20.04 last 11.49)
 - mkdir 325 (time 1786439606.01 total 30.04 last 12.10)
 - mkdir 439 (time 1786439616.05 total 40.08 last 11.36)
 - mkdir 568 (time 1786439626.14 total 50.17 last 12.79)
 - mkdir 686 (time 1786439636.15 total 60.19 last 11.78)
 - mkdir 801 (time 1786439646.16 total 70.19 last 11.50)
 - mkdir 921 (time 1786439656.18 total 80.22 last 11.97)
 - mkdir 982 (time 1786439666.25 total 90.29 last 6.06)
total: 1000 mkdir in 92.75 seconds: 10.78 ops/second
 - mkdir 90 (time 1786439586.02 total 10.03 last 8.97)
 - mkdir 202 (time 1786439596.02 total 20.04 last 11.20)
 - mkdir 317 (time 1786439606.06 total 30.08 last 11.45)
 - mkdir 430 (time 1786439616.09 total 40.11 last 11.27)
 - mkdir 556 (time 1786439626.12 total 50.14 last 12.57)
 - mkdir 670 (time 1786439636.14 total 60.16 last 11.38)
 - mkdir 785 (time 1786439646.16 total 70.18 last 11.48)
 - mkdir 906 (time 1786439656.20 total 80.22 last 12.05)
 - mkdir 967 (time 1786439666.29 total 90.31 last 6.05)
total: 1000 mkdir in 95.23 seconds: 10.50 ops/second
Time for file creation 111 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 25 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.48 seconds: 21.04 ops/second
 - mkdir 142 (time 1786440193.82 total 10.05 last 14.12)
 - mkdir 286 (time 1786440203.85 total 20.09 last 14.35)
 - mkdir 422 (time 1786440213.86 total 30.10 last 13.59)
 - mkdir 563 (time 1786440223.88 total 40.12 last 14.07)
 - mkdir 690 (time 1786440233.89 total 50.13 last 12.69)
 - mkdir 826 (time 1786440243.89 total 60.13 last 13.60)
 - mkdir 996 (time 1786440253.95 total 70.18 last 16.91)
total: 1000 mkdir in 70.41 seconds: 14.20 ops/second
 - mkdir 133 (time 1786440193.24 total 10.11 last 13.16)
 - mkdir 275 (time 1786440203.25 total 20.12 last 14.18)
 - mkdir 406 (time 1786440213.32 total 30.19 last 13.00)
 - mkdir 548 (time 1786440223.35 total 40.22 last 14.16)
 - mkdir 675 (time 1786440233.39 total 50.26 last 12.65)
 - mkdir 809 (time 1786440243.42 total 60.28 last 13.37)
 - mkdir 966 (time 1786440253.45 total 70.32 last 15.65)
total: 1000 mkdir in 73.59 seconds: 13.59 ops/second
 - mkdir 134 (time 1786440192.23 total 10.09 last 13.27)
 - mkdir 267 (time 1786440202.24 total 20.10 last 13.29)
 - mkdir 403 (time 1786440212.30 total 30.16 last 13.52)
 - mkdir 537 (time 1786440222.33 total 40.19 last 13.36)
 - mkdir 666 (time 1786440232.39 total 50.25 last 12.82)
 - mkdir 796 (time 1786440242.40 total 60.26 last 12.99)
 - mkdir 951 (time 1786440252.43 total 70.30 last 15.44)
total: 1000 mkdir in 75.39 seconds: 13.26 ops/second
 - mkdir 142 (time 1786440193.59 total 10.02 last 14.17)
 - mkdir 282 (time 1786440203.62 total 20.04 last 13.96)
 - mkdir 409 (time 1786440213.66 total 30.08 last 12.65)
 - mkdir 547 (time 1786440223.73 total 40.16 last 13.69)
 - mkdir 665 (time 1786440233.79 total 50.21 last 11.74)
 - mkdir 796 (time 1786440243.88 total 60.31 last 12.98)
 - mkdir 962 (time 1786440253.91 total 70.34 last 16.55)
total: 1000 mkdir in 76.46 seconds: 13.08 ops/second
 - mkdir 134 (time 1786440193.68 total 10.04 last 13.35)
 - mkdir 277 (time 1786440203.70 total 20.07 last 14.26)
 - mkdir 403 (time 1786440213.74 total 30.10 last 12.56)
 - mkdir 541 (time 1786440223.82 total 40.18 last 13.68)
 - mkdir 671 (time 1786440233.87 total 50.23 last 12.94)
 - mkdir 797 (time 1786440243.90 total 60.27 last 12.55)
 - mkdir 956 (time 1786440253.91 total 70.27 last 15.89)
total: 1000 mkdir in 78.30 seconds: 12.77 ops/second
 - mkdir 139 (time 1786440193.97 total 10.11 last 13.75)
 - mkdir 277 (time 1786440204.00 total 20.14 last 13.77)
 - mkdir 406 (time 1786440214.00 total 30.14 last 12.89)
 - mkdir 548 (time 1786440224.05 total 40.19 last 14.14)
 - mkdir 667 (time 1786440234.11 total 50.25 last 11.82)
 - mkdir 799 (time 1786440244.14 total 60.28 last 13.17)
 - mkdir 955 (time 1786440254.16 total 70.30 last 15.56)
total: 1000 mkdir in 79.23 seconds: 12.62 ops/second
 - mkdir 119 (time 1786440189.13 total 10.08 last 11.81)
 - mkdir 251 (time 1786440199.14 total 20.08 last 13.19)
 - mkdir 373 (time 1786440209.18 total 30.13 last 12.15)
 - mkdir 492 (time 1786440219.24 total 40.18 last 11.84)
 - mkdir 623 (time 1786440229.27 total 50.22 last 13.05)
 - mkdir 739 (time 1786440239.29 total 60.24 last 11.58)
 - mkdir 877 (time 1786440249.36 total 70.30 last 13.71)
 - mkdir 981 (time 1786440259.45 total 80.39 last 10.31)
total: 1000 mkdir in 84.04 seconds: 11.90 ops/second
 - mkdir 131 (time 1786440192.73 total 10.04 last 13.05)
 - mkdir 262 (time 1786440202.80 total 20.11 last 13.01)
 - mkdir 390 (time 1786440212.82 total 30.14 last 12.77)
 - mkdir 527 (time 1786440222.83 total 40.15 last 13.69)
 - mkdir 652 (time 1786440232.87 total 50.18 last 12.45)
 - mkdir 773 (time 1786440242.90 total 60.21 last 12.07)
 - mkdir 929 (time 1786440252.92 total 70.23 last 15.57)
 - mkdir 996 (time 1786440263.08 total 80.40 last 6.59)
total: 1000 mkdir in 80.75 seconds: 12.38 ops/second
 - mkdir 135 (time 1786440193.77 total 10.06 last 13.42)
 - mkdir 269 (time 1786440203.85 total 20.14 last 13.29)
 - mkdir 399 (time 1786440213.86 total 30.15 last 12.99)
 - mkdir 533 (time 1786440223.88 total 40.17 last 13.38)
 - mkdir 661 (time 1786440233.88 total 50.17 last 12.80)
 - mkdir 791 (time 1786440243.89 total 60.18 last 12.99)
 - mkdir 946 (time 1786440253.94 total 70.23 last 15.42)
total: 1000 mkdir in 79.92 seconds: 12.51 ops/second
 - mkdir 134 (time 1786440193.82 total 10.02 last 13.37)
 - mkdir 271 (time 1786440203.92 total 20.12 last 13.57)
 - mkdir 398 (time 1786440214.00 total 30.21 last 12.60)
 - mkdir 531 (time 1786440224.02 total 40.22 last 13.28)
 - mkdir 652 (time 1786440234.07 total 50.27 last 12.04)
 - mkdir 777 (time 1786440244.12 total 60.32 last 12.43)
 - mkdir 935 (time 1786440254.14 total 70.34 last 15.77)
 - mkdir 987 (time 1786440264.18 total 80.38 last 5.18)
total: 1000 mkdir in 81.40 seconds: 12.29 ops/second
Time for file creation 93 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786440274 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1786440275 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786440277 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1786440277 ; total 1 ; last 1)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786440275 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1786440276 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1786440275 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1786440277 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1786440276 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1786440276 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
Time for file removal 59 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8