== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 13:07:48 (1789146468)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.52 ops/second
 - mkdir 195 (time 1789146488.96 total 10.04 last 19.43)
 - mkdir 368 (time 1789146498.99 total 20.07 last 17.24)
 - mkdir 531 (time 1789146509.00 total 30.08 last 16.29)
 - mkdir 692 (time 1789146519.03 total 40.11 last 16.04)
 - mkdir 867 (time 1789146529.04 total 50.12 last 17.49)
total: 1000 mkdir in 58.11 seconds: 17.21 ops/second
 - mkdir 207 (time 1789146490.68 total 10.06 last 20.58)
 - mkdir 394 (time 1789146500.70 total 20.07 last 18.67)
 - mkdir 556 (time 1789146510.75 total 30.12 last 16.12)
 - mkdir 721 (time 1789146520.77 total 40.14 last 16.47)
 - mkdir 895 (time 1789146530.80 total 50.18 last 17.34)
total: 1000 mkdir in 56.89 seconds: 17.58 ops/second
 - mkdir 208 (time 1789146490.67 total 10.05 last 20.69)
 - mkdir 395 (time 1789146500.70 total 20.09 last 18.64)
 - mkdir 560 (time 1789146510.74 total 30.13 last 16.43)
 - mkdir 722 (time 1789146520.78 total 40.17 last 16.14)
 - mkdir 893 (time 1789146530.80 total 50.18 last 17.07)
total: 1000 mkdir in 57.20 seconds: 17.48 ops/second
 - mkdir 211 (time 1789146490.69 total 10.11 last 20.88)
 - mkdir 393 (time 1789146500.71 total 20.12 last 18.17)
 - mkdir 555 (time 1789146510.73 total 30.14 last 16.17)
 - mkdir 718 (time 1789146520.74 total 40.15 last 16.29)
 - mkdir 894 (time 1789146530.80 total 50.21 last 17.50)
total: 1000 mkdir in 57.42 seconds: 17.42 ops/second
 - mkdir 207 (time 1789146490.15 total 10.02 last 20.66)
 - mkdir 390 (time 1789146500.20 total 20.07 last 18.21)
 - mkdir 547 (time 1789146510.29 total 30.16 last 15.57)
 - mkdir 705 (time 1789146520.34 total 40.21 last 15.71)
 - mkdir 882 (time 1789146530.37 total 50.24 last 17.65)
total: 1000 mkdir in 58.10 seconds: 17.21 ops/second
 - mkdir 207 (time 1789146490.69 total 10.11 last 20.46)
 - mkdir 394 (time 1789146500.69 total 20.12 last 18.70)
 - mkdir 550 (time 1789146510.73 total 30.15 last 15.54)
 - mkdir 712 (time 1789146520.75 total 40.18 last 16.16)
 - mkdir 887 (time 1789146530.80 total 50.23 last 17.42)
total: 1000 mkdir in 57.84 seconds: 17.29 ops/second
 - mkdir 202 (time 1789146490.03 total 10.03 last 20.15)
 - mkdir 378 (time 1789146500.06 total 20.05 last 17.56)
 - mkdir 540 (time 1789146510.14 total 30.14 last 16.06)
 - mkdir 699 (time 1789146520.20 total 40.20 last 15.80)
 - mkdir 877 (time 1789146530.23 total 50.22 last 17.76)
total: 1000 mkdir in 58.60 seconds: 17.06 ops/second
 - mkdir 197 (time 1789146489.30 total 10.01 last 19.69)
 - mkdir 366 (time 1789146499.32 total 20.02 last 16.87)
 - mkdir 524 (time 1789146509.32 total 30.02 last 15.80)
 - mkdir 685 (time 1789146519.34 total 40.05 last 16.07)
 - mkdir 858 (time 1789146529.37 total 50.08 last 17.24)
total: 1000 mkdir in 59.52 seconds: 16.80 ops/second
 - mkdir 204 (time 1789146490.95 total 10.04 last 20.32)
 - mkdir 386 (time 1789146500.98 total 20.07 last 18.14)
 - mkdir 542 (time 1789146511.07 total 30.15 last 15.47)
 - mkdir 709 (time 1789146521.13 total 40.21 last 16.60)
 - mkdir 884 (time 1789146531.16 total 50.24 last 17.45)
total: 1000 mkdir in 58.52 seconds: 17.09 ops/second
 - mkdir 194 (time 1789146489.67 total 10.01 last 19.39)
 - mkdir 367 (time 1789146499.70 total 20.03 last 17.25)
 - mkdir 517 (time 1789146509.75 total 30.09 last 14.92)
 - mkdir 678 (time 1789146519.78 total 40.12 last 16.05)
 - mkdir 854 (time 1789146529.82 total 50.16 last 17.53)
total: 1000 mkdir in 60.08 seconds: 16.64 ops/second
Time for file creation 72 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.54 seconds: 18.63 ops/second
 - mkdir 165 (time 1789147022.54 total 10.08 last 16.36)
 - mkdir 317 (time 1789147032.57 total 20.11 last 15.16)
 - mkdir 509 (time 1789147042.58 total 30.13 last 19.17)
 - mkdir 714 (time 1789147052.63 total 40.18 last 20.40)
 - mkdir 891 (time 1789147062.68 total 50.23 last 17.61)
total: 1000 mkdir in 55.57 seconds: 17.99 ops/second
 - mkdir 156 (time 1789147022.38 total 10.08 last 15.47)
 - mkdir 306 (time 1789147032.45 total 20.15 last 14.90)
 - mkdir 500 (time 1789147042.47 total 30.17 last 19.36)
 - mkdir 704 (time 1789147052.55 total 40.25 last 20.23)
 - mkdir 883 (time 1789147062.58 total 50.28 last 17.85)
total: 1000 mkdir in 55.87 seconds: 17.90 ops/second
 - mkdir 162 (time 1789147022.79 total 10.00 last 16.20)
 - mkdir 313 (time 1789147032.79 total 20.00 last 15.10)
 - mkdir 502 (time 1789147042.82 total 30.03 last 18.85)
 - mkdir 706 (time 1789147052.83 total 40.04 last 20.37)
 - mkdir 878 (time 1789147062.85 total 50.06 last 17.17)
total: 1000 mkdir in 56.13 seconds: 17.82 ops/second
 - mkdir 156 (time 1789147023.71 total 10.04 last 15.54)
 - mkdir 313 (time 1789147033.72 total 20.05 last 15.68)
 - mkdir 503 (time 1789147043.72 total 30.06 last 18.99)
 - mkdir 720 (time 1789147053.76 total 40.10 last 21.61)
 - mkdir 887 (time 1789147063.81 total 50.14 last 16.62)
total: 1000 mkdir in 55.87 seconds: 17.90 ops/second
 - mkdir 156 (time 1789147023.63 total 10.02 last 15.57)
 - mkdir 313 (time 1789147033.72 total 20.10 last 15.57)
 - mkdir 506 (time 1789147043.72 total 30.10 last 19.30)
 - mkdir 717 (time 1789147053.77 total 40.16 last 20.99)
 - mkdir 887 (time 1789147063.79 total 50.17 last 16.98)
total: 1000 mkdir in 56.13 seconds: 17.81 ops/second
 - mkdir 163 (time 1789147023.55 total 10.06 last 16.20)
 - mkdir 317 (time 1789147033.57 total 20.08 last 15.38)
 - mkdir 509 (time 1789147043.59 total 30.10 last 19.16)
 - mkdir 718 (time 1789147053.62 total 40.13 last 20.84)
 - mkdir 885 (time 1789147063.67 total 50.18 last 16.61)
total: 1000 mkdir in 56.33 seconds: 17.75 ops/second
 - mkdir 156 (time 1789147023.54 total 10.02 last 15.57)
 - mkdir 314 (time 1789147033.58 total 20.05 last 15.75)
 - mkdir 504 (time 1789147043.60 total 30.08 last 18.95)
 - mkdir 716 (time 1789147053.63 total 40.11 last 21.15)
 - mkdir 889 (time 1789147063.68 total 50.16 last 17.20)
total: 1000 mkdir in 56.41 seconds: 17.73 ops/second
 - mkdir 154 (time 1789147023.44 total 10.07 last 15.30)
 - mkdir 315 (time 1789147033.48 total 20.10 last 16.04)
 - mkdir 507 (time 1789147043.51 total 30.14 last 19.14)
 - mkdir 713 (time 1789147053.51 total 40.14 last 20.60)
 - mkdir 885 (time 1789147063.62 total 50.25 last 17.01)
total: 1000 mkdir in 56.56 seconds: 17.68 ops/second
 - mkdir 159 (time 1789147023.68 total 10.03 last 15.86)
 - mkdir 318 (time 1789147033.73 total 20.08 last 15.81)
 - mkdir 507 (time 1789147043.74 total 30.09 last 18.88)
 - mkdir 715 (time 1789147053.75 total 40.10 last 20.77)
 - mkdir 883 (time 1789147063.79 total 50.14 last 16.74)
total: 1000 mkdir in 56.78 seconds: 17.61 ops/second
 - mkdir 156 (time 1789147024.00 total 10.04 last 15.54)
 - mkdir 317 (time 1789147034.04 total 20.08 last 16.04)
 - mkdir 512 (time 1789147044.07 total 30.10 last 19.45)
 - mkdir 719 (time 1789147054.08 total 40.11 last 20.68)
 - mkdir 889 (time 1789147064.14 total 50.18 last 16.89)
total: 1000 mkdir in 56.63 seconds: 17.66 ops/second
Time for file creation 70 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789147080 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789147081 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789147081 ; total 1 ; last 1)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789147081 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789147081 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789147081 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789147081 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789147081 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789147081 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789147081 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 40 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8