== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 17:41:58 (1790804518)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.40 seconds: 25.09 ops/second
 - mkdir 158 (time 1790804539.30 total 10.03 last 15.76)
 - mkdir 346 (time 1790804549.33 total 20.06 last 18.74)
 - mkdir 522 (time 1790804559.38 total 30.11 last 17.51)
 - mkdir 690 (time 1790804569.43 total 40.16 last 16.73)
 - mkdir 870 (time 1790804579.45 total 50.19 last 17.95)
total: 1000 mkdir in 57.80 seconds: 17.30 ops/second
 - mkdir 167 (time 1790804539.66 total 10.04 last 16.63)
 - mkdir 345 (time 1790804549.68 total 20.05 last 17.78)
 - mkdir 522 (time 1790804559.68 total 30.06 last 17.69)
 - mkdir 690 (time 1790804569.72 total 40.10 last 16.73)
 - mkdir 869 (time 1790804579.76 total 50.13 last 17.84)
total: 1000 mkdir in 57.81 seconds: 17.30 ops/second
 - mkdir 159 (time 1790804539.52 total 10.03 last 15.85)
 - mkdir 329 (time 1790804549.53 total 20.03 last 16.99)
 - mkdir 508 (time 1790804559.59 total 30.10 last 17.78)
 - mkdir 679 (time 1790804569.64 total 40.15 last 17.03)
 - mkdir 862 (time 1790804579.65 total 50.15 last 18.28)
total: 1000 mkdir in 58.38 seconds: 17.13 ops/second
 - mkdir 165 (time 1790804539.93 total 10.06 last 16.39)
 - mkdir 346 (time 1790804550.04 total 20.18 last 17.90)
 - mkdir 517 (time 1790804560.09 total 30.22 last 17.02)
 - mkdir 685 (time 1790804570.10 total 40.24 last 16.77)
 - mkdir 864 (time 1790804580.11 total 50.25 last 17.89)
total: 1000 mkdir in 58.47 seconds: 17.10 ops/second
 - mkdir 159 (time 1790804539.77 total 10.01 last 15.88)
 - mkdir 340 (time 1790804549.78 total 20.02 last 18.08)
 - mkdir 514 (time 1790804559.81 total 30.05 last 17.35)
 - mkdir 678 (time 1790804569.82 total 40.06 last 16.38)
 - mkdir 860 (time 1790804579.83 total 50.07 last 18.19)
total: 1000 mkdir in 58.68 seconds: 17.04 ops/second
 - mkdir 162 (time 1790804539.77 total 10.00 last 16.20)
 - mkdir 342 (time 1790804549.78 total 20.01 last 17.98)
 - mkdir 519 (time 1790804559.84 total 30.07 last 17.59)
 - mkdir 686 (time 1790804569.88 total 40.11 last 16.64)
 - mkdir 863 (time 1790804579.89 total 50.12 last 17.68)
total: 1000 mkdir in 58.67 seconds: 17.04 ops/second
 - mkdir 155 (time 1790804539.17 total 10.01 last 15.49)
 - mkdir 337 (time 1790804549.20 total 20.04 last 18.14)
 - mkdir 512 (time 1790804559.22 total 30.06 last 17.47)
 - mkdir 677 (time 1790804569.22 total 40.06 last 16.50)
 - mkdir 852 (time 1790804579.25 total 50.09 last 17.45)
total: 1000 mkdir in 59.34 seconds: 16.85 ops/second
 - mkdir 169 (time 1790804540.29 total 10.01 last 16.88)
 - mkdir 346 (time 1790804550.33 total 20.05 last 17.63)
 - mkdir 526 (time 1790804560.37 total 30.09 last 17.93)
 - mkdir 691 (time 1790804570.44 total 40.16 last 16.38)
 - mkdir 874 (time 1790804580.47 total 50.19 last 18.25)
total: 1000 mkdir in 58.33 seconds: 17.15 ops/second
 - mkdir 154 (time 1790804538.87 total 10.08 last 15.28)
 - mkdir 326 (time 1790804548.89 total 20.10 last 17.17)
 - mkdir 493 (time 1790804558.90 total 30.11 last 16.68)
 - mkdir 656 (time 1790804568.93 total 40.14 last 16.24)
 - mkdir 838 (time 1790804578.98 total 50.19 last 18.12)
total: 1000 mkdir in 60.18 seconds: 16.62 ops/second
 - mkdir 146 (time 1790804539.18 total 10.04 last 14.54)
 - mkdir 322 (time 1790804549.26 total 20.12 last 17.46)
 - mkdir 497 (time 1790804559.28 total 30.13 last 17.47)
 - mkdir 665 (time 1790804569.28 total 40.14 last 16.79)
 - mkdir 840 (time 1790804579.29 total 50.15 last 17.48)
 - mkdir 998 (time 1790804589.33 total 60.19 last 15.74)
total: 1000 mkdir in 60.26 seconds: 16.60 ops/second
Time for file creation 70 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 19.80 ops/second
 - mkdir 197 (time 1790805107.54 total 10.06 last 19.59)
 - mkdir 381 (time 1790805117.60 total 20.11 last 18.30)
 - mkdir 534 (time 1790805127.60 total 30.11 last 15.30)
 - mkdir 733 (time 1790805137.64 total 40.15 last 19.81)
 - mkdir 920 (time 1790805147.65 total 50.16 last 18.68)
total: 1000 mkdir in 54.92 seconds: 18.21 ops/second
 - mkdir 183 (time 1790805106.63 total 10.03 last 18.25)
 - mkdir 365 (time 1790805116.68 total 20.08 last 18.11)
 - mkdir 514 (time 1790805126.75 total 30.15 last 14.79)
 - mkdir 708 (time 1790805136.75 total 40.16 last 19.39)
 - mkdir 895 (time 1790805146.77 total 50.17 last 18.68)
total: 1000 mkdir in 56.29 seconds: 17.77 ops/second
 - mkdir 180 (time 1790805107.21 total 10.01 last 17.97)
 - mkdir 355 (time 1790805117.23 total 20.03 last 17.47)
 - mkdir 504 (time 1790805127.23 total 30.03 last 14.90)
 - mkdir 702 (time 1790805137.27 total 40.07 last 19.72)
 - mkdir 890 (time 1790805147.28 total 50.09 last 18.77)
total: 1000 mkdir in 57.04 seconds: 17.53 ops/second
 - mkdir 188 (time 1790805108.10 total 10.01 last 18.78)
 - mkdir 364 (time 1790805118.11 total 20.02 last 17.59)
 - mkdir 515 (time 1790805128.15 total 30.06 last 15.04)
 - mkdir 716 (time 1790805138.19 total 40.10 last 20.01)
 - mkdir 902 (time 1790805148.21 total 50.12 last 18.57)
total: 1000 mkdir in 57.18 seconds: 17.49 ops/second
 - mkdir 187 (time 1790805108.24 total 10.02 last 18.65)
 - mkdir 358 (time 1790805118.31 total 20.09 last 16.99)
 - mkdir 514 (time 1790805128.35 total 30.13 last 15.54)
 - mkdir 716 (time 1790805138.37 total 40.15 last 20.15)
 - mkdir 904 (time 1790805148.48 total 50.26 last 18.60)
total: 1000 mkdir in 57.11 seconds: 17.51 ops/second
 - mkdir 189 (time 1790805108.24 total 10.00 last 18.90)
 - mkdir 363 (time 1790805118.27 total 20.02 last 17.36)
 - mkdir 513 (time 1790805128.31 total 30.07 last 14.93)
 - mkdir 716 (time 1790805138.36 total 40.12 last 20.21)
 - mkdir 900 (time 1790805148.41 total 50.17 last 18.31)
total: 1000 mkdir in 57.17 seconds: 17.49 ops/second
 - mkdir 189 (time 1790805108.43 total 10.06 last 18.79)
 - mkdir 358 (time 1790805118.47 total 20.10 last 16.84)
 - mkdir 509 (time 1790805128.56 total 30.19 last 14.96)
 - mkdir 713 (time 1790805138.58 total 40.21 last 20.35)
 - mkdir 900 (time 1790805148.59 total 50.21 last 18.70)
total: 1000 mkdir in 57.29 seconds: 17.46 ops/second
 - mkdir 193 (time 1790805108.58 total 10.02 last 19.26)
 - mkdir 360 (time 1790805118.65 total 20.09 last 16.59)
 - mkdir 516 (time 1790805128.65 total 30.10 last 15.59)
 - mkdir 720 (time 1790805138.69 total 40.13 last 20.33)
 - mkdir 902 (time 1790805148.76 total 50.20 last 18.08)
total: 1000 mkdir in 57.36 seconds: 17.43 ops/second
 - mkdir 183 (time 1790805107.87 total 10.02 last 18.27)
 - mkdir 360 (time 1790805117.90 total 20.05 last 17.63)
 - mkdir 507 (time 1790805127.96 total 30.10 last 14.63)
 - mkdir 701 (time 1790805137.97 total 40.12 last 19.37)
 - mkdir 887 (time 1790805148.00 total 50.15 last 18.54)
total: 1000 mkdir in 58.13 seconds: 17.20 ops/second
 - mkdir 180 (time 1790805108.53 total 10.04 last 17.93)
 - mkdir 340 (time 1790805118.55 total 20.06 last 15.97)
 - mkdir 487 (time 1790805128.58 total 30.09 last 14.66)
 - mkdir 690 (time 1790805138.58 total 40.09 last 20.30)
 - mkdir 870 (time 1790805148.63 total 50.14 last 17.91)
total: 1000 mkdir in 59.50 seconds: 16.81 ops/second
Time for file creation 69 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790805164 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790805165 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1790805166 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1790805166 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1790805166 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1790805166 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1790805166 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1790805166 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1790805167 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1790805166 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
Time for file removal 46 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8