== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 13:48:30 (1790963310)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.54 seconds: 18.67 ops/second
 - mkdir 204 (time 1790963331.85 total 10.01 last 20.39)
 - mkdir 376 (time 1790963341.88 total 20.04 last 17.15)
 - mkdir 523 (time 1790963351.89 total 30.04 last 14.69)
 - mkdir 673 (time 1790963361.93 total 40.08 last 14.94)
 - mkdir 832 (time 1790963371.94 total 50.10 last 15.87)
 - mkdir 984 (time 1790963381.95 total 60.11 last 15.18)
total: 1000 mkdir in 61.10 seconds: 16.37 ops/second
 - mkdir 197 (time 1790963331.30 total 10.03 last 19.65)
 - mkdir 370 (time 1790963341.33 total 20.05 last 17.25)
 - mkdir 522 (time 1790963351.54 total 30.26 last 14.89)
 - mkdir 673 (time 1790963361.55 total 40.27 last 15.08)
 - mkdir 820 (time 1790963371.56 total 50.29 last 14.68)
 - mkdir 971 (time 1790963381.57 total 60.30 last 15.08)
total: 1000 mkdir in 62.77 seconds: 15.93 ops/second
 - mkdir 196 (time 1790963331.16 total 10.07 last 19.46)
 - mkdir 368 (time 1790963341.22 total 20.13 last 17.10)
 - mkdir 520 (time 1790963351.30 total 30.21 last 15.08)
 - mkdir 664 (time 1790963361.31 total 40.22 last 14.39)
 - mkdir 814 (time 1790963371.33 total 50.24 last 14.96)
 - mkdir 967 (time 1790963381.40 total 60.31 last 15.20)
total: 1000 mkdir in 62.98 seconds: 15.88 ops/second
 - mkdir 198 (time 1790963331.02 total 10.01 last 19.78)
 - mkdir 371 (time 1790963341.07 total 20.06 last 17.22)
 - mkdir 521 (time 1790963351.10 total 30.09 last 14.95)
 - mkdir 666 (time 1790963361.13 total 40.12 last 14.46)
 - mkdir 819 (time 1790963371.16 total 50.15 last 15.25)
 - mkdir 964 (time 1790963381.18 total 60.17 last 14.47)
total: 1000 mkdir in 63.21 seconds: 15.82 ops/second
 - mkdir 198 (time 1790963331.61 total 10.01 last 19.79)
 - mkdir 363 (time 1790963341.64 total 20.04 last 16.44)
 - mkdir 509 (time 1790963351.77 total 30.17 last 14.42)
 - mkdir 658 (time 1790963361.80 total 40.20 last 14.85)
 - mkdir 811 (time 1790963371.81 total 50.21 last 15.29)
 - mkdir 958 (time 1790963381.85 total 60.25 last 14.64)
total: 1000 mkdir in 63.86 seconds: 15.66 ops/second
 - mkdir 196 (time 1790963331.53 total 10.04 last 19.53)
 - mkdir 367 (time 1790963341.53 total 20.04 last 17.10)
 - mkdir 516 (time 1790963351.59 total 30.10 last 14.81)
 - mkdir 659 (time 1790963361.60 total 40.11 last 14.28)
 - mkdir 812 (time 1790963371.68 total 50.19 last 15.18)
 - mkdir 957 (time 1790963381.69 total 60.20 last 14.49)
total: 1000 mkdir in 64.54 seconds: 15.49 ops/second
 - mkdir 192 (time 1790963330.38 total 10.07 last 19.07)
 - mkdir 361 (time 1790963340.46 total 20.15 last 16.76)
 - mkdir 509 (time 1790963350.47 total 30.16 last 14.79)
 - mkdir 648 (time 1790963360.52 total 40.21 last 13.83)
 - mkdir 797 (time 1790963370.54 total 50.23 last 14.87)
 - mkdir 943 (time 1790963380.54 total 60.24 last 14.59)
total: 1000 mkdir in 65.80 seconds: 15.20 ops/second
 - mkdir 200 (time 1790963331.85 total 10.02 last 19.95)
 - mkdir 363 (time 1790963341.87 total 20.04 last 16.27)
 - mkdir 505 (time 1790963351.87 total 30.05 last 14.19)
 - mkdir 656 (time 1790963361.92 total 40.09 last 15.04)
 - mkdir 803 (time 1790963371.93 total 50.11 last 14.67)
 - mkdir 949 (time 1790963382.00 total 60.17 last 14.50)
total: 1000 mkdir in 66.14 seconds: 15.12 ops/second
 - mkdir 192 (time 1790963330.29 total 10.04 last 19.13)
 - mkdir 356 (time 1790963340.30 total 20.05 last 16.38)
 - mkdir 502 (time 1790963350.31 total 30.07 last 14.58)
 - mkdir 631 (time 1790963360.33 total 40.08 last 12.89)
 - mkdir 776 (time 1790963370.35 total 50.10 last 14.47)
 - mkdir 924 (time 1790963380.42 total 60.17 last 14.70)
total: 1000 mkdir in 68.42 seconds: 14.62 ops/second
 - mkdir 188 (time 1790963330.86 total 10.11 last 18.59)
 - mkdir 351 (time 1790963340.88 total 20.13 last 16.27)
 - mkdir 494 (time 1790963350.94 total 30.19 last 14.22)
 - mkdir 628 (time 1790963360.94 total 40.19 last 13.39)
 - mkdir 775 (time 1790963370.96 total 50.21 last 14.68)
 - mkdir 919 (time 1790963381.03 total 60.28 last 14.30)
total: 1000 mkdir in 69.13 seconds: 14.47 ops/second
Time for file creation 77 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.52 seconds: 19.11 ops/second
 - mkdir 175 (time 1790963891.37 total 10.05 last 17.42)
 - mkdir 358 (time 1790963901.40 total 20.07 last 18.25)
 - mkdir 541 (time 1790963911.40 total 30.07 last 18.30)
 - mkdir 720 (time 1790963921.44 total 40.11 last 17.83)
 - mkdir 906 (time 1790963931.45 total 50.13 last 18.57)
total: 1000 mkdir in 55.17 seconds: 18.13 ops/second
 - mkdir 179 (time 1790963892.89 total 10.00 last 17.89)
 - mkdir 367 (time 1790963902.94 total 20.05 last 18.71)
 - mkdir 554 (time 1790963912.98 total 30.10 last 18.61)
 - mkdir 738 (time 1790963923.05 total 40.17 last 18.27)
 - mkdir 932 (time 1790963933.07 total 50.19 last 19.37)
total: 1000 mkdir in 53.93 seconds: 18.54 ops/second
 - mkdir 168 (time 1790963892.19 total 10.02 last 16.76)
 - mkdir 353 (time 1790963902.23 total 20.07 last 18.41)
 - mkdir 541 (time 1790963912.28 total 30.12 last 18.71)
 - mkdir 721 (time 1790963922.29 total 40.13 last 17.98)
 - mkdir 914 (time 1790963932.33 total 50.17 last 19.22)
total: 1000 mkdir in 55.01 seconds: 18.18 ops/second
 - mkdir 185 (time 1790963892.77 total 10.04 last 18.43)
 - mkdir 369 (time 1790963902.79 total 20.05 last 18.37)
 - mkdir 562 (time 1790963912.79 total 30.05 last 19.30)
 - mkdir 736 (time 1790963922.83 total 40.10 last 17.32)
 - mkdir 926 (time 1790963932.88 total 50.15 last 18.90)
total: 1000 mkdir in 54.47 seconds: 18.36 ops/second
 - mkdir 172 (time 1790963892.32 total 10.01 last 17.19)
 - mkdir 363 (time 1790963902.35 total 20.04 last 19.04)
 - mkdir 550 (time 1790963912.37 total 30.06 last 18.66)
 - mkdir 726 (time 1790963922.40 total 40.08 last 17.56)
 - mkdir 915 (time 1790963932.41 total 50.10 last 18.87)
total: 1000 mkdir in 55.04 seconds: 18.17 ops/second
 - mkdir 174 (time 1790963892.47 total 10.00 last 17.39)
 - mkdir 354 (time 1790963902.50 total 20.04 last 17.94)
 - mkdir 537 (time 1790963912.51 total 30.04 last 18.30)
 - mkdir 711 (time 1790963922.57 total 40.10 last 17.29)
 - mkdir 905 (time 1790963932.58 total 50.11 last 19.39)
total: 1000 mkdir in 56.03 seconds: 17.85 ops/second
 - mkdir 175 (time 1790963893.12 total 10.03 last 17.45)
 - mkdir 363 (time 1790963903.16 total 20.07 last 18.72)
 - mkdir 541 (time 1790963913.21 total 30.12 last 17.70)
 - mkdir 715 (time 1790963923.23 total 40.14 last 17.37)
 - mkdir 905 (time 1790963933.26 total 50.16 last 18.95)
total: 1000 mkdir in 56.14 seconds: 17.81 ops/second
 - mkdir 179 (time 1790963893.04 total 10.02 last 17.86)
 - mkdir 362 (time 1790963903.08 total 20.06 last 18.24)
 - mkdir 543 (time 1790963913.13 total 30.10 last 18.01)
 - mkdir 719 (time 1790963923.15 total 40.13 last 17.55)
 - mkdir 906 (time 1790963933.16 total 50.14 last 18.69)
total: 1000 mkdir in 56.26 seconds: 17.77 ops/second
 - mkdir 177 (time 1790963892.95 total 10.00 last 17.70)
 - mkdir 350 (time 1790963902.96 total 20.00 last 17.29)
 - mkdir 526 (time 1790963913.01 total 30.06 last 17.51)
 - mkdir 701 (time 1790963923.08 total 40.13 last 17.38)
 - mkdir 896 (time 1790963933.09 total 50.13 last 19.49)
total: 1000 mkdir in 56.78 seconds: 17.61 ops/second
 - mkdir 169 (time 1790963892.63 total 10.00 last 16.89)
 - mkdir 341 (time 1790963902.73 total 20.11 last 17.02)
 - mkdir 518 (time 1790963912.75 total 30.12 last 17.68)
 - mkdir 690 (time 1790963922.78 total 40.16 last 17.14)
 - mkdir 879 (time 1790963932.83 total 50.20 last 18.81)
total: 1000 mkdir in 57.60 seconds: 17.36 ops/second
Time for file creation 66 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790963948 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1790963948 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1790963948 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1790963949 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1790963949 ; total 1 ; last 1)
total: 1000 unlinks in 23 seconds: 43.478260 unlinks/second
 - unlinked 0 (time 1790963949 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1790963949 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1790963949 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1790963949 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
 - unlinked 0 (time 1790963949 ; total 0 ; last 0)
total: 1000 unlinks in 22 seconds: 45.454544 unlinks/second
Time for file removal 33 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8