== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 14:39:16 (1790793556)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.67 seconds: 14.93 ops/second
 - mkdir 175 (time 1790793580.72 total 10.00 last 17.50)
 - mkdir 341 (time 1790793590.75 total 20.03 last 16.55)
 - mkdir 533 (time 1790793600.85 total 30.13 last 19.00)
 - mkdir 716 (time 1790793610.87 total 40.15 last 18.28)
 - mkdir 889 (time 1790793620.90 total 50.18 last 17.25)
total: 1000 mkdir in 57.49 seconds: 17.40 ops/second
 - mkdir 170 (time 1790793579.03 total 10.01 last 16.99)
 - mkdir 315 (time 1790793589.04 total 20.02 last 14.48)
 - mkdir 511 (time 1790793599.09 total 30.07 last 19.50)
 - mkdir 694 (time 1790793609.09 total 40.08 last 18.29)
 - mkdir 866 (time 1790793619.12 total 50.10 last 17.16)
total: 1000 mkdir in 59.30 seconds: 16.86 ops/second
 - mkdir 169 (time 1790793580.13 total 10.04 last 16.84)
 - mkdir 324 (time 1790793590.16 total 20.07 last 15.45)
 - mkdir 514 (time 1790793600.19 total 30.09 last 18.95)
 - mkdir 695 (time 1790793610.22 total 40.13 last 18.04)
 - mkdir 866 (time 1790793620.26 total 50.17 last 17.03)
total: 1000 mkdir in 60.02 seconds: 16.66 ops/second
 - mkdir 169 (time 1790793580.50 total 10.07 last 16.78)
 - mkdir 321 (time 1790793590.51 total 20.08 last 15.19)
 - mkdir 510 (time 1790793600.54 total 30.11 last 18.84)
 - mkdir 696 (time 1790793610.67 total 40.24 last 18.36)
 - mkdir 871 (time 1790793620.70 total 50.27 last 17.44)
total: 1000 mkdir in 59.80 seconds: 16.72 ops/second
 - mkdir 180 (time 1790793581.46 total 10.02 last 17.97)
 - mkdir 345 (time 1790793591.47 total 20.03 last 16.48)
 - mkdir 526 (time 1790793601.48 total 30.04 last 18.08)
 - mkdir 711 (time 1790793611.49 total 40.05 last 18.49)
 - mkdir 885 (time 1790793621.49 total 50.05 last 17.40)
total: 1000 mkdir in 58.82 seconds: 17.00 ops/second
 - mkdir 188 (time 1790793581.76 total 10.06 last 18.69)
 - mkdir 356 (time 1790793591.77 total 20.08 last 16.77)
 - mkdir 534 (time 1790793601.82 total 30.12 last 17.72)
 - mkdir 718 (time 1790793611.86 total 40.16 last 18.33)
 - mkdir 889 (time 1790793621.91 total 50.21 last 17.02)
total: 1000 mkdir in 58.78 seconds: 17.01 ops/second
 - mkdir 184 (time 1790793581.32 total 10.01 last 18.38)
 - mkdir 339 (time 1790793591.33 total 20.02 last 15.48)
 - mkdir 529 (time 1790793601.36 total 30.05 last 18.94)
 - mkdir 710 (time 1790793611.37 total 40.06 last 18.09)
 - mkdir 882 (time 1790793621.39 total 50.09 last 17.15)
total: 1000 mkdir in 59.26 seconds: 16.87 ops/second
 - mkdir 183 (time 1790793581.50 total 10.00 last 18.30)
 - mkdir 341 (time 1790793591.50 total 20.00 last 15.80)
 - mkdir 515 (time 1790793601.57 total 30.07 last 17.27)
 - mkdir 704 (time 1790793611.66 total 40.16 last 18.74)
 - mkdir 876 (time 1790793621.67 total 50.17 last 17.18)
total: 1000 mkdir in 59.90 seconds: 16.69 ops/second
 - mkdir 162 (time 1790793580.30 total 10.01 last 16.19)
 - mkdir 321 (time 1790793590.38 total 20.09 last 15.77)
 - mkdir 509 (time 1790793600.40 total 30.11 last 18.77)
 - mkdir 692 (time 1790793610.49 total 40.20 last 18.14)
 - mkdir 863 (time 1790793620.52 total 50.23 last 17.04)
 - mkdir 989 (time 1790793630.55 total 60.26 last 12.57)
total: 1000 mkdir in 61.47 seconds: 16.27 ops/second
 - mkdir 159 (time 1790793579.52 total 10.00 last 15.90)
 - mkdir 301 (time 1790793589.57 total 20.05 last 14.13)
 - mkdir 485 (time 1790793599.62 total 30.10 last 18.31)
 - mkdir 663 (time 1790793609.64 total 40.12 last 17.77)
 - mkdir 831 (time 1790793619.65 total 50.13 last 16.78)
 - mkdir 969 (time 1790793629.74 total 60.22 last 13.68)
total: 1000 mkdir in 63.50 seconds: 15.75 ops/second
Time for file creation 74 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.53 seconds: 18.74 ops/second
 - mkdir 178 (time 1790794155.78 total 10.02 last 17.76)
 - mkdir 341 (time 1790794165.78 total 20.03 last 16.29)
 - mkdir 496 (time 1790794175.82 total 30.07 last 15.44)
 - mkdir 639 (time 1790794185.86 total 40.10 last 14.25)
 - mkdir 799 (time 1790794195.95 total 50.20 last 15.85)
 - mkdir 960 (time 1790794205.97 total 60.22 last 16.06)
total: 1000 mkdir in 62.60 seconds: 15.97 ops/second
 - mkdir 177 (time 1790794155.88 total 10.00 last 17.70)
 - mkdir 342 (time 1790794165.90 total 20.02 last 16.46)
 - mkdir 500 (time 1790794175.92 total 30.04 last 15.77)
 - mkdir 640 (time 1790794185.95 total 40.07 last 13.96)
 - mkdir 792 (time 1790794195.95 total 50.07 last 15.19)
 - mkdir 953 (time 1790794206.00 total 60.12 last 16.02)
total: 1000 mkdir in 62.88 seconds: 15.90 ops/second
 - mkdir 145 (time 1790794153.30 total 10.04 last 14.44)
 - mkdir 326 (time 1790794163.34 total 20.08 last 18.03)
 - mkdir 462 (time 1790794173.38 total 30.11 last 13.55)
 - mkdir 610 (time 1790794183.44 total 40.17 last 14.71)
 - mkdir 766 (time 1790794193.45 total 50.19 last 15.57)
 - mkdir 902 (time 1790794203.48 total 60.21 last 13.57)
total: 1000 mkdir in 66.02 seconds: 15.15 ops/second
 - mkdir 187 (time 1790794156.67 total 10.04 last 18.63)
 - mkdir 339 (time 1790794166.69 total 20.06 last 15.17)
 - mkdir 496 (time 1790794176.72 total 30.09 last 15.66)
 - mkdir 641 (time 1790794186.73 total 40.11 last 14.48)
 - mkdir 792 (time 1790794196.74 total 50.11 last 15.09)
 - mkdir 960 (time 1790794206.79 total 60.16 last 16.73)
total: 1000 mkdir in 63.11 seconds: 15.85 ops/second
 - mkdir 193 (time 1790794156.85 total 10.01 last 19.27)
 - mkdir 351 (time 1790794166.86 total 20.03 last 15.78)
 - mkdir 507 (time 1790794176.88 total 30.04 last 15.58)
 - mkdir 645 (time 1790794186.92 total 40.09 last 13.74)
 - mkdir 793 (time 1790794196.93 total 50.10 last 14.78)
 - mkdir 958 (time 1790794206.96 total 60.12 last 16.46)
total: 1000 mkdir in 63.06 seconds: 15.86 ops/second
 - mkdir 193 (time 1790794157.01 total 10.04 last 19.22)
 - mkdir 350 (time 1790794167.05 total 20.08 last 15.65)
 - mkdir 503 (time 1790794177.11 total 30.14 last 15.20)
 - mkdir 643 (time 1790794187.14 total 40.17 last 13.96)
 - mkdir 793 (time 1790794197.16 total 50.19 last 14.98)
 - mkdir 959 (time 1790794207.24 total 60.27 last 16.46)
total: 1000 mkdir in 63.25 seconds: 15.81 ops/second
 - mkdir 190 (time 1790794157.35 total 10.04 last 18.93)
 - mkdir 343 (time 1790794167.37 total 20.06 last 15.26)
 - mkdir 505 (time 1790794177.41 total 30.10 last 16.15)
 - mkdir 644 (time 1790794187.47 total 40.16 last 13.81)
 - mkdir 795 (time 1790794197.48 total 50.17 last 15.09)
 - mkdir 964 (time 1790794207.50 total 60.18 last 16.87)
total: 1000 mkdir in 62.91 seconds: 15.89 ops/second
 - mkdir 192 (time 1790794157.33 total 10.01 last 19.19)
 - mkdir 351 (time 1790794167.36 total 20.03 last 15.86)
 - mkdir 507 (time 1790794177.42 total 30.10 last 15.49)
 - mkdir 645 (time 1790794187.43 total 40.10 last 13.79)
 - mkdir 792 (time 1790794197.44 total 50.12 last 14.68)
 - mkdir 956 (time 1790794207.47 total 60.15 last 16.35)
total: 1000 mkdir in 63.59 seconds: 15.73 ops/second
 - mkdir 184 (time 1790794157.11 total 10.03 last 18.34)
 - mkdir 338 (time 1790794167.14 total 20.06 last 15.36)
 - mkdir 494 (time 1790794177.29 total 30.21 last 15.37)
 - mkdir 634 (time 1790794187.32 total 40.24 last 13.96)
 - mkdir 777 (time 1790794197.35 total 50.27 last 14.26)
 - mkdir 935 (time 1790794207.39 total 60.31 last 15.74)
total: 1000 mkdir in 65.67 seconds: 15.23 ops/second
 - mkdir 169 (time 1790794156.13 total 10.01 last 16.88)
 - mkdir 319 (time 1790794166.17 total 20.05 last 14.94)
 - mkdir 466 (time 1790794176.20 total 30.08 last 14.66)
 - mkdir 599 (time 1790794186.21 total 40.09 last 13.29)
 - mkdir 746 (time 1790794196.25 total 50.13 last 14.63)
 - mkdir 899 (time 1790794206.26 total 60.14 last 15.29)
total: 1000 mkdir in 68.73 seconds: 14.55 ops/second
Time for file creation 80 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790794221 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1790794223 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1790794223 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1790794224 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1790794224 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790794224 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790794224 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790794224 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790794224 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790794225 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8