== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 12:40:32 (1788799232)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.50 seconds: 20.07 ops/second
 - mkdir 190 (time 1788799251.68 total 10.00 last 18.99)
 - mkdir 344 (time 1788799261.70 total 20.02 last 15.38)
 - mkdir 525 (time 1788799271.74 total 30.06 last 18.03)
 - mkdir 671 (time 1788799281.79 total 40.11 last 14.52)
 - mkdir 823 (time 1788799291.83 total 50.15 last 15.14)
total: 1000 mkdir in 59.19 seconds: 16.90 ops/second
 - mkdir 196 (time 1788799252.93 total 10.08 last 19.45)
 - mkdir 359 (time 1788799262.94 total 20.08 last 16.29)
 - mkdir 544 (time 1788799272.95 total 30.09 last 18.49)
 - mkdir 679 (time 1788799282.98 total 40.13 last 13.45)
 - mkdir 832 (time 1788799293.04 total 50.19 last 15.21)
total: 1000 mkdir in 59.08 seconds: 16.93 ops/second
 - mkdir 189 (time 1788799252.29 total 10.04 last 18.83)
 - mkdir 344 (time 1788799262.34 total 20.09 last 15.42)
 - mkdir 525 (time 1788799272.37 total 30.11 last 18.05)
 - mkdir 667 (time 1788799282.40 total 40.15 last 14.15)
 - mkdir 819 (time 1788799292.40 total 50.15 last 15.19)
 - mkdir 999 (time 1788799302.53 total 60.28 last 17.78)
total: 1000 mkdir in 60.28 seconds: 16.59 ops/second
 - mkdir 197 (time 1788799252.71 total 10.12 last 19.47)
 - mkdir 353 (time 1788799262.76 total 20.16 last 15.53)
 - mkdir 529 (time 1788799272.80 total 30.21 last 17.52)
 - mkdir 666 (time 1788799282.85 total 40.25 last 13.64)
 - mkdir 817 (time 1788799292.88 total 50.29 last 15.05)
 - mkdir 997 (time 1788799302.91 total 60.32 last 17.95)
total: 1000 mkdir in 60.50 seconds: 16.53 ops/second
 - mkdir 187 (time 1788799252.71 total 10.04 last 18.62)
 - mkdir 338 (time 1788799262.73 total 20.06 last 15.07)
 - mkdir 514 (time 1788799272.75 total 30.08 last 17.56)
 - mkdir 650 (time 1788799282.76 total 40.09 last 13.59)
 - mkdir 809 (time 1788799292.81 total 50.14 last 15.82)
 - mkdir 990 (time 1788799302.81 total 60.14 last 18.10)
total: 1000 mkdir in 61.42 seconds: 16.28 ops/second
 - mkdir 186 (time 1788799252.94 total 10.09 last 18.44)
 - mkdir 342 (time 1788799262.99 total 20.14 last 15.52)
 - mkdir 521 (time 1788799273.01 total 30.16 last 17.86)
 - mkdir 659 (time 1788799283.07 total 40.22 last 13.71)
 - mkdir 812 (time 1788799293.13 total 50.28 last 15.22)
 - mkdir 991 (time 1788799303.16 total 60.31 last 17.84)
total: 1000 mkdir in 61.30 seconds: 16.31 ops/second
 - mkdir 191 (time 1788799252.81 total 10.06 last 18.99)
 - mkdir 348 (time 1788799262.85 total 20.10 last 15.64)
 - mkdir 523 (time 1788799272.90 total 30.14 last 17.42)
 - mkdir 656 (time 1788799282.91 total 40.15 last 13.28)
 - mkdir 810 (time 1788799292.94 total 50.18 last 15.35)
 - mkdir 988 (time 1788799303.01 total 60.26 last 17.67)
total: 1000 mkdir in 61.78 seconds: 16.19 ops/second
 - mkdir 184 (time 1788799252.75 total 10.03 last 18.34)
 - mkdir 337 (time 1788799262.78 total 20.06 last 15.25)
 - mkdir 514 (time 1788799272.89 total 30.17 last 17.52)
 - mkdir 651 (time 1788799282.97 total 40.25 last 13.59)
 - mkdir 805 (time 1788799293.00 total 50.28 last 15.35)
 - mkdir 982 (time 1788799303.07 total 60.35 last 17.57)
total: 1000 mkdir in 62.16 seconds: 16.09 ops/second
 - mkdir 182 (time 1788799252.70 total 10.01 last 18.18)
 - mkdir 329 (time 1788799262.70 total 20.02 last 14.70)
 - mkdir 502 (time 1788799272.71 total 30.02 last 17.29)
 - mkdir 641 (time 1788799282.84 total 40.16 last 13.72)
 - mkdir 792 (time 1788799292.87 total 50.18 last 15.06)
 - mkdir 972 (time 1788799302.90 total 60.21 last 17.95)
total: 1000 mkdir in 62.84 seconds: 15.91 ops/second
 - mkdir 174 (time 1788799252.65 total 10.08 last 17.26)
 - mkdir 321 (time 1788799262.67 total 20.11 last 14.66)
 - mkdir 490 (time 1788799272.69 total 30.13 last 16.87)
 - mkdir 625 (time 1788799282.81 total 40.25 last 13.33)
 - mkdir 781 (time 1788799292.87 total 50.31 last 15.51)
 - mkdir 964 (time 1788799302.92 total 60.36 last 18.20)
total: 1000 mkdir in 63.60 seconds: 15.72 ops/second
Time for file creation 72 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.38 seconds: 26.56 ops/second
 - mkdir 191 (time 1788799842.11 total 10.02 last 19.06)
 - mkdir 386 (time 1788799852.14 total 20.06 last 19.43)
 - mkdir 577 (time 1788799862.18 total 30.10 last 19.02)
 - mkdir 772 (time 1788799872.19 total 40.11 last 19.48)
 - mkdir 991 (time 1788799882.25 total 50.16 last 21.79)
total: 1000 mkdir in 50.49 seconds: 19.81 ops/second
 - mkdir 189 (time 1788799842.04 total 10.07 last 18.76)
 - mkdir 380 (time 1788799852.04 total 20.08 last 19.09)
 - mkdir 575 (time 1788799862.07 total 30.11 last 19.45)
 - mkdir 768 (time 1788799872.08 total 40.11 last 19.29)
 - mkdir 986 (time 1788799882.11 total 50.14 last 21.73)
total: 1000 mkdir in 50.67 seconds: 19.74 ops/second
 - mkdir 191 (time 1788799841.85 total 10.00 last 19.09)
 - mkdir 387 (time 1788799851.86 total 20.01 last 19.59)
 - mkdir 579 (time 1788799861.92 total 30.08 last 19.07)
 - mkdir 767 (time 1788799871.94 total 40.09 last 18.77)
 - mkdir 984 (time 1788799881.94 total 50.10 last 21.70)
total: 1000 mkdir in 50.80 seconds: 19.69 ops/second
 - mkdir 189 (time 1788799842.31 total 10.02 last 18.86)
 - mkdir 379 (time 1788799852.32 total 20.04 last 18.97)
 - mkdir 563 (time 1788799862.35 total 30.07 last 18.35)
 - mkdir 757 (time 1788799872.39 total 40.10 last 19.33)
 - mkdir 976 (time 1788799882.41 total 50.13 last 21.85)
total: 1000 mkdir in 51.93 seconds: 19.26 ops/second
 - mkdir 183 (time 1788799841.75 total 10.02 last 18.27)
 - mkdir 371 (time 1788799851.78 total 20.05 last 18.74)
 - mkdir 553 (time 1788799861.81 total 30.08 last 18.15)
 - mkdir 740 (time 1788799871.82 total 40.09 last 18.68)
 - mkdir 961 (time 1788799881.83 total 50.09 last 22.09)
total: 1000 mkdir in 52.58 seconds: 19.02 ops/second
 - mkdir 190 (time 1788799842.38 total 10.01 last 18.98)
 - mkdir 374 (time 1788799852.38 total 20.01 last 18.40)
 - mkdir 563 (time 1788799862.43 total 30.06 last 18.81)
 - mkdir 753 (time 1788799872.47 total 40.10 last 18.93)
 - mkdir 973 (time 1788799882.51 total 50.14 last 21.91)
total: 1000 mkdir in 52.32 seconds: 19.11 ops/second
 - mkdir 193 (time 1788799842.63 total 10.02 last 19.26)
 - mkdir 379 (time 1788799852.67 total 20.06 last 18.52)
 - mkdir 569 (time 1788799862.70 total 30.09 last 18.95)
 - mkdir 758 (time 1788799872.76 total 40.14 last 18.80)
 - mkdir 977 (time 1788799882.82 total 50.21 last 21.76)
total: 1000 mkdir in 52.20 seconds: 19.16 ops/second
 - mkdir 190 (time 1788799842.53 total 10.00 last 18.99)
 - mkdir 376 (time 1788799852.58 total 20.05 last 18.52)
 - mkdir 558 (time 1788799862.59 total 30.06 last 18.18)
 - mkdir 754 (time 1788799872.62 total 40.09 last 19.53)
 - mkdir 970 (time 1788799882.63 total 50.10 last 21.59)
total: 1000 mkdir in 52.49 seconds: 19.05 ops/second
 - mkdir 194 (time 1788799842.61 total 10.01 last 19.38)
 - mkdir 381 (time 1788799852.64 total 20.04 last 18.65)
 - mkdir 565 (time 1788799862.64 total 30.04 last 18.40)
 - mkdir 754 (time 1788799872.68 total 40.09 last 18.81)
 - mkdir 972 (time 1788799882.70 total 50.10 last 21.77)
total: 1000 mkdir in 52.45 seconds: 19.06 ops/second
 - mkdir 175 (time 1788799842.22 total 10.02 last 17.47)
 - mkdir 360 (time 1788799852.23 total 20.02 last 18.50)
 - mkdir 537 (time 1788799862.29 total 30.08 last 17.60)
 - mkdir 729 (time 1788799872.31 total 40.10 last 19.16)
 - mkdir 945 (time 1788799882.32 total 50.11 last 21.58)
total: 1000 mkdir in 53.96 seconds: 18.53 ops/second
Time for file creation 62 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788799892 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788799893 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788799893 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788799893 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788799892 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1788799893 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788799893 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1788799893 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1788799893 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1788799893 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
Time for file removal 36 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8