== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 19:13:39 (1790118819)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.44 ops/second
 - mkdir 128 (time 1790118841.74 total 10.03 last 12.76)
 - mkdir 319 (time 1790118851.81 total 20.10 last 18.97)
 - mkdir 509 (time 1790118861.82 total 30.12 last 18.97)
 - mkdir 678 (time 1790118871.89 total 40.18 last 16.79)
 - mkdir 884 (time 1790118881.94 total 50.23 last 20.50)
total: 1000 mkdir in 55.98 seconds: 17.86 ops/second
 - mkdir 133 (time 1790118842.72 total 10.02 last 13.27)
 - mkdir 326 (time 1790118852.74 total 20.04 last 19.26)
 - mkdir 518 (time 1790118862.75 total 30.05 last 19.18)
 - mkdir 691 (time 1790118872.76 total 40.06 last 17.28)
 - mkdir 896 (time 1790118882.77 total 50.08 last 20.47)
total: 1000 mkdir in 55.14 seconds: 18.14 ops/second
 - mkdir 145 (time 1790118843.71 total 10.04 last 14.45)
 - mkdir 336 (time 1790118853.77 total 20.09 last 18.99)
 - mkdir 524 (time 1790118863.82 total 30.14 last 18.70)
 - mkdir 693 (time 1790118873.83 total 40.15 last 16.89)
 - mkdir 905 (time 1790118883.85 total 50.17 last 21.16)
total: 1000 mkdir in 55.06 seconds: 18.16 ops/second
 - mkdir 133 (time 1790118842.59 total 10.01 last 13.28)
 - mkdir 326 (time 1790118852.60 total 20.03 last 19.27)
 - mkdir 517 (time 1790118862.64 total 30.06 last 19.03)
 - mkdir 685 (time 1790118872.72 total 40.15 last 16.66)
 - mkdir 887 (time 1790118882.74 total 50.17 last 20.16)
total: 1000 mkdir in 56.28 seconds: 17.77 ops/second
 - mkdir 131 (time 1790118842.55 total 10.05 last 13.03)
 - mkdir 320 (time 1790118852.58 total 20.09 last 18.84)
 - mkdir 508 (time 1790118862.60 total 30.11 last 18.76)
 - mkdir 677 (time 1790118872.65 total 40.16 last 16.81)
 - mkdir 883 (time 1790118882.65 total 50.16 last 20.60)
total: 1000 mkdir in 56.48 seconds: 17.70 ops/second
 - mkdir 139 (time 1790118843.44 total 10.00 last 13.90)
 - mkdir 340 (time 1790118853.46 total 20.02 last 20.07)
 - mkdir 525 (time 1790118863.49 total 30.05 last 18.44)
 - mkdir 693 (time 1790118873.51 total 40.07 last 16.76)
 - mkdir 899 (time 1790118883.55 total 50.11 last 20.54)
total: 1000 mkdir in 55.73 seconds: 17.94 ops/second
 - mkdir 144 (time 1790118843.88 total 10.04 last 14.35)
 - mkdir 338 (time 1790118853.91 total 20.07 last 19.35)
 - mkdir 526 (time 1790118863.93 total 30.09 last 18.76)
 - mkdir 695 (time 1790118873.98 total 40.14 last 16.82)
 - mkdir 904 (time 1790118884.03 total 50.18 last 20.81)
total: 1000 mkdir in 55.42 seconds: 18.05 ops/second
 - mkdir 124 (time 1790118841.31 total 10.04 last 12.35)
 - mkdir 305 (time 1790118851.34 total 20.08 last 18.04)
 - mkdir 484 (time 1790118861.35 total 30.08 last 17.89)
 - mkdir 647 (time 1790118871.37 total 40.11 last 16.26)
 - mkdir 849 (time 1790118881.40 total 50.14 last 20.14)
total: 1000 mkdir in 58.03 seconds: 17.23 ops/second
 - mkdir 135 (time 1790118843.59 total 10.05 last 13.44)
 - mkdir 325 (time 1790118853.61 total 20.07 last 18.97)
 - mkdir 505 (time 1790118863.65 total 30.11 last 17.93)
 - mkdir 674 (time 1790118873.69 total 40.15 last 16.83)
 - mkdir 882 (time 1790118883.71 total 50.16 last 20.76)
total: 1000 mkdir in 57.45 seconds: 17.41 ops/second
 - mkdir 126 (time 1790118842.62 total 10.03 last 12.56)
 - mkdir 307 (time 1790118852.63 total 20.05 last 18.07)
 - mkdir 484 (time 1790118862.65 total 30.06 last 17.67)
 - mkdir 651 (time 1790118872.67 total 40.08 last 16.68)
 - mkdir 858 (time 1790118882.70 total 50.12 last 20.62)
total: 1000 mkdir in 58.52 seconds: 17.09 ops/second
Time for file creation 70 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.51 seconds: 19.57 ops/second
 - mkdir 143 (time 1790119432.31 total 10.02 last 14.28)
 - mkdir 345 (time 1790119442.32 total 20.03 last 20.17)
 - mkdir 527 (time 1790119452.35 total 30.06 last 18.16)
 - mkdir 708 (time 1790119462.35 total 40.06 last 18.09)
 - mkdir 851 (time 1790119472.35 total 50.06 last 14.30)
total: 1000 mkdir in 57.28 seconds: 17.46 ops/second
 - mkdir 144 (time 1790119432.66 total 10.02 last 14.37)
 - mkdir 350 (time 1790119442.67 total 20.03 last 20.59)
 - mkdir 530 (time 1790119452.73 total 30.09 last 17.89)
 - mkdir 712 (time 1790119462.73 total 40.09 last 18.20)
 - mkdir 849 (time 1790119472.74 total 50.10 last 13.68)
total: 1000 mkdir in 57.72 seconds: 17.33 ops/second
 - mkdir 144 (time 1790119432.61 total 10.01 last 14.39)
 - mkdir 345 (time 1790119442.65 total 20.05 last 20.02)
 - mkdir 528 (time 1790119452.75 total 30.14 last 18.13)
 - mkdir 708 (time 1790119462.77 total 40.17 last 17.95)
 - mkdir 846 (time 1790119472.79 total 50.19 last 13.77)
total: 1000 mkdir in 58.40 seconds: 17.12 ops/second
 - mkdir 140 (time 1790119432.00 total 10.02 last 13.98)
 - mkdir 335 (time 1790119442.10 total 20.11 last 19.31)
 - mkdir 522 (time 1790119452.12 total 30.13 last 18.66)
 - mkdir 694 (time 1790119462.14 total 40.15 last 17.17)
 - mkdir 833 (time 1790119472.21 total 50.23 last 13.79)
total: 1000 mkdir in 59.35 seconds: 16.85 ops/second
 - mkdir 148 (time 1790119433.28 total 10.08 last 14.68)
 - mkdir 356 (time 1790119443.33 total 20.13 last 20.68)
 - mkdir 530 (time 1790119453.35 total 30.15 last 17.37)
 - mkdir 715 (time 1790119463.39 total 40.19 last 18.43)
 - mkdir 851 (time 1790119473.41 total 50.21 last 13.57)
total: 1000 mkdir in 58.49 seconds: 17.10 ops/second
 - mkdir 148 (time 1790119433.38 total 10.02 last 14.77)
 - mkdir 354 (time 1790119443.42 total 20.07 last 20.51)
 - mkdir 524 (time 1790119453.43 total 30.08 last 16.99)
 - mkdir 711 (time 1790119463.51 total 40.16 last 18.54)
 - mkdir 847 (time 1790119473.54 total 50.19 last 13.56)
total: 1000 mkdir in 58.84 seconds: 16.99 ops/second
 - mkdir 145 (time 1790119433.04 total 10.00 last 14.50)
 - mkdir 349 (time 1790119443.07 total 20.03 last 20.34)
 - mkdir 519 (time 1790119453.07 total 30.04 last 16.99)
 - mkdir 699 (time 1790119463.09 total 40.06 last 17.97)
 - mkdir 837 (time 1790119473.11 total 50.08 last 13.77)
total: 1000 mkdir in 59.78 seconds: 16.73 ops/second
 - mkdir 139 (time 1790119432.82 total 10.03 last 13.86)
 - mkdir 337 (time 1790119442.82 total 20.03 last 19.80)
 - mkdir 507 (time 1790119452.86 total 30.07 last 16.93)
 - mkdir 695 (time 1790119462.91 total 40.12 last 18.71)
 - mkdir 836 (time 1790119472.92 total 50.13 last 14.09)
total: 1000 mkdir in 60.09 seconds: 16.64 ops/second
 - mkdir 138 (time 1790119433.07 total 10.08 last 13.68)
 - mkdir 342 (time 1790119443.12 total 20.13 last 20.31)
 - mkdir 514 (time 1790119453.15 total 30.17 last 17.14)
 - mkdir 698 (time 1790119463.18 total 40.19 last 18.35)
 - mkdir 835 (time 1790119473.21 total 50.23 last 13.65)
 - mkdir 999 (time 1790119483.22 total 60.23 last 16.39)
total: 1000 mkdir in 60.23 seconds: 16.60 ops/second
 - mkdir 136 (time 1790119431.85 total 10.02 last 13.58)
 - mkdir 325 (time 1790119441.87 total 20.03 last 18.87)
 - mkdir 505 (time 1790119451.89 total 30.06 last 17.96)
 - mkdir 679 (time 1790119461.90 total 40.07 last 17.39)
 - mkdir 818 (time 1790119471.92 total 50.09 last 13.87)
 - mkdir 988 (time 1790119481.96 total 60.13 last 16.93)
total: 1000 mkdir in 61.63 seconds: 16.22 ops/second
Time for file creation 73 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790119494 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1790119495 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1790119496 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1790119496 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1790119496 ; total 1 ; last 1)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1790119496 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1790119496 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1790119496 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1790119497 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1790119497 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
Time for file removal 51 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8