== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 18:12:49 (1788991969)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.42 seconds: 23.69 ops/second
 - mkdir 210 (time 1788991988.64 total 10.03 last 20.94)
 - mkdir 404 (time 1788991998.69 total 20.08 last 19.31)
 - mkdir 592 (time 1788992008.69 total 30.08 last 18.79)
 - mkdir 832 (time 1788992018.74 total 40.12 last 23.89)
total: 1000 mkdir in 47.41 seconds: 21.09 ops/second
 - mkdir 212 (time 1788991988.89 total 10.02 last 21.16)
 - mkdir 403 (time 1788991998.95 total 20.07 last 18.99)
 - mkdir 598 (time 1788992008.98 total 30.11 last 19.43)
 - mkdir 830 (time 1788992019.00 total 40.13 last 23.16)
total: 1000 mkdir in 47.74 seconds: 20.95 ops/second
 - mkdir 213 (time 1788991988.63 total 10.06 last 21.17)
 - mkdir 401 (time 1788991998.68 total 20.11 last 18.71)
 - mkdir 588 (time 1788992008.71 total 30.14 last 18.64)
 - mkdir 826 (time 1788992018.73 total 40.16 last 23.76)
total: 1000 mkdir in 48.17 seconds: 20.76 ops/second
 - mkdir 204 (time 1788991988.22 total 10.06 last 20.27)
 - mkdir 397 (time 1788991998.25 total 20.10 last 19.24)
 - mkdir 577 (time 1788992008.27 total 30.12 last 17.96)
 - mkdir 810 (time 1788992018.27 total 40.12 last 23.30)
total: 1000 mkdir in 48.60 seconds: 20.58 ops/second
 - mkdir 208 (time 1788991988.15 total 10.07 last 20.65)
 - mkdir 395 (time 1788991998.16 total 20.08 last 18.69)
 - mkdir 576 (time 1788992008.22 total 30.14 last 17.99)
 - mkdir 808 (time 1788992018.22 total 40.14 last 23.20)
total: 1000 mkdir in 49.02 seconds: 20.40 ops/second
 - mkdir 201 (time 1788991988.64 total 10.05 last 19.99)
 - mkdir 384 (time 1788991998.67 total 20.08 last 18.25)
 - mkdir 570 (time 1788992008.69 total 30.10 last 18.57)
 - mkdir 802 (time 1788992018.72 total 40.13 last 23.12)
total: 1000 mkdir in 49.62 seconds: 20.16 ops/second
 - mkdir 204 (time 1788991989.16 total 10.11 last 20.18)
 - mkdir 394 (time 1788991999.21 total 20.15 last 18.91)
 - mkdir 587 (time 1788992009.21 total 30.15 last 19.30)
 - mkdir 810 (time 1788992019.28 total 40.22 last 22.14)
total: 1000 mkdir in 49.23 seconds: 20.31 ops/second
 - mkdir 203 (time 1788991988.46 total 10.01 last 20.27)
 - mkdir 390 (time 1788991998.52 total 20.07 last 18.59)
 - mkdir 568 (time 1788992008.55 total 30.10 last 17.75)
 - mkdir 792 (time 1788992018.60 total 40.15 last 22.30)
 - mkdir 993 (time 1788992028.66 total 50.21 last 19.98)
total: 1000 mkdir in 50.57 seconds: 19.77 ops/second
 - mkdir 201 (time 1788991989.05 total 10.04 last 20.02)
 - mkdir 389 (time 1788991999.12 total 20.11 last 18.66)
 - mkdir 571 (time 1788992009.14 total 30.13 last 18.17)
 - mkdir 796 (time 1788992019.16 total 40.15 last 22.46)
total: 1000 mkdir in 50.03 seconds: 19.99 ops/second
 - mkdir 195 (time 1788991987.93 total 10.04 last 19.42)
 - mkdir 379 (time 1788991997.98 total 20.09 last 18.31)
 - mkdir 554 (time 1788992008.01 total 30.12 last 17.44)
 - mkdir 771 (time 1788992018.04 total 40.15 last 21.64)
 - mkdir 973 (time 1788992028.09 total 50.20 last 20.10)
total: 1000 mkdir in 51.81 seconds: 19.30 ops/second
Time for file creation 58 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 10 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.45 seconds: 22.28 ops/second
 - mkdir 202 (time 1788992572.75 total 10.01 last 20.19)
 - mkdir 363 (time 1788992582.79 total 20.04 last 16.04)
 - mkdir 499 (time 1788992592.80 total 30.05 last 13.59)
 - mkdir 646 (time 1788992602.86 total 40.11 last 14.61)
 - mkdir 787 (time 1788992612.89 total 50.15 last 14.05)
 - mkdir 927 (time 1788992622.92 total 60.17 last 13.96)
total: 1000 mkdir in 64.84 seconds: 15.42 ops/second
 - mkdir 201 (time 1788992572.68 total 10.05 last 20.00)
 - mkdir 363 (time 1788992582.73 total 20.10 last 16.13)
 - mkdir 499 (time 1788992592.80 total 30.17 last 13.50)
 - mkdir 638 (time 1788992602.86 total 40.23 last 13.82)
 - mkdir 766 (time 1788992612.87 total 50.24 last 12.78)
 - mkdir 903 (time 1788992622.94 total 60.31 last 13.60)
total: 1000 mkdir in 68.11 seconds: 14.68 ops/second
 - mkdir 194 (time 1788992573.40 total 10.02 last 19.37)
 - mkdir 362 (time 1788992583.42 total 20.03 last 16.78)
 - mkdir 496 (time 1788992593.43 total 30.04 last 13.38)
 - mkdir 636 (time 1788992603.47 total 40.08 last 13.94)
 - mkdir 767 (time 1788992613.47 total 50.09 last 13.10)
 - mkdir 906 (time 1788992623.52 total 60.14 last 13.83)
total: 1000 mkdir in 67.64 seconds: 14.78 ops/second
 - mkdir 194 (time 1788992573.42 total 10.06 last 19.29)
 - mkdir 357 (time 1788992583.46 total 20.11 last 16.22)
 - mkdir 493 (time 1788992593.46 total 30.11 last 13.60)
 - mkdir 630 (time 1788992603.49 total 40.14 last 13.66)
 - mkdir 766 (time 1788992613.59 total 50.23 last 13.47)
 - mkdir 907 (time 1788992623.65 total 60.29 last 14.02)
total: 1000 mkdir in 67.74 seconds: 14.76 ops/second
 - mkdir 198 (time 1788992572.99 total 10.00 last 19.80)
 - mkdir 355 (time 1788992583.03 total 20.04 last 15.64)
 - mkdir 491 (time 1788992593.04 total 30.05 last 13.58)
 - mkdir 625 (time 1788992603.07 total 40.07 last 13.37)
 - mkdir 759 (time 1788992613.10 total 50.11 last 13.35)
 - mkdir 897 (time 1788992623.17 total 60.18 last 13.71)
total: 1000 mkdir in 68.60 seconds: 14.58 ops/second
 - mkdir 194 (time 1788992573.54 total 10.03 last 19.35)
 - mkdir 357 (time 1788992583.66 total 20.15 last 16.10)
 - mkdir 491 (time 1788992593.68 total 30.17 last 13.37)
 - mkdir 634 (time 1788992603.72 total 40.22 last 14.24)
 - mkdir 769 (time 1788992613.77 total 50.27 last 13.43)
 - mkdir 902 (time 1788992623.81 total 60.30 last 13.25)
total: 1000 mkdir in 69.40 seconds: 14.41 ops/second
 - mkdir 197 (time 1788992572.61 total 10.03 last 19.64)
 - mkdir 351 (time 1788992582.67 total 20.09 last 15.31)
 - mkdir 477 (time 1788992592.68 total 30.10 last 12.58)
 - mkdir 611 (time 1788992602.72 total 40.14 last 13.34)
 - mkdir 744 (time 1788992612.72 total 50.14 last 13.30)
 - mkdir 879 (time 1788992622.76 total 60.18 last 13.46)
 - mkdir 996 (time 1788992632.78 total 70.20 last 11.67)
total: 1000 mkdir in 70.68 seconds: 14.15 ops/second
 - mkdir 193 (time 1788992573.67 total 10.00 last 19.30)
 - mkdir 351 (time 1788992583.75 total 20.08 last 15.68)
 - mkdir 487 (time 1788992593.81 total 30.14 last 13.52)
 - mkdir 629 (time 1788992603.86 total 40.18 last 14.14)
 - mkdir 762 (time 1788992613.91 total 50.24 last 13.23)
 - mkdir 898 (time 1788992623.99 total 60.32 last 13.49)
total: 1000 mkdir in 69.98 seconds: 14.29 ops/second
 - mkdir 194 (time 1788992573.46 total 10.03 last 19.34)
 - mkdir 352 (time 1788992583.48 total 20.05 last 15.78)
 - mkdir 485 (time 1788992593.48 total 30.05 last 13.30)
 - mkdir 619 (time 1788992603.49 total 40.06 last 13.38)
 - mkdir 751 (time 1788992613.51 total 50.08 last 13.18)
 - mkdir 884 (time 1788992623.52 total 60.09 last 13.29)
 - mkdir 995 (time 1788992633.65 total 70.22 last 10.95)
total: 1000 mkdir in 70.80 seconds: 14.13 ops/second
 - mkdir 188 (time 1788992573.43 total 10.07 last 18.67)
 - mkdir 341 (time 1788992583.45 total 20.09 last 15.27)
 - mkdir 466 (time 1788992593.49 total 30.14 last 12.44)
 - mkdir 599 (time 1788992603.50 total 40.14 last 13.29)
 - mkdir 726 (time 1788992613.56 total 50.20 last 12.62)
 - mkdir 855 (time 1788992623.63 total 60.27 last 12.81)
 - mkdir 962 (time 1788992633.66 total 70.30 last 10.67)
total: 1000 mkdir in 73.45 seconds: 13.61 ops/second
Time for file creation 82 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788992646 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1788992647 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1788992647 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1788992647 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1788992647 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1788992647 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1788992648 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1788992648 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1788992648 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1788992648 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
Time for file removal 51 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8