== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 06:45:10 (1788950710)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.53 seconds: 18.86 ops/second
 - mkdir 159 (time 1788950736.04 total 10.03 last 15.86)
 - mkdir 352 (time 1788950746.05 total 20.04 last 19.27)
 - mkdir 544 (time 1788950756.08 total 30.07 last 19.14)
 - mkdir 712 (time 1788950766.15 total 40.14 last 16.69)
 - mkdir 930 (time 1788950776.16 total 50.14 last 21.79)
total: 1000 mkdir in 53.10 seconds: 18.83 ops/second
 - mkdir 157 (time 1788950736.98 total 10.01 last 15.69)
 - mkdir 360 (time 1788950746.98 total 20.01 last 20.29)
 - mkdir 550 (time 1788950757.01 total 30.04 last 18.95)
 - mkdir 724 (time 1788950767.03 total 40.05 last 17.37)
 - mkdir 953 (time 1788950777.05 total 50.08 last 22.84)
total: 1000 mkdir in 52.38 seconds: 19.09 ops/second
 - mkdir 160 (time 1788950736.78 total 10.00 last 15.99)
 - mkdir 355 (time 1788950746.86 total 20.08 last 19.35)
 - mkdir 542 (time 1788950756.88 total 30.10 last 18.66)
 - mkdir 714 (time 1788950766.91 total 40.13 last 17.16)
 - mkdir 944 (time 1788950776.92 total 50.14 last 22.96)
total: 1000 mkdir in 53.11 seconds: 18.83 ops/second
 - mkdir 155 (time 1788950736.55 total 10.02 last 15.47)
 - mkdir 346 (time 1788950746.59 total 20.06 last 19.02)
 - mkdir 536 (time 1788950756.68 total 30.15 last 18.83)
 - mkdir 708 (time 1788950766.71 total 40.18 last 17.16)
 - mkdir 931 (time 1788950776.71 total 50.18 last 22.29)
total: 1000 mkdir in 53.77 seconds: 18.60 ops/second
 - mkdir 159 (time 1788950737.35 total 10.10 last 15.74)
 - mkdir 356 (time 1788950747.37 total 20.12 last 19.66)
 - mkdir 549 (time 1788950757.42 total 30.17 last 19.20)
 - mkdir 726 (time 1788950767.46 total 40.21 last 17.63)
 - mkdir 958 (time 1788950777.49 total 50.24 last 23.13)
total: 1000 mkdir in 53.14 seconds: 18.82 ops/second
 - mkdir 157 (time 1788950737.04 total 10.04 last 15.64)
 - mkdir 347 (time 1788950747.12 total 20.12 last 18.85)
 - mkdir 538 (time 1788950757.13 total 30.13 last 19.08)
 - mkdir 712 (time 1788950767.14 total 40.13 last 17.39)
 - mkdir 944 (time 1788950777.14 total 50.14 last 23.20)
total: 1000 mkdir in 53.86 seconds: 18.57 ops/second
 - mkdir 155 (time 1788950736.80 total 10.09 last 15.36)
 - mkdir 348 (time 1788950746.85 total 20.14 last 19.20)
 - mkdir 535 (time 1788950756.88 total 30.17 last 18.65)
 - mkdir 702 (time 1788950766.92 total 40.21 last 16.64)
 - mkdir 932 (time 1788950776.94 total 50.23 last 22.96)
total: 1000 mkdir in 54.74 seconds: 18.27 ops/second
 - mkdir 146 (time 1788950735.44 total 10.11 last 14.44)
 - mkdir 325 (time 1788950745.45 total 20.13 last 17.87)
 - mkdir 521 (time 1788950755.66 total 30.33 last 19.21)
 - mkdir 687 (time 1788950765.69 total 40.36 last 16.55)
 - mkdir 908 (time 1788950775.69 total 50.37 last 22.09)
total: 1000 mkdir in 56.18 seconds: 17.80 ops/second
 - mkdir 156 (time 1788950737.62 total 10.05 last 15.52)
 - mkdir 356 (time 1788950747.68 total 20.12 last 19.88)
 - mkdir 541 (time 1788950757.70 total 30.13 last 18.47)
 - mkdir 715 (time 1788950767.71 total 40.14 last 17.38)
 - mkdir 949 (time 1788950777.72 total 50.15 last 23.38)
total: 1000 mkdir in 54.57 seconds: 18.32 ops/second
 - mkdir 147 (time 1788950736.52 total 10.04 last 14.63)
 - mkdir 327 (time 1788950746.58 total 20.10 last 17.90)
 - mkdir 508 (time 1788950756.68 total 30.20 last 17.93)
 - mkdir 677 (time 1788950766.72 total 40.24 last 16.82)
 - mkdir 899 (time 1788950776.75 total 50.28 last 22.13)
total: 1000 mkdir in 57.77 seconds: 17.31 ops/second
Time for file creation 71 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 17 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.43 seconds: 22.99 ops/second
 - mkdir 186 (time 1788951301.63 total 10.04 last 18.53)
 - mkdir 376 (time 1788951311.68 total 20.09 last 18.89)
 - mkdir 556 (time 1788951321.71 total 30.12 last 17.95)
 - mkdir 746 (time 1788951331.72 total 40.13 last 18.99)
 - mkdir 907 (time 1788951341.74 total 50.15 last 16.06)
total: 1000 mkdir in 55.35 seconds: 18.07 ops/second
 - mkdir 173 (time 1788951300.49 total 10.03 last 17.25)
 - mkdir 350 (time 1788951310.53 total 20.07 last 17.63)
 - mkdir 527 (time 1788951320.56 total 30.10 last 17.65)
 - mkdir 698 (time 1788951330.60 total 40.14 last 17.03)
 - mkdir 861 (time 1788951340.61 total 50.15 last 16.29)
total: 1000 mkdir in 58.79 seconds: 17.01 ops/second
 - mkdir 178 (time 1788951302.20 total 10.07 last 17.67)
 - mkdir 365 (time 1788951312.23 total 20.09 last 18.66)
 - mkdir 542 (time 1788951322.24 total 30.11 last 17.68)
 - mkdir 736 (time 1788951332.29 total 40.16 last 19.29)
 - mkdir 903 (time 1788951342.32 total 50.19 last 16.66)
total: 1000 mkdir in 57.68 seconds: 17.34 ops/second
 - mkdir 178 (time 1788951302.74 total 10.00 last 17.79)
 - mkdir 374 (time 1788951312.76 total 20.02 last 19.57)
 - mkdir 544 (time 1788951322.76 total 30.02 last 17.00)
 - mkdir 733 (time 1788951332.80 total 40.06 last 18.83)
 - mkdir 910 (time 1788951342.81 total 50.07 last 17.68)
total: 1000 mkdir in 58.59 seconds: 17.07 ops/second
 - mkdir 179 (time 1788951302.46 total 10.01 last 17.87)
 - mkdir 363 (time 1788951312.48 total 20.04 last 18.36)
 - mkdir 543 (time 1788951322.54 total 30.09 last 17.91)
 - mkdir 733 (time 1788951332.59 total 40.14 last 18.90)
 - mkdir 903 (time 1788951342.62 total 50.17 last 16.95)
total: 1000 mkdir in 59.00 seconds: 16.95 ops/second
 - mkdir 178 (time 1788951302.80 total 10.06 last 17.69)
 - mkdir 371 (time 1788951312.85 total 20.11 last 19.22)
 - mkdir 542 (time 1788951322.87 total 30.13 last 17.05)
 - mkdir 730 (time 1788951333.00 total 40.26 last 18.56)
 - mkdir 908 (time 1788951343.02 total 50.28 last 17.77)
total: 1000 mkdir in 58.75 seconds: 17.02 ops/second
 - mkdir 173 (time 1788951302.71 total 10.05 last 17.22)
 - mkdir 360 (time 1788951312.73 total 20.08 last 18.65)
 - mkdir 535 (time 1788951322.73 total 30.08 last 17.50)
 - mkdir 724 (time 1788951332.74 total 40.08 last 18.89)
 - mkdir 902 (time 1788951342.76 total 50.10 last 17.76)
total: 1000 mkdir in 59.19 seconds: 16.89 ops/second
 - mkdir 176 (time 1788951302.37 total 10.04 last 17.54)
 - mkdir 361 (time 1788951312.41 total 20.08 last 18.43)
 - mkdir 533 (time 1788951322.46 total 30.12 last 17.12)
 - mkdir 720 (time 1788951332.57 total 40.24 last 18.49)
 - mkdir 893 (time 1788951342.58 total 50.25 last 17.28)
total: 1000 mkdir in 59.81 seconds: 16.72 ops/second
 - mkdir 175 (time 1788951303.00 total 10.11 last 17.31)
 - mkdir 375 (time 1788951313.02 total 20.13 last 19.96)
 - mkdir 543 (time 1788951323.05 total 30.16 last 16.75)
 - mkdir 728 (time 1788951333.06 total 40.17 last 18.47)
 - mkdir 908 (time 1788951343.14 total 50.25 last 17.86)
total: 1000 mkdir in 59.57 seconds: 16.79 ops/second
 - mkdir 168 (time 1788951302.42 total 10.05 last 16.71)
 - mkdir 347 (time 1788951312.44 total 20.07 last 17.87)
 - mkdir 516 (time 1788951322.52 total 30.15 last 16.77)
 - mkdir 699 (time 1788951332.54 total 40.17 last 18.25)
 - mkdir 873 (time 1788951342.56 total 50.19 last 17.37)
 - mkdir 988 (time 1788951352.58 total 60.21 last 11.48)
total: 1000 mkdir in 61.08 seconds: 16.37 ops/second
Time for file creation 72 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788951362 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788951362 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788951362 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788951363 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788951363 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788951363 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788951363 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788951363 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1788951364 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788951363 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8