== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 06:30:06 (1787049006)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.52 ops/second
 - mkdir 165 (time 1787049026.07 total 10.09 last 16.35)
 - mkdir 321 (time 1787049036.11 total 20.13 last 15.54)
 - mkdir 483 (time 1787049046.15 total 30.17 last 16.13)
 - mkdir 655 (time 1787049056.16 total 40.18 last 17.18)
 - mkdir 819 (time 1787049066.23 total 50.25 last 16.28)
 - mkdir 980 (time 1787049076.27 total 60.29 last 16.04)
total: 1000 mkdir in 61.41 seconds: 16.28 ops/second
 - mkdir 156 (time 1787049027.84 total 10.02 last 15.56)
 - mkdir 313 (time 1787049037.88 total 20.06 last 15.64)
 - mkdir 477 (time 1787049047.92 total 30.10 last 16.35)
 - mkdir 655 (time 1787049057.93 total 40.11 last 17.77)
 - mkdir 814 (time 1787049067.95 total 50.13 last 15.88)
 - mkdir 977 (time 1787049078.00 total 60.18 last 16.21)
total: 1000 mkdir in 62.47 seconds: 16.01 ops/second
 - mkdir 162 (time 1787049028.66 total 10.10 last 16.05)
 - mkdir 324 (time 1787049038.69 total 20.13 last 16.15)
 - mkdir 488 (time 1787049048.76 total 30.20 last 16.28)
 - mkdir 664 (time 1787049058.77 total 40.21 last 17.58)
 - mkdir 823 (time 1787049068.84 total 50.27 last 15.79)
 - mkdir 983 (time 1787049078.87 total 60.31 last 15.95)
total: 1000 mkdir in 62.00 seconds: 16.13 ops/second
 - mkdir 160 (time 1787049027.93 total 10.04 last 15.93)
 - mkdir 317 (time 1787049037.94 total 20.05 last 15.69)
 - mkdir 479 (time 1787049047.95 total 30.06 last 16.18)
 - mkdir 654 (time 1787049057.99 total 40.10 last 17.43)
 - mkdir 817 (time 1787049068.05 total 50.16 last 16.21)
 - mkdir 976 (time 1787049078.11 total 60.22 last 15.80)
total: 1000 mkdir in 62.74 seconds: 15.94 ops/second
 - mkdir 156 (time 1787049029.13 total 10.01 last 15.58)
 - mkdir 326 (time 1787049039.14 total 20.03 last 16.98)
 - mkdir 489 (time 1787049049.19 total 30.08 last 16.22)
 - mkdir 665 (time 1787049059.22 total 40.10 last 17.56)
 - mkdir 821 (time 1787049069.31 total 50.19 last 15.46)
 - mkdir 974 (time 1787049079.37 total 60.26 last 15.20)
total: 1000 mkdir in 63.51 seconds: 15.75 ops/second
 - mkdir 157 (time 1787049029.03 total 10.01 last 15.69)
 - mkdir 317 (time 1787049039.06 total 20.04 last 15.95)
 - mkdir 476 (time 1787049049.10 total 30.08 last 15.84)
 - mkdir 656 (time 1787049059.12 total 40.10 last 17.96)
 - mkdir 810 (time 1787049069.15 total 50.14 last 15.35)
 - mkdir 967 (time 1787049079.18 total 60.16 last 15.66)
total: 1000 mkdir in 64.48 seconds: 15.51 ops/second
 - mkdir 160 (time 1787049028.64 total 10.01 last 15.99)
 - mkdir 313 (time 1787049038.69 total 20.06 last 15.22)
 - mkdir 473 (time 1787049048.78 total 30.15 last 15.87)
 - mkdir 648 (time 1787049058.83 total 40.20 last 17.41)
 - mkdir 804 (time 1787049068.83 total 50.20 last 15.60)
 - mkdir 963 (time 1787049078.96 total 60.33 last 15.70)
total: 1000 mkdir in 65.35 seconds: 15.30 ops/second
 - mkdir 152 (time 1787049029.16 total 10.08 last 15.08)
 - mkdir 306 (time 1787049039.17 total 20.09 last 15.39)
 - mkdir 460 (time 1787049049.18 total 30.10 last 15.39)
 - mkdir 644 (time 1787049059.24 total 40.16 last 18.28)
 - mkdir 800 (time 1787049069.34 total 50.26 last 15.44)
 - mkdir 955 (time 1787049079.38 total 60.30 last 15.45)
total: 1000 mkdir in 65.82 seconds: 15.19 ops/second
 - mkdir 151 (time 1787049029.20 total 10.02 last 15.07)
 - mkdir 311 (time 1787049039.23 total 20.06 last 15.94)
 - mkdir 468 (time 1787049049.29 total 30.11 last 15.62)
 - mkdir 644 (time 1787049059.31 total 40.13 last 17.56)
 - mkdir 795 (time 1787049069.38 total 50.20 last 15.00)
 - mkdir 947 (time 1787049079.50 total 60.33 last 15.02)
total: 1000 mkdir in 66.64 seconds: 15.01 ops/second
 - mkdir 150 (time 1787049028.86 total 10.02 last 14.97)
 - mkdir 299 (time 1787049038.89 total 20.05 last 14.86)
 - mkdir 452 (time 1787049048.96 total 30.11 last 15.20)
 - mkdir 631 (time 1787049058.97 total 40.13 last 17.87)
 - mkdir 784 (time 1787049069.01 total 50.16 last 15.25)
 - mkdir 938 (time 1787049079.07 total 60.22 last 15.30)
total: 1000 mkdir in 67.43 seconds: 14.83 ops/second
Time for file creation 77 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.75 seconds: 13.39 ops/second
 - mkdir 132 (time 1787049660.43 total 10.00 last 13.20)
 - mkdir 276 (time 1787049670.50 total 20.07 last 14.30)
 - mkdir 437 (time 1787049680.54 total 30.11 last 16.03)
 - mkdir 596 (time 1787049690.61 total 40.18 last 15.79)
 - mkdir 743 (time 1787049700.69 total 50.26 last 14.58)
 - mkdir 917 (time 1787049710.72 total 60.29 last 17.35)
total: 1000 mkdir in 64.94 seconds: 15.40 ops/second
 - mkdir 132 (time 1787049661.00 total 10.06 last 13.13)
 - mkdir 276 (time 1787049671.02 total 20.07 last 14.38)
 - mkdir 445 (time 1787049681.04 total 30.10 last 16.86)
 - mkdir 596 (time 1787049691.10 total 40.15 last 15.02)
 - mkdir 740 (time 1787049701.13 total 50.18 last 14.35)
 - mkdir 910 (time 1787049711.15 total 60.20 last 16.97)
total: 1000 mkdir in 65.18 seconds: 15.34 ops/second
 - mkdir 127 (time 1787049660.25 total 10.02 last 12.67)
 - mkdir 269 (time 1787049670.33 total 20.10 last 14.09)
 - mkdir 428 (time 1787049680.34 total 30.11 last 15.88)
 - mkdir 582 (time 1787049690.42 total 40.19 last 15.28)
 - mkdir 722 (time 1787049700.42 total 50.19 last 14.00)
 - mkdir 895 (time 1787049710.45 total 60.22 last 17.25)
total: 1000 mkdir in 66.63 seconds: 15.01 ops/second
 - mkdir 129 (time 1787049659.88 total 10.04 last 12.84)
 - mkdir 264 (time 1787049669.92 total 20.08 last 13.45)
 - mkdir 420 (time 1787049679.96 total 30.12 last 15.53)
 - mkdir 575 (time 1787049689.97 total 40.14 last 15.48)
 - mkdir 719 (time 1787049700.02 total 50.18 last 14.33)
 - mkdir 888 (time 1787049710.07 total 60.23 last 16.81)
total: 1000 mkdir in 67.69 seconds: 14.77 ops/second
 - mkdir 132 (time 1787049661.38 total 10.03 last 13.17)
 - mkdir 272 (time 1787049671.41 total 20.06 last 13.95)
 - mkdir 440 (time 1787049681.43 total 30.08 last 16.77)
 - mkdir 591 (time 1787049691.46 total 40.11 last 15.05)
 - mkdir 734 (time 1787049701.47 total 50.12 last 14.28)
 - mkdir 904 (time 1787049711.50 total 60.15 last 16.94)
total: 1000 mkdir in 66.52 seconds: 15.03 ops/second
 - mkdir 129 (time 1787049660.98 total 10.04 last 12.85)
 - mkdir 273 (time 1787049671.04 total 20.09 last 14.32)
 - mkdir 437 (time 1787049681.05 total 30.11 last 16.37)
 - mkdir 587 (time 1787049691.10 total 40.16 last 14.93)
 - mkdir 729 (time 1787049701.15 total 50.20 last 14.14)
 - mkdir 897 (time 1787049711.17 total 60.23 last 16.75)
total: 1000 mkdir in 67.97 seconds: 14.71 ops/second
 - mkdir 126 (time 1787049661.32 total 10.03 last 12.56)
 - mkdir 268 (time 1787049671.34 total 20.06 last 14.16)
 - mkdir 429 (time 1787049681.37 total 30.08 last 16.05)
 - mkdir 577 (time 1787049691.37 total 40.08 last 14.80)
 - mkdir 722 (time 1787049701.41 total 50.12 last 14.45)
 - mkdir 892 (time 1787049711.41 total 60.12 last 17.00)
total: 1000 mkdir in 68.17 seconds: 14.67 ops/second
 - mkdir 123 (time 1787049661.57 total 10.06 last 12.23)
 - mkdir 273 (time 1787049671.60 total 20.08 last 14.96)
 - mkdir 434 (time 1787049681.64 total 30.12 last 16.03)
 - mkdir 586 (time 1787049691.72 total 40.21 last 15.08)
 - mkdir 730 (time 1787049701.74 total 50.23 last 14.37)
 - mkdir 898 (time 1787049711.76 total 60.25 last 16.76)
total: 1000 mkdir in 68.30 seconds: 14.64 ops/second
 - mkdir 126 (time 1787049661.47 total 10.09 last 12.49)
 - mkdir 268 (time 1787049671.49 total 20.11 last 14.17)
 - mkdir 434 (time 1787049681.50 total 30.12 last 16.57)
 - mkdir 586 (time 1787049691.52 total 40.14 last 15.18)
 - mkdir 730 (time 1787049701.53 total 50.15 last 14.38)
 - mkdir 896 (time 1787049711.54 total 60.16 last 16.59)
total: 1000 mkdir in 68.69 seconds: 14.56 ops/second
 - mkdir 121 (time 1787049661.00 total 10.09 last 11.99)
 - mkdir 255 (time 1787049671.05 total 20.14 last 13.34)
 - mkdir 411 (time 1787049681.11 total 30.20 last 15.51)
 - mkdir 559 (time 1787049691.17 total 40.25 last 14.72)
 - mkdir 706 (time 1787049701.17 total 50.26 last 14.69)
 - mkdir 876 (time 1787049711.19 total 60.28 last 16.97)
total: 1000 mkdir in 70.20 seconds: 14.25 ops/second
Time for file creation 81 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787049728 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787049729 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787049730 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787049730 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787049730 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787049730 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787049730 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787049730 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787049731 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787049730 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8