== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 08:17:37 (1787141857)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.58 seconds: 17.19 ops/second
 - mkdir 116 (time 1787141879.30 total 10.01 last 11.59)
 - mkdir 242 (time 1787141889.35 total 20.06 last 12.54)
 - mkdir 374 (time 1787141899.36 total 30.07 last 13.18)
 - mkdir 514 (time 1787141909.41 total 40.12 last 13.94)
 - mkdir 652 (time 1787141919.49 total 50.20 last 13.68)
 - mkdir 800 (time 1787141929.51 total 60.22 last 14.77)
 - mkdir 973 (time 1787141939.54 total 70.25 last 17.26)
total: 1000 mkdir in 72.25 seconds: 13.84 ops/second
 - mkdir 129 (time 1787141881.77 total 10.05 last 12.84)
 - mkdir 261 (time 1787141891.85 total 20.13 last 13.09)
 - mkdir 401 (time 1787141901.87 total 30.16 last 13.97)
 - mkdir 531 (time 1787141911.90 total 40.18 last 12.97)
 - mkdir 686 (time 1787141921.97 total 50.25 last 15.38)
 - mkdir 830 (time 1787141931.99 total 60.27 last 14.38)
 - mkdir 990 (time 1787141942.09 total 70.37 last 15.84)
total: 1000 mkdir in 71.57 seconds: 13.97 ops/second
 - mkdir 131 (time 1787141882.48 total 10.03 last 13.06)
 - mkdir 255 (time 1787141892.49 total 20.04 last 12.39)
 - mkdir 387 (time 1787141902.49 total 30.04 last 13.19)
 - mkdir 522 (time 1787141912.50 total 40.05 last 13.49)
 - mkdir 680 (time 1787141922.52 total 50.07 last 15.78)
 - mkdir 836 (time 1787141932.53 total 60.08 last 15.58)
 - mkdir 988 (time 1787141942.54 total 70.09 last 15.18)
total: 1000 mkdir in 71.50 seconds: 13.99 ops/second
 - mkdir 129 (time 1787141882.39 total 10.02 last 12.88)
 - mkdir 254 (time 1787141892.42 total 20.04 last 12.47)
 - mkdir 389 (time 1787141902.56 total 30.18 last 13.31)
 - mkdir 523 (time 1787141912.59 total 40.21 last 13.36)
 - mkdir 677 (time 1787141922.59 total 50.22 last 15.39)
 - mkdir 831 (time 1787141932.60 total 60.22 last 15.39)
 - mkdir 978 (time 1787141942.68 total 70.30 last 14.59)
total: 1000 mkdir in 73.09 seconds: 13.68 ops/second
 - mkdir 124 (time 1787141881.82 total 10.07 last 12.32)
 - mkdir 241 (time 1787141891.85 total 20.09 last 11.67)
 - mkdir 380 (time 1787141901.91 total 30.15 last 13.82)
 - mkdir 510 (time 1787141911.99 total 40.24 last 12.89)
 - mkdir 667 (time 1787141922.03 total 50.27 last 15.64)
 - mkdir 814 (time 1787141932.04 total 60.29 last 14.68)
 - mkdir 972 (time 1787141942.15 total 70.40 last 15.63)
total: 1000 mkdir in 73.90 seconds: 13.53 ops/second
 - mkdir 110 (time 1787141879.55 total 10.07 last 10.92)
 - mkdir 223 (time 1787141889.57 total 20.09 last 11.28)
 - mkdir 349 (time 1787141899.62 total 30.14 last 12.53)
 - mkdir 487 (time 1787141909.63 total 40.15 last 13.79)
 - mkdir 622 (time 1787141919.64 total 50.16 last 13.49)
 - mkdir 774 (time 1787141929.69 total 60.21 last 15.11)
 - mkdir 943 (time 1787141939.70 total 70.22 last 16.88)
total: 1000 mkdir in 76.21 seconds: 13.12 ops/second
 - mkdir 126 (time 1787141882.83 total 10.05 last 12.53)
 - mkdir 250 (time 1787141892.83 total 20.05 last 12.40)
 - mkdir 385 (time 1787141902.91 total 30.13 last 13.40)
 - mkdir 517 (time 1787141912.93 total 40.15 last 13.17)
 - mkdir 669 (time 1787141923.06 total 50.28 last 15.01)
 - mkdir 834 (time 1787141933.09 total 60.32 last 16.44)
 - mkdir 974 (time 1787141943.11 total 70.33 last 13.98)
total: 1000 mkdir in 73.75 seconds: 13.56 ops/second
 - mkdir 124 (time 1787141882.58 total 10.04 last 12.36)
 - mkdir 247 (time 1787141892.62 total 20.08 last 12.25)
 - mkdir 383 (time 1787141902.64 total 30.10 last 13.57)
 - mkdir 514 (time 1787141912.69 total 40.15 last 13.04)
 - mkdir 665 (time 1787141922.71 total 50.17 last 15.07)
 - mkdir 821 (time 1787141932.72 total 60.18 last 15.59)
 - mkdir 965 (time 1787141942.84 total 70.30 last 14.22)
total: 1000 mkdir in 74.75 seconds: 13.38 ops/second
 - mkdir 122 (time 1787141882.65 total 10.07 last 12.12)
 - mkdir 244 (time 1787141892.67 total 20.09 last 12.17)
 - mkdir 376 (time 1787141902.72 total 30.14 last 13.14)
 - mkdir 509 (time 1787141912.72 total 40.14 last 13.30)
 - mkdir 661 (time 1787141922.73 total 50.15 last 15.19)
 - mkdir 817 (time 1787141932.78 total 60.20 last 15.52)
 - mkdir 963 (time 1787141942.88 total 70.30 last 14.45)
total: 1000 mkdir in 75.06 seconds: 13.32 ops/second
 - mkdir 112 (time 1787141882.25 total 10.02 last 11.18)
 - mkdir 231 (time 1787141892.29 total 20.06 last 11.86)
 - mkdir 365 (time 1787141902.38 total 30.15 last 13.28)
 - mkdir 494 (time 1787141912.46 total 40.23 last 12.80)
 - mkdir 649 (time 1787141922.50 total 50.27 last 15.43)
 - mkdir 808 (time 1787141932.54 total 60.31 last 15.84)
 - mkdir 956 (time 1787141942.54 total 70.31 last 14.80)
total: 1000 mkdir in 75.58 seconds: 13.23 ops/second
Time for file creation 89 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.56 seconds: 18.00 ops/second
 - mkdir 165 (time 1787142486.41 total 10.07 last 16.39)
 - mkdir 371 (time 1787142496.41 total 20.07 last 20.60)
 - mkdir 553 (time 1787142506.44 total 30.10 last 18.14)
 - mkdir 697 (time 1787142516.47 total 40.12 last 14.36)
 - mkdir 879 (time 1787142526.47 total 50.13 last 18.19)
total: 1000 mkdir in 55.58 seconds: 17.99 ops/second
 - mkdir 177 (time 1787142488.11 total 10.04 last 17.64)
 - mkdir 382 (time 1787142498.14 total 20.07 last 20.43)
 - mkdir 557 (time 1787142508.15 total 30.08 last 17.49)
 - mkdir 696 (time 1787142518.21 total 40.14 last 13.82)
 - mkdir 894 (time 1787142528.24 total 50.16 last 19.75)
total: 1000 mkdir in 56.16 seconds: 17.81 ops/second
 - mkdir 173 (time 1787142488.91 total 10.07 last 17.19)
 - mkdir 390 (time 1787142498.95 total 20.10 last 21.62)
 - mkdir 557 (time 1787142509.02 total 30.17 last 16.58)
 - mkdir 696 (time 1787142519.07 total 40.23 last 13.82)
 - mkdir 909 (time 1787142529.08 total 50.24 last 21.28)
total: 1000 mkdir in 55.79 seconds: 17.93 ops/second
 - mkdir 182 (time 1787142488.94 total 10.01 last 18.19)
 - mkdir 403 (time 1787142498.96 total 20.03 last 22.05)
 - mkdir 568 (time 1787142508.96 total 30.03 last 16.50)
 - mkdir 705 (time 1787142519.02 total 40.09 last 13.61)
 - mkdir 908 (time 1787142529.05 total 50.12 last 20.24)
total: 1000 mkdir in 56.37 seconds: 17.74 ops/second
 - mkdir 175 (time 1787142489.07 total 10.05 last 17.41)
 - mkdir 398 (time 1787142499.08 total 20.06 last 22.28)
 - mkdir 562 (time 1787142509.12 total 30.10 last 16.33)
 - mkdir 695 (time 1787142519.12 total 40.11 last 13.30)
 - mkdir 901 (time 1787142529.18 total 50.16 last 20.48)
total: 1000 mkdir in 57.26 seconds: 17.46 ops/second
 - mkdir 162 (time 1787142487.30 total 10.05 last 16.13)
 - mkdir 360 (time 1787142497.31 total 20.06 last 19.77)
 - mkdir 533 (time 1787142507.32 total 30.07 last 17.28)
 - mkdir 671 (time 1787142517.36 total 40.10 last 13.75)
 - mkdir 857 (time 1787142527.38 total 50.12 last 18.56)
total: 1000 mkdir in 59.08 seconds: 16.93 ops/second
 - mkdir 176 (time 1787142489.30 total 10.01 last 17.58)
 - mkdir 394 (time 1787142499.38 total 20.09 last 21.63)
 - mkdir 564 (time 1787142509.39 total 30.10 last 16.99)
 - mkdir 701 (time 1787142519.41 total 40.12 last 13.67)
 - mkdir 902 (time 1787142529.43 total 50.14 last 20.06)
total: 1000 mkdir in 57.93 seconds: 17.26 ops/second
 - mkdir 173 (time 1787142488.84 total 10.06 last 17.20)
 - mkdir 385 (time 1787142498.86 total 20.08 last 21.16)
 - mkdir 546 (time 1787142508.90 total 30.12 last 16.03)
 - mkdir 686 (time 1787142518.93 total 40.15 last 13.97)
 - mkdir 886 (time 1787142528.94 total 50.16 last 19.97)
total: 1000 mkdir in 59.27 seconds: 16.87 ops/second
 - mkdir 165 (time 1787142488.71 total 10.02 last 16.46)
 - mkdir 375 (time 1787142498.74 total 20.05 last 20.95)
 - mkdir 536 (time 1787142508.76 total 30.07 last 16.07)
 - mkdir 671 (time 1787142518.76 total 40.07 last 13.50)
 - mkdir 877 (time 1787142528.82 total 50.13 last 20.47)
total: 1000 mkdir in 59.76 seconds: 16.73 ops/second
 - mkdir 168 (time 1787142489.38 total 10.03 last 16.76)
 - mkdir 373 (time 1787142499.45 total 20.09 last 20.36)
 - mkdir 530 (time 1787142509.48 total 30.13 last 15.65)
 - mkdir 669 (time 1787142519.54 total 40.18 last 13.82)
 - mkdir 877 (time 1787142529.57 total 50.22 last 20.72)
 - mkdir 995 (time 1787142539.65 total 60.29 last 11.72)
total: 1000 mkdir in 60.52 seconds: 16.52 ops/second
Time for file creation 75 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787142546 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787142547 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787142547 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787142548 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787142548 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787142548 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787142548 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787142548 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787142548 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787142548 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
Time for file removal 46 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8