== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 00:47:15 (1787114835)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.56 seconds: 17.75 ops/second
 - mkdir 161 (time 1787114854.76 total 10.09 last 15.96)
 - mkdir 300 (time 1787114864.77 total 20.09 last 13.89)
 - mkdir 433 (time 1787114874.80 total 30.13 last 13.25)
 - mkdir 570 (time 1787114884.84 total 40.16 last 13.65)
 - mkdir 707 (time 1787114894.87 total 50.20 last 13.65)
 - mkdir 854 (time 1787114904.98 total 60.30 last 14.55)
 - mkdir 980 (time 1787114915.06 total 70.38 last 12.50)
total: 1000 mkdir in 71.86 seconds: 13.92 ops/second
 - mkdir 161 (time 1787114855.09 total 10.03 last 16.05)
 - mkdir 300 (time 1787114865.15 total 20.09 last 13.82)
 - mkdir 431 (time 1787114875.16 total 30.10 last 13.09)
 - mkdir 567 (time 1787114885.26 total 40.20 last 13.46)
 - mkdir 702 (time 1787114895.28 total 50.22 last 13.48)
 - mkdir 845 (time 1787114905.31 total 60.25 last 14.26)
 - mkdir 972 (time 1787114915.40 total 70.34 last 12.58)
total: 1000 mkdir in 73.09 seconds: 13.68 ops/second
 - mkdir 161 (time 1787114855.62 total 10.03 last 16.05)
 - mkdir 304 (time 1787114865.64 total 20.05 last 14.27)
 - mkdir 440 (time 1787114875.68 total 30.09 last 13.55)
 - mkdir 568 (time 1787114885.69 total 40.11 last 12.78)
 - mkdir 709 (time 1787114895.75 total 50.16 last 14.02)
 - mkdir 855 (time 1787114905.80 total 60.22 last 14.52)
 - mkdir 980 (time 1787114915.85 total 70.26 last 12.44)
total: 1000 mkdir in 72.58 seconds: 13.78 ops/second
 - mkdir 155 (time 1787114854.41 total 10.02 last 15.47)
 - mkdir 296 (time 1787114864.49 total 20.10 last 13.99)
 - mkdir 424 (time 1787114874.54 total 30.14 last 12.74)
 - mkdir 558 (time 1787114884.59 total 40.19 last 13.34)
 - mkdir 697 (time 1787114894.63 total 50.23 last 13.84)
 - mkdir 848 (time 1787114904.72 total 60.32 last 14.97)
 - mkdir 966 (time 1787114914.84 total 70.45 last 11.65)
total: 1000 mkdir in 74.29 seconds: 13.46 ops/second
 - mkdir 158 (time 1787114855.14 total 10.02 last 15.77)
 - mkdir 296 (time 1787114865.22 total 20.10 last 13.69)
 - mkdir 433 (time 1787114875.28 total 30.15 last 13.63)
 - mkdir 565 (time 1787114885.30 total 40.18 last 13.16)
 - mkdir 701 (time 1787114895.31 total 50.19 last 13.59)
 - mkdir 841 (time 1787114905.31 total 60.19 last 14.00)
 - mkdir 964 (time 1787114915.40 total 70.28 last 12.19)
total: 1000 mkdir in 74.30 seconds: 13.46 ops/second
 - mkdir 159 (time 1787114855.60 total 10.02 last 15.87)
 - mkdir 295 (time 1787114865.62 total 20.05 last 13.56)
 - mkdir 432 (time 1787114875.66 total 30.08 last 13.65)
 - mkdir 564 (time 1787114885.69 total 40.11 last 13.16)
 - mkdir 703 (time 1787114895.74 total 50.17 last 13.82)
 - mkdir 849 (time 1787114905.76 total 60.18 last 14.57)
 - mkdir 966 (time 1787114915.77 total 70.20 last 11.69)
total: 1000 mkdir in 74.74 seconds: 13.38 ops/second
 - mkdir 160 (time 1787114855.49 total 10.08 last 15.88)
 - mkdir 295 (time 1787114865.60 total 20.19 last 13.35)
 - mkdir 429 (time 1787114875.65 total 30.24 last 13.33)
 - mkdir 563 (time 1787114885.70 total 40.28 last 13.34)
 - mkdir 703 (time 1787114895.76 total 50.35 last 13.91)
 - mkdir 848 (time 1787114905.81 total 60.39 last 14.43)
 - mkdir 969 (time 1787114915.85 total 70.43 last 12.06)
total: 1000 mkdir in 74.94 seconds: 13.34 ops/second
 - mkdir 161 (time 1787114855.67 total 10.01 last 16.08)
 - mkdir 294 (time 1787114865.68 total 20.03 last 13.28)
 - mkdir 427 (time 1787114875.71 total 30.06 last 13.26)
 - mkdir 559 (time 1787114885.73 total 40.08 last 13.17)
 - mkdir 697 (time 1787114895.80 total 50.14 last 13.71)
 - mkdir 845 (time 1787114905.83 total 60.18 last 14.75)
 - mkdir 964 (time 1787114915.85 total 70.19 last 11.89)
total: 1000 mkdir in 75.03 seconds: 13.33 ops/second
 - mkdir 151 (time 1787114855.32 total 10.05 last 15.03)
 - mkdir 282 (time 1787114865.37 total 20.09 last 13.04)
 - mkdir 413 (time 1787114875.40 total 30.13 last 13.06)
 - mkdir 550 (time 1787114885.42 total 40.14 last 13.68)
 - mkdir 686 (time 1787114895.43 total 50.16 last 13.58)
 - mkdir 834 (time 1787114905.45 total 60.17 last 14.78)
 - mkdir 955 (time 1787114915.50 total 70.22 last 12.04)
total: 1000 mkdir in 77.04 seconds: 12.98 ops/second
 - mkdir 147 (time 1787114855.32 total 10.01 last 14.69)
 - mkdir 277 (time 1787114865.33 total 20.01 last 12.99)
 - mkdir 407 (time 1787114875.42 total 30.10 last 12.88)
 - mkdir 541 (time 1787114885.43 total 40.12 last 13.38)
 - mkdir 681 (time 1787114895.45 total 50.14 last 13.97)
 - mkdir 829 (time 1787114905.49 total 60.18 last 14.74)
 - mkdir 949 (time 1787114915.54 total 70.22 last 11.94)
total: 1000 mkdir in 77.47 seconds: 12.91 ops/second
Time for file creation 87 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 17 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.62 seconds: 16.02 ops/second
 - mkdir 142 (time 1787115550.34 total 10.04 last 14.14)
 - mkdir 280 (time 1787115560.39 total 20.10 last 13.73)
 - mkdir 429 (time 1787115570.45 total 30.16 last 14.81)
 - mkdir 575 (time 1787115580.53 total 40.24 last 14.48)
 - mkdir 723 (time 1787115590.55 total 50.25 last 14.78)
 - mkdir 853 (time 1787115600.56 total 60.27 last 12.98)
 - mkdir 990 (time 1787115610.62 total 70.33 last 13.62)
total: 1000 mkdir in 70.97 seconds: 14.09 ops/second
 - mkdir 145 (time 1787115551.54 total 10.04 last 14.45)
 - mkdir 290 (time 1787115561.57 total 20.07 last 14.46)
 - mkdir 441 (time 1787115571.59 total 30.09 last 15.07)
 - mkdir 586 (time 1787115581.63 total 40.12 last 14.45)
 - mkdir 744 (time 1787115591.66 total 50.15 last 15.75)
 - mkdir 863 (time 1787115601.72 total 60.22 last 11.83)
 - mkdir 999 (time 1787115611.80 total 70.30 last 13.49)
total: 1000 mkdir in 70.30 seconds: 14.23 ops/second
 - mkdir 145 (time 1787115552.22 total 10.04 last 14.44)
 - mkdir 290 (time 1787115562.22 total 20.04 last 14.50)
 - mkdir 440 (time 1787115572.27 total 30.09 last 14.92)
 - mkdir 591 (time 1787115582.32 total 40.14 last 15.03)
 - mkdir 745 (time 1787115592.43 total 50.25 last 15.23)
 - mkdir 865 (time 1787115602.44 total 60.26 last 11.99)
 - mkdir 994 (time 1787115612.57 total 70.39 last 12.73)
total: 1000 mkdir in 71.10 seconds: 14.06 ops/second
 - mkdir 140 (time 1787115547.38 total 10.02 last 13.97)
 - mkdir 270 (time 1787115557.40 total 20.04 last 12.97)
 - mkdir 404 (time 1787115567.43 total 30.07 last 13.36)
 - mkdir 544 (time 1787115577.44 total 40.08 last 13.98)
 - mkdir 671 (time 1787115587.47 total 50.11 last 12.66)
 - mkdir 804 (time 1787115597.50 total 60.14 last 13.26)
 - mkdir 927 (time 1787115607.53 total 70.17 last 12.25)
total: 1000 mkdir in 76.59 seconds: 13.06 ops/second
 - mkdir 134 (time 1787115549.69 total 10.02 last 13.38)
 - mkdir 265 (time 1787115559.72 total 20.05 last 13.06)
 - mkdir 407 (time 1787115569.75 total 30.07 last 14.16)
 - mkdir 557 (time 1787115579.80 total 40.13 last 14.92)
 - mkdir 694 (time 1787115589.88 total 50.21 last 13.59)
 - mkdir 827 (time 1787115599.97 total 60.30 last 13.18)
 - mkdir 957 (time 1787115610.01 total 70.34 last 12.94)
total: 1000 mkdir in 74.64 seconds: 13.40 ops/second
 - mkdir 149 (time 1787115551.80 total 10.02 last 14.88)
 - mkdir 289 (time 1787115561.81 total 20.03 last 13.98)
 - mkdir 431 (time 1787115571.84 total 30.05 last 14.16)
 - mkdir 573 (time 1787115581.85 total 40.06 last 14.19)
 - mkdir 731 (time 1787115591.91 total 50.13 last 15.70)
 - mkdir 844 (time 1787115601.91 total 60.13 last 11.30)
 - mkdir 975 (time 1787115611.92 total 70.14 last 13.09)
total: 1000 mkdir in 73.42 seconds: 13.62 ops/second
 - mkdir 143 (time 1787115551.86 total 10.01 last 14.29)
 - mkdir 283 (time 1787115561.91 total 20.06 last 13.93)
 - mkdir 431 (time 1787115571.93 total 30.08 last 14.77)
 - mkdir 574 (time 1787115581.98 total 40.13 last 14.23)
 - mkdir 733 (time 1787115592.00 total 50.15 last 15.86)
 - mkdir 845 (time 1787115602.03 total 60.18 last 11.17)
 - mkdir 977 (time 1787115612.17 total 70.32 last 13.02)
total: 1000 mkdir in 73.58 seconds: 13.59 ops/second
 - mkdir 139 (time 1787115551.48 total 10.05 last 13.82)
 - mkdir 278 (time 1787115561.51 total 20.09 last 13.86)
 - mkdir 418 (time 1787115571.54 total 30.11 last 13.97)
 - mkdir 553 (time 1787115581.58 total 40.15 last 13.44)
 - mkdir 708 (time 1787115591.61 total 50.18 last 15.46)
 - mkdir 825 (time 1787115601.64 total 60.21 last 11.66)
 - mkdir 963 (time 1787115611.66 total 70.23 last 13.78)
total: 1000 mkdir in 75.28 seconds: 13.28 ops/second
 - mkdir 140 (time 1787115551.01 total 10.04 last 13.95)
 - mkdir 275 (time 1787115561.04 total 20.06 last 13.47)
 - mkdir 417 (time 1787115571.07 total 30.10 last 14.15)
 - mkdir 561 (time 1787115581.08 total 40.11 last 14.38)
 - mkdir 706 (time 1787115591.11 total 50.13 last 14.47)
 - mkdir 826 (time 1787115601.11 total 60.14 last 11.99)
 - mkdir 960 (time 1787115611.18 total 70.20 last 13.31)
total: 1000 mkdir in 75.77 seconds: 13.20 ops/second
 - mkdir 136 (time 1787115552.05 total 10.12 last 13.44)
 - mkdir 273 (time 1787115562.10 total 20.18 last 13.62)
 - mkdir 414 (time 1787115572.11 total 30.18 last 14.09)
 - mkdir 553 (time 1787115582.16 total 40.24 last 13.83)
 - mkdir 707 (time 1787115592.25 total 50.33 last 15.26)
 - mkdir 819 (time 1787115602.28 total 60.35 last 11.18)
 - mkdir 951 (time 1787115612.49 total 70.56 last 12.93)
total: 1000 mkdir in 76.67 seconds: 13.04 ops/second
Time for file creation 89 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787115626 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787115627 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787115628 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787115629 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787115628 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1787115629 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787115629 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1787115629 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1787115629 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787115629 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
Time for file removal 51 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8