== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 00:00:56 (1787803256)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.48 seconds: 20.69 ops/second
 - mkdir 151 (time 1787803276.51 total 10.01 last 15.09)
 - mkdir 317 (time 1787803286.52 total 20.01 last 16.60)
 - mkdir 482 (time 1787803296.57 total 30.07 last 16.41)
 - mkdir 653 (time 1787803306.60 total 40.09 last 17.06)
 - mkdir 809 (time 1787803316.60 total 50.09 last 15.59)
 - mkdir 957 (time 1787803326.67 total 60.17 last 14.69)
total: 1000 mkdir in 62.38 seconds: 16.03 ops/second
 - mkdir 167 (time 1787803278.67 total 10.02 last 16.67)
 - mkdir 333 (time 1787803288.70 total 20.04 last 16.56)
 - mkdir 505 (time 1787803298.71 total 30.05 last 17.18)
 - mkdir 681 (time 1787803308.71 total 40.06 last 17.59)
 - mkdir 833 (time 1787803318.72 total 50.06 last 15.19)
 - mkdir 987 (time 1787803328.74 total 60.09 last 15.36)
total: 1000 mkdir in 61.45 seconds: 16.27 ops/second
 - mkdir 161 (time 1787803278.84 total 10.01 last 16.09)
 - mkdir 320 (time 1787803288.87 total 20.03 last 15.86)
 - mkdir 489 (time 1787803298.90 total 30.06 last 16.85)
 - mkdir 671 (time 1787803308.91 total 40.08 last 18.17)
 - mkdir 829 (time 1787803318.94 total 50.10 last 15.76)
 - mkdir 986 (time 1787803329.02 total 60.19 last 15.57)
total: 1000 mkdir in 62.17 seconds: 16.08 ops/second
 - mkdir 161 (time 1787803279.82 total 10.03 last 16.05)
 - mkdir 326 (time 1787803289.89 total 20.11 last 16.38)
 - mkdir 494 (time 1787803299.91 total 30.13 last 16.76)
 - mkdir 668 (time 1787803309.96 total 40.18 last 17.32)
 - mkdir 821 (time 1787803319.96 total 50.18 last 15.29)
 - mkdir 973 (time 1787803330.04 total 60.26 last 15.09)
total: 1000 mkdir in 65.49 seconds: 15.27 ops/second
 - mkdir 159 (time 1787803280.11 total 10.13 last 15.70)
 - mkdir 328 (time 1787803290.11 total 20.14 last 16.89)
 - mkdir 481 (time 1787803300.15 total 30.17 last 15.24)
 - mkdir 653 (time 1787803310.17 total 40.19 last 17.17)
 - mkdir 809 (time 1787803320.19 total 50.21 last 15.57)
 - mkdir 956 (time 1787803330.20 total 60.22 last 14.69)
total: 1000 mkdir in 67.73 seconds: 14.76 ops/second
 - mkdir 161 (time 1787803279.87 total 10.03 last 16.06)
 - mkdir 322 (time 1787803289.93 total 20.08 last 16.01)
 - mkdir 486 (time 1787803299.95 total 30.11 last 16.35)
 - mkdir 658 (time 1787803309.97 total 40.12 last 17.18)
 - mkdir 809 (time 1787803320.03 total 50.18 last 15.01)
 - mkdir 957 (time 1787803330.11 total 60.27 last 14.68)
total: 1000 mkdir in 68.02 seconds: 14.70 ops/second
 - mkdir 164 (time 1787803280.25 total 10.00 last 16.40)
 - mkdir 328 (time 1787803290.26 total 20.01 last 16.39)
 - mkdir 486 (time 1787803300.29 total 30.04 last 15.76)
 - mkdir 659 (time 1787803310.35 total 40.10 last 17.19)
 - mkdir 813 (time 1787803320.39 total 50.14 last 15.34)
 - mkdir 958 (time 1787803330.41 total 60.16 last 14.46)
total: 1000 mkdir in 67.96 seconds: 14.72 ops/second
 - mkdir 158 (time 1787803280.20 total 10.03 last 15.75)
 - mkdir 321 (time 1787803290.21 total 20.04 last 16.29)
 - mkdir 483 (time 1787803300.22 total 30.04 last 16.19)
 - mkdir 658 (time 1787803310.25 total 40.08 last 17.44)
 - mkdir 809 (time 1787803320.29 total 50.12 last 15.04)
 - mkdir 955 (time 1787803330.29 total 60.12 last 14.60)
total: 1000 mkdir in 68.29 seconds: 14.64 ops/second
 - mkdir 148 (time 1787803279.36 total 10.09 last 14.67)
 - mkdir 305 (time 1787803289.41 total 20.13 last 15.63)
 - mkdir 460 (time 1787803299.44 total 30.16 last 15.45)
 - mkdir 634 (time 1787803309.50 total 40.22 last 17.30)
 - mkdir 791 (time 1787803319.55 total 50.27 last 15.62)
 - mkdir 945 (time 1787803329.60 total 60.33 last 15.31)
total: 1000 mkdir in 69.62 seconds: 14.36 ops/second
 - mkdir 153 (time 1787803279.80 total 10.04 last 15.24)
 - mkdir 309 (time 1787803289.87 total 20.11 last 15.49)
 - mkdir 460 (time 1787803299.88 total 30.11 last 15.09)
 - mkdir 637 (time 1787803309.88 total 40.12 last 17.69)
 - mkdir 790 (time 1787803319.94 total 50.18 last 15.21)
 - mkdir 940 (time 1787803329.99 total 60.22 last 14.93)
total: 1000 mkdir in 69.49 seconds: 14.39 ops/second
Time for file creation 82 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.69 seconds: 14.47 ops/second
 - mkdir 95 (time 1787803941.85 total 10.13 last 9.37)
 - mkdir 195 (time 1787803951.88 total 20.17 last 9.97)
 - mkdir 328 (time 1787803961.91 total 30.20 last 13.26)
 - mkdir 463 (time 1787803971.92 total 40.21 last 13.48)
 - mkdir 600 (time 1787803981.95 total 50.24 last 13.66)
 - mkdir 739 (time 1787803992.05 total 60.34 last 13.76)
 - mkdir 898 (time 1787804002.12 total 70.41 last 15.79)
total: 1000 mkdir in 76.21 seconds: 13.12 ops/second
 - mkdir 104 (time 1787803942.94 total 10.12 last 10.28)
 - mkdir 204 (time 1787803953.05 total 20.23 last 9.89)
 - mkdir 336 (time 1787803963.09 total 30.26 last 13.15)
 - mkdir 467 (time 1787803973.16 total 40.33 last 13.01)
 - mkdir 600 (time 1787803983.22 total 50.40 last 13.21)
 - mkdir 742 (time 1787803993.23 total 60.40 last 14.19)
 - mkdir 900 (time 1787804003.24 total 70.42 last 15.78)
total: 1000 mkdir in 76.78 seconds: 13.02 ops/second
 - mkdir 93 (time 1787803940.54 total 10.04 last 9.26)
 - mkdir 195 (time 1787803950.72 total 20.22 last 10.02)
 - mkdir 310 (time 1787803960.78 total 30.29 last 11.43)
 - mkdir 441 (time 1787803970.93 total 40.44 last 12.91)
 - mkdir 578 (time 1787803980.97 total 50.47 last 13.65)
 - mkdir 716 (time 1787803990.99 total 60.50 last 13.77)
 - mkdir 876 (time 1787804001.07 total 70.57 last 15.87)
total: 1000 mkdir in 79.11 seconds: 12.64 ops/second
 - mkdir 106 (time 1787803943.99 total 10.01 last 10.59)
 - mkdir 209 (time 1787803954.04 total 20.06 last 10.25)
 - mkdir 341 (time 1787803964.08 total 30.10 last 13.15)
 - mkdir 475 (time 1787803974.13 total 40.15 last 13.34)
 - mkdir 612 (time 1787803984.19 total 50.21 last 13.61)
 - mkdir 757 (time 1787803994.20 total 60.22 last 14.48)
 - mkdir 918 (time 1787804004.22 total 70.24 last 16.08)
total: 1000 mkdir in 75.83 seconds: 13.19 ops/second
 - mkdir 99 (time 1787803943.42 total 10.17 last 9.73)
 - mkdir 200 (time 1787803953.44 total 20.20 last 10.08)
 - mkdir 332 (time 1787803963.48 total 30.23 last 13.15)
 - mkdir 459 (time 1787803973.51 total 40.27 last 12.66)
 - mkdir 594 (time 1787803983.54 total 50.29 last 13.47)
 - mkdir 736 (time 1787803993.58 total 60.33 last 14.14)
 - mkdir 897 (time 1787804003.62 total 70.37 last 16.04)
total: 1000 mkdir in 77.36 seconds: 12.93 ops/second
 - mkdir 92 (time 1787803943.42 total 10.00 last 9.20)
 - mkdir 192 (time 1787803953.44 total 20.02 last 9.98)
 - mkdir 324 (time 1787803963.49 total 30.07 last 13.14)
 - mkdir 455 (time 1787803973.49 total 40.08 last 13.09)
 - mkdir 595 (time 1787803983.52 total 50.10 last 13.96)
 - mkdir 740 (time 1787803993.64 total 60.22 last 14.33)
 - mkdir 900 (time 1787804003.66 total 70.24 last 15.97)
total: 1000 mkdir in 77.89 seconds: 12.84 ops/second
 - mkdir 104 (time 1787803944.13 total 10.01 last 10.39)
 - mkdir 202 (time 1787803954.16 total 20.04 last 9.77)
 - mkdir 335 (time 1787803964.23 total 30.11 last 13.20)
 - mkdir 469 (time 1787803974.42 total 40.30 last 13.15)
 - mkdir 607 (time 1787803984.47 total 50.35 last 13.73)
 - mkdir 753 (time 1787803994.50 total 60.38 last 14.56)
 - mkdir 910 (time 1787804004.52 total 70.40 last 15.67)
total: 1000 mkdir in 78.88 seconds: 12.68 ops/second
 - mkdir 99 (time 1787803944.08 total 10.01 last 9.89)
 - mkdir 194 (time 1787803954.10 total 20.03 last 9.48)
 - mkdir 324 (time 1787803964.15 total 30.09 last 12.93)
 - mkdir 457 (time 1787803974.23 total 40.16 last 13.20)
 - mkdir 591 (time 1787803984.24 total 50.17 last 13.39)
 - mkdir 735 (time 1787803994.30 total 60.24 last 14.31)
 - mkdir 902 (time 1787804004.32 total 70.25 last 16.67)
total: 1000 mkdir in 79.14 seconds: 12.64 ops/second
 - mkdir 94 (time 1787803943.90 total 10.06 last 9.35)
 - mkdir 192 (time 1787803953.95 total 20.10 last 9.76)
 - mkdir 321 (time 1787803964.01 total 30.16 last 12.82)
 - mkdir 450 (time 1787803974.01 total 40.17 last 12.90)
 - mkdir 585 (time 1787803984.02 total 50.18 last 13.48)
 - mkdir 725 (time 1787803994.09 total 60.25 last 13.91)
 - mkdir 874 (time 1787804004.10 total 70.26 last 14.89)
 - mkdir 981 (time 1787804014.15 total 80.31 last 10.65)
total: 1000 mkdir in 81.92 seconds: 12.21 ops/second
 - mkdir 89 (time 1787803943.33 total 10.11 last 8.80)
 - mkdir 180 (time 1787803953.40 total 20.18 last 9.04)
 - mkdir 308 (time 1787803963.41 total 30.20 last 12.78)
 - mkdir 441 (time 1787803973.45 total 40.23 last 13.26)
 - mkdir 576 (time 1787803983.49 total 50.28 last 13.44)
 - mkdir 715 (time 1787803993.55 total 60.33 last 13.82)
 - mkdir 866 (time 1787804003.57 total 70.35 last 15.07)
 - mkdir 977 (time 1787804013.63 total 80.42 last 11.03)
total: 1000 mkdir in 82.68 seconds: 12.09 ops/second
Time for file creation 97 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787804029 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787804029 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787804029 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787804030 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787804030 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787804030 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787804030 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787804031 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787804030 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787804030 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
Time for file removal 44 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8