== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 00:39:04 (1787114344)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.47 seconds: 21.28 ops/second
 - mkdir 211 (time 1787114365.63 total 10.04 last 21.02)
 - mkdir 428 (time 1787114375.70 total 20.11 last 21.55)
 - mkdir 642 (time 1787114385.80 total 30.20 last 21.20)
 - mkdir 820 (time 1787114395.82 total 40.22 last 17.76)
total: 1000 mkdir in 48.38 seconds: 20.67 ops/second
 - mkdir 209 (time 1787114365.52 total 10.01 last 20.87)
 - mkdir 417 (time 1787114375.56 total 20.05 last 20.72)
 - mkdir 626 (time 1787114385.63 total 30.12 last 20.76)
 - mkdir 804 (time 1787114395.63 total 40.12 last 17.80)
total: 1000 mkdir in 49.46 seconds: 20.22 ops/second
 - mkdir 201 (time 1787114365.23 total 10.02 last 20.05)
 - mkdir 408 (time 1787114375.25 total 20.04 last 20.67)
 - mkdir 621 (time 1787114385.26 total 30.05 last 21.27)
 - mkdir 801 (time 1787114395.29 total 40.08 last 17.94)
total: 1000 mkdir in 49.86 seconds: 20.06 ops/second
 - mkdir 213 (time 1787114366.63 total 10.01 last 21.27)
 - mkdir 425 (time 1787114376.66 total 20.05 last 21.13)
 - mkdir 639 (time 1787114386.71 total 30.10 last 21.30)
 - mkdir 825 (time 1787114396.75 total 40.14 last 18.52)
total: 1000 mkdir in 48.51 seconds: 20.61 ops/second
 - mkdir 216 (time 1787114365.96 total 10.04 last 21.52)
 - mkdir 425 (time 1787114376.00 total 20.08 last 20.81)
 - mkdir 635 (time 1787114386.01 total 30.08 last 20.99)
 - mkdir 816 (time 1787114396.04 total 40.11 last 18.05)
total: 1000 mkdir in 49.25 seconds: 20.31 ops/second
 - mkdir 211 (time 1787114366.10 total 10.01 last 21.09)
 - mkdir 415 (time 1787114376.14 total 20.04 last 20.33)
 - mkdir 621 (time 1787114386.18 total 30.08 last 20.51)
 - mkdir 807 (time 1787114396.22 total 40.12 last 18.53)
total: 1000 mkdir in 49.32 seconds: 20.28 ops/second
 - mkdir 205 (time 1787114366.43 total 10.01 last 20.48)
 - mkdir 411 (time 1787114376.48 total 20.05 last 20.51)
 - mkdir 617 (time 1787114386.56 total 30.13 last 20.43)
 - mkdir 807 (time 1787114396.59 total 40.17 last 18.94)
total: 1000 mkdir in 49.95 seconds: 20.02 ops/second
 - mkdir 206 (time 1787114366.48 total 10.01 last 20.58)
 - mkdir 417 (time 1787114376.51 total 20.03 last 21.05)
 - mkdir 623 (time 1787114386.57 total 30.10 last 20.46)
 - mkdir 805 (time 1787114396.59 total 40.11 last 18.17)
total: 1000 mkdir in 50.02 seconds: 19.99 ops/second
 - mkdir 197 (time 1787114366.41 total 10.01 last 19.67)
 - mkdir 399 (time 1787114376.41 total 20.02 last 20.18)
 - mkdir 595 (time 1787114386.46 total 30.06 last 19.52)
 - mkdir 778 (time 1787114396.47 total 40.08 last 18.27)
 - mkdir 979 (time 1787114406.50 total 50.11 last 20.05)
total: 1000 mkdir in 51.83 seconds: 19.29 ops/second
 - mkdir 205 (time 1787114366.32 total 10.05 last 20.39)
 - mkdir 407 (time 1787114376.35 total 20.08 last 20.15)
 - mkdir 606 (time 1787114386.40 total 30.13 last 19.80)
 - mkdir 783 (time 1787114396.41 total 40.14 last 17.68)
 - mkdir 978 (time 1787114406.48 total 50.20 last 19.37)
total: 1000 mkdir in 52.06 seconds: 19.21 ops/second
Time for file creation 63 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.78 seconds: 12.89 ops/second
 - mkdir 146 (time 1787114950.78 total 10.02 last 14.57)
 - mkdir 306 (time 1787114960.82 total 20.06 last 15.94)
 - mkdir 498 (time 1787114970.83 total 30.07 last 19.17)
 - mkdir 619 (time 1787114980.92 total 40.17 last 11.99)
 - mkdir 734 (time 1787114991.03 total 50.27 last 11.38)
 - mkdir 852 (time 1787115001.07 total 60.32 last 11.75)
 - mkdir 969 (time 1787115011.17 total 70.41 last 11.59)
total: 1000 mkdir in 72.48 seconds: 13.80 ops/second
 - mkdir 152 (time 1787114952.19 total 10.01 last 15.19)
 - mkdir 327 (time 1787114962.23 total 20.04 last 17.44)
 - mkdir 510 (time 1787114972.28 total 30.10 last 18.20)
 - mkdir 631 (time 1787114982.31 total 40.12 last 12.07)
 - mkdir 735 (time 1787114992.32 total 50.14 last 10.39)
 - mkdir 865 (time 1787115002.37 total 60.19 last 12.94)
 - mkdir 983 (time 1787115012.40 total 70.22 last 11.76)
total: 1000 mkdir in 71.55 seconds: 13.98 ops/second
 - mkdir 162 (time 1787114953.81 total 10.01 last 16.18)
 - mkdir 359 (time 1787114963.83 total 20.03 last 19.66)
 - mkdir 526 (time 1787114973.86 total 30.07 last 16.65)
 - mkdir 639 (time 1787114983.86 total 40.07 last 11.30)
 - mkdir 751 (time 1787114993.91 total 50.11 last 11.15)
 - mkdir 875 (time 1787115003.98 total 60.19 last 12.31)
 - mkdir 995 (time 1787115014.06 total 70.26 last 11.91)
total: 1000 mkdir in 70.85 seconds: 14.11 ops/second
 - mkdir 147 (time 1787114952.92 total 10.06 last 14.61)
 - mkdir 330 (time 1787114962.94 total 20.08 last 18.26)
 - mkdir 502 (time 1787114972.96 total 30.11 last 17.16)
 - mkdir 624 (time 1787114983.00 total 40.15 last 12.15)
 - mkdir 729 (time 1787114993.02 total 50.17 last 10.48)
 - mkdir 852 (time 1787115003.18 total 60.33 last 12.11)
 - mkdir 974 (time 1787115013.23 total 70.38 last 12.13)
total: 1000 mkdir in 73.90 seconds: 13.53 ops/second
 - mkdir 154 (time 1787114953.87 total 10.04 last 15.33)
 - mkdir 344 (time 1787114964.00 total 20.18 last 18.75)
 - mkdir 510 (time 1787114974.02 total 30.20 last 16.57)
 - mkdir 621 (time 1787114984.09 total 40.27 last 11.02)
 - mkdir 731 (time 1787114994.11 total 50.28 last 10.99)
 - mkdir 861 (time 1787115004.19 total 60.37 last 12.89)
 - mkdir 979 (time 1787115014.26 total 70.44 last 11.72)
total: 1000 mkdir in 73.03 seconds: 13.69 ops/second
 - mkdir 154 (time 1787114954.00 total 10.08 last 15.27)
 - mkdir 340 (time 1787114964.03 total 20.11 last 18.55)
 - mkdir 509 (time 1787114974.05 total 30.14 last 16.86)
 - mkdir 627 (time 1787114984.12 total 40.20 last 11.73)
 - mkdir 731 (time 1787114994.16 total 50.24 last 10.36)
 - mkdir 859 (time 1787115004.17 total 60.25 last 12.79)
 - mkdir 976 (time 1787115014.21 total 70.30 last 11.64)
total: 1000 mkdir in 73.47 seconds: 13.61 ops/second
 - mkdir 151 (time 1787114953.65 total 10.04 last 15.04)
 - mkdir 338 (time 1787114963.65 total 20.04 last 18.70)
 - mkdir 503 (time 1787114973.69 total 30.09 last 16.43)
 - mkdir 616 (time 1787114983.74 total 40.13 last 11.25)
 - mkdir 723 (time 1787114993.80 total 50.19 last 10.63)
 - mkdir 854 (time 1787115003.97 total 60.37 last 12.88)
 - mkdir 971 (time 1787115014.07 total 70.46 last 11.59)
total: 1000 mkdir in 74.25 seconds: 13.47 ops/second
 - mkdir 160 (time 1787114953.80 total 10.05 last 15.92)
 - mkdir 347 (time 1787114963.80 total 20.06 last 18.69)
 - mkdir 512 (time 1787114973.81 total 30.06 last 16.49)
 - mkdir 620 (time 1787114983.81 total 40.07 last 10.79)
 - mkdir 723 (time 1787114993.89 total 50.15 last 10.22)
 - mkdir 849 (time 1787115003.93 total 60.18 last 12.55)
 - mkdir 971 (time 1787115014.04 total 70.29 last 12.07)
total: 1000 mkdir in 74.22 seconds: 13.47 ops/second
 - mkdir 149 (time 1787114953.66 total 10.05 last 14.82)
 - mkdir 335 (time 1787114963.68 total 20.07 last 18.57)
 - mkdir 497 (time 1787114973.72 total 30.11 last 16.13)
 - mkdir 607 (time 1787114983.74 total 40.13 last 10.98)
 - mkdir 708 (time 1787114993.75 total 50.14 last 10.09)
 - mkdir 834 (time 1787115003.85 total 60.24 last 12.47)
 - mkdir 954 (time 1787115013.94 total 70.32 last 11.90)
total: 1000 mkdir in 75.67 seconds: 13.22 ops/second
 - mkdir 144 (time 1787114953.13 total 10.01 last 14.38)
 - mkdir 319 (time 1787114963.17 total 20.05 last 17.43)
 - mkdir 481 (time 1787114973.24 total 30.12 last 16.09)
 - mkdir 594 (time 1787114983.34 total 40.22 last 11.19)
 - mkdir 692 (time 1787114993.53 total 50.41 last 9.62)
 - mkdir 810 (time 1787115003.56 total 60.44 last 11.77)
 - mkdir 927 (time 1787115013.68 total 70.56 last 11.56)
total: 1000 mkdir in 77.84 seconds: 12.85 ops/second
Time for file creation 89 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787115026 ; total 1 ; last 1)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787115026 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787115029 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787115029 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787115030 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787115030 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787115030 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1787115030 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1787115030 ; total 1 ; last 1)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1787115030 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
Time for file removal 52 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8