== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 23:03:52 (1787454232)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.72 seconds: 13.82 ops/second
 - mkdir 177 (time 1787454255.89 total 10.06 last 17.59)
 - mkdir 399 (time 1787454265.92 total 20.09 last 22.14)
 - mkdir 592 (time 1787454275.95 total 30.12 last 19.25)
 - mkdir 823 (time 1787454285.97 total 40.14 last 23.05)
 - mkdir 999 (time 1787454295.98 total 50.15 last 17.59)
total: 1000 mkdir in 50.15 seconds: 19.94 ops/second
 - mkdir 172 (time 1787454257.13 total 10.08 last 17.07)
 - mkdir 401 (time 1787454267.16 total 20.11 last 22.83)
 - mkdir 616 (time 1787454277.21 total 30.15 last 21.40)
 - mkdir 835 (time 1787454287.22 total 40.16 last 21.88)
total: 1000 mkdir in 49.93 seconds: 20.03 ops/second
 - mkdir 178 (time 1787454256.66 total 10.06 last 17.70)
 - mkdir 400 (time 1787454266.66 total 20.06 last 22.20)
 - mkdir 606 (time 1787454276.67 total 30.07 last 20.58)
 - mkdir 820 (time 1787454286.69 total 40.08 last 21.36)
 - mkdir 994 (time 1787454296.71 total 50.11 last 17.35)
total: 1000 mkdir in 50.57 seconds: 19.77 ops/second
 - mkdir 167 (time 1787454256.28 total 10.01 last 16.68)
 - mkdir 396 (time 1787454266.31 total 20.04 last 22.84)
 - mkdir 593 (time 1787454276.33 total 30.05 last 19.67)
 - mkdir 810 (time 1787454286.34 total 40.07 last 21.66)
 - mkdir 989 (time 1787454296.45 total 50.18 last 17.71)
total: 1000 mkdir in 51.19 seconds: 19.54 ops/second
 - mkdir 171 (time 1787454256.73 total 10.09 last 16.94)
 - mkdir 399 (time 1787454266.75 total 20.11 last 22.76)
 - mkdir 608 (time 1787454276.79 total 30.14 last 20.82)
 - mkdir 820 (time 1787454286.80 total 40.16 last 21.16)
 - mkdir 990 (time 1787454296.83 total 50.18 last 16.96)
total: 1000 mkdir in 51.10 seconds: 19.57 ops/second
 - mkdir 174 (time 1787454257.41 total 10.06 last 17.29)
 - mkdir 398 (time 1787454267.43 total 20.08 last 22.36)
 - mkdir 612 (time 1787454277.45 total 30.10 last 21.36)
 - mkdir 829 (time 1787454287.48 total 40.13 last 21.64)
 - mkdir 995 (time 1787454297.55 total 50.20 last 16.49)
total: 1000 mkdir in 50.71 seconds: 19.72 ops/second
 - mkdir 168 (time 1787454256.89 total 10.03 last 16.75)
 - mkdir 397 (time 1787454266.90 total 20.04 last 22.87)
 - mkdir 607 (time 1787454276.91 total 30.05 last 20.98)
 - mkdir 816 (time 1787454286.92 total 40.05 last 20.90)
 - mkdir 985 (time 1787454296.94 total 50.08 last 16.85)
total: 1000 mkdir in 51.57 seconds: 19.39 ops/second
 - mkdir 169 (time 1787454257.25 total 10.04 last 16.83)
 - mkdir 400 (time 1787454267.32 total 20.11 last 22.95)
 - mkdir 606 (time 1787454277.35 total 30.14 last 20.54)
 - mkdir 820 (time 1787454287.40 total 40.19 last 21.28)
 - mkdir 985 (time 1787454297.55 total 50.34 last 16.27)
total: 1000 mkdir in 51.80 seconds: 19.31 ops/second
 - mkdir 170 (time 1787454257.39 total 10.04 last 16.94)
 - mkdir 396 (time 1787454267.44 total 20.09 last 22.48)
 - mkdir 603 (time 1787454277.49 total 30.13 last 20.61)
 - mkdir 809 (time 1787454287.54 total 40.19 last 20.49)
 - mkdir 973 (time 1787454297.59 total 50.24 last 16.32)
total: 1000 mkdir in 53.25 seconds: 18.78 ops/second
 - mkdir 157 (time 1787454255.99 total 10.00 last 15.70)
 - mkdir 377 (time 1787454266.06 total 20.07 last 21.85)
 - mkdir 566 (time 1787454276.08 total 30.09 last 18.85)
 - mkdir 782 (time 1787454286.16 total 40.17 last 21.43)
 - mkdir 956 (time 1787454296.17 total 50.18 last 17.39)
total: 1000 mkdir in 54.97 seconds: 18.19 ops/second
Time for file creation 67 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.43 seconds: 23.37 ops/second
 - mkdir 175 (time 1787454797.27 total 10.02 last 17.47)
 - mkdir 375 (time 1787454807.29 total 20.04 last 19.96)
 - mkdir 540 (time 1787454817.32 total 30.06 last 16.46)
 - mkdir 744 (time 1787454827.33 total 40.07 last 20.38)
 - mkdir 913 (time 1787454837.35 total 50.09 last 16.87)
total: 1000 mkdir in 55.50 seconds: 18.02 ops/second
 - mkdir 155 (time 1787454795.60 total 10.02 last 15.47)
 - mkdir 362 (time 1787454805.61 total 20.03 last 20.68)
 - mkdir 515 (time 1787454815.62 total 30.05 last 15.27)
 - mkdir 715 (time 1787454825.65 total 40.08 last 19.94)
 - mkdir 884 (time 1787454835.68 total 50.10 last 16.86)
total: 1000 mkdir in 57.23 seconds: 17.47 ops/second
 - mkdir 170 (time 1787454797.02 total 10.01 last 16.99)
 - mkdir 365 (time 1787454807.05 total 20.04 last 19.43)
 - mkdir 534 (time 1787454817.09 total 30.08 last 16.84)
 - mkdir 734 (time 1787454827.09 total 40.08 last 20.00)
 - mkdir 899 (time 1787454837.09 total 50.08 last 16.49)
total: 1000 mkdir in 56.61 seconds: 17.67 ops/second
 - mkdir 162 (time 1787454796.41 total 10.04 last 16.13)
 - mkdir 360 (time 1787454806.42 total 20.05 last 19.79)
 - mkdir 524 (time 1787454816.48 total 30.11 last 16.30)
 - mkdir 724 (time 1787454826.52 total 40.15 last 19.93)
 - mkdir 889 (time 1787454836.63 total 50.26 last 16.31)
total: 1000 mkdir in 57.53 seconds: 17.38 ops/second
 - mkdir 164 (time 1787454796.81 total 10.04 last 16.34)
 - mkdir 359 (time 1787454806.84 total 20.07 last 19.44)
 - mkdir 520 (time 1787454816.88 total 30.11 last 16.03)
 - mkdir 721 (time 1787454826.91 total 40.14 last 20.05)
 - mkdir 887 (time 1787454836.92 total 50.15 last 16.58)
total: 1000 mkdir in 57.69 seconds: 17.33 ops/second
 - mkdir 146 (time 1787454794.93 total 10.01 last 14.59)
 - mkdir 347 (time 1787454804.96 total 20.04 last 20.04)
 - mkdir 498 (time 1787454814.97 total 30.05 last 15.08)
 - mkdir 698 (time 1787454824.97 total 40.05 last 20.00)
 - mkdir 859 (time 1787454834.98 total 50.05 last 16.09)
total: 1000 mkdir in 59.62 seconds: 16.77 ops/second
 - mkdir 174 (time 1787454796.82 total 10.02 last 17.36)
 - mkdir 366 (time 1787454806.85 total 20.06 last 19.13)
 - mkdir 527 (time 1787454816.90 total 30.11 last 16.02)
 - mkdir 724 (time 1787454826.91 total 40.11 last 19.70)
 - mkdir 889 (time 1787454836.99 total 50.19 last 16.37)
total: 1000 mkdir in 57.81 seconds: 17.30 ops/second
 - mkdir 172 (time 1787454797.18 total 10.03 last 17.15)
 - mkdir 365 (time 1787454807.20 total 20.05 last 19.27)
 - mkdir 527 (time 1787454817.21 total 30.06 last 16.18)
 - mkdir 728 (time 1787454827.27 total 40.12 last 19.98)
 - mkdir 892 (time 1787454837.30 total 50.15 last 16.34)
total: 1000 mkdir in 57.60 seconds: 17.36 ops/second
 - mkdir 166 (time 1787454797.25 total 10.01 last 16.58)
 - mkdir 355 (time 1787454807.26 total 20.02 last 18.88)
 - mkdir 516 (time 1787454817.29 total 30.05 last 16.05)
 - mkdir 712 (time 1787454827.33 total 40.09 last 19.52)
 - mkdir 874 (time 1787454837.34 total 50.11 last 16.17)
total: 1000 mkdir in 59.29 seconds: 16.87 ops/second
 - mkdir 158 (time 1787454796.81 total 10.02 last 15.77)
 - mkdir 342 (time 1787454806.88 total 20.09 last 18.27)
 - mkdir 499 (time 1787454816.90 total 30.11 last 15.66)
 - mkdir 693 (time 1787454826.92 total 40.13 last 19.36)
 - mkdir 848 (time 1787454837.01 total 50.22 last 15.36)
 - mkdir 971 (time 1787454847.10 total 60.31 last 12.19)
total: 1000 mkdir in 62.60 seconds: 15.97 ops/second
Time for file creation 74 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787454860 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787454859 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787454860 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787454861 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787454861 ; total 1 ; last 1)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787454860 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787454861 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787454861 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787454860 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787454861 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
Time for file removal 44 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8