== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:44:46 (1787863486)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.50 seconds: 20.19 ops/second
 - mkdir 130 (time 1787863509.11 total 10.03 last 12.96)
 - mkdir 291 (time 1787863519.16 total 20.08 last 16.02)
 - mkdir 437 (time 1787863529.23 total 30.15 last 14.51)
 - mkdir 567 (time 1787863539.34 total 40.26 last 12.86)
 - mkdir 712 (time 1787863549.35 total 50.27 last 14.48)
 - mkdir 850 (time 1787863559.36 total 60.28 last 13.79)
total: 1000 mkdir in 69.58 seconds: 14.37 ops/second
 - mkdir 126 (time 1787863508.80 total 10.01 last 12.58)
 - mkdir 287 (time 1787863518.84 total 20.06 last 16.03)
 - mkdir 432 (time 1787863528.87 total 30.09 last 14.45)
 - mkdir 563 (time 1787863538.94 total 40.16 last 13.01)
 - mkdir 705 (time 1787863549.00 total 50.22 last 14.12)
 - mkdir 844 (time 1787863559.01 total 60.23 last 13.89)
total: 1000 mkdir in 69.92 seconds: 14.30 ops/second
 - mkdir 124 (time 1787863509.10 total 10.04 last 12.35)
 - mkdir 280 (time 1787863519.17 total 20.11 last 15.49)
 - mkdir 424 (time 1787863529.19 total 30.13 last 14.36)
 - mkdir 558 (time 1787863539.29 total 40.23 last 13.26)
 - mkdir 702 (time 1787863549.34 total 50.28 last 14.33)
 - mkdir 847 (time 1787863559.41 total 60.35 last 14.40)
total: 1000 mkdir in 70.07 seconds: 14.27 ops/second
 - mkdir 130 (time 1787863510.09 total 10.09 last 12.88)
 - mkdir 295 (time 1787863520.13 total 20.13 last 16.44)
 - mkdir 440 (time 1787863530.14 total 30.14 last 14.48)
 - mkdir 571 (time 1787863540.19 total 40.19 last 13.03)
 - mkdir 719 (time 1787863550.25 total 50.25 last 14.71)
 - mkdir 854 (time 1787863560.25 total 60.25 last 13.50)
total: 1000 mkdir in 69.77 seconds: 14.33 ops/second
 - mkdir 126 (time 1787863509.90 total 10.05 last 12.54)
 - mkdir 285 (time 1787863519.91 total 20.06 last 15.88)
 - mkdir 428 (time 1787863529.96 total 30.11 last 14.23)
 - mkdir 558 (time 1787863539.97 total 40.12 last 12.99)
 - mkdir 705 (time 1787863550.01 total 50.16 last 14.64)
 - mkdir 848 (time 1787863560.03 total 60.18 last 14.27)
 - mkdir 994 (time 1787863570.05 total 70.20 last 14.57)
total: 1000 mkdir in 70.61 seconds: 14.16 ops/second
 - mkdir 130 (time 1787863510.55 total 10.04 last 12.94)
 - mkdir 296 (time 1787863520.57 total 20.06 last 16.57)
 - mkdir 434 (time 1787863530.63 total 30.12 last 13.72)
 - mkdir 567 (time 1787863540.70 total 40.19 last 13.21)
 - mkdir 710 (time 1787863550.74 total 50.23 last 14.25)
 - mkdir 849 (time 1787863560.83 total 60.32 last 13.77)
total: 1000 mkdir in 70.27 seconds: 14.23 ops/second
 - mkdir 134 (time 1787863510.71 total 10.05 last 13.34)
 - mkdir 302 (time 1787863520.72 total 20.05 last 16.79)
 - mkdir 445 (time 1787863530.72 total 30.05 last 14.30)
 - mkdir 578 (time 1787863540.74 total 40.08 last 13.27)
 - mkdir 720 (time 1787863550.79 total 50.13 last 14.12)
 - mkdir 856 (time 1787863560.83 total 60.17 last 13.55)
 - mkdir 995 (time 1787863570.98 total 70.32 last 13.69)
total: 1000 mkdir in 70.67 seconds: 14.15 ops/second
 - mkdir 122 (time 1787863509.90 total 10.00 last 12.20)
 - mkdir 279 (time 1787863519.90 total 20.00 last 15.70)
 - mkdir 419 (time 1787863529.93 total 30.03 last 13.96)
 - mkdir 552 (time 1787863539.97 total 40.08 last 13.24)
 - mkdir 698 (time 1787863549.98 total 50.09 last 14.59)
 - mkdir 831 (time 1787863559.99 total 60.09 last 13.30)
 - mkdir 976 (time 1787863570.13 total 70.24 last 14.29)
total: 1000 mkdir in 72.84 seconds: 13.73 ops/second
 - mkdir 123 (time 1787863510.43 total 10.08 last 12.20)
 - mkdir 285 (time 1787863520.44 total 20.09 last 16.18)
 - mkdir 422 (time 1787863530.46 total 30.11 last 13.68)
 - mkdir 551 (time 1787863540.49 total 40.14 last 12.85)
 - mkdir 695 (time 1787863550.51 total 50.16 last 14.37)
 - mkdir 832 (time 1787863560.57 total 60.22 last 13.62)
 - mkdir 974 (time 1787863570.70 total 70.35 last 14.01)
total: 1000 mkdir in 72.75 seconds: 13.75 ops/second
 - mkdir 119 (time 1787863510.18 total 10.01 last 11.89)
 - mkdir 274 (time 1787863520.24 total 20.06 last 15.42)
 - mkdir 405 (time 1787863530.28 total 30.11 last 13.04)
 - mkdir 533 (time 1787863540.32 total 40.15 last 12.75)
 - mkdir 677 (time 1787863550.40 total 50.23 last 14.29)
 - mkdir 819 (time 1787863560.43 total 60.25 last 14.16)
 - mkdir 959 (time 1787863570.43 total 70.26 last 13.99)
total: 1000 mkdir in 74.03 seconds: 13.51 ops/second
Time for file creation 86 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.59 seconds: 16.94 ops/second
 - mkdir 224 (time 1787864095.84 total 10.03 last 22.33)
 - mkdir 421 (time 1787864105.85 total 20.04 last 19.69)
 - mkdir 608 (time 1787864115.88 total 30.06 last 18.65)
 - mkdir 840 (time 1787864125.88 total 40.07 last 23.19)
total: 1000 mkdir in 48.73 seconds: 20.52 ops/second
 - mkdir 223 (time 1787864096.36 total 10.01 last 22.28)
 - mkdir 417 (time 1787864106.40 total 20.05 last 19.33)
 - mkdir 615 (time 1787864116.45 total 30.10 last 19.70)
 - mkdir 845 (time 1787864126.48 total 40.13 last 22.93)
total: 1000 mkdir in 48.57 seconds: 20.59 ops/second
 - mkdir 228 (time 1787864096.94 total 10.07 last 22.65)
 - mkdir 422 (time 1787864106.95 total 20.08 last 19.37)
 - mkdir 614 (time 1787864116.98 total 30.11 last 19.14)
 - mkdir 846 (time 1787864126.99 total 40.12 last 23.17)
total: 1000 mkdir in 49.18 seconds: 20.33 ops/second
 - mkdir 227 (time 1787864096.84 total 10.04 last 22.61)
 - mkdir 418 (time 1787864106.84 total 20.04 last 19.10)
 - mkdir 613 (time 1787864116.87 total 30.07 last 19.45)
 - mkdir 844 (time 1787864126.89 total 40.09 last 23.05)
total: 1000 mkdir in 49.36 seconds: 20.26 ops/second
 - mkdir 215 (time 1787864096.28 total 10.05 last 21.39)
 - mkdir 409 (time 1787864106.33 total 20.10 last 19.31)
 - mkdir 602 (time 1787864116.35 total 30.12 last 19.25)
 - mkdir 833 (time 1787864126.39 total 40.16 last 23.01)
total: 1000 mkdir in 49.94 seconds: 20.02 ops/second
 - mkdir 220 (time 1787864096.78 total 10.01 last 21.97)
 - mkdir 409 (time 1787864106.85 total 20.08 last 18.78)
 - mkdir 596 (time 1787864116.85 total 30.08 last 18.69)
 - mkdir 835 (time 1787864126.91 total 40.14 last 23.77)
 - mkdir 997 (time 1787864136.99 total 50.22 last 16.06)
total: 1000 mkdir in 50.43 seconds: 19.83 ops/second
 - mkdir 232 (time 1787864097.24 total 10.05 last 23.08)
 - mkdir 425 (time 1787864107.26 total 20.07 last 19.27)
 - mkdir 622 (time 1787864117.27 total 30.08 last 19.67)
 - mkdir 845 (time 1787864127.30 total 40.11 last 22.23)
total: 1000 mkdir in 50.07 seconds: 19.97 ops/second
 - mkdir 229 (time 1787864097.42 total 10.04 last 22.82)
 - mkdir 421 (time 1787864107.44 total 20.05 last 19.17)
 - mkdir 611 (time 1787864117.44 total 30.06 last 18.99)
 - mkdir 840 (time 1787864127.45 total 40.07 last 22.88)
 - mkdir 999 (time 1787864137.49 total 50.11 last 15.84)
total: 1000 mkdir in 50.11 seconds: 19.96 ops/second
 - mkdir 215 (time 1787864096.51 total 10.05 last 21.40)
 - mkdir 398 (time 1787864106.59 total 20.12 last 18.16)
 - mkdir 583 (time 1787864116.60 total 30.13 last 18.49)
 - mkdir 816 (time 1787864126.61 total 40.14 last 23.28)
 - mkdir 978 (time 1787864136.73 total 50.27 last 15.99)
total: 1000 mkdir in 52.27 seconds: 19.13 ops/second
 - mkdir 221 (time 1787864097.51 total 10.07 last 21.95)
 - mkdir 408 (time 1787864107.55 total 20.11 last 18.62)
 - mkdir 598 (time 1787864117.61 total 30.17 last 18.89)
 - mkdir 824 (time 1787864127.62 total 40.18 last 22.57)
 - mkdir 982 (time 1787864137.73 total 50.29 last 15.62)
total: 1000 mkdir in 51.96 seconds: 19.24 ops/second
Time for file creation 63 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787864147 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787864148 ; total 1 ; last 1)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787864148 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787864149 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787864150 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787864149 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787864149 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787864149 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787864150 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787864149 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8