== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 04:29:23 (1790756963)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.55 seconds: 18.24 ops/second
 - mkdir 191 (time 1790756984.27 total 10.03 last 19.05)
 - mkdir 372 (time 1790756994.28 total 20.03 last 18.09)
 - mkdir 540 (time 1790757004.30 total 30.06 last 16.75)
 - mkdir 710 (time 1790757014.32 total 40.07 last 16.97)
 - mkdir 878 (time 1790757024.34 total 50.10 last 16.76)
total: 1000 mkdir in 56.99 seconds: 17.55 ops/second
 - mkdir 183 (time 1790756982.62 total 10.04 last 18.23)
 - mkdir 350 (time 1790756992.69 total 20.11 last 16.59)
 - mkdir 507 (time 1790757002.73 total 30.15 last 15.63)
 - mkdir 681 (time 1790757012.77 total 40.19 last 17.33)
 - mkdir 839 (time 1790757022.83 total 50.25 last 15.71)
total: 1000 mkdir in 59.55 seconds: 16.79 ops/second
 - mkdir 186 (time 1790756985.05 total 10.04 last 18.53)
 - mkdir 353 (time 1790756995.08 total 20.07 last 16.65)
 - mkdir 517 (time 1790757005.10 total 30.08 last 16.38)
 - mkdir 689 (time 1790757015.13 total 40.12 last 17.13)
 - mkdir 858 (time 1790757025.15 total 50.14 last 16.87)
total: 1000 mkdir in 60.09 seconds: 16.64 ops/second
 - mkdir 181 (time 1790756984.84 total 10.02 last 18.06)
 - mkdir 349 (time 1790756994.86 total 20.04 last 16.78)
 - mkdir 511 (time 1790757004.89 total 30.07 last 16.15)
 - mkdir 685 (time 1790757014.93 total 40.11 last 17.32)
 - mkdir 848 (time 1790757024.94 total 50.12 last 16.28)
 - mkdir 997 (time 1790757034.98 total 60.16 last 14.85)
total: 1000 mkdir in 60.53 seconds: 16.52 ops/second
 - mkdir 187 (time 1790756985.26 total 10.12 last 18.48)
 - mkdir 354 (time 1790756995.27 total 20.13 last 16.68)
 - mkdir 519 (time 1790757005.30 total 30.16 last 16.46)
 - mkdir 690 (time 1790757015.30 total 40.16 last 17.09)
 - mkdir 856 (time 1790757025.34 total 50.19 last 16.54)
 - mkdir 999 (time 1790757035.35 total 60.21 last 14.28)
total: 1000 mkdir in 60.21 seconds: 16.61 ops/second
 - mkdir 180 (time 1790756985.50 total 10.03 last 17.95)
 - mkdir 351 (time 1790756995.52 total 20.06 last 17.05)
 - mkdir 515 (time 1790757005.55 total 30.08 last 16.36)
 - mkdir 683 (time 1790757015.55 total 40.09 last 16.79)
 - mkdir 851 (time 1790757025.56 total 50.10 last 16.78)
 - mkdir 993 (time 1790757035.63 total 60.16 last 14.10)
total: 1000 mkdir in 60.91 seconds: 16.42 ops/second
 - mkdir 181 (time 1790756985.63 total 10.03 last 18.04)
 - mkdir 348 (time 1790756995.66 total 20.06 last 16.66)
 - mkdir 514 (time 1790757005.66 total 30.06 last 16.59)
 - mkdir 687 (time 1790757015.69 total 40.09 last 17.25)
 - mkdir 853 (time 1790757025.74 total 50.14 last 16.52)
 - mkdir 991 (time 1790757035.82 total 60.22 last 13.70)
total: 1000 mkdir in 61.27 seconds: 16.32 ops/second
 - mkdir 179 (time 1790756985.52 total 10.02 last 17.87)
 - mkdir 352 (time 1790756995.54 total 20.04 last 17.27)
 - mkdir 518 (time 1790757005.58 total 30.07 last 16.54)
 - mkdir 682 (time 1790757015.62 total 40.12 last 16.33)
 - mkdir 847 (time 1790757025.64 total 50.14 last 16.47)
 - mkdir 987 (time 1790757035.73 total 60.23 last 13.88)
total: 1000 mkdir in 61.88 seconds: 16.16 ops/second
 - mkdir 173 (time 1790756985.02 total 10.04 last 17.23)
 - mkdir 329 (time 1790756995.07 total 20.09 last 15.52)
 - mkdir 486 (time 1790757005.10 total 30.12 last 15.66)
 - mkdir 659 (time 1790757015.14 total 40.16 last 17.23)
 - mkdir 826 (time 1790757025.15 total 50.17 last 16.69)
 - mkdir 973 (time 1790757035.26 total 60.28 last 14.54)
total: 1000 mkdir in 63.36 seconds: 15.78 ops/second
 - mkdir 179 (time 1790756985.66 total 10.05 last 17.82)
 - mkdir 337 (time 1790756995.68 total 20.07 last 15.77)
 - mkdir 498 (time 1790757005.71 total 30.10 last 16.05)
 - mkdir 668 (time 1790757015.73 total 40.12 last 16.95)
 - mkdir 834 (time 1790757025.74 total 50.13 last 16.59)
 - mkdir 975 (time 1790757035.89 total 60.28 last 13.89)
total: 1000 mkdir in 62.80 seconds: 15.92 ops/second
Time for file creation 74 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 20.17 ops/second
 - mkdir 206 (time 1790757536.86 total 10.03 last 20.54)
 - mkdir 387 (time 1790757546.89 total 20.06 last 18.04)
 - mkdir 584 (time 1790757556.92 total 30.09 last 19.64)
 - mkdir 755 (time 1790757566.92 total 40.09 last 17.10)
 - mkdir 958 (time 1790757576.95 total 50.12 last 20.24)
total: 1000 mkdir in 52.24 seconds: 19.14 ops/second
 - mkdir 205 (time 1790757539.17 total 10.04 last 20.42)
 - mkdir 397 (time 1790757549.18 total 20.05 last 19.19)
 - mkdir 595 (time 1790757559.22 total 30.09 last 19.72)
 - mkdir 760 (time 1790757569.22 total 40.09 last 16.50)
 - mkdir 966 (time 1790757579.26 total 50.13 last 20.52)
total: 1000 mkdir in 53.73 seconds: 18.61 ops/second
 - mkdir 195 (time 1790757538.84 total 10.05 last 19.41)
 - mkdir 378 (time 1790757548.88 total 20.08 last 18.24)
 - mkdir 578 (time 1790757558.89 total 30.09 last 19.98)
 - mkdir 750 (time 1790757568.89 total 40.10 last 17.19)
 - mkdir 955 (time 1790757578.92 total 50.12 last 20.44)
total: 1000 mkdir in 54.76 seconds: 18.26 ops/second
 - mkdir 192 (time 1790757539.21 total 10.05 last 19.11)
 - mkdir 377 (time 1790757549.23 total 20.07 last 18.46)
 - mkdir 580 (time 1790757559.23 total 30.07 last 20.29)
 - mkdir 748 (time 1790757569.26 total 40.09 last 16.76)
 - mkdir 956 (time 1790757579.34 total 50.17 last 20.64)
total: 1000 mkdir in 55.46 seconds: 18.03 ops/second
 - mkdir 187 (time 1790757538.16 total 10.03 last 18.65)
 - mkdir 364 (time 1790757548.18 total 20.04 last 17.68)
 - mkdir 564 (time 1790757558.20 total 30.07 last 19.95)
 - mkdir 730 (time 1790757568.27 total 40.13 last 16.49)
 - mkdir 931 (time 1790757578.27 total 50.13 last 20.10)
total: 1000 mkdir in 57.15 seconds: 17.50 ops/second
 - mkdir 185 (time 1790757538.75 total 10.04 last 18.43)
 - mkdir 362 (time 1790757548.82 total 20.11 last 17.57)
 - mkdir 557 (time 1790757558.83 total 30.12 last 19.49)
 - mkdir 726 (time 1790757568.89 total 40.18 last 16.80)
 - mkdir 933 (time 1790757578.89 total 50.18 last 20.70)
total: 1000 mkdir in 57.25 seconds: 17.47 ops/second
 - mkdir 190 (time 1790757539.58 total 10.07 last 18.87)
 - mkdir 373 (time 1790757549.64 total 20.13 last 18.18)
 - mkdir 574 (time 1790757559.67 total 30.16 last 20.05)
 - mkdir 738 (time 1790757569.68 total 40.17 last 16.38)
 - mkdir 943 (time 1790757579.75 total 50.24 last 20.36)
total: 1000 mkdir in 56.98 seconds: 17.55 ops/second
 - mkdir 191 (time 1790757539.44 total 10.01 last 19.08)
 - mkdir 371 (time 1790757549.45 total 20.02 last 17.98)
 - mkdir 569 (time 1790757559.49 total 30.06 last 19.73)
 - mkdir 733 (time 1790757569.53 total 40.09 last 16.34)
 - mkdir 941 (time 1790757579.53 total 50.10 last 20.79)
total: 1000 mkdir in 57.16 seconds: 17.49 ops/second
 - mkdir 192 (time 1790757539.41 total 10.07 last 19.06)
 - mkdir 366 (time 1790757549.46 total 20.12 last 17.32)
 - mkdir 562 (time 1790757559.49 total 30.15 last 19.54)
 - mkdir 723 (time 1790757569.54 total 40.20 last 16.02)
 - mkdir 932 (time 1790757579.57 total 50.23 last 20.84)
total: 1000 mkdir in 57.61 seconds: 17.36 ops/second
 - mkdir 183 (time 1790757539.00 total 10.02 last 18.27)
 - mkdir 364 (time 1790757549.03 total 20.04 last 18.05)
 - mkdir 549 (time 1790757559.03 total 30.05 last 18.48)
 - mkdir 713 (time 1790757569.10 total 40.11 last 16.30)
 - mkdir 918 (time 1790757579.12 total 50.14 last 20.44)
total: 1000 mkdir in 58.58 seconds: 17.07 ops/second
Time for file creation 67 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790757595 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790757595 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790757596 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790757596 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790757596 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790757596 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790757597 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790757597 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790757597 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790757597 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8