== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 11:32:35 (1787758355)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.87 seconds: 11.47 ops/second
 - mkdir 126 (time 1787758383.12 total 10.04 last 12.55)
 - mkdir 289 (time 1787758393.18 total 20.10 last 16.21)
 - mkdir 456 (time 1787758403.18 total 30.10 last 16.69)
 - mkdir 563 (time 1787758413.21 total 40.13 last 10.67)
 - mkdir 713 (time 1787758423.26 total 50.17 last 14.94)
 - mkdir 897 (time 1787758433.26 total 60.18 last 18.39)
total: 1000 mkdir in 66.04 seconds: 15.14 ops/second
 - mkdir 119 (time 1787758383.01 total 10.04 last 11.86)
 - mkdir 283 (time 1787758393.06 total 20.09 last 16.32)
 - mkdir 452 (time 1787758403.08 total 30.11 last 16.87)
 - mkdir 562 (time 1787758413.13 total 40.15 last 10.95)
 - mkdir 714 (time 1787758423.27 total 50.29 last 14.99)
 - mkdir 890 (time 1787758433.27 total 60.29 last 17.60)
total: 1000 mkdir in 66.66 seconds: 15.00 ops/second
 - mkdir 123 (time 1787758380.00 total 10.06 last 12.23)
 - mkdir 257 (time 1787758390.03 total 20.08 last 13.37)
 - mkdir 401 (time 1787758400.03 total 30.09 last 14.39)
 - mkdir 538 (time 1787758410.13 total 40.19 last 13.57)
 - mkdir 675 (time 1787758420.14 total 50.20 last 13.69)
 - mkdir 849 (time 1787758430.20 total 60.26 last 17.29)
total: 1000 mkdir in 69.97 seconds: 14.29 ops/second
 - mkdir 131 (time 1787758384.06 total 10.04 last 13.05)
 - mkdir 287 (time 1787758394.10 total 20.07 last 15.54)
 - mkdir 464 (time 1787758404.15 total 30.12 last 17.61)
 - mkdir 565 (time 1787758414.15 total 40.12 last 10.10)
 - mkdir 725 (time 1787758424.15 total 50.13 last 15.99)
 - mkdir 909 (time 1787758434.17 total 60.14 last 18.38)
total: 1000 mkdir in 66.54 seconds: 15.03 ops/second
 - mkdir 133 (time 1787758383.97 total 10.01 last 13.28)
 - mkdir 289 (time 1787758394.04 total 20.09 last 15.49)
 - mkdir 461 (time 1787758404.06 total 30.11 last 17.16)
 - mkdir 562 (time 1787758414.11 total 40.16 last 10.05)
 - mkdir 716 (time 1787758424.13 total 50.18 last 15.37)
 - mkdir 902 (time 1787758434.18 total 60.23 last 18.52)
total: 1000 mkdir in 66.94 seconds: 14.94 ops/second
 - mkdir 125 (time 1787758383.24 total 10.04 last 12.45)
 - mkdir 285 (time 1787758393.25 total 20.05 last 15.98)
 - mkdir 456 (time 1787758403.29 total 30.08 last 17.04)
 - mkdir 558 (time 1787758413.31 total 40.11 last 10.18)
 - mkdir 710 (time 1787758423.36 total 50.16 last 15.12)
 - mkdir 891 (time 1787758433.43 total 60.22 last 17.99)
total: 1000 mkdir in 68.02 seconds: 14.70 ops/second
 - mkdir 126 (time 1787758383.72 total 10.01 last 12.59)
 - mkdir 282 (time 1787758393.80 total 20.09 last 15.47)
 - mkdir 452 (time 1787758403.82 total 30.12 last 16.96)
 - mkdir 557 (time 1787758413.85 total 40.15 last 10.47)
 - mkdir 711 (time 1787758423.89 total 50.19 last 15.34)
 - mkdir 890 (time 1787758433.94 total 60.23 last 17.82)
total: 1000 mkdir in 67.74 seconds: 14.76 ops/second
 - mkdir 127 (time 1787758383.96 total 10.02 last 12.67)
 - mkdir 281 (time 1787758394.03 total 20.10 last 15.28)
 - mkdir 453 (time 1787758404.08 total 30.15 last 17.12)
 - mkdir 556 (time 1787758414.10 total 40.17 last 10.28)
 - mkdir 715 (time 1787758424.10 total 50.17 last 15.90)
 - mkdir 895 (time 1787758434.12 total 60.18 last 17.98)
total: 1000 mkdir in 67.73 seconds: 14.77 ops/second
 - mkdir 127 (time 1787758384.30 total 10.10 last 12.58)
 - mkdir 286 (time 1787758394.35 total 20.15 last 15.82)
 - mkdir 454 (time 1787758404.43 total 30.22 last 16.67)
 - mkdir 557 (time 1787758414.46 total 40.25 last 10.27)
 - mkdir 713 (time 1787758424.48 total 50.28 last 15.56)
 - mkdir 888 (time 1787758434.50 total 60.29 last 17.48)
total: 1000 mkdir in 68.52 seconds: 14.59 ops/second
 - mkdir 124 (time 1787758383.85 total 10.03 last 12.36)
 - mkdir 278 (time 1787758393.87 total 20.05 last 15.36)
 - mkdir 447 (time 1787758403.87 total 30.05 last 16.90)
 - mkdir 547 (time 1787758413.94 total 40.12 last 9.93)
 - mkdir 701 (time 1787758423.95 total 50.13 last 15.38)
 - mkdir 882 (time 1787758434.00 total 60.18 last 18.01)
total: 1000 mkdir in 69.18 seconds: 14.45 ops/second
Time for file creation 85 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.46 seconds: 21.97 ops/second
 - mkdir 174 (time 1787758977.06 total 10.01 last 17.38)
 - mkdir 324 (time 1787758987.10 total 20.04 last 14.95)
 - mkdir 477 (time 1787758997.14 total 30.09 last 15.23)
 - mkdir 593 (time 1787759007.21 total 40.16 last 11.52)
 - mkdir 716 (time 1787759017.25 total 50.19 last 12.26)
 - mkdir 871 (time 1787759027.28 total 60.22 last 15.45)
total: 1000 mkdir in 68.67 seconds: 14.56 ops/second
 - mkdir 190 (time 1787758978.91 total 10.01 last 18.98)
 - mkdir 340 (time 1787758988.92 total 20.02 last 14.99)
 - mkdir 490 (time 1787758998.97 total 30.08 last 14.91)
 - mkdir 602 (time 1787759008.99 total 40.09 last 11.18)
 - mkdir 725 (time 1787759019.03 total 50.14 last 12.25)
 - mkdir 885 (time 1787759029.03 total 60.14 last 16.00)
total: 1000 mkdir in 67.28 seconds: 14.86 ops/second
 - mkdir 188 (time 1787758979.52 total 10.01 last 18.78)
 - mkdir 342 (time 1787758989.53 total 20.02 last 15.39)
 - mkdir 484 (time 1787758999.55 total 30.04 last 14.18)
 - mkdir 594 (time 1787759009.60 total 40.09 last 10.94)
 - mkdir 722 (time 1787759019.62 total 50.11 last 12.78)
 - mkdir 888 (time 1787759029.63 total 60.12 last 16.58)
total: 1000 mkdir in 67.90 seconds: 14.73 ops/second
 - mkdir 190 (time 1787758979.80 total 10.03 last 18.95)
 - mkdir 343 (time 1787758989.84 total 20.07 last 15.23)
 - mkdir 486 (time 1787758999.88 total 30.11 last 14.24)
 - mkdir 601 (time 1787759009.93 total 40.16 last 11.45)
 - mkdir 723 (time 1787759019.96 total 50.20 last 12.15)
 - mkdir 884 (time 1787759030.03 total 60.26 last 16.00)
total: 1000 mkdir in 68.31 seconds: 14.64 ops/second
 - mkdir 199 (time 1787758980.02 total 10.09 last 19.73)
 - mkdir 349 (time 1787758990.03 total 20.10 last 14.99)
 - mkdir 484 (time 1787759000.09 total 30.16 last 13.42)
 - mkdir 598 (time 1787759010.13 total 40.19 last 11.36)
 - mkdir 725 (time 1787759020.13 total 50.20 last 12.70)
 - mkdir 885 (time 1787759030.13 total 60.20 last 15.99)
total: 1000 mkdir in 68.23 seconds: 14.66 ops/second
 - mkdir 201 (time 1787758980.46 total 10.04 last 20.02)
 - mkdir 351 (time 1787758990.50 total 20.08 last 14.94)
 - mkdir 490 (time 1787759000.60 total 30.19 last 13.75)
 - mkdir 608 (time 1787759010.68 total 40.26 last 11.71)
 - mkdir 736 (time 1787759020.71 total 50.29 last 12.76)
 - mkdir 898 (time 1787759030.73 total 60.32 last 16.16)
total: 1000 mkdir in 68.21 seconds: 14.66 ops/second
 - mkdir 193 (time 1787758980.24 total 10.03 last 19.25)
 - mkdir 346 (time 1787758990.27 total 20.05 last 15.26)
 - mkdir 480 (time 1787759000.31 total 30.09 last 13.35)
 - mkdir 599 (time 1787759010.39 total 40.17 last 11.80)
 - mkdir 722 (time 1787759020.40 total 50.19 last 12.28)
 - mkdir 878 (time 1787759030.41 total 60.19 last 15.59)
total: 1000 mkdir in 69.70 seconds: 14.35 ops/second
 - mkdir 194 (time 1787758980.10 total 10.04 last 19.33)
 - mkdir 340 (time 1787758990.13 total 20.07 last 14.56)
 - mkdir 477 (time 1787759000.16 total 30.09 last 13.66)
 - mkdir 594 (time 1787759010.23 total 40.16 last 11.62)
 - mkdir 715 (time 1787759020.23 total 50.16 last 12.09)
 - mkdir 874 (time 1787759030.25 total 60.18 last 15.87)
 - mkdir 999 (time 1787759040.34 total 70.28 last 12.39)
total: 1000 mkdir in 70.28 seconds: 14.23 ops/second
 - mkdir 191 (time 1787758979.91 total 10.02 last 19.07)
 - mkdir 338 (time 1787758989.93 total 20.04 last 14.67)
 - mkdir 478 (time 1787758999.96 total 30.07 last 13.96)
 - mkdir 594 (time 1787759010.04 total 40.15 last 11.51)
 - mkdir 720 (time 1787759020.08 total 50.19 last 12.55)
 - mkdir 872 (time 1787759030.12 total 60.23 last 15.14)
 - mkdir 995 (time 1787759040.20 total 70.31 last 12.20)
total: 1000 mkdir in 70.79 seconds: 14.13 ops/second
 - mkdir 182 (time 1787758980.37 total 10.04 last 18.12)
 - mkdir 329 (time 1787758990.43 total 20.10 last 14.62)
 - mkdir 463 (time 1787759000.48 total 30.15 last 13.33)
 - mkdir 577 (time 1787759010.48 total 40.15 last 11.40)
 - mkdir 705 (time 1787759020.52 total 50.19 last 12.75)
 - mkdir 863 (time 1787759030.52 total 60.20 last 15.80)
 - mkdir 983 (time 1787759040.61 total 70.29 last 11.89)
total: 1000 mkdir in 72.09 seconds: 13.87 ops/second
Time for file creation 84 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787759052 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787759054 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787759054 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787759055 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787759055 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787759055 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787759055 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787759055 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787759055 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787759055 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 46 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8