== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 03:56:55 (1786780615)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.48 seconds: 20.90 ops/second
 - mkdir 154 (time 1786780637.02 total 10.11 last 15.23)
 - mkdir 319 (time 1786780647.07 total 20.16 last 16.42)
 - mkdir 480 (time 1786780657.10 total 30.19 last 16.05)
 - mkdir 668 (time 1786780667.17 total 40.26 last 18.68)
 - mkdir 847 (time 1786780677.17 total 50.27 last 17.88)
total: 1000 mkdir in 59.02 seconds: 16.94 ops/second
 - mkdir 146 (time 1786780637.68 total 10.00 last 14.60)
 - mkdir 303 (time 1786780647.75 total 20.07 last 15.59)
 - mkdir 470 (time 1786780657.77 total 30.09 last 16.67)
 - mkdir 661 (time 1786780667.80 total 40.12 last 19.04)
 - mkdir 842 (time 1786780677.83 total 50.15 last 18.05)
 - mkdir 997 (time 1786780687.95 total 60.27 last 15.31)
total: 1000 mkdir in 60.62 seconds: 16.50 ops/second
 - mkdir 158 (time 1786780639.04 total 10.02 last 15.77)
 - mkdir 311 (time 1786780649.09 total 20.07 last 15.23)
 - mkdir 477 (time 1786780659.09 total 30.07 last 16.60)
 - mkdir 669 (time 1786780669.14 total 40.12 last 19.10)
 - mkdir 850 (time 1786780679.23 total 50.21 last 17.94)
 - mkdir 995 (time 1786780689.39 total 60.37 last 14.27)
total: 1000 mkdir in 61.05 seconds: 16.38 ops/second
 - mkdir 151 (time 1786780639.05 total 10.02 last 15.07)
 - mkdir 302 (time 1786780649.09 total 20.06 last 15.04)
 - mkdir 472 (time 1786780659.11 total 30.08 last 16.96)
 - mkdir 663 (time 1786780669.15 total 40.11 last 19.03)
 - mkdir 845 (time 1786780679.18 total 50.15 last 18.14)
 - mkdir 992 (time 1786780689.25 total 60.21 last 14.60)
total: 1000 mkdir in 61.29 seconds: 16.32 ops/second
 - mkdir 133 (time 1786780636.71 total 10.01 last 13.29)
 - mkdir 278 (time 1786780646.77 total 20.07 last 14.41)
 - mkdir 436 (time 1786780656.79 total 30.09 last 15.77)
 - mkdir 626 (time 1786780666.81 total 40.11 last 18.96)
 - mkdir 804 (time 1786780676.81 total 50.11 last 17.79)
 - mkdir 969 (time 1786780686.82 total 60.12 last 16.49)
total: 1000 mkdir in 64.94 seconds: 15.40 ops/second
 - mkdir 148 (time 1786780638.18 total 10.03 last 14.76)
 - mkdir 298 (time 1786780648.23 total 20.08 last 14.93)
 - mkdir 464 (time 1786780658.28 total 30.13 last 16.51)
 - mkdir 649 (time 1786780668.30 total 40.15 last 18.46)
 - mkdir 826 (time 1786780678.34 total 50.19 last 17.64)
 - mkdir 980 (time 1786780688.47 total 60.32 last 15.20)
total: 1000 mkdir in 63.79 seconds: 15.68 ops/second
 - mkdir 152 (time 1786780638.90 total 10.14 last 14.99)
 - mkdir 304 (time 1786780648.96 total 20.20 last 15.11)
 - mkdir 468 (time 1786780658.97 total 30.21 last 16.39)
 - mkdir 658 (time 1786780668.97 total 40.22 last 18.98)
 - mkdir 835 (time 1786780679.00 total 50.25 last 17.65)
 - mkdir 979 (time 1786780689.15 total 60.39 last 14.20)
total: 1000 mkdir in 63.69 seconds: 15.70 ops/second
 - mkdir 151 (time 1786780638.21 total 10.03 last 15.06)
 - mkdir 301 (time 1786780648.24 total 20.05 last 14.96)
 - mkdir 465 (time 1786780658.26 total 30.08 last 16.37)
 - mkdir 647 (time 1786780668.28 total 40.09 last 18.17)
 - mkdir 825 (time 1786780678.33 total 50.15 last 17.71)
 - mkdir 974 (time 1786780688.34 total 60.16 last 14.89)
total: 1000 mkdir in 64.44 seconds: 15.52 ops/second
 - mkdir 142 (time 1786780637.92 total 10.08 last 14.09)
 - mkdir 293 (time 1786780647.95 total 20.11 last 15.05)
 - mkdir 454 (time 1786780657.96 total 30.12 last 16.08)
 - mkdir 636 (time 1786780667.97 total 40.13 last 18.18)
 - mkdir 814 (time 1786780678.03 total 50.19 last 17.70)
 - mkdir 966 (time 1786780688.04 total 60.20 last 15.18)
total: 1000 mkdir in 65.52 seconds: 15.26 ops/second
 - mkdir 148 (time 1786780638.63 total 10.04 last 14.74)
 - mkdir 296 (time 1786780648.64 total 20.05 last 14.78)
 - mkdir 459 (time 1786780658.74 total 30.15 last 16.15)
 - mkdir 646 (time 1786780668.76 total 40.18 last 18.65)
 - mkdir 821 (time 1786780678.78 total 50.19 last 17.48)
 - mkdir 970 (time 1786780688.92 total 60.33 last 14.69)
total: 1000 mkdir in 65.08 seconds: 15.37 ops/second
Time for file creation 78 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.38 seconds: 25.99 ops/second
 - mkdir 210 (time 1786781166.98 total 10.02 last 20.95)
 - mkdir 436 (time 1786781177.03 total 20.07 last 22.49)
 - mkdir 664 (time 1786781187.03 total 30.07 last 22.80)
 - mkdir 874 (time 1786781197.07 total 40.11 last 20.93)
total: 1000 mkdir in 46.32 seconds: 21.59 ops/second
 - mkdir 204 (time 1786781166.69 total 10.02 last 20.36)
 - mkdir 423 (time 1786781176.70 total 20.03 last 21.88)
 - mkdir 640 (time 1786781186.70 total 30.03 last 21.69)
 - mkdir 850 (time 1786781196.74 total 40.08 last 20.90)
total: 1000 mkdir in 48.32 seconds: 20.70 ops/second
 - mkdir 207 (time 1786781166.63 total 10.08 last 20.54)
 - mkdir 431 (time 1786781176.64 total 20.09 last 22.37)
 - mkdir 644 (time 1786781186.66 total 30.11 last 21.26)
 - mkdir 847 (time 1786781196.69 total 40.14 last 20.24)
total: 1000 mkdir in 48.60 seconds: 20.58 ops/second
 - mkdir 210 (time 1786781166.16 total 10.04 last 20.91)
 - mkdir 427 (time 1786781176.19 total 20.07 last 21.64)
 - mkdir 637 (time 1786781186.25 total 30.13 last 20.87)
 - mkdir 843 (time 1786781196.30 total 40.18 last 20.50)
total: 1000 mkdir in 49.11 seconds: 20.36 ops/second
 - mkdir 210 (time 1786781167.04 total 10.02 last 20.96)
 - mkdir 432 (time 1786781177.05 total 20.03 last 22.18)
 - mkdir 649 (time 1786781187.06 total 30.04 last 21.67)
 - mkdir 850 (time 1786781197.07 total 40.04 last 20.10)
total: 1000 mkdir in 49.08 seconds: 20.38 ops/second
 - mkdir 207 (time 1786781166.72 total 10.01 last 20.68)
 - mkdir 430 (time 1786781176.73 total 20.02 last 22.27)
 - mkdir 641 (time 1786781186.75 total 30.04 last 21.05)
 - mkdir 840 (time 1786781196.78 total 40.07 last 19.85)
total: 1000 mkdir in 49.93 seconds: 20.03 ops/second
 - mkdir 204 (time 1786781167.02 total 10.03 last 20.35)
 - mkdir 420 (time 1786781177.03 total 20.04 last 21.57)
 - mkdir 642 (time 1786781187.05 total 30.06 last 22.15)
 - mkdir 849 (time 1786781197.08 total 40.09 last 20.64)
 - mkdir 998 (time 1786781207.14 total 50.15 last 14.82)
total: 1000 mkdir in 50.26 seconds: 19.89 ops/second
 - mkdir 201 (time 1786781166.90 total 10.01 last 20.08)
 - mkdir 428 (time 1786781176.92 total 20.03 last 22.65)
 - mkdir 644 (time 1786781186.94 total 30.05 last 21.56)
 - mkdir 839 (time 1786781196.96 total 40.07 last 19.47)
 - mkdir 993 (time 1786781207.15 total 50.26 last 15.11)
total: 1000 mkdir in 51.02 seconds: 19.60 ops/second
 - mkdir 199 (time 1786781165.84 total 10.04 last 19.82)
 - mkdir 416 (time 1786781175.89 total 20.09 last 21.59)
 - mkdir 621 (time 1786781185.90 total 30.09 last 20.50)
 - mkdir 821 (time 1786781195.91 total 40.11 last 19.97)
 - mkdir 987 (time 1786781206.10 total 50.30 last 16.29)
total: 1000 mkdir in 52.25 seconds: 19.14 ops/second
 - mkdir 199 (time 1786781166.72 total 10.01 last 19.89)
 - mkdir 420 (time 1786781176.78 total 20.06 last 21.97)
 - mkdir 628 (time 1786781186.80 total 30.08 last 20.76)
 - mkdir 833 (time 1786781196.84 total 40.13 last 20.40)
 - mkdir 984 (time 1786781206.93 total 50.21 last 14.98)
total: 1000 mkdir in 51.97 seconds: 19.24 ops/second
Time for file creation 60 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786781216 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786781216 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786781217 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786781217 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786781217 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786781217 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786781218 ; total 1 ; last 1)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786781217 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786781217 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786781218 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
Time for file removal 36 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8