== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 06:43:25 (1788864205)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.44 seconds: 22.68 ops/second
 - mkdir 140 (time 1788864225.30 total 10.02 last 13.97)
 - mkdir 330 (time 1788864235.42 total 20.14 last 18.78)
 - mkdir 471 (time 1788864245.46 total 30.18 last 14.05)
 - mkdir 624 (time 1788864255.47 total 40.19 last 15.28)
 - mkdir 781 (time 1788864265.52 total 50.24 last 15.63)
 - mkdir 925 (time 1788864275.54 total 60.26 last 14.36)
total: 1000 mkdir in 65.21 seconds: 15.34 ops/second
 - mkdir 175 (time 1788864228.20 total 10.01 last 17.47)
 - mkdir 361 (time 1788864238.24 total 20.05 last 18.53)
 - mkdir 495 (time 1788864248.25 total 30.06 last 13.39)
 - mkdir 657 (time 1788864258.28 total 40.09 last 16.15)
 - mkdir 813 (time 1788864268.34 total 50.15 last 15.51)
 - mkdir 960 (time 1788864278.37 total 60.18 last 14.66)
total: 1000 mkdir in 62.55 seconds: 15.99 ops/second
 - mkdir 170 (time 1788864227.06 total 10.01 last 16.99)
 - mkdir 349 (time 1788864237.06 total 20.01 last 17.89)
 - mkdir 489 (time 1788864247.08 total 30.03 last 13.97)
 - mkdir 651 (time 1788864257.10 total 40.05 last 16.17)
 - mkdir 801 (time 1788864267.17 total 50.12 last 14.89)
 - mkdir 943 (time 1788864277.18 total 60.13 last 14.19)
total: 1000 mkdir in 63.96 seconds: 15.63 ops/second
 - mkdir 160 (time 1788864226.84 total 10.04 last 15.93)
 - mkdir 342 (time 1788864236.84 total 20.05 last 18.19)
 - mkdir 479 (time 1788864246.86 total 30.07 last 13.67)
 - mkdir 639 (time 1788864256.91 total 40.11 last 15.93)
 - mkdir 793 (time 1788864266.94 total 50.15 last 15.34)
 - mkdir 935 (time 1788864276.97 total 60.18 last 14.16)
total: 1000 mkdir in 64.55 seconds: 15.49 ops/second
 - mkdir 178 (time 1788864228.02 total 10.02 last 17.76)
 - mkdir 349 (time 1788864238.10 total 20.10 last 16.96)
 - mkdir 486 (time 1788864248.14 total 30.14 last 13.64)
 - mkdir 646 (time 1788864258.19 total 40.19 last 15.92)
 - mkdir 799 (time 1788864268.25 total 50.25 last 15.21)
 - mkdir 947 (time 1788864278.28 total 60.28 last 14.76)
total: 1000 mkdir in 65.21 seconds: 15.34 ops/second
 - mkdir 173 (time 1788864228.05 total 10.01 last 17.29)
 - mkdir 346 (time 1788864238.05 total 20.01 last 17.29)
 - mkdir 485 (time 1788864248.08 total 30.04 last 13.87)
 - mkdir 644 (time 1788864258.14 total 40.10 last 15.81)
 - mkdir 800 (time 1788864268.17 total 50.13 last 15.55)
 - mkdir 941 (time 1788864278.23 total 60.19 last 14.02)
total: 1000 mkdir in 65.24 seconds: 15.33 ops/second
 - mkdir 151 (time 1788864226.84 total 10.04 last 15.04)
 - mkdir 326 (time 1788864236.86 total 20.06 last 17.46)
 - mkdir 463 (time 1788864246.90 total 30.11 last 13.64)
 - mkdir 622 (time 1788864256.91 total 40.11 last 15.89)
 - mkdir 773 (time 1788864266.92 total 50.13 last 15.07)
 - mkdir 919 (time 1788864276.95 total 60.15 last 14.56)
total: 1000 mkdir in 67.01 seconds: 14.92 ops/second
 - mkdir 172 (time 1788864228.39 total 10.00 last 17.20)
 - mkdir 344 (time 1788864238.45 total 20.05 last 17.11)
 - mkdir 480 (time 1788864248.46 total 30.07 last 13.58)
 - mkdir 640 (time 1788864258.53 total 40.14 last 15.90)
 - mkdir 795 (time 1788864268.59 total 50.20 last 15.40)
 - mkdir 939 (time 1788864278.59 total 60.20 last 14.40)
total: 1000 mkdir in 66.50 seconds: 15.04 ops/second
 - mkdir 168 (time 1788864227.83 total 10.03 last 16.76)
 - mkdir 339 (time 1788864237.83 total 20.03 last 17.09)
 - mkdir 470 (time 1788864247.85 total 30.04 last 13.08)
 - mkdir 626 (time 1788864257.93 total 40.12 last 15.48)
 - mkdir 780 (time 1788864267.97 total 50.17 last 15.33)
 - mkdir 928 (time 1788864278.00 total 60.20 last 14.75)
total: 1000 mkdir in 67.58 seconds: 14.80 ops/second
 - mkdir 162 (time 1788864228.06 total 10.05 last 16.12)
 - mkdir 329 (time 1788864238.07 total 20.07 last 16.68)
 - mkdir 453 (time 1788864248.11 total 30.10 last 12.36)
 - mkdir 605 (time 1788864258.18 total 40.18 last 15.09)
 - mkdir 759 (time 1788864268.23 total 50.23 last 15.33)
 - mkdir 904 (time 1788864278.30 total 60.29 last 14.40)
total: 1000 mkdir in 70.23 seconds: 14.24 ops/second
Time for file creation 80 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 20 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.53 seconds: 18.77 ops/second
 - mkdir 178 (time 1788864800.79 total 10.09 last 17.64)
 - mkdir 377 (time 1788864810.85 total 20.15 last 19.78)
 - mkdir 566 (time 1788864820.87 total 30.17 last 18.86)
 - mkdir 712 (time 1788864830.96 total 40.26 last 14.46)
 - mkdir 874 (time 1788864841.04 total 50.34 last 16.07)
total: 1000 mkdir in 56.80 seconds: 17.61 ops/second
 - mkdir 177 (time 1788864801.28 total 10.04 last 17.64)
 - mkdir 374 (time 1788864811.32 total 20.07 last 19.63)
 - mkdir 568 (time 1788864821.37 total 30.13 last 19.29)
 - mkdir 712 (time 1788864831.38 total 40.14 last 14.39)
 - mkdir 870 (time 1788864841.41 total 50.16 last 15.76)
total: 1000 mkdir in 56.83 seconds: 17.60 ops/second
 - mkdir 180 (time 1788864802.29 total 10.05 last 17.90)
 - mkdir 391 (time 1788864812.33 total 20.09 last 21.03)
 - mkdir 578 (time 1788864822.37 total 30.13 last 18.62)
 - mkdir 724 (time 1788864832.41 total 40.17 last 14.54)
 - mkdir 880 (time 1788864842.43 total 50.19 last 15.58)
total: 1000 mkdir in 56.52 seconds: 17.69 ops/second
 - mkdir 177 (time 1788864801.63 total 10.03 last 17.64)
 - mkdir 381 (time 1788864811.66 total 20.06 last 20.35)
 - mkdir 568 (time 1788864821.69 total 30.09 last 18.65)
 - mkdir 711 (time 1788864831.70 total 40.10 last 14.28)
 - mkdir 868 (time 1788864841.71 total 50.11 last 15.68)
total: 1000 mkdir in 57.73 seconds: 17.32 ops/second
 - mkdir 181 (time 1788864801.94 total 10.01 last 18.08)
 - mkdir 383 (time 1788864811.98 total 20.05 last 20.13)
 - mkdir 574 (time 1788864822.00 total 30.08 last 19.05)
 - mkdir 720 (time 1788864832.02 total 40.09 last 14.58)
 - mkdir 874 (time 1788864842.07 total 50.14 last 15.31)
total: 1000 mkdir in 57.50 seconds: 17.39 ops/second
 - mkdir 186 (time 1788864802.53 total 10.02 last 18.56)
 - mkdir 400 (time 1788864812.54 total 20.03 last 21.37)
 - mkdir 590 (time 1788864822.55 total 30.05 last 18.97)
 - mkdir 727 (time 1788864832.57 total 40.06 last 13.68)
 - mkdir 882 (time 1788864842.62 total 50.11 last 15.42)
total: 1000 mkdir in 57.03 seconds: 17.53 ops/second
 - mkdir 179 (time 1788864801.93 total 10.00 last 17.90)
 - mkdir 383 (time 1788864811.98 total 20.05 last 20.30)
 - mkdir 568 (time 1788864822.00 total 30.07 last 18.46)
 - mkdir 712 (time 1788864832.03 total 40.09 last 14.37)
 - mkdir 867 (time 1788864842.09 total 50.16 last 15.40)
total: 1000 mkdir in 57.92 seconds: 17.27 ops/second
 - mkdir 175 (time 1788864802.42 total 10.00 last 17.49)
 - mkdir 383 (time 1788864812.44 total 20.03 last 20.76)
 - mkdir 562 (time 1788864822.45 total 30.04 last 17.88)
 - mkdir 708 (time 1788864832.51 total 40.10 last 14.51)
 - mkdir 864 (time 1788864842.51 total 50.10 last 15.59)
total: 1000 mkdir in 58.78 seconds: 17.01 ops/second
 - mkdir 171 (time 1788864802.33 total 10.06 last 16.99)
 - mkdir 375 (time 1788864812.36 total 20.10 last 20.33)
 - mkdir 557 (time 1788864822.41 total 30.14 last 18.12)
 - mkdir 697 (time 1788864832.44 total 40.17 last 13.96)
 - mkdir 855 (time 1788864842.48 total 50.22 last 15.73)
total: 1000 mkdir in 59.52 seconds: 16.80 ops/second
 - mkdir 167 (time 1788864802.14 total 10.04 last 16.64)
 - mkdir 359 (time 1788864812.14 total 20.04 last 19.20)
 - mkdir 543 (time 1788864822.16 total 30.05 last 18.37)
 - mkdir 682 (time 1788864832.17 total 40.07 last 13.88)
 - mkdir 837 (time 1788864842.18 total 50.08 last 15.49)
 - mkdir 997 (time 1788864852.20 total 60.10 last 15.96)
total: 1000 mkdir in 60.24 seconds: 16.60 ops/second
Time for file creation 70 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788864860 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1788864861 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788864862 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1788864862 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1788864862 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1788864862 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788864862 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788864863 ; total 1 ; last 1)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1788864863 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1788864862 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
Time for file removal 38 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8