== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 20:20:45 (1788481245)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.42 seconds: 23.82 ops/second
 - mkdir 167 (time 1788481264.22 total 10.03 last 16.65)
 - mkdir 313 (time 1788481274.25 total 20.06 last 14.56)
 - mkdir 454 (time 1788481284.25 total 30.06 last 14.10)
 - mkdir 613 (time 1788481294.25 total 40.07 last 15.90)
 - mkdir 791 (time 1788481304.28 total 50.09 last 17.75)
 - mkdir 979 (time 1788481314.30 total 60.12 last 18.76)
total: 1000 mkdir in 61.31 seconds: 16.31 ops/second
 - mkdir 176 (time 1788481265.43 total 10.01 last 17.59)
 - mkdir 325 (time 1788481275.49 total 20.07 last 14.81)
 - mkdir 460 (time 1788481285.59 total 30.17 last 13.36)
 - mkdir 638 (time 1788481295.67 total 40.25 last 17.66)
 - mkdir 819 (time 1788481305.68 total 50.26 last 18.08)
 - mkdir 989 (time 1788481315.70 total 60.28 last 16.97)
total: 1000 mkdir in 61.27 seconds: 16.32 ops/second
 - mkdir 169 (time 1788481264.91 total 10.05 last 16.82)
 - mkdir 314 (time 1788481274.93 total 20.07 last 14.47)
 - mkdir 446 (time 1788481284.98 total 30.12 last 13.13)
 - mkdir 613 (time 1788481295.01 total 40.15 last 16.66)
 - mkdir 785 (time 1788481305.02 total 50.16 last 17.18)
 - mkdir 959 (time 1788481315.09 total 60.23 last 17.27)
total: 1000 mkdir in 64.34 seconds: 15.54 ops/second
 - mkdir 169 (time 1788481265.40 total 10.03 last 16.85)
 - mkdir 316 (time 1788481275.49 total 20.12 last 14.57)
 - mkdir 445 (time 1788481285.59 total 30.22 last 12.77)
 - mkdir 622 (time 1788481295.64 total 40.27 last 17.61)
 - mkdir 798 (time 1788481305.65 total 50.28 last 17.59)
 - mkdir 966 (time 1788481315.69 total 60.32 last 16.73)
total: 1000 mkdir in 63.92 seconds: 15.64 ops/second
 - mkdir 173 (time 1788481262.86 total 10.01 last 17.27)
 - mkdir 313 (time 1788481272.93 total 20.08 last 13.90)
 - mkdir 446 (time 1788481282.93 total 30.09 last 13.29)
 - mkdir 591 (time 1788481293.02 total 40.18 last 14.38)
 - mkdir 751 (time 1788481303.07 total 50.22 last 15.92)
 - mkdir 922 (time 1788481313.07 total 60.22 last 17.10)
total: 1000 mkdir in 66.74 seconds: 14.98 ops/second
 - mkdir 173 (time 1788481265.61 total 10.00 last 17.29)
 - mkdir 318 (time 1788481275.63 total 20.02 last 14.48)
 - mkdir 448 (time 1788481285.68 total 30.07 last 12.93)
 - mkdir 621 (time 1788481295.71 total 40.10 last 17.26)
 - mkdir 788 (time 1788481305.76 total 50.15 last 16.61)
 - mkdir 957 (time 1788481315.78 total 60.17 last 16.88)
total: 1000 mkdir in 64.94 seconds: 15.40 ops/second
 - mkdir 170 (time 1788481265.57 total 10.11 last 16.82)
 - mkdir 310 (time 1788481275.61 total 20.14 last 13.95)
 - mkdir 442 (time 1788481285.73 total 30.26 last 13.05)
 - mkdir 614 (time 1788481295.77 total 40.30 last 17.13)
 - mkdir 785 (time 1788481305.86 total 50.39 last 16.95)
 - mkdir 956 (time 1788481315.95 total 60.48 last 16.95)
total: 1000 mkdir in 65.44 seconds: 15.28 ops/second
 - mkdir 170 (time 1788481265.01 total 10.02 last 16.97)
 - mkdir 314 (time 1788481275.06 total 20.06 last 14.34)
 - mkdir 442 (time 1788481285.09 total 30.10 last 12.75)
 - mkdir 605 (time 1788481295.10 total 40.11 last 16.29)
 - mkdir 777 (time 1788481305.13 total 50.14 last 17.14)
 - mkdir 947 (time 1788481315.17 total 60.17 last 16.94)
total: 1000 mkdir in 65.93 seconds: 15.17 ops/second
 - mkdir 168 (time 1788481265.54 total 10.00 last 16.79)
 - mkdir 305 (time 1788481275.61 total 20.07 last 13.61)
 - mkdir 440 (time 1788481285.65 total 30.12 last 13.43)
 - mkdir 610 (time 1788481295.72 total 40.19 last 16.89)
 - mkdir 779 (time 1788481305.76 total 50.23 last 16.83)
 - mkdir 944 (time 1788481315.78 total 60.25 last 16.46)
total: 1000 mkdir in 66.44 seconds: 15.05 ops/second
 - mkdir 157 (time 1788481263.81 total 10.03 last 15.65)
 - mkdir 297 (time 1788481273.86 total 20.08 last 13.93)
 - mkdir 427 (time 1788481283.92 total 30.14 last 12.93)
 - mkdir 574 (time 1788481293.93 total 40.14 last 14.69)
 - mkdir 736 (time 1788481304.00 total 50.22 last 16.08)
 - mkdir 907 (time 1788481314.07 total 60.29 last 16.99)
total: 1000 mkdir in 68.87 seconds: 14.52 ops/second
Time for file creation 76 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.46 seconds: 21.81 ops/second
 - mkdir 167 (time 1788481815.84 total 10.05 last 16.62)
 - mkdir 297 (time 1788481825.87 total 20.09 last 12.95)
 - mkdir 438 (time 1788481835.89 total 30.10 last 14.08)
 - mkdir 585 (time 1788481845.91 total 40.12 last 14.67)
 - mkdir 752 (time 1788481855.96 total 50.17 last 16.61)
 - mkdir 941 (time 1788481866.04 total 60.26 last 18.75)
total: 1000 mkdir in 62.91 seconds: 15.90 ops/second
 - mkdir 164 (time 1788481815.01 total 10.08 last 16.27)
 - mkdir 294 (time 1788481825.09 total 20.16 last 12.90)
 - mkdir 431 (time 1788481835.13 total 30.20 last 13.64)
 - mkdir 575 (time 1788481845.23 total 40.30 last 14.26)
 - mkdir 736 (time 1788481855.23 total 50.30 last 16.10)
 - mkdir 910 (time 1788481865.23 total 60.30 last 17.40)
total: 1000 mkdir in 65.29 seconds: 15.32 ops/second
 - mkdir 158 (time 1788481816.17 total 10.08 last 15.67)
 - mkdir 284 (time 1788481826.26 total 20.17 last 12.49)
 - mkdir 428 (time 1788481836.28 total 30.19 last 14.37)
 - mkdir 576 (time 1788481846.29 total 40.21 last 14.78)
 - mkdir 745 (time 1788481856.31 total 50.22 last 16.88)
 - mkdir 931 (time 1788481866.36 total 60.27 last 18.50)
total: 1000 mkdir in 64.24 seconds: 15.57 ops/second
 - mkdir 161 (time 1788481815.22 total 10.04 last 16.03)
 - mkdir 289 (time 1788481825.22 total 20.04 last 12.80)
 - mkdir 425 (time 1788481835.28 total 30.10 last 13.53)
 - mkdir 570 (time 1788481845.31 total 40.13 last 14.46)
 - mkdir 731 (time 1788481855.33 total 50.15 last 16.06)
 - mkdir 912 (time 1788481865.35 total 60.17 last 18.06)
total: 1000 mkdir in 65.34 seconds: 15.30 ops/second
 - mkdir 160 (time 1788481813.72 total 10.08 last 15.87)
 - mkdir 285 (time 1788481823.75 total 20.11 last 12.46)
 - mkdir 424 (time 1788481833.77 total 30.13 last 13.87)
 - mkdir 560 (time 1788481843.78 total 40.14 last 13.59)
 - mkdir 707 (time 1788481853.80 total 50.17 last 14.66)
 - mkdir 875 (time 1788481863.81 total 60.17 last 16.79)
total: 1000 mkdir in 67.70 seconds: 14.77 ops/second
 - mkdir 156 (time 1788481815.61 total 10.01 last 15.58)
 - mkdir 283 (time 1788481825.64 total 20.04 last 12.66)
 - mkdir 421 (time 1788481835.66 total 30.06 last 13.77)
 - mkdir 562 (time 1788481845.73 total 40.13 last 14.00)
 - mkdir 724 (time 1788481855.82 total 50.21 last 16.07)
 - mkdir 913 (time 1788481865.85 total 60.25 last 18.84)
total: 1000 mkdir in 65.76 seconds: 15.21 ops/second
 - mkdir 163 (time 1788481815.76 total 10.01 last 16.28)
 - mkdir 292 (time 1788481825.89 total 20.14 last 12.73)
 - mkdir 431 (time 1788481836.03 total 30.28 last 13.71)
 - mkdir 569 (time 1788481846.09 total 40.35 last 13.71)
 - mkdir 734 (time 1788481856.11 total 50.36 last 16.47)
 - mkdir 916 (time 1788481866.14 total 60.39 last 18.15)
total: 1000 mkdir in 65.77 seconds: 15.21 ops/second
 - mkdir 162 (time 1788481816.11 total 10.08 last 16.07)
 - mkdir 288 (time 1788481826.15 total 20.11 last 12.56)
 - mkdir 431 (time 1788481836.19 total 30.16 last 14.23)
 - mkdir 572 (time 1788481846.22 total 40.19 last 14.07)
 - mkdir 735 (time 1788481856.24 total 50.21 last 16.26)
 - mkdir 912 (time 1788481866.29 total 60.26 last 17.61)
total: 1000 mkdir in 65.85 seconds: 15.19 ops/second
 - mkdir 159 (time 1788481816.02 total 10.07 last 15.80)
 - mkdir 285 (time 1788481826.07 total 20.11 last 12.54)
 - mkdir 427 (time 1788481836.16 total 30.20 last 14.07)
 - mkdir 566 (time 1788481846.17 total 40.21 last 13.89)
 - mkdir 732 (time 1788481856.20 total 50.24 last 16.55)
 - mkdir 910 (time 1788481866.23 total 60.28 last 17.74)
total: 1000 mkdir in 65.95 seconds: 15.16 ops/second
 - mkdir 151 (time 1788481816.07 total 10.12 last 14.92)
 - mkdir 268 (time 1788481826.09 total 20.14 last 11.68)
 - mkdir 399 (time 1788481836.17 total 30.22 last 13.00)
 - mkdir 532 (time 1788481846.17 total 40.22 last 13.29)
 - mkdir 694 (time 1788481856.22 total 50.27 last 16.13)
 - mkdir 866 (time 1788481866.22 total 60.27 last 17.19)
total: 1000 mkdir in 68.80 seconds: 14.54 ops/second
Time for file creation 79 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788481882 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1788481883 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1788481883 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1788481883 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788481883 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788481883 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788481883 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788481884 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1788481884 ; total 1 ; last 1)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1788481884 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
Time for file removal 39 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8