== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 14:34:30 (1788546870)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.38 seconds: 26.06 ops/second
 - mkdir 204 (time 1788546891.13 total 10.06 last 20.28)
 - mkdir 394 (time 1788546901.15 total 20.08 last 18.96)
 - mkdir 561 (time 1788546911.19 total 30.12 last 16.64)
 - mkdir 701 (time 1788546921.20 total 40.13 last 13.99)
 - mkdir 858 (time 1788546931.23 total 50.15 last 15.66)
total: 1000 mkdir in 56.49 seconds: 17.70 ops/second
 - mkdir 196 (time 1788546890.56 total 10.03 last 19.54)
 - mkdir 381 (time 1788546900.65 total 20.12 last 18.33)
 - mkdir 545 (time 1788546910.70 total 30.17 last 16.32)
 - mkdir 685 (time 1788546920.79 total 40.26 last 13.87)
 - mkdir 847 (time 1788546930.84 total 50.30 last 16.13)
total: 1000 mkdir in 57.60 seconds: 17.36 ops/second
 - mkdir 193 (time 1788546891.36 total 10.03 last 19.25)
 - mkdir 382 (time 1788546901.38 total 20.04 last 18.87)
 - mkdir 544 (time 1788546911.41 total 30.08 last 16.14)
 - mkdir 690 (time 1788546921.45 total 40.12 last 14.55)
 - mkdir 849 (time 1788546931.54 total 50.20 last 15.76)
total: 1000 mkdir in 57.73 seconds: 17.32 ops/second
 - mkdir 197 (time 1788546890.32 total 10.04 last 19.62)
 - mkdir 376 (time 1788546900.34 total 20.06 last 17.86)
 - mkdir 532 (time 1788546910.42 total 30.14 last 15.48)
 - mkdir 672 (time 1788546920.44 total 40.16 last 13.98)
 - mkdir 834 (time 1788546930.50 total 50.22 last 16.10)
total: 1000 mkdir in 59.07 seconds: 16.93 ops/second
 - mkdir 199 (time 1788546890.78 total 10.02 last 19.86)
 - mkdir 377 (time 1788546900.81 total 20.05 last 17.75)
 - mkdir 541 (time 1788546910.83 total 30.07 last 16.37)
 - mkdir 678 (time 1788546920.86 total 40.10 last 13.66)
 - mkdir 836 (time 1788546930.89 total 50.12 last 15.76)
total: 1000 mkdir in 58.89 seconds: 16.98 ops/second
 - mkdir 192 (time 1788546890.44 total 10.03 last 19.15)
 - mkdir 369 (time 1788546900.47 total 20.06 last 17.64)
 - mkdir 529 (time 1788546910.54 total 30.12 last 15.90)
 - mkdir 668 (time 1788546920.62 total 40.20 last 13.79)
 - mkdir 827 (time 1788546930.71 total 50.30 last 15.76)
total: 1000 mkdir in 59.50 seconds: 16.81 ops/second
 - mkdir 196 (time 1788546889.97 total 10.02 last 19.57)
 - mkdir 378 (time 1788546899.97 total 20.02 last 18.19)
 - mkdir 531 (time 1788546909.99 total 30.04 last 15.27)
 - mkdir 666 (time 1788546920.03 total 40.08 last 13.45)
 - mkdir 818 (time 1788546930.09 total 50.13 last 15.12)
 - mkdir 996 (time 1788546940.12 total 60.17 last 17.74)
total: 1000 mkdir in 60.49 seconds: 16.53 ops/second
 - mkdir 191 (time 1788546891.35 total 10.07 last 18.97)
 - mkdir 378 (time 1788546901.39 total 20.11 last 18.62)
 - mkdir 537 (time 1788546911.51 total 30.22 last 15.72)
 - mkdir 683 (time 1788546921.54 total 40.26 last 14.55)
 - mkdir 833 (time 1788546931.56 total 50.28 last 14.97)
total: 1000 mkdir in 59.57 seconds: 16.79 ops/second
 - mkdir 196 (time 1788546891.53 total 10.01 last 19.57)
 - mkdir 381 (time 1788546901.57 total 20.05 last 18.43)
 - mkdir 542 (time 1788546911.59 total 30.08 last 16.06)
 - mkdir 684 (time 1788546921.67 total 40.16 last 14.08)
 - mkdir 833 (time 1788546931.71 total 50.20 last 14.85)
total: 1000 mkdir in 60.04 seconds: 16.66 ops/second
 - mkdir 183 (time 1788546891.34 total 10.02 last 18.27)
 - mkdir 360 (time 1788546901.39 total 20.06 last 17.62)
 - mkdir 510 (time 1788546911.48 total 30.15 last 14.87)
 - mkdir 649 (time 1788546921.52 total 40.19 last 13.85)
 - mkdir 788 (time 1788546931.53 total 50.20 last 13.88)
 - mkdir 960 (time 1788546941.57 total 60.24 last 17.13)
total: 1000 mkdir in 62.36 seconds: 16.03 ops/second
Time for file creation 71 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.42 seconds: 23.93 ops/second
 - mkdir 168 (time 1788547462.07 total 10.01 last 16.78)
 - mkdir 347 (time 1788547472.09 total 20.02 last 17.88)
 - mkdir 530 (time 1788547482.11 total 30.05 last 18.26)
 - mkdir 708 (time 1788547492.15 total 40.09 last 17.73)
 - mkdir 882 (time 1788547502.20 total 50.14 last 17.32)
total: 1000 mkdir in 56.71 seconds: 17.63 ops/second
 - mkdir 176 (time 1788547464.86 total 10.04 last 17.53)
 - mkdir 368 (time 1788547474.89 total 20.06 last 19.16)
 - mkdir 558 (time 1788547484.94 total 30.11 last 18.90)
 - mkdir 737 (time 1788547494.98 total 40.15 last 17.83)
 - mkdir 908 (time 1788547504.99 total 50.17 last 17.07)
total: 1000 mkdir in 56.22 seconds: 17.79 ops/second
 - mkdir 173 (time 1788547464.71 total 10.02 last 17.26)
 - mkdir 358 (time 1788547474.73 total 20.04 last 18.46)
 - mkdir 542 (time 1788547484.75 total 30.06 last 18.36)
 - mkdir 716 (time 1788547494.78 total 40.09 last 17.35)
 - mkdir 885 (time 1788547504.83 total 50.14 last 16.81)
total: 1000 mkdir in 59.08 seconds: 16.93 ops/second
 - mkdir 173 (time 1788547464.73 total 10.01 last 17.29)
 - mkdir 364 (time 1788547474.73 total 20.01 last 19.10)
 - mkdir 543 (time 1788547484.81 total 30.09 last 17.76)
 - mkdir 715 (time 1788547494.87 total 40.15 last 17.10)
 - mkdir 886 (time 1788547504.90 total 50.18 last 17.05)
total: 1000 mkdir in 59.08 seconds: 16.93 ops/second
 - mkdir 172 (time 1788547464.85 total 10.05 last 17.12)
 - mkdir 356 (time 1788547474.92 total 20.11 last 18.29)
 - mkdir 540 (time 1788547484.92 total 30.11 last 18.40)
 - mkdir 717 (time 1788547494.92 total 40.12 last 17.69)
 - mkdir 889 (time 1788547504.98 total 50.18 last 17.10)
total: 1000 mkdir in 59.17 seconds: 16.90 ops/second
 - mkdir 178 (time 1788547465.13 total 10.01 last 17.79)
 - mkdir 357 (time 1788547475.18 total 20.05 last 17.82)
 - mkdir 544 (time 1788547485.19 total 30.07 last 18.68)
 - mkdir 721 (time 1788547495.21 total 40.08 last 17.67)
 - mkdir 894 (time 1788547505.24 total 50.11 last 17.25)
total: 1000 mkdir in 58.87 seconds: 16.99 ops/second
 - mkdir 166 (time 1788547463.82 total 10.02 last 16.56)
 - mkdir 348 (time 1788547473.82 total 20.03 last 18.20)
 - mkdir 531 (time 1788547483.83 total 30.04 last 18.28)
 - mkdir 704 (time 1788547493.83 total 40.04 last 17.29)
 - mkdir 868 (time 1788547503.87 total 50.08 last 16.33)
 - mkdir 998 (time 1788547513.91 total 60.12 last 12.95)
total: 1000 mkdir in 60.26 seconds: 16.60 ops/second
 - mkdir 170 (time 1788547464.58 total 10.03 last 16.96)
 - mkdir 353 (time 1788547474.60 total 20.04 last 18.27)
 - mkdir 533 (time 1788547484.62 total 30.07 last 17.95)
 - mkdir 706 (time 1788547494.65 total 40.10 last 17.25)
 - mkdir 873 (time 1788547504.66 total 50.10 last 16.70)
 - mkdir 997 (time 1788547514.66 total 60.10 last 12.40)
total: 1000 mkdir in 60.33 seconds: 16.58 ops/second
 - mkdir 159 (time 1788547463.51 total 10.05 last 15.81)
 - mkdir 334 (time 1788547473.51 total 20.06 last 17.49)
 - mkdir 517 (time 1788547483.52 total 30.07 last 18.28)
 - mkdir 690 (time 1788547493.54 total 40.09 last 17.27)
 - mkdir 852 (time 1788547503.56 total 50.10 last 16.17)
 - mkdir 980 (time 1788547513.61 total 60.16 last 12.73)
total: 1000 mkdir in 62.28 seconds: 16.06 ops/second
 - mkdir 162 (time 1788547464.39 total 10.01 last 16.18)
 - mkdir 342 (time 1788547474.41 total 20.03 last 17.97)
 - mkdir 514 (time 1788547484.43 total 30.06 last 17.16)
 - mkdir 684 (time 1788547494.51 total 40.13 last 16.87)
 - mkdir 849 (time 1788547504.56 total 50.18 last 16.42)
 - mkdir 969 (time 1788547514.69 total 60.31 last 11.85)
total: 1000 mkdir in 62.81 seconds: 15.92 ops/second
Time for file creation 72 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788547524 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1788547525 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788547525 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788547525 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1788547526 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788547526 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788547526 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1788547526 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1788547526 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1788547526 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8