Finally we get option to manage performance for Visual Studio in 2017 version. You can see it from help menu.
Here are options to manage performance.
It says that, if you set it to Use Default Behavior i.e. load source control explorer at startup it might take 4 seconds to load visual studio.
Recommended option is: Do not show window at startup. This will save up to 4 seconds on visual studio startup.