The first 50 turns or so seem like a click-fest. You have few worlds, economy is tight, and there are not many ships to pilot. It does take a while to build up a good infrastructure. However, after a while the game begins to slow down considerably. You have to check the AI's ships positions, constantly check production, manuver your ships to strategic points (offensive or defensive.) and finally, ensure that all your planets have a good balance between economic, research, and manufacturing aspects. On larger maps, I can easily spend 5 to 10 minutes checking and re-checking my strategy to make sure it is still working before I hit the "Turn" button.
If you want to slow things down in the beginning...I never ever ever use the Auto-Explore option on my scouts so I can find all the juicy planets in range first. This will help you a lot at the start of the game and keep you from clicking <Turn> so much.