If I have several clusters that would also work. I guess I will have to play with the queues some to see how I can make constructors not go towards the military point.
It seems that this is best accomplished with colony rally points.
All I did was create a "normal" rally point. There are also Fleet and Colony I think as the other options.
No. You're still not understanding what a colony rally point is.
Colony is not an option of the rally point settings, the rally point settings are normal, fleet and attack. The Colony Rally point is a function of the colony, not a function of the rally point. The only way to set colony rally points are by using the governor to set all colonies that have no rally point to have the same rally point. The only other way to set colony rally points and the only way to have different planets have different colony rally points is to set each planets rally point on an individual planet by planet basis. You can then set planets producing military ships to go to your military rally point and planets building constructors to go to your constructor rally point.
Otherwise there is no way to direct different types of ships to different rally points except by setting each and every ship/fleet's destination individually.
You set a colony rally point for each individual planet in one of two ways. The easiest way is to select the planet on the main screen and click the rally button which brings up the assign rally point dialog box which in this case applies to the planet as opposed to a ship/fleet. This is shown in the following screenshot. The second method is to go to the colony screen and click on "Build Ship"to get to the Starport screen and then click on "Rally Point" at the bottom of the screen but the first method is far easier.

I said as much an hour ago.
I know. I was just a little more explicit as to precisely what you click to do it.
It appeared he was confused and I wanted to be as explicit as possible. He still later thought a colony rally point was a particular setting of the rally point like fleet or attack as opposed to a setting for each planet. Also I suggested the cluster with intermediate rally points in reply 1.
One thing I didn't know was that there is an autolaunch setting in the option menu. I still only play DL which doesn't have that option. In DL setting a colony rally point is the *only* way to get autolaunch that's why I use it and then each turn simply use the governor to kill the destination.
One final point about rally points is that you can move them. Some folks create new rally points and delete the old as the action moves, it can save a little time to just move the current rally point and all the ships/fleets en route to it will simply adjust their path.