From the colony manager screen:

Select a planet->Change the build queue->Exit back to colony manager. The build queue is not updated.

Select a planet->Click to change the starship build. You go directly back to the colony manager instead of the ship build screen.

I'm going to submit a bug report, but the first one was really confusing me at first and I thought I would give others a heads up.