I see, i.m guessing it only happens when you change the race name as I altered a few other races but not their name and i don't get multiples of them.
Correct. The name has to be changed in order for the game to recognize it as a raceconfig.xml file.
I tried deleting the altarian empire entry on the screen where you select your abilities etc. i started the game and they were still there!
Okay, go to "Owner\Documents\My Games\*Version of GC2 You Want to Edit*", then scroll down until you see a file that says "Altarian Empire." It's a raceconfig.xml file. Just right-click the file, scroll down on the pop-up menu, and hit "Delete." That should do the trick, but to be on the safe side, start a new game as a generic civ, then quit the game right after it is done loading, then perform all the instructions I just listed.
If you need anymore help, feel free to ask.