Thanks for the advice!
I just played a game right now. I used 6 out of 10 ability bonuses and I set all the AI's to "smart". I then selected a medium galaxy and set the habitable planets to "rare".
The game started out ok.. I explored the galaxy and colonized 1 solar system with 2 planets (total of 3 planets).
There was one sector that had 2 Torian systems, 2 Yor Collective systems and 1 minor race systems. I thought wow.. a sector with 5 habitable systems, how great would it be to own all those systems and set lots of starbases in the sector. About 10 turns later, the Yor Collective AND the minor race (they usually get great planets) surrendered to the Torians. I thought, "Now I'm screwed, they've got 6 planets in 1 sector!".
Anyway, I played on and decided to build up a defensive force, rather than an offensive one. I build starbases on 3 resources and invaded 1 planet owned by a minor race. Right after I invaded the planet, the minor race surrendered to the Torians (with 2 planets) and I thought... "THIS IS REALLY UNFAIR!....Ok.. this might be the challange I wanted :)".
At this point the Torians were bigger than I was in every way. They had 8 planets (I had 4) and they had lots more influence, military, population and technology than I. From then on I just built every social improvement I could on my 4 planets and built starbases and not ships.
About the time I researched Battleship, most of the systems in the galaxy converted to terran ownership (in about 10 turns) and I won MILITARY VICTORY without attacking anyone (aside from the original minor race). Admittedly, by then I did have the best influence, military and technology, but the funny thing is my score was only 902. LOL