Draginol Draginol

A victim of ones own success

A victim of ones own success

Practical realities of adaptive software development

Stardock's business model has been predicated adapting to what users request.  The company's motto is "Innovation on demand".

The idea being that we release the best product we can and then we rapidly enhance it based on user feedback.  Users of Object Desktop, for instance, are very familiar with this.  We have also introduced this model to our game development which has had very positive results.  Our conclusion isn't so much that Stardock is "great" at customer service but rather most PC game companies are simply not geared up to do the kind of development model we're used to.

The PC utility market is extremely competitive and so rapid updates are one of our critical advantagers.  Since 1999, a huge percentage of Stardock's R&D budget has been put into building an infrastructure to crank out user requested updates quickly.

Central to that strategy has been Stardock Central which allows, literally, a developer to put up a build onto the system and have it available to users without creating an installer.  In addition, a custom set of forums that interact with the user's account information was created over the past few years that lets them interact with all our sites, Stardock Central, and access things quickly and easily depending on which site they're on.  It also has allowed us to implement various "community" features that helps make users part of the team -- because they are.

Where the model is starting to break down is as we've become more mainstream, the sheer numbers of users has started to show weaknesses in our system.  In addition, the demographic has dramatically changed which has significantly hampered our ability to do what we're best known for doing -- crank out rapid updates.

In the past, especially with Object Desktop, our demographic was almost completely all power users.  As a result, we could release alpha-level updates to those users who, in turn, would let us know what changes they wanted or any bugs they found. Power users who weren't comfortable with alphas would wait for betas and power users not comfortable with either would wait for releases.  Bugs, features, etc. would be queued up to be addressed and the system flowed nicely.

Over the past year or so, the utility market we're in, the desktop enhancement market has had two odd things happen: First, the market has increased in size dramatically. Secondly, the number of other providers of such software has strangely declined (despite more opportunity).  What happened to all these developers is subject for a different topic. But the net result is that WinCustomize.com, Stardock's site for supporting Windows customization, exploded with far more users than had been expected. Even now, it's basically limited by server levels.

The market size increasing though has brought in users who are not power users. Users who don't read manuals, don't understand the difference between alpha, beta, RC, release. Don't know how to resolve problems on their own.  The net result has been that the same updates that we used to just throw out onto Object Desktop (or ThinkDesk) now have to go through an internal QA or else we'll suffer in massive support calls (phone, email, more phone, more email) that drowns out truly serious support (In the last week of February, a sampling of tech support email resulted in the conclusion that roughly 2 out of 3 emails would have been resolved had the user simply looked at the readme in the given product or gone to the knowledge base -- two years ago, that would have been 1 out of 10 emails).

Of course, we're not set up with that kind of internal QA, not in terms of a long-term infrastructure.  When we do a major release like WindowBlinds 5 or Galactic Civilizations II we can put together a pretty impressive QA team using people from other parts of the company. But those people are far too expensive to have doing QA for the long term.  So now we're in the position of having to build a full time QA staff that can rapidly handle the updates that come from the various development teams and get them out there.

Similarly, we're going to have to start hiring people to do forum support. More people I should say.  In our rapid development model, we would put up an update that would list what's in there and users would respond with what they found worked/didn't work.  Now, we put up updates and people will ask "Did you fix <bug X>?" or "When is <Feature Y> going to be put in?"  That is, assuming the user even reads through the change log at all before asking questions.  Then there's the users who read the change log but don't try the update and complain about theoretical things.  "Oh, I don't like that new WindowFX feature, I think it might slow down my computer." or "I think the economic change in GalCiv II is bad" (without having tried it).

Of course, right now, we simply don't have those people to beef up a permanent large scale QA department or to act as a day to day buffer between development and support. They have to be hired and trained which we are, but it's a slow process.

So the business model of developing niche software (desktop enhancement utilities and turn based strategy games) in order to attract power users and hard core games has started to break down.  They have started to break down because those markets are no longer niche markets. Turn based strategy games have become mainstream and desktop enhancements are mainstream. And so we will have to evolve.  But it's been painful and likely to continue to be painful for awhile.

29,780 views 29 replies
Reply #26 Top
don't forget that you can also have *free* moderators (that is : they are not paid, they are just reliable fans willing to help)

Well, I may be wrong but i think that all people with the rank of Governor have moderators right. And they aren't all stardock members.
Reply #27 Top

I think one of the things at work here with regards to support that hasn't been mentioned is that joe-user thinks a beta release is something very different from what we in the software world (well old school) think of. This is directly down to the effect of endless Google and Microsoft "betas", software that gets released into the wild for extended periods with no support and yet is treated as a fully released productioon ready product by droves of users. Unsupport "beta" game patches from the development houses (unsupported by distributors) have only served to reinforce this notion.

Thus, when Stardock posts a new "beta" what happens? Every man and his dog rush to download it because a beta to them is just another software release. Naturally they then recoil in horror when the thing crashes or a glaring issue crops up. Their expectations are wildly out of step with what Stardock is thinking when releasing a beta into the wider community. Yes there are a few disclaimers but who amongst these users reads such things? Isn't that just the usual legal jargon you get with Microsoft and co? Clearly not - but they're so used to blindly blazing past this stuff that they'll rarely stop to consider the implications.

Some of the suggestions above are right on the money in relation to drawing the power users into the fold and keeping them close, to provide you with that invaluable feedback you couldn't otherwise get with purely internal testing. Meantime you need to keep the masses a little more at arms length and keep them happy with all the frequent communications that we've come to expect and respect.

That said, there are frequent comments on these forums about the "feel" of these forums being off. I too never feel terribly comfortable with the SD forums and I can't quite put my finger on why or just what it is. I use a great many forums and there's just something not quite right here. Maybe you need a little more structure. Maybe it's because I can't seem to find my own posts (did they disappear?), and maybe it's just some basic navigation and cues that aren't there or rather aren't immediately obvious. But overall a cleaner more streamlined and intuitive forum should go a long way towards making users more inclined to look before asking and check faqs before asking the same old stuff time and time again.

Then you can more readily bury the beta releases a little more out of sight, and with some stronger warnings about just what the beta entails maybe you can reduce people's expectations a little and get back to the more measured feedback and dialog you're wanting.

Still, I have to profess that I've avoided the two beta releases because of the number of outright crash reports and apparent quirks of these new builds. I guess what bothers me the most is that through good intentions, a rush to deliver what the users want (demand?) and a desire to keep interest and sales high, there's a considerable risk that code stability will suffer. A buggy release could, in very short order, negate much of the amazing goodwill that's been built up in recent times and I for one would hate to see that happen.

From the outside looking in there are a surprising number of crashes and seemingly obvious issues being reported, although beta 2 looks a lot better. I appreciate that not having tried them i can't really comment with any authority on this, and I risk coming across as someone who reads all the moaning and takes it as gospel, but with your plans to release 1.1 next week I'm simply hoping that this upcoming release is getting the time it needs to properly cement the success that is GC2. Remember all these non-power-users that you're talking about will be a lot less tolerant of bugs and the need for incremental quick releases, so taking the time needed to ensure this build is watertight and polished is probably more important than ever.

Needless to say, the team at Stardock have my utmost respect and I applaud what you're doing and how you're doing it. You're setting new standards in customer interaction, customer engagement, openness and all around good humour and I cannot but be impressesd. But there are inevitably going to be some growing pains with the well deserved success of GC2 and the rest of your products.
Reply #28 Top
I've read all of Brad's post, but not all the comments.

Brad: Have an offer to sign up for beta-testing. Make the users go through a lengthy sign-up process (or something to weed out the chaff -- stardock central's ease of use kind of goes against that) and make them understand they are BETA testers (perhaps with an NDA).

The basic idea - which I'm sure brighter minds are working on - is to separate the ALPHA and BETA updates from the general public being able to just click & download them. You've made it too easy, I'm afraid to say.
Reply #29 Top
re #28: Horrible Idea... Keep beta testing the way it is!

I've no doubt that Stardock will transition. You guys are just so darn popular you need more folks, period. I am confident that you will grow and prosper.

The more popular you guys are the bigger chance that trolls and undisciplined kiddies will spawn in the forums. Cheers on getting some mods (moderators).

It's happend more times than we can count.. (You might be a galactic redneck if.... ) someone disses the AI for being a tard when they're playing easy level Someone claims the game is bugged to hell and after we get them to post their debug, we catch them with last year's drivers (or worse yet 2004! ) Someone claims they found a bug and its actually that the game was designed intentionally that way. Someone claims Stardock sucks, has the worst tech support ever, etc. when we KNOW that they are outright wrong about that, and they are expecting immediate response/miracles and/or being unreasonable. For the record, Stardock has wonderful, beautiful people that work in customer support. I wish Stardock owned more companies so I get that level of support elsewhere The latest one, (you might be a galactic redneck if) You tell people not to download the latest beta cause it has bugs. This one proves it to the world when you post it on the forums.