Crowdsourcing Software QA

Just saw the TechCrunch post about uTest, a crowdsourcing approach to software QA.  This is pure genius in my opinion.  QA is always a huge bottleneck in software development projects, and nobody wants to do it.  Kind of like double-checking your math homework.  Unit testing helps with a lot of it, but there are always a lot of tests that simply need a human to do them, and there’s no way you can automate the test (especially with rich Web interfaces).

uTest supposedly have over 2000 testers signed up today, which is a pretty formidable workforce (depending on how many projects they’re working on).  Not a bad way for somebody to make some extra coin in their spare time, and not a bad way for small business to offload their software QA process.

This strikes me as one of those painfully obvious ideas that companies should already be implementing internally.  Your QA department is overstressed?  Crowdsource your QA to anybody who wants to pitch in for a little extra cash (or some other kind of incentive).  Even if this is only rolled out internally it would give some relief to overworked QA departments, along with exposing the product to people who may have valuable insight.  If uTest has tightly wrapped up the legal end of things I can see them making a serious dent in QA departments, especially for small software shops.

Share and Enjoy:
  • Print
  • Digg
  • Facebook
  • Google Bookmarks
  • HackerNews
  • Reddit
  • http://www.zachleat.com/ Zach Leatherman

    If your application is web based, Selenium is a powerful tool that is a nice complement to existing web testing utilities.

    http://selenium.openqa.org/

    We use it at my work and it's a perfect fit.

  • Randy

    Jason,
    Microsoft has been doing this for years, cal it 1.0 and ship it, let the world test and provide fixes in the first service pack. works for them…

    randy

  • http://blog.belive.ws/2008/02/13/utest-beta-testers-community/ uTest – Beta Testers Community.

    With the software evolution, to offer to their users more features and become compatible with the most popular operative systems, some software applications tend to have hidden bugs. Imagine if you are Bill Gates, and you want to know if the last version of Word contains bugs! Microsoft and other companies uses the power of their community to test their software (and of course report bugs) and in exchange the testers will receive a discount, money or a software application. [...]

    http://blog.belive.ws/2008/02/13/utest-beta-testers-community/

    Regards,
    Adriano Lopes