How To Get The Most Out Of Crowdsourcing

Over the years I’ve written numerous times about not only the growth in crowdsourcing and other methods of open innovation, but the various studies seeking to understand how we can do so effectively.  It probably reached peak popularity a few years ago, when numerous studies emerged looking at everything from Innocentive style challenges to GalaxyZoo style citizen science projects.

The academic world have not been resting on their laurels however, and a recent paper from the University of Southern California explores how you can make the best of any crowdsourcing project you embark upon.

Crowdsourcing has very different risks depending on whether you’re hosting the challenge or participating.  For the hosts, you only pay out when you pick the winner, so it’s pretty risk free, but for participants, you risk putting a lot of effort in with no reward at the end.

The study explores how to manage this trade off to ensure you get the right mix of quality and quantity in your competition.  You basically strive to reduce the uncertainties as much as you can, whether These uncertainties tend to fall into one of three categories:

• Ill-defined criteria for success – many innovation challenges are So what can you do to reduce these uncertainties?  Based upon data from a real-life crowdsourcing platform, the researchers came up with a number of key strategies.  The first is to guarantee the prize If that’s not something you’re happy with, the next best strategy is to ensure you engage regularly with participants.  It’s normal for contests to last for a prolonged period of time, with some lasting several months.  It’s important, especially for longer contests, to engage with participants and provide them with feedback on their submissions.  What might seem insignificant feedback has actually proven to be hugely reassuring, even if only to convince the participant that the sponsor is an active participant in the challenge.  This also makes the participants more assured that the challenge is above board, and that payments will be made.

  The way you participate was also found to be important, with contestants looking for clues as to the competition they face from your feedback.  If people believe a deadset winner is already out there, then it’s very demotivating.  As such, it’s not a good idea to give really high ratings to participants, especially in the early stages, although when the prize was guaranteed, the demotivating effect of high ratings was diminished.

  Alternatively, you also don’t want to rate solutions too poorly.  If you rate too many entries as unacceptable, this has a negative effect on participation as it damages the relationship with participants as a whole.  It raises a fear that no solutions will ultimately be selected and so time is being wasted.

  It perhaps goes without saying that crowdsourcing contests are not guaranteed to succeed, and there are strategies you can deploy to enhance your prospects.  This paper provides an interesting new angle to explore, and will hopefully give you some useful tips for your next crowdsourced challenge.

  

  Wait! Before you go…

Adi Gaskell tells us: “I am a free range human who believes that the future already exists if we know where to look. From the bustling Knowledge Quarter in London, it is my mission in life to hunt down those things and bring them to a wider audience, with my posts here focusing particularly on the latest research on innovation and change.” Follow Adi @adigaskell