Submissions/Crowd control - How to build effective community monitoring for crowdsourced projects

This is an accepted submission for Wikimania 2015.

From the session].
Submission no.
Title of the submission
Crowd control - How to build effective community monitoring for crowdsourced projects
Type of submission (discussion, hot seat, panel, presentation, tutorial, workshop)


Author of the submission

Rebecca Cotton

E-mail address

Rebecca Cotton
Country of origin
Abstract (at least 300 words to describe your proposal)

Crowdsourcing is all the range for 2015 and beyond. The Wikimedia movement as well as many other free knowledge projects have gained decades of experiences with this. In the past few years the idea of crowdsourcing has been seeping more and more into commercial business ideas and is slowly gaining a foothold in local governance.

The gains are obvious: many people working on little tasks collaboratively have the potential to get things done a lot faster and more effectively than very few people taking on a huge task by themselves.

Successful crowdsourcing projects often times have one thing in common - excellent community management.

In order to do great community management it can be very helpful to take of the blindfolds and take a dive into data about the community.

  • How big is the community?
  • What kind of people are part of your community?
  • How do people contribute toward the community?
  • What do they need?
  • What are different user dynamics between people contributing often and those contributing sporadically?
  • And if you want both kind of contributors, how can you build a system that makes it a great experience for both kinds of people?

The most important question being of course:

  • How do you know if your crowdsourced project is healthy (aka. working as designed)?

I have been designing and using measurements for key performance indicators (KPIs) for both Wikimedia projects (evaluating the whole volunteer support program as well as single projects) as well as a business relying on crowdsourcing for data collection.

In this talk I will give an intro to how to set up KPIs for crowdsourcing projects:

  • What questions to ask
  • How to verify thesis you have from limited data sets
  • How to work with user stories and set up lean and simple user testing with very little resources
  • And how to set up a low maintenance process to monitor the data contentiously

Since Wikimania talks only last 30 mins I would also offer 1-2 workshops of ca. 1 hour in the open spaces at Wikimania for interested folks where we can discuss and work on your own projects or just discuss the whole topic more in depth. Just indicate below if you would also be interested in more intensive workshops.


WikiCulture & Community

Length of session
30 minutes
Will you attend Wikimania if your submission is not accepted?

I will try, but it depends on getting a scholarship.


Interested attendees

If you are interested in attending this session, please sign with your username below. This will help reviewers to decide which sessions are of high interest. Sign with a hash and four tildes. (# ~~~~).

I am interested in the talk

  1. Daniel Mietchen (talk) 01:18, 15 February 2015 (UTC)[reply]
  2. Jaredzimmerman (WMF) (talk) 08:51, 23 February 2015 (UTC)[reply]
  3. Sage (Wiki Ed) (talk) 00:20, 25 February 2015 (UTC)[reply]
  4. KrystleChung (talk) 20:30, 1 March 2015 (UTC)[reply]
  5. Quiddity (WMF) (talk) 06:19, 23 March 2015 (UTC)[reply]
  6. Лорд Бъмбъри (talk) 10:57, 30 March 2015 (UTC)[reply]
  7. Pineapples100 (talk) 22:39, 30 March 2015 (UTC)[reply]
  8. Ad Huikeshoven (talk) 13:00, 14 June 2015 (UTC)[reply]
  9. Maximo Perez Rivas (talk) 17:15, 16 July 2015 (UTC)[reply]
  10. Add your username here.

I am interested in taking part in a workshop

  1. Ad Huikeshoven (talk) 13:00, 14 June 2015 (UTC)[reply]
  2. Maximo Perez Rivas (talk) 17:14, 16 July 2015 (UTC)[reply]
  3. Add your username here.