Jump to content

Submissions/Making it Count: Programs Evaluation 2015

This is an accepted submission for Wikimania 2015.

Submission no.
Title of the submission

Making it Count: Programs Evaluation 2015

Type of submission (discussion, hot seat, panel, presentation, tutorial, workshop)


Author of the submission

Jaime Anstee

Co-Presenters: Edward Galvez, Maria Cruz

E-mail address



JAnstee (WMF)

Country of origin

United States

Affiliation, if any (organisation, company etc.)

Wikimedia Foundation

Personal homepage or blog


Abstract (at least 300 words to describe your proposal)

In November 2012, the Wikimedia Funds Dissemination Committee (FDC) proposed that we discuss “impact, outcomes and innovation, including how to measure, evaluate and learn” across the Wikimedia movement. This request raised some important questions, such as: • What will lead to a significant improvement in our overall community health? • How can we better learn from each other and adapt our programs?

To address the latter of these questions and help measure the impact of our programs, the Wikimedia Foundation’s Program Evaluation and Design initiative started in April 2013, with a small team and a community call to discuss program evaluation and has been working to develop evaluation capacity and reporting in order to map and mine programattic efforts led by volunteer and grantee community [program leaders.

This session will offer an overview of the second round of programs evaluation reporting covering 10 popular outreach programs — from on-wiki writing contests, photo events, and edit-a-thons to Wikimedia Education Programs and Conferences — findings related to their impact, and recommendations for increasing program effectiveness in terms of how programs develop, change and contribute to larger movement goals.

The data included in our second round of evaluation reports is expected to enable program leaders to compare, contrast, and connect to one another across different locations, languages and cultures. Specifically, the programs evaluation reports will: • help to guide choices of programs that impact shared movement goals • help find and share stories across different Wikimedia communities • help the WMF Grantmaking team to identify promising practices, and develop program toolkits and learning patterns • inform communities about promising practices and potential new partnerships

In addition to offering a brief overview of the latest programs impact evaluations, the session will include a facilitated application and discussion activity about how to use the existing measures to inform effective program planning and to continue to develop measures that capture our programs outcomes and impact. Session objectives include that Participants will:

  • Learn the scope of the 2015 Programs Evaluation reporting.
  • Learn how to contribute to shared program learning.
  • Practice how to use the reports to choose programs and set reasonable program targets.
  • Develop routes for shared learning and data use in program design.


WikiCulture & Community

Length of session (if other than 30 minutes, specify how long)

45 minutes

Will you attend Wikimania if your submission is not accepted?


Slides or further information (optional)

Slide deck

Special requests

Interested attendees

If you are interested in attending this session, please sign with your username below. This will help reviewers to decide which sessions are of high interest. Sign with a hash and four tildes. (# ~~~~).

  1. AKoval (WMF) (talk) 18:42, 28 February 2015 (UTC)[reply]
  2. Ocaasi (talk) 23:34, 4 March 2015 (UTC)[reply]
  3. Varnent (talk) 22:03, 8 March 2015 (UTC)[reply]
  4. Ovedc (talk) 08:55, 12 May 2015 (UTC)[reply]
  5. Ad Huikeshoven (talk) 07:02, 3 July 2015 (UTC)[reply]
  6. Add your username here.