Web's Largest listing of crowdsourcing and crowdfunding events

Events

Advertise

Web's Largest Directory of Sites

2,358 crowdsourcing and crowdfunding sites

Communitysourcing: Engaging Local Crowds to Perform Expert Work Via Physical Kiosks

document Cloud Labor, Distributed Knowledge

Communitysourcing: Engaging Local Crowds to Perform Expert Work Via Physical Kiosks
Posted on June 21, 2012

Online labor markets, such as Amazon’s Mechanical Turk, have been used to crowdsource simple, short tasks like image labeling and transcription. However, expert knowledge is often lacking in such markets, making it impossible to complete certain classes of tasks. In this work we introduce an alternative mechanism for crowdsourcing tasks that require specialized knowledge or skill: communitysourcing — the use of physical kiosks to elicit work from specific populations. We investigate the potential of communitysourcing by designing, implementing and evaluating Umati: the communitysourcing vending machine. Umati allows users to earn credits by performing tasks using a touchscreen attached to the machine. Physical rewards (in this case, snacks) are dispensed through traditional vending mechanics. We evaluated whether communitysourcing can accomplish expert work by using Umati to grade Computer Science exams.

We placed Umati in a university Computer Science building, targeting students with grading tasks for snacks. Over one week, 328 unique users (302 of whom were students) completed 7771 tasks (7240 by students). 80\% of users had never participated in a crowdsourcing market before. We found that Umati was able to grade exams with 2% higher accuracy (at the same price) or at 33% lower cost (at equivalent accuracy) than traditional single-expert grading. Mechanical Turk workers had no success grading the same exams. These results indicate that communitysourcing can …

One challenge in building a web design tool that attempts to leverage examples is gathering design alternatives and providing mappings between web page elements. We present a crowdsourcing interface to collect user-generated correspondences between two web pages. Our iterative refinement of the interface was guided by three main design principles: modularize the task, minimize user errors, and provide relevant information. As an initial experiment, we collected fifteen web pages with diverse style and layout, and deployed the interface on Amazons Mechanical Turk. Preliminary data analysis shows that Turkers take longer than experts and define fewer mappings in general. Further evaluation and experiments with different types of pages will identify directions for a web design tool that enables the use of any web page as a design template.

Summary
Online labor markets, such as Amazon’s Mechanical Turk, have been used to crowdsource simple, short tasks like image labeling and transcription. However, expert knowledge is often lacking in such markets, making it impossible to complete certain classes of tasks.

Description
This work introduces an alternative mechanism for crowdsourcing tasks that require specialized knowledge or skill: communitysourcing — the use of physical kiosks to elicit work from specific populations. It investigates the potential of communitysourcing by designing, implementing and evaluating Umati: the communitysourcing vending machine.

Tags: Amazon, Crowdsourcing, Outsourcing, Umati, web design tool, web page elements

Posted by Claire Mackay

Jun 21, 2012 08:25 am GMT Viewed 1097 times

Author: johnkrol Source

Contact us if you are owner of this content and want to make changes.

Download Flag This

Events

Communitysourcing: Engaging Local Crowds to Perform Expert Work Via Physical Kiosks

Comments

Crowdsourcing.org

Categories

Content

Crowdsourcing.org, an initiative by massolution®

Events

Related Content

Communitysourcing: Engaging Local Crowds to Perform Expert Work Via Physical Kiosks

Comments

Crowdsourcing.org

Categories

Content

Crowdsourcing.org, an initiative by massolution®