Milestone 8 Pumas Foundation 1 Micro macrotask market

From crowdresearch
Jump to: navigation, search

Building communities and empathy as markets

Micro+macrotask market - Goals

Could the same marketplace scale from 2 to N people not just labeling images, but also Photoshopping my vacation photos or mixing my new song? The main idea is to maintain the submission approach from microtask markets, which is focused on two to hundreds of replications, but find ways to make it accessible to both microtask and expert work.

As Adam Marcus mentioned last week: "Why would a programmer want to join a crowd work platform? The draw of AMT right now is that you can find jobs quickly. Can we enable that same benefit for programmers?”

Challenges

The challenges lie on creating a market place that is expandable to both types of tasking. We will have to think how this market can look, how they bind together and if the approach feels natural for both types of tasking.

Tasks are an important aspect, and their submission has to be considered, how will this be done.

Who has the final saying on the quality of the system and how is feedback handled?

How do you trust that someone is an expert?


Micro-tasking vs Macro-tasking Overview

Micro-tasking refers to dividing work into smaller pieces and providing each piece to a worker. The worker gets paid to do that task. Mechanical Turk, AMT, Microtask and MobileWorks are some examples of micro-tasking markets. One the other hand macro-tasking refers to bigger tasks, more like projects. These can be tackled by a single person or a team. They represent "large jobs" [ref] on the crowd market. There is supposed to be more collaboration between requesters and workers - contrary with to the current situation of micro-tasking - and regular meeting to see project advancements, giving feedback and arranging new milestones. How do we create a market that can work with both schemes? Communities and empathy.


Proposal Overview

Pilars.png

To build an expandable market we need the idea of having micro-tasking behind macro-tasking. The pilars (or foundations) shown above act as the core areas of this idea, they sustain any project: funding, testing, technical development and creative aspects.

Projects or individual tasks are formed. People can choose one (or more) pilar(s) to join depending on their interests, goals and skills. They are background checked and connected with other requesters/workers in the same circle. Everybody is entitled to propose projects and tasks are assigned per projects.

Projects and Tasks

Join.png

Workers can have one of two options: Join a projects and get assign part of the project or do a simply task, which is part of a project, but they do not have to know what the project is about (similar to having HITS). In both options workers are entitled to communicate with other workers and requester to get feedback or help.

Tasks.png

Tasks are not rejected, they are reviewed, if the requester is not pleased with the final outcome then he/she can ask for change or give it to another worker. If the task is returned for changes the worker has to receive feedback from the requester and a new deadline (like a second chance for improvement). If the requester asks to have another workers perform the task then the first worker has to be paid 50% of the original price obtained. Nobody walks away empty handed, but if malicious activity is suspected on either side then actions can be taken by a higher law committee which is set to regulate and moderate all instances. This attribute goes above the foundations The moderators can chose to resolve the issue by in a small committee or can be posted to the whole community to get voted and peer-reviewed. This depends on the severity and type of issue. If privacy of data is involved a small committee is preferred.

Trust

Trust is created by empathy and aligning workers and requesters to hobbies, so that they can all take part on social activities, get to know each other and trust each other to work together, to communicate and to ask for help and even revisions.

Hobbies.png

Workers/Requesters also gain "trust points" (similar to reputation) according to their work. They have points for social activities and for work. Work trust points are gained according to how well someone performed a specific task, if there were issues involved, how big was the task, how much was it paid. A rubric for trust points is created (and weighted) according to those parameters.

Community

The whole idea is to make this market a community. Work on empathy to build trust and distribute power. Work on open communities where multidisciplinary is thanked but everybody can pitch in with ideas and help. Everyone can contribute with their own skills, expertise and interests. Creative people can join crowd creativity and join those type of projects or even be a subsection in other projects that involve creativity. Programmers can join expertise teams and add their skills to the work done.

Cooperation.png