WinterMilestone 1 hamdur.rahman

From crowdresearch
Jump to: navigation, search

Experience the life of a Worker on Mechanical Turk

Registration declined

Reflect on your experience as a worker on Mechanical Turk. What did you like? What did you dislike? If you're from outside the USA and unable to access MTurk, try try the worker sandbox, or other sites like CrowdFlower or Microworkers or Clickworker.

Experience the life of a Requester on Mechanical Turk

Not available in my country

Reflect on your experience as a requester on Mechanical Turk. What did you like? What did you dislike? Also attach the CSV file generated when you download the HIT results. If you're from outside the USA and unable to access MTurk, you can try the MTurk requester sandbox, or CrowdFlower or Microworkers or Clickworker

Explore alternative crowd-labor markets

Compare and contrast the crowd-labor market you just explored (TaskRabbit/oDesk/GalaxyZoo) to Mechanical Turk.

Microworkers

What are the task performed by me?

  • Register as microworker.
  • Find job for me.
  • Performed job like "Signup".

What did you like?

  • Very different from other website. It provides single registration and then I can be worker as well as requester.
  • Bonus for quality and quantity of work.

What did you dislike?

  • The registration process should be simple for user. There are lot of informative hints/checks that should be informed beforehand (Like password rule).
  • The very first page provide lot of words with conflicting concepts like jobs, tasks, campaigns as well as lot of abbreviation that will only force a user to read the help or exit.
  • The work described seems that the requester has described it from his point of view and expect the worker to understand it.
  • Worker cannot create a mental model as to how he can complete a work(I will use this word) and earn money.
    • What to achieve is not described properly.
    • What are the steps from initiation to competition.
    • How a worker can succeed or has he succeeded?
    • How to send a proof of job done correctly? No instant feedback.
  • The work takes more time than mentioned as requester create concepts of work from his point of view rather stepping in the shoe of worker. Always the question will come "Is it worth my time" to do this work.
  • Too much is asked to prove your authenticity and quality. Too much cross checks.

What do you think can be improved about the system?

  • Searching of works was tough and filters made it more frustrating. They could have taken information from user while registering like country, language, skills, hobbies. This can be used as automatic filtering.
  • The form for requester is very lengthy with lot of instructions and conditions. If the requester can be provided with form that helps him to create a work with contextual instructions and conditions and step wise guidance.

Upwork/oDesk

What are the task performed by me?

  • Register as worker and requester.
  • Find job for me.
  • Performed job like "Signup".
  • Created job

What did you like?

  • It provides a step wise process to create your profile like services I can provide to client, education, skills.
  • For a work, there is lot of information that can help a worker like client feedback, proposal, status, information about client and much more.
  • From the requester point of view, the categories and filters to find freelancers really helped.
  • The job creation form has also step wise approach.

What did you dislike?

  • Even after having most of my information, it doesn't help me in searching a work that reflect the information that I have provided.
  • Two concepts are thrown to user "Find work" and "Find Job" pointing to the same page. Totally inconsistent.
  • The registration process should be simple for user. There are lot of information hints that should be informed beforehand (Like username rule).
  • It doesn't matter for the platform that a specialized job is done by an non-specialized person but it will impact timeline and quality.

What do you think can be improved about the system?

  • Even having a very intuitive form for creation of work, it fall flat at the most important juncture and that is describing a work and success criteria that can be easily understood by worker.

Readings

MobileWorks

* What do you like about the system / what are its strengths?

    • Breaking a task into smaller task.
    • Creating task that can be done from mobile.
    • Providing quality rating to worker and payment is dependent on this factor also.
    • Worker know before ahead what they will earn by completing this job.

* What do you think can be improved about the system?

    • The main aim of this platform to provide employment and development tool to worker at the bottom of pyramid. So this platform should not focus to become a platform that provides secondary job or extra money only.
    • Same task is provided to two worker to maintain quality reduces the efficiency of the platform.
    • Survey is not the right method to know about the usability of the platform. Some of the factor are time taken to compete a work, accuracy of work and more.

Flash Teams

I will start from the problem statement

  • What might we create if we knew that our children would become crowd workers?
  • Create a new standard for crowdsourcing platforms

It means, we are designing for the reflective user goal, which means designing to build long-term product relationships. It also mean, this platform should integrate in user broader life experience. So we have to also focus on user motivation, his life goals like learning new things, good earning for living, respect and success.

* What do you like about the system / what are its strengths?

    • The platform provide a way to accomplish complex interdependent goals like engineering and design.
    • Creation of an organization structure to complete a work. Providing responsibility of work and combing blocks that complete the work.
    • Creation of block that can be reused in other contexts.
    • Runtime recruitment of workers based on the need and skills
    • The whole worker organization is modular, team can easily grow and shrink.
    • Pipeline for parallel processing of work.
    • Structured hand-off between two blocks

* What do you think can be improved about the system?

    • The field experiment done was controlled to know the benefit between flash team and self managed team. These two teams where independent, but at the same time we could have thought about a team, where platform could help to create workflow, automated planning and notification and the work is done by self managed team with out DRI. Self managed team, if collaborated efficiently can help each other and keep the whole environment motivated. DRI is also a worker who is paid to do his job as per is KRA and it may happen that he will push other workers and that will result in dissatisfaction in the team.
    • If every task can be made as independent delivery with clear input and output, the team can become self-managed and there is no need of DRI. In longer term, even the DRI cannot resolve issues and all decision has to be taken by the requester. Its better to create a cohesive self managed team that can deliver, resolve issue and coordinate with requester and worker in earlier block as well as in the same block to get/provide clarity on work and expectation. One person in the block will take responsibility of impediments on rotation basis .
    • Runtime recruitment is a good idea but it should also take into consideration the learning of new worker about the project, domain and the environment. One aspect of the organization behavior is, supporting the team. I don't know how this will be taken care.
    • Since we are targeting to become a platform that can provide employment. We have to also consider the reflexive goal of worker like:
      • Learning new things while doing his work. We can consider of putting UI designer as mentee in user research block.
      • User will also want to advance in career and earn more with time to meet his end goals. so this platform should also take care of the career graph of a worker into consideration to create impact on workers and keep them motivated and hence trust the platform.
    • To create efficient parallel processing the workers of the nearest block (Input and Output) can also communicate and collaborate.
    • Worker should also know about the next task in is bucket as this will help him prepare.
    • Who fills the estimated time line? Worker should always update the time of completion. The system should automatically calculate velocity of the worker and block for further planning as well as future planning.
    • While creating a team authoring it will be near impossible of a user (requester) to review the team to ensure that all team blocks make sense in this context. The requester can take help of an expert worker. It will create an innovative platform where any person who has an idea can translate it into product with help of expert workers.
    • Foundry uses the planning algorithm to create a path with blocks. The planning algorithm should also take into account the human manipulation instinct and improvisation as per situation and learning. Like deliver a MVP (minimum viable product) to attend a trade show timeline.

Daemo

  • What do you like about the system / what are its strengths?
  • What do you think can be improved about the system?