CrowdSurfWork Platform

CSW Levels

Currently our CrowdSurfWork levels span between 4 through 7.   The details and resources for each level is provided below.

If you have questions about your level and qualifications please refer to the Levels below.  If you can not find the answer you are looking for feel free to contact us at support@crowdsurfwork.com. (May 2015 update: We are currently promoting to Level 4, before granting Transcription Review qualifications in Mturk to preserve fairness and accuracy of Transcript Reviews.)

.

Level 4 (MTurk only)

Job: Full Text Editor

Qualifications:

  • Transcription Qualification in Mechanical Turk
  • Transcription Review Qualification in Mechanical Turk
  • Full Text Review Qualification in Mechanical Turk
  • Full Text Review – General Media Qualification in Crowd Virtualizer (High volume demand only)

Requirements:

  • 0 rejections due to fraud in Transcription Tasks
  • Minimum approval rate of 95% in Transcription Tasks (unjustified rejects that caused a lower score will be considered)
  • QC Score of 3.7 or higher in Transcription Tasks  (unjustified rejects that caused a lower score will be considered)
  • Minimum of 500-1000 HITs transcribed in Mturk
  • Maintain a Full Text Review QC Score 3.5 and 3.64 and an approval rating of 90%

Back to the top
.

Level 5 (Mturk / CrowdSurfWork)

Job: Quality Control Checker

Qualifications:

  • Transcription Qualification in Mechanical Turk
  • Transcription Review Qualification in Mechanical Turk
  • Full Text Review Qualification in Mturk
  • Quality Control Transcript Qualification in CrowdSurfWork or MTurk
  • Timing Qualification in CrowdSurfWork or MTurk
  • Speaker ID Qualification CrowdSurfWork or MTurk
  • Special Handling Critical Qualification  CrowdSurfWork or MTurk

Requirements:

  • A minimum of 50 approved Full Text Review Tasks
  • 0 rejects due to fraud in Transcription Tasks
  • Approval rate of 100% or higher in Transcription Tasks  (unjustified rejects that caused a lower score will be considered)
  • QC Score of 3.7 or higher in Transcription Tasks (unjustified rejects that caused a lower score will be considered)
  • Minimum of 1000 HITs transcribed in Mturk
  • No fraudulent reviewing on Mtruk (Grading too harshly or too leniently, letting bad HITs pass without correcting them)
  • Achieve a Full Text Review QC Score 3.65 – 3.74 and an approval rating of 90%  and keep it up
  • No fraudulent QC reviews delivered
  • No fraudulent Timing Tasks delivered

Back to the top
.

Level 6 (MTurk / CrowdSurfWork)

Job: Quality Control Reject Editor

Qualifications:

  • Transcription Qualification in Mechanical Turk
  • Full Text Review Qualification in Mturk
  • Quality Control Transcript Qualification in CrowdSurfWork or MTurk
  • Timing Qualification in CrowdSurfWork or MTurk
  • Speaker ID Qualification CrowdSurfWork or MTurk
  • Special Handling Critical Qualification  CrowdSurfWork or MTurk
  • Transcription Review Qualification in Mechanical Turk
  • QC Reject Qualification CrowdSurfWork or MTurk
  • Entertainment Timing in CrowdSurfWork or MTurk
  • Invitations to work Special Handling Tasks when demand is there (Qualifications will be revoked again after completion of limited time projects)

Requirements:

  • A minimum of 50 approved Full Text Review Tasks, 50 QC tasks, and 50 timing tasks.
  • 0 rejects due to fraud in Transcription Tasks
  • Approval rate of 100% or higher in Transcription Tasks  (unjustified rejects that caused a lower score will be considered)
  • QC Score of 3.7 or higher in Transcription Tasks  (unjustified rejects that caused a lower score will be considered)
  • Minimum of 1000 HITs transcribed in Mturk
  • Minimum of 100 HITs reviewed in Mturk
  • No fraudulent reviewing on Mturk (Grading too harshly or too leniently, letting bad HITs pass without correcting them)
  • Achieve a Full Text Review and Special Handling QC Score between 3.75 – 3.84 and approval ratings of 90%
  • No fraudulent QC reviews delivered
  • No fraudulent Timing Tasks delivered
  • QC Reject QC Score of 3.75 or higher and an approval rating of 90%

Back to the top
.

Level 7 (MTurk + CrowdSurfWork)

Job: Master Transcript Editor

Qualifications:

  • Transcription Qualification in Mechanical Turk
  • Full Text Review Qualification in Mturk
  • Quality Control Transcript Qualification in CrowdSurfWork or MTurk
  • Timing Qualification in CrowdSurfWork or MTurk
  • Speaker ID Qualification CrowdSurfWork or MTurk
  • Special Handling Critical Qualification  CrowdSurfWork or MTurk
  • Transcription Review Qualification in Mechanical Turk
  • QC Reject Qualification CrowdSurfWork or MTurk
  • Entertainment Timing in CrowdSurfWork or MTurk
  • Invitations to work Special Handling Tasks when demand is there (Qualifications will be revoked again after completion of limited time projects)
  • Invitations to work limited time Special Projects and Beta Testing

Requirements:

  • A minimum of 50 approved Full Text Review Tasks, 50 QC tasks, 50 timing tasks, and 50 QC Reject tasks.
  • 0 rejects due to fraud in Transcription Tasks
  • Approval rate of 100% or higher in Transcription Tasks  (unjustified rejects that caused a lower score will be considered)
  • QC Score of 3.7 or higher in Transcription Tasks  (unjustified rejects that caused a lower score will be considered)
  • Minimum of 300 HITs transcribed in MT
  • Minimum of 50 HITs reviewed in MT
  • No fraudulent reviewing (Grading too harshly or too leniently, letting bad HITs pass without correcting them)
  • Keep a Full Text Review QC Score between 3.85 – 4.0 and an approval rating of 95%
  • No fraudulent QC reviews delivered
  • No fraudulent Timing Tasks delivered
  • QC Reject – QC Score of 3.75 or higher and an approval rating of 95%
  • No justified Rejects in QC Reject tasks

Back to the top
Please note: CrowdSurf will promote and/or demote workers based on merit and demand for work.* 

 

 

*Merit is based on Average QC scores, and QC scores for different tasks are calculated separately.