If you're like me, the thought of receiving a grade for your work can be scary. I still shudder at the memory of receiving papers back in grade school with red editing marks all over the place. However, you owe it to yourself (and to the Turkers who will edit your work) to check in at the turkers.castingwords.com site and review the feedback that your Turking peers have provided. Armed with your Worker ID at the site, you'll have access to the status of your CastingWords' HITs as well as the feedback generated by the "grading" HITs completed by your fellow Turkers.
Yes, some of the graders can be unnecessarily harsh. Don't take the criticism personally. Look for trends that will help you correct things that you may not even realize you're doing. For example, I didn't realize that the rules for labeling speaker names had changed until I read the comments pointing out my error. If you're still in doubt after reviewing the comments, double-check the style guide or post a question at Turker Nation. Don't worry. We're all human and with the Mechanical Turk's "artificial artificial intelligence," mistakes will happen. The key is learning from your mistakes and the only way to do that is to swallow your pride and read your feedback.
Posted by qs933
Comments