Do you use custom software to interact with MTurk, or is there already some good software for interacting with it already? I have an image dataset I want classified and I've been putting it off for a while...
Sites like CrowdFlower have point-and-click interfaces that allow you to just upload a CSV and drag and drop its columns as fields in your task template.
What I used to do was host the images on a server, publicly, then upload the URL of the images and use it to display the images within the task. It's OK for one-offs. You get a thousand free rows with the CrowdFlower trial [1] and that's probably the most painless way to go for a classification problem.
In our case though, everything will be written in-house. Automation is how we keep headcount low.
