I've only used MTurk a couple of times for transcriptions of video. So I don't know it and this conversation with Jake was a couple of years ago, so hazy on details. His main message was that people are using MTurk all wrong and there is huge potential if people knew how to use it.
A few things I remember....
>>
https://www.reddit.com/r/mturkI think the one he said was most active was
http://turkernation.com/I think there's another one too
Also, he said he paid a lot. He aimed to pay people $15/hr, more if they were really good. Partly that was just a matter of his personal philosophy/ethics, but partly because being one of the best payers means that when you post a job, you bump to the front of the queue.
Now is where I'm getting hazy, but I believe he said that he does small jobs as "auditions." If people prove themselves, they go into his pool of top performers. Then when he posts big jobs, only his top performers get the invites. Since he's paying more than most, they top performers drop everything else and do his work. So he can scale up really fast.
He kept emphasizing that people see MTurk as a *cheap* way to get help and he thinks that misses the potential. If you don't try to go cheap, it becomes a fast, quality, scalable way to get help.
Again, this was a dinner conversation at Pubcon and I didn't go last year, so it was 1.5 or 2.5 years ago so I'm scratching the deep memory banks.