Powerset outsources query result evaluation to Mechanical Turk

10 months ago by Tim Finin

TechCrunch reports that Powerset is using Amazon’s Mechanical Turk to evaluate different search results for queries. Techcrunch has a screenshot of an example Turk query. “See the screen shot… users are shown a query and a number of results and are asked to evaluate the relevancy of each result from five choices. In this case, the query is “revealing bikinis.” Users are asked to eval ... Continue reading

Source: ebiquity.umbc.edu