<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Using Amazon&#8217;s Mechanical Turk to cheat Digg</title>
	<atom:link href="http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/feed/" rel="self" type="application/rss+xml" />
	<link>http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/</link>
	<description></description>
	<lastBuildDate>Tue, 07 Sep 2010 21:59:48 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0.1</generator>
	<item>
		<title>By: james</title>
		<link>http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/comment-page-1/#comment-99</link>
		<dc:creator>james</dc:creator>
		<pubDate>Sat, 19 Jan 2008 01:55:54 +0000</pubDate>
		<guid isPermaLink="false">http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/#comment-99</guid>
		<description>http://www.AWSurveys.com/HomeMain.cfm?RefID=hpacura
very easy!! :)</description>
		<content:encoded><![CDATA[<p><a href="http://www.AWSurveys.com/HomeMain.cfm?RefID=hpacura" rel="nofollow">http://www.AWSurveys.com/HomeMain.cfm?RefID=hpacura</a><br />
very easy!! <img src='http://anerroroccurredwhileprocessingthisdirective.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ryan Mahoski</title>
		<link>http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/comment-page-1/#comment-4</link>
		<dc:creator>Ryan Mahoski</dc:creator>
		<pubDate>Tue, 22 May 2007 00:30:47 +0000</pubDate>
		<guid isPermaLink="false">http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/#comment-4</guid>
		<description>Great response. One corollary: As relationships between requesters and workers mature, requesters may come to understand the ethical boundaries of individual workers. It is conceivable that a requester could use this information to qualify the unethical workers for rogue HITs, thus circumventing Turk&#039;s dragnet.</description>
		<content:encoded><![CDATA[<p>Great response. One corollary: As relationships between requesters and workers mature, requesters may come to understand the ethical boundaries of individual workers. It is conceivable that a requester could use this information to qualify the unethical workers for rogue HITs, thus circumventing Turk&#8217;s dragnet.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: billy</title>
		<link>http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/comment-page-1/#comment-3</link>
		<dc:creator>billy</dc:creator>
		<pubDate>Mon, 21 May 2007 21:26:30 +0000</pubDate>
		<guid isPermaLink="false">http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/#comment-3</guid>
		<description>Hi Ryan,

Thanks for your comment.

The problem is that a &quot;Good Samaritan&quot; may look the other way when they are being paid to do something.

Furthermore, as the Turk gets more popular, Amazon staff moderating will get tougher and tougher (lots of jobs to sift through)

And finally, if the Turk is big enough and the job is small enough, I can probably get it done under the radar and before they cancel my account.  You can&#039;t undo what&#039;s already been done (and accounts are disposable commodities)

The problem is that spammers and con-artists will always find a way around our methods.  It&#039;s just human ingenuity (especially when it comes to making a buck)

I do agree with you though, that at least Amazon has installed some amount of precautionary measures.

Thanks for also taking a look at my artwork.  I got a nice sculpture in the works -- coming out soon :)</description>
		<content:encoded><![CDATA[<p>Hi Ryan,</p>
<p>Thanks for your comment.</p>
<p>The problem is that a &#8220;Good Samaritan&#8221; may look the other way when they are being paid to do something.</p>
<p>Furthermore, as the Turk gets more popular, Amazon staff moderating will get tougher and tougher (lots of jobs to sift through)</p>
<p>And finally, if the Turk is big enough and the job is small enough, I can probably get it done under the radar and before they cancel my account.  You can&#8217;t undo what&#8217;s already been done (and accounts are disposable commodities)</p>
<p>The problem is that spammers and con-artists will always find a way around our methods.  It&#8217;s just human ingenuity (especially when it comes to making a buck)</p>
<p>I do agree with you though, that at least Amazon has installed some amount of precautionary measures.</p>
<p>Thanks for also taking a look at my artwork.  I got a nice sculpture in the works &#8212; coming out soon <img src='http://anerroroccurredwhileprocessingthisdirective.com/wp-includes/images/smilies/icon_smile.gif' alt=':)' class='wp-smiley' /> </p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ryan Mahoski</title>
		<link>http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/comment-page-1/#comment-2</link>
		<dc:creator>Ryan Mahoski</dc:creator>
		<pubDate>Mon, 21 May 2007 02:28:40 +0000</pubDate>
		<guid isPermaLink="false">http://anerroroccurredwhileprocessingthisdirective.com/2007/05/14/using-amazons-mechanical-turk-to-cheat-digg/#comment-2</guid>
		<description>Very insightful, Billy. You appear to be someone who thinks a couple of steps ahead. I do think your Turk ideas introduce a couple of serious problems, however. 

I suspect Amazon would quickly learn of your scheme (all three scenarios violate AWS policy) and probably close your AWS account. Your hypotheticals are clever and may well expose a loophole but I doubt Amazon would risk corporate goodwill to requester whim so carelessly. It seems to me that Amazon has probably already considered how their service might be used for evil. Any wealth Amazon gained ($100 * 10% = $10, in the case of the digg sham) would pale in comparison to the P.R. trouble your proposed HIT group would invite. No doubt, Amazon has a few mechanisms in place to abort deviant behavior. 

Consider the HIT browser interface, where workers have two primary choices: Accept HIT or Report this HIT as Inappropriate (Why?). The latter button is much larger in the hopes good samaritans will rat out the requesters who appear to be playing dirty. The parenthetical (Why?) is a popup link:
----------------------------------------------------
When should I report a HIT as inappropriate?

If you see a HIT that may violate the Amazon Mechanical Turk Participation Agreement, or otherwise goes against the spirit of Amazon Mechanical Turk, you can report the HIT as inappropriate. Reported HITs will be reviewed by Amazon Mechanical Turk staff and considered for removal from the web site.

For example, a HIT that solicits users to sign up for accounts or offers on other web sites is inappropriate because it violates the Participation Agreement.

If you have any questions about what is considered appropriate material, or if you have any questions about the Participation Agreement, feel free to contact us. Thank you!
----------------------------------------------------
In this way, workers help police the space and it&#039;s probable Amazon has set up additional triggers in order to nab scoundrels. I think that requesters who might, despite the above, still be considering the gambit would be wise to heed the warnings on the official CreateHIT web form:
----------------------------------------------------
You may not ask Workers to:

1) Provide personally identifiable information
2) Violate the terms of service of another site
3) Click on affiliate links or ads

These are violations of the Mechanical Turk Participation Agreement and can result in the termination of your account.
----------------------------------------------------
I think your proposed cheats risk not just a requester&#039;s Mechanical Turk privileges but in fact one&#039;s entire AWS account not to mention reputation/karma. You may well be onto a shrewd hack but my advice is: drop the racket ideas and focus your energy on the extraordinary legitimate possibilities of Mechanical Turk. I think the naysayers&#039; arguments are weak; this tool should have been going supernova by now and instead developers are ignoring it almost entirely.

Still want an angle? With AWS, but especially with Mechanical Turk, developers ought to be paying better attention to security.

Imagine if someone stole another person&#039;s AWS identity by, say, hacking into the requester&#039;s web server. Assuming the requester hadn&#039;t taken additional server-side security measures (and it&#039;s safe to say most do not), the hacker would find both access keys in plain view, unencrypted. The successful intruder can now masquerade in Tor as the requester. This is a serious problem. A GetAccountBalance call identifies his available resources for whatever HITs his conscience and creativity allow him to create. If the scheme doesn&#039;t work (e.g., workers report questionable HITs), the hacker casually moves on leaving the real requester to deal with the authorities.

Another AWS security tip: if you enable global write access on an S3 bucket, obfuscate the bucket so only your application knows its name. Otherwise, pranksters or business competitors might think you&#039;re soliciting terabytes of random gifts.
..........
Your eye for the aesthetic and imagination for color is remarkable. Self Portrait and Invasion were especially haunting. May I suggest a donation link?</description>
		<content:encoded><![CDATA[<p>Very insightful, Billy. You appear to be someone who thinks a couple of steps ahead. I do think your Turk ideas introduce a couple of serious problems, however. </p>
<p>I suspect Amazon would quickly learn of your scheme (all three scenarios violate AWS policy) and probably close your AWS account. Your hypotheticals are clever and may well expose a loophole but I doubt Amazon would risk corporate goodwill to requester whim so carelessly. It seems to me that Amazon has probably already considered how their service might be used for evil. Any wealth Amazon gained ($100 * 10% = $10, in the case of the digg sham) would pale in comparison to the P.R. trouble your proposed HIT group would invite. No doubt, Amazon has a few mechanisms in place to abort deviant behavior. </p>
<p>Consider the HIT browser interface, where workers have two primary choices: Accept HIT or Report this HIT as Inappropriate (Why?). The latter button is much larger in the hopes good samaritans will rat out the requesters who appear to be playing dirty. The parenthetical (Why?) is a popup link:<br />
&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;-<br />
When should I report a HIT as inappropriate?</p>
<p>If you see a HIT that may violate the Amazon Mechanical Turk Participation Agreement, or otherwise goes against the spirit of Amazon Mechanical Turk, you can report the HIT as inappropriate. Reported HITs will be reviewed by Amazon Mechanical Turk staff and considered for removal from the web site.</p>
<p>For example, a HIT that solicits users to sign up for accounts or offers on other web sites is inappropriate because it violates the Participation Agreement.</p>
<p>If you have any questions about what is considered appropriate material, or if you have any questions about the Participation Agreement, feel free to contact us. Thank you!<br />
&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;-<br />
In this way, workers help police the space and it&#8217;s probable Amazon has set up additional triggers in order to nab scoundrels. I think that requesters who might, despite the above, still be considering the gambit would be wise to heed the warnings on the official CreateHIT web form:<br />
&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;-<br />
You may not ask Workers to:</p>
<p>1) Provide personally identifiable information<br />
2) Violate the terms of service of another site<br />
3) Click on affiliate links or ads</p>
<p>These are violations of the Mechanical Turk Participation Agreement and can result in the termination of your account.<br />
&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;&#8212;-<br />
I think your proposed cheats risk not just a requester&#8217;s Mechanical Turk privileges but in fact one&#8217;s entire AWS account not to mention reputation/karma. You may well be onto a shrewd hack but my advice is: drop the racket ideas and focus your energy on the extraordinary legitimate possibilities of Mechanical Turk. I think the naysayers&#8217; arguments are weak; this tool should have been going supernova by now and instead developers are ignoring it almost entirely.</p>
<p>Still want an angle? With AWS, but especially with Mechanical Turk, developers ought to be paying better attention to security.</p>
<p>Imagine if someone stole another person&#8217;s AWS identity by, say, hacking into the requester&#8217;s web server. Assuming the requester hadn&#8217;t taken additional server-side security measures (and it&#8217;s safe to say most do not), the hacker would find both access keys in plain view, unencrypted. The successful intruder can now masquerade in Tor as the requester. This is a serious problem. A GetAccountBalance call identifies his available resources for whatever HITs his conscience and creativity allow him to create. If the scheme doesn&#8217;t work (e.g., workers report questionable HITs), the hacker casually moves on leaving the real requester to deal with the authorities.</p>
<p>Another AWS security tip: if you enable global write access on an S3 bucket, obfuscate the bucket so only your application knows its name. Otherwise, pranksters or business competitors might think you&#8217;re soliciting terabytes of random gifts.<br />
&#8230;&#8230;&#8230;.<br />
Your eye for the aesthetic and imagination for color is remarkable. Self Portrait and Invasion were especially haunting. May I suggest a donation link?</p>
]]></content:encoded>
	</item>
</channel>
</rss>
