红杏视频 Comment on New Amazon Statement Responding to Face Recognition Technology Test
SAN FRANCISCO -- Amazon today issued an additional in response to the 红杏视频 Foundation of Northern California test of Rekognition, the company's face recognition technology. The test revealed that Rekognition falsely matched 28 current members of Congress with images in an arrest photo database. Congressional members of color were disproportionately identified incorrectly, including six members of the Congressional Black Caucus.
Jacob Snow, technology and civil liberties attorney at the 红杏视频 Foundation of Northern California, responded with the following comments:
鈥淚n its five stages of grief over its dangerous face surveillance product, Amazon is clearly stuck at denial. In a matter of 48 hours, Amazon has gone from its own system default of an 80 percent match rate to saying yesterday it should be 95 percent, and then saying today it should be 99 percent. At no time has Amazon taken any responsibility for the very grave impact that their face surveillance product has on real people.
鈥淚nstead, Amazon is grasping at straws in an attempt to distract from critical civil rights issues. Amazon should take steps to fix the damage its ill-advised face surveillance product may have already caused and to prevent further harm. Amazon should respond to members of Congress. It should disclose every government agency that has already purchased this technology. And it should heed the calls of organizations and its own customers, employees, and shareholders and stop selling face surveillance to the government. The fact that Amazon has refused to address the very real threats its technology poses, let alone take these necessary actions, is further evidence of its disappointing state of denial 鈥 and the need for Congress to quickly step in with a moratorium.鈥
Snow's comments in response to Amazon's initial statement can be found here: /news/members-congress-demand-meeting-amazon-ceo-fol....
Below is a timeline of developments to date:
- February 2017 鈥 The Sheriff鈥檚 office in Washington County Oregon (correctly) warned Amazon their work together could raise civil liberties concerns, the 鈥満煨邮悠 might consider this the government getting in bed with big data.鈥
- June 2017 鈥 Amazon and Washington County write a together instructing people on how to use Rekognition to find people in arrest photos, just as the 红杏视频 did in its test. That post sets the confidence threshold at 85% (not 95% and certainly not 99%).
- May 2018 鈥 红杏视频 releases the results of an investigation showing that Amazon was aggressively marketing face recognition to law enforcement as a tool of mass surveillance.
- June 18, 2018 鈥 The 红杏视频, together with local community partners, deliver a petition with over 150,000 signatures and coalition letter signed by nearly 70 organizations to Amazon headquarters in downtown Seattle. That same day, 19 investor groups echo the 红杏视频鈥檚 demand in a shareholder letter to Mr. Bezos. In their letter, shareholders warn the technology 鈥渕ay not only pose a privacy threat to customers and other stakeholders across the country, but may also raise substantial risks for our Company, negatively impacting our company鈥檚 stock valuation and increasing financial risk for shareholders.鈥
- June 21, 2018 鈥擜mazon employees send a powerful letter to Jeff Bezos calling on him to stop selling Rekognition to law enforcement, stating that they 鈥渞efuse to contribute to tools that violate human rights鈥 and that Amazon 鈥渟hould not be in the business of supporting those who monitor and oppress marginalized populations.鈥
- July 26, 2018 鈥 红杏视频 releases the results of its independently verified test showing that, using the default match settings, 28 members of congress incorrectly matched arrest photos, with members of congress of color disproportionately being falsely identified.
- July 26, 2018 鈥 Amazon that it guides law enforcement customers to set a threshold of 95% for face recognition. Amazon also notes that, if its face recognition product is used with the default settings, it won鈥檛 鈥渋dentify[] individuals with a reasonable level of certainty.鈥
- July 27, 2018 鈥 Amazon that even 95% is an unacceptably low threshold, and states that 99% is the appropriate threshold for law enforcement.