Group 8, Members: Jonathan Downs, Peter Maurer, Sean Rowland, Victoria Worrall
Identify, link to and describe error-laden experience
Google Photos tags black people as ‘gorillas’ in photo recognition software (http://blogs.wsj.com/digits/2015/07/01/google-mistakenly-tags-black-people-as-gorillas-showing-limits-of-algorithms/).
Short description of above experience
Black users take a photo of themselves and upload it to the Google Photos App. The app’s automatic image labeling process labels the photo of the users into the ‘gorillas’ category. The users are rightfully shocked by the label.
Our design process
We identified where in the original process the error occurred. We then branched off before the error occurred and implemented an alternate solution. We also maintained the flow of the original application but with the correct (intended) output instead.
Description of proposed intervention
Black users take a photo of themselves and upload it to the Google Photos App. An anthropologist hired by Google has already identified a series of sensitive labels. The automatic imaging label process labels the photos of users into the gorillas category. Since this label is sensitive, the photo goes through an additional, more advanced, screening process. The users are correctly labeled as ‘people’ and are content.
Concept sketch of proposed intervention