Sexist Apps and Biased Algorithms | Sara Wachter-Boettcher | Talks at Google

TL;DR

Sara Wachter-Boettcher discusses the issues of bias and the lack of ethics in the technology industry, using examples such as Google Maps' mini cupcakes feature and image recognition algorithms. She argues that tech companies often prioritize their goals over the needs and experiences of users, perpetuating harmful stereotypes and marginalizing certain groups.

Transcript

[MUSIC PLAYING] SPEAKER: Hi, everyone. Welcome to Talks at Google from Cambridge, Massachusetts. And today, we're very happy to host Sara Wachter-Boettcher and her new book, "Technically Wrong." Sara's been a web designer and UX consultant. And so she's in the industry, but not necessarily, completely, of it. And I think this gives her a great fres... Read More

Key Insights

• 👥 Tech companies frequently prioritize their goals and assumptions over the needs and experiences of users, perpetuating biases and marginalizing certain groups.
• 🐛 Bias and ethical concerns are not bugs in the system but systemic issues that require more than just individual action.
• 🤍 Embedding white supremacy in technology occurs when design decisions prioritize the experiences and perspectives of white people and ignore or exclude others.

Questions & Answers

Q: How did Taylor Lorenz and other critics respond to Google Maps' mini cupcakes feature?

Taylor Lorenz and other critics expressed concerns about the lack of an option to turn off the feature, its potential impact on people with eating disorders, the perpetuation of diet culture, and the inaccurate calorie counts.

Q: What were some examples of biased design choices highlighted by the speaker?

The speaker mentioned examples such as a scale sending an email congratulating weight loss to a toddler, push notifications congratulating weight loss after giving birth, and a message from Etsy assuming the customer would seek Valentine's Day gifts for a male partner.

Q: What does the speaker mean by "embedding white supremacy" in technology?

The speaker argues that tech companies often prioritize the needs and experiences of white people, resulting in design decisions that perpetuate biases and exclude or marginalize non-white individuals. This prioritization reinforces white supremacist attitudes and inequalities.

Q: How does the speaker suggest addressing bias and ethics in technology?

The speaker emphasizes the need for a systemic approach to address bias and ethics in technology. This includes hiring diverse teams, creating an organizational culture that encourages all team members to voice concerns, documenting assumptions made in design processes, and considering the historical context and potential consequences of design decisions.

Summary & Key Takeaways

• Sara Wachter-Boettcher highlights the case of Google Maps' mini cupcakes feature which displayed the number of calories burned when walking alongside the number of mini cupcakes it equated to, pointing out the lack of consideration for people with eating disorders and the perpetuation of diet culture.

• She explains how tech companies often prioritize their own assumptions and goals over the needs and experiences of users, resulting in exclusionary and alienating product choices.

• The speaker emphasizes the importance of recognizing the impact of technology on people's lives and society, and the need for tech companies to question and address biases and ethical concerns in their products and design decisions.