We all need to become critical testers | Tanja Vos | TEDxOpenUniversiteitHeerlen

TL;DR

Insufficient testing of software can lead to disruptions, as seen in the child care benefit scandal in the Netherlands, emphasizing the need for better testing practices in our increasingly software-reliant world.

Transcript

so how's everybody's day going so far from the moment you got up this morning and your alarm clock went off you got your smartphone out and you sent some messages you read the news and some of you came here by bus or train yeah you took the car imagine the amount of software you have been using doing that we don't realize it but we are surrounded b... Read More

Key Insights

• 😣 Software testing is essential in a software-reliant world, as disruptions caused by faulty software can have severe consequences on individuals and society.
• 🤔 Traditional teaching of software testing needs to be reexamined, shifting towards an empiricism-based approach that emphasizes exploration, experimentation, and critical thinking.
• 🛰️ Testing AI systems poses unique challenges due to their reliance on data and the blackbox nature of artificial intelligence, requiring a human-in-the-loop approach for quality assessment.
• 🎓 Testing should be prioritized and integrated into all levels of education to empower individuals to become critical and adept at evaluating software and AI systems.

Questions & Answers

Q: Why was the child care benefit scandal in the Netherlands considered a software issue?

The scandal was caused by a discriminatory algorithm used to profile people, thereby disrupting lives and leading to job loss, homelessness, and family separation. The root cause of the scandal was identified as insufficient testing of the algorithm.

Q: How does software testing differ from formal verification?

Software testing assesses the quality of a system by evaluating its behavior and outcomes, while formal verification aims to prove the correctness of a software system. Testing acknowledges the limitations of achieving complete error absence or flawless functionality.

Q: Why is testing often neglected in computer science education?

Testing has been overlooked in curricula due to students' disinterest, teachers prioritizing other topics, and misconceptions about testing's value. The perception of testing as mundane button-pushing undermines its importance.

Q: How does the paradigm of empiricism improve software testing?

Embracing empiricism involves thorough exploration, experimentation, and questioning rather than relying solely on incomplete or ambiguous specifications. It acknowledges the inherent complexity of systems and the often unspoken knowledge that shapes their behavior.

Summary & Key Takeaways

• Software is an integral part of our daily lives, and when it doesn't work properly, it can cause frustration and disruption.

• The child care benefit scandal in the Netherlands, caused by a discriminatory algorithm, highlights the consequences of inadequate testing.

• Traditional teaching of software testing is flawed, and a paradigm shift towards empiricism is needed to effectively evaluate software quality.