Can You Trust an AI to Judge Fairly? Exploring LLM Biases

Transcript

Today, I'm going to tell you our latest research on evaluating the fairness of large language model as judges, aka LLM as a judge. LLM as a judge has been widely used for evaluating and improving generative AI technology. However, our study shows that none of the current judges are perfect. And I'm going to tell you why. So let us start by formally... Read More