Claude 3.7: Anthropic's Strategy, ChatGPT's Strategy, plus the need for real world evals

Transcript

the launch of Claude 3.7 is really underlining for me that we need better evals or better evaluations for AI models right now I think models are very overfitted to the evaluations that are widely published like the Aime and so all of these models score incredibly well on these widely known evaluations but it's because they are trained from the get-... Read More