The RL Irony in LLMs (and its insane new meta)

Transcript

In the latest Andre Carpathy interview with Doris Patel, he said that AGI is still a decade away and reinforcement learning is definitely not the key for us to get there. And in another interview with Ilias Scutzver, he also said roughly the same thing. But with how much the current LM improvements rely on RL at giving it human level capabilities l... Read More