From 1T Tokens to ZB Scale—How to move past the internet and scale LLMs

Transcript

so this past fall at the nurp conference Ilia suver said that we are in a world that has data as oil we are in a world where data is running out and that that phrase has been haunting me ever since I want to suggest a pathway to more data right now large language models can get trained on something like a trillion tokens of very curated text it's n... Read More