16/12/2024
Language models have almost eaten it all.
I am curious to see the cool strategies that will come up to keep improving models - after eating, its time for digestion. I bet the next frontier for language models will be reasoning and making connections between different topics.
https://www.nature.com/articles/d41586-024-03990-2
AI developers are rapidly picking the Internet clean to train large language models such as those behind ChatGPT. Here’s how they are trying to get around the problem.