The large language models behind AI chatbots are developing so rapidly that after eight months, a model only needs half the computing power to hit the same benchmark score – which is much faster than the rate at which computer chips improve
The artificial intelligence models behind popular chatbots developing faster than Moore’s law, a measure of how quickly computer hardware performance increases. That suggests the developers of AI systems, known as large language models (LLMs), are becoming smarter at doing more with less.
Nvidia\’s Blackwell AI \’superchip\’ is the most powerful yet
“There are basically two ways your performance might improve,” says Tamay Besiroglu at the Massachusetts Institute of Technology. One is to scale up the size of an LLM,…