Things we learned about LLMs in 2024
A lot has happened in the world of Large Language Models over the course of 2024. Here’s a review of things we figured out about the field in the past twelve months, plus my attempt at identifying key themes and pivotal moments.
Includes: ‘Prompt driven app generation is a commodity already’, ‘Synthetic training data works great’, the environmental impact got better and much worse, and ‘LLMs somehow got even harder to use’.