Intro to LLMs and recent developments

ChatGPT is used almost synonymously with LLMs. But that’s just the tip of the iceberg – the development is extremely dynamic.

This presentation gives an overview of the architecture and the recent development of different models. We will show how models can run on your own computer (with or without a GPU) and with free cloud services.

A lot of effort is spent in researching optimizations like quantization which leads to speedups and reduced RAM usage.Sparse mixture of experts models (SMoE) are a new architectural approach which power the most recent powerful models. Combining different LLM approaches leads to interesting business opportunities which have not yet been fully realized.

In the outlook we venture a prediction about future directions in LLMs.